-----============= acceptance-small: sanity-hsm ============----- Tue Jun 17 12:44:25 EDT 2025 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg229-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanity-hsm.*ex: No such file or directory excepting tests: === sanity-hsm: start setup 12:44:31 (1750178671) === Starting client oleg229-client.virtnet: -o user_xattr,flock 192.168.202.129@tcp:/lustre /mnt/lustre2 Started clients oleg229-client.virtnet: 192.168.202.129@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) oleg229-client.virtnet: executing check_config_client /mnt/lustre oleg229-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg229-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6d0f800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b7c1e000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6d0f800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b7c1e000.idle_timeout=debug disable quota as required oleg229-server: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-hsm: finish setup 12:44:42 (1750178682) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7258] nobody:x:99: Killing existing copytools on oleg229-client.virtnet pkill: pidfile not valid Try `pkill --help' for more information. Set HSM on and start Set sanity-hsm HSM policy == sanity-hsm test 1A: lfs hsm flags root/non-root access ========================================================== 12:45:04 (1750178704) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_set] [--norelease] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_clear] [--norelease] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_set] [--exists] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] lfs hsm_set: change hsm flags for '/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm' failed: Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] PASS 1A (2s) == sanity-hsm test 1a: mmap & cat a HSM released file ==== 12:45:06 (1750178706) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.137113 s, 7.6 MB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Verifying released state: PASS 1a (5s) == sanity-hsm test 1b: Archive, Release and Restore composite file ========================================================== 12:45:11 (1750178711) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0191928 s, 54.6 MB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' archive /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' release /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm verify released state: pass restore /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm verify restored state: pass PASS 1b (4s) == sanity-hsm test 1c: Check setting archive-id in lfs hsm_set ========================================================== 12:45:15 (1750178715) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] verifying archive number is 32 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] verifying archive number is still 32 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] verifying archive number is 33 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] verifying archive number is 16 PASS 1c (2s) == sanity-hsm test 1d: Archive, Release and Restore DoM file ========================================================== 12:45:17 (1750178717) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200296 s, 52.4 MB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' archive /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm release /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm verify released state: pass restore /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm Waiting 200s for 'SUCCEED' verify restored state: pass PASS 1d (4s) == sanity-hsm test 1e: Archive, Release and Restore SEL file ========================================================== 12:45:21 (1750178721) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194736 s, 53.8 MB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' archive /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm Waiting 200s for 'SUCCEED' release /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm verify released state: pass restore /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm Waiting 200s for 'SUCCEED' verify restored state: pass PASS 1e (6s) == sanity-hsm test 1f: DoM file release after restore ==== 12:45:27 (1750178727) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.028369 s, 37.0 MB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' archive /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm release /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm verify released state: pass restore /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm Waiting 200s for 'SUCCEED' verify restored state: pass release again /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm: (0x0000000d) released exists archived, archive_id:1 verify released state: pass PASS 1f (3s) == sanity-hsm test 2: Check file dirtyness when doing setattr ========================================================== 12:45:31 (1750178731) 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00155676 s, 0.0 kB/s 0x200000402:0x9:0x0 PASS 2 (1s) == sanity-hsm test 3: Check file dirtyness when opening for write ========================================================== 12:45:32 (1750178732) Succeed in opening file "/mnt/lustre/d3.sanity-hsm/f3.sanity-hsm"(flags=O_WRONLY) 3+0 records in 3+0 records out 3+0 records in 3+0 records out PASS 3 (2s) == sanity-hsm test 4: Useless cancel must not be registered ========================================================== 12:45:34 (1750178734) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0601186 s, 17.4 MB/s PASS 4 (2s) == sanity-hsm test 8: Test default archive number ======== 12:45:36 (1750178736) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_8/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' PASS 8 (4s) == sanity-hsm test 9A: Use of explicit archive number, with dedicated copytool ========================================================== 12:45:40 (1750178740) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_9A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 3 "/mnt/lustre2"' oleg229-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg229-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=0877c7da-23aa-4fba-b9df-806fd35fc58e archive_id=3 requests=[current:0 ok:0 errors:0] on mds1 Waiting 200s for 'SUCCEED' PASS 9A (8s) == sanity-hsm test 9a: Multiple remote agents ============ 12:45:48 (1750178748) SKIP: sanity-hsm test_9a Need 3 or more clients, have 1 SKIP 9a (1s) == sanity-hsm test 10a: Archive a file =================== 12:45:49 (1750178749) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Verifying content Verifying hsm state Verifying archive number is 2 PASS 10a (3s) == sanity-hsm test 10b: Archive of non dirty file must work without doing request ========================================================== 12:45:52 (1750178752) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' PASS 10b (4s) == sanity-hsm test 10c: Check forbidden archive ========== 12:45:56 (1750178756) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Cannot send HSM request (use of /mnt/lustre/d10c.sanity-hsm/f10c.sanity-hsm): Operation not permitted PASS 10c (2s) == sanity-hsm test 10d: Archive a file on the default archive id ========================================================== 12:45:58 (1750178758) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' PASS 10d (3s) == sanity-hsm test 11a: Import a file ==================== 12:46:01 (1750178761) lhsmtool_posix: 1750178762.467339 lhsmtool_posix[21825]: action=1 src=d11a.sanity-hsm/f11a.sanity-hsm dst=/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750178762.470166 lhsmtool_posix[21825]: importing '/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11a//d11a.sanity-hsm/f11a.sanity-hsm' lhsmtool_posix: 1750178762.484245 lhsmtool_posix[21825]: imported '/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11a//042b/0x200000401:0x2a:0x0'=='/tmp/arc1/sanity-hsm.test_11a//d11a.sanity-hsm/f11a.sanity-hsm' lhsmtool_posix: 1750178762.484329 lhsmtool_posix[21825]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Verifying released state: Verifying imported size 159=159 Verifying released pattern: released Verifying new fid 0x200000401:0x2a:0x0 in archive PASS 11a (2s) == sanity-hsm test 11b: Import a deleted file using its FID ========================================================== 12:46:03 (1750178763) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_11b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' lhsmtool_posix: 1750178765.904233 lhsmtool_posix[22574]: action=1 src=0x200000402:0x12:0x0 dst=/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750178765.909259 lhsmtool_posix[22574]: Resolving [0x200000402:0x12:0x0] to /tmp/arc1/sanity-hsm.test_11b//0410/0x200000402:0x12:0x0 lhsmtool_posix: 1750178765.909323 lhsmtool_posix[22574]: importing '/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11b//0410/0x200000402:0x12:0x0' lhsmtool_posix: 1750178765.920873 lhsmtool_posix[22574]: imported '/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11b//042d/0x200000401:0x2c:0x0'=='/tmp/arc1/sanity-hsm.test_11b//0410/0x200000402:0x12:0x0' lhsmtool_posix: 1750178765.920940 lhsmtool_posix[22574]: process finished, errs: 0 major, 0 minor, rc=0 (Success) /mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm: OK PASS 11b (4s) == sanity-hsm test 11c: Import a file to a directory with a pool ========================================================== 12:46:07 (1750178767) Creating new pool test_11c oleg229-server: Pool lustre.test_11c created Adding targets to pool oleg229-server: OST lustre-OST0001_UUID added to pool lustre.test_11c lhsmtool_posix: 1750178772.794478 lhsmtool_posix[23321]: action=1 src=d11c.sanity-hsm/f11c.sanity-hsm dst=/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750178772.797747 lhsmtool_posix[23321]: importing '/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11c//d11c.sanity-hsm/f11c.sanity-hsm' lhsmtool_posix: 1750178772.817469 lhsmtool_posix[23321]: imported '/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11c//042e/0x200000401:0x2f:0x0'=='/tmp/arc1/sanity-hsm.test_11c//d11c.sanity-hsm/f11c.sanity-hsm' lhsmtool_posix: 1750178772.817534 lhsmtool_posix[23321]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Destroy the created pools: test_11c lustre.test_11c oleg229-server: OST lustre-OST0001_UUID removed from pool lustre.test_11c oleg229-server: Pool lustre.test_11c destroyed Waiting 90s for 'foo' PASS 11c (12s) == sanity-hsm test 12a: Restore an imported file explicitly ========================================================== 12:46:19 (1750178779) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1750178780.031066 lhsmtool_posix[24107]: action=1 src=d12a.sanity-hsm/f12a.sanity-hsm dst=/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750178780.033838 lhsmtool_posix[24107]: importing '/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12a//d12a.sanity-hsm/f12a.sanity-hsm' lhsmtool_posix: 1750178780.046378 lhsmtool_posix[24107]: imported '/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12a//0433/0x200000401:0x32:0x0'=='/tmp/arc1/sanity-hsm.test_12a//d12a.sanity-hsm/f12a.sanity-hsm' lhsmtool_posix: 1750178780.046451 lhsmtool_posix[24107]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Verifying released state: Waiting 200s for 'SUCCEED' Verifying file state: PASS 12a (3s) == sanity-hsm test 12b: Restore an imported file implicitly ========================================================== 12:46:23 (1750178783) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1750178783.548474 lhsmtool_posix[24871]: action=1 src=d12b.sanity-hsm/f12b.sanity-hsm dst=/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750178783.551368 lhsmtool_posix[24871]: importing '/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12b//d12b.sanity-hsm/f12b.sanity-hsm' lhsmtool_posix: 1750178783.566042 lhsmtool_posix[24871]: imported '/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12b//0434/0x200000401:0x35:0x0'=='/tmp/arc1/sanity-hsm.test_12b//d12b.sanity-hsm/f12b.sanity-hsm' lhsmtool_posix: 1750178783.566102 lhsmtool_posix[24871]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Verifying released state: Verifying file state after restore: PASS 12b (3s) == sanity-hsm test 12c: Restore a file with stripe of 2 == 12:46:25 (1750178785) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 5+0 records in 5+0 records out 5242880 bytes (5.2 MB) copied, 0.0315985 s, 166 MB/s /mnt/lustre/d12c.sanity-hsm/f12c.sanity-hsm: OK PASS 12c (4s) == sanity-hsm test 12d: Restore of a non archived, non released file must work ========================================================== 12:46:29 (1750178789) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 12d (3s) == sanity-hsm test 12e: Check forbidden restore ========== 12:46:32 (1750178792) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' /mnt/lustre/d12e.sanity-hsm/f12e.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:1 Cannot send HSM request (use of /mnt/lustre/d12e.sanity-hsm/f12e.sanity-hsm): Operation not permitted PASS 12e (3s) == sanity-hsm test 12f: Restore a released file explicitly ========================================================== 12:46:36 (1750178796) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Waiting 200s for 'SUCCEED' Verifying file state: PASS 12f (4s) == sanity-hsm test 12g: Restore a released file implicitly ========================================================== 12:46:40 (1750178800) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12g/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' PASS 12g (5s) == sanity-hsm test 12h: Restore a released file implicitly from a second node ========================================================== 12:46:45 (1750178805) SKIP: sanity-hsm test_12h Need 2 or more clients, have 1 SKIP 12h (1s) == sanity-hsm test 12m: Archive/release/implicit restore ========================================================== 12:46:46 (1750178806) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12m/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' PASS 12m (4s) == sanity-hsm test 12n: Import/implicit restore/release == 12:46:50 (1750178810) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12n/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1750178811.229142 lhsmtool_posix[30112]: action=1 src=d12n.sanity-hsm/f12n.sanity-hsm dst=/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750178811.232860 lhsmtool_posix[30112]: importing '/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12n//d12n.sanity-hsm/f12n.sanity-hsm' lhsmtool_posix: 1750178811.251869 lhsmtool_posix[30112]: imported '/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12n//0445/0x200000401:0x44:0x0'=='/tmp/arc1/sanity-hsm.test_12n//d12n.sanity-hsm/f12n.sanity-hsm' lhsmtool_posix: 1750178811.251949 lhsmtool_posix[30112]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 12n (3s) == sanity-hsm test 12o: Layout-swap failure during Restore leaves file released ========================================================== 12:46:53 (1750178813) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12o/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' fail_loc=0x152 mdt.lustre-MDT0000.hsm.policy=+NRA diff: /mnt/lustre/d12o.sanity-hsm/f12o.sanity-hsm: No data available mdt.lustre-MDT0000.hsm.policy=-NRA fail_loc=0 mdt.lustre-MDT0000.hsm_control=purge PASS 12o (17s) == sanity-hsm test 12p: implicit restore of a file on copytool mount point ========================================================== 12:47:10 (1750178830) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12p/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' PASS 12p (4s) == sanity-hsm test 12q: file attributes are refreshed after restore ========================================================== 12:47:14 (1750178834) Starting client: oleg229-client.virtnet: -o user_xattr,flock 192.168.202.129@tcp:/lustre /mnt/lustre3 Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12q/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre3"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0612572 s, 17.1 MB/s Killing existing copytools on oleg229-client.virtnet copytools stopped in 0s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12q/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre3"' Stopping client oleg229-client.virtnet /mnt/lustre3 (opts:) PASS 12q (9s) == sanity-hsm test 12r: lseek restores released file ===== 12:47:23 (1750178843) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12r/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 12r (3s) == sanity-hsm test 12s: race between restore requests ==== 12:47:26 (1750178846) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12s/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' fail_loc=0x8000018b PASS 12s (9s) == sanity-hsm test 12t: Multiple parallel reads for a HSM imported file ========================================================== 12:47:35 (1750178855) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12t/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' lhsmtool_posix: 1750178857.840075 lhsmtool_posix[2138]: action=1 src=0x200000402:0x2c:0x0 dst=/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750178857.845040 lhsmtool_posix[2138]: Resolving [0x200000402:0x2c:0x0] to /tmp/arc1/sanity-hsm.test_12t//042e/0x200000402:0x2c:0x0 lhsmtool_posix: 1750178857.845121 lhsmtool_posix[2138]: importing '/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12t//042e/0x200000402:0x2c:0x0' lhsmtool_posix: 1750178857.866330 lhsmtool_posix[2138]: imported '/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12t//0453/0x200000401:0x52:0x0'=='/tmp/arc1/sanity-hsm.test_12t//042e/0x200000402:0x2c:0x0' lhsmtool_posix: 1750178857.866440 lhsmtool_posix[2138]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 12t (4s) == sanity-hsm test 12u: Multiple reads on multiple HSM imported files in parallel ========================================================== 12:47:39 (1750178859) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12u/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1750178864.521402 lhsmtool_posix[3062]: action=1 src=0x200000402:0x2e:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0 mount_point=/mnt/lustre2 lhsmtool_posix: 1750178864.530173 lhsmtool_posix[3062]: Resolving [0x200000402:0x2e:0x0] to /tmp/arc1/sanity-hsm.test_12u//042c/0x200000402:0x2e:0x0 lhsmtool_posix: 1750178864.530276 lhsmtool_posix[3062]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0' from '/tmp/arc1/sanity-hsm.test_12u//042c/0x200000402:0x2e:0x0' lhsmtool_posix: 1750178864.545009 lhsmtool_posix[3062]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0' from '/tmp/arc1/sanity-hsm.test_12u//0455/0x200000401:0x54:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042c/0x200000402:0x2e:0x0' lhsmtool_posix: 1750178864.545351 lhsmtool_posix[3062]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1750178864.639539 lhsmtool_posix[3091]: action=1 src=0x200000402:0x2f:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1 mount_point=/mnt/lustre2 lhsmtool_posix: 1750178864.642370 lhsmtool_posix[3091]: Resolving [0x200000402:0x2f:0x0] to /tmp/arc1/sanity-hsm.test_12u//042d/0x200000402:0x2f:0x0 lhsmtool_posix: 1750178864.642444 lhsmtool_posix[3091]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1' from '/tmp/arc1/sanity-hsm.test_12u//042d/0x200000402:0x2f:0x0' lhsmtool_posix: 1750178864.658247 lhsmtool_posix[3091]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1' from '/tmp/arc1/sanity-hsm.test_12u//0454/0x200000401:0x55:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042d/0x200000402:0x2f:0x0' lhsmtool_posix: 1750178864.658322 lhsmtool_posix[3091]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1750178864.739862 lhsmtool_posix[3120]: action=1 src=0x200000402:0x30:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2 mount_point=/mnt/lustre2 lhsmtool_posix: 1750178864.742583 lhsmtool_posix[3120]: Resolving [0x200000402:0x30:0x0] to /tmp/arc1/sanity-hsm.test_12u//0432/0x200000402:0x30:0x0 lhsmtool_posix: 1750178864.742639 lhsmtool_posix[3120]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2' from '/tmp/arc1/sanity-hsm.test_12u//0432/0x200000402:0x30:0x0' lhsmtool_posix: 1750178864.757185 lhsmtool_posix[3120]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2' from '/tmp/arc1/sanity-hsm.test_12u//0457/0x200000401:0x56:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0432/0x200000402:0x30:0x0' lhsmtool_posix: 1750178864.757249 lhsmtool_posix[3120]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1750178864.836281 lhsmtool_posix[3149]: action=1 src=0x200000402:0x31:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3 mount_point=/mnt/lustre2 lhsmtool_posix: 1750178864.839349 lhsmtool_posix[3149]: Resolving [0x200000402:0x31:0x0] to /tmp/arc1/sanity-hsm.test_12u//0433/0x200000402:0x31:0x0 lhsmtool_posix: 1750178864.839398 lhsmtool_posix[3149]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3' from '/tmp/arc1/sanity-hsm.test_12u//0433/0x200000402:0x31:0x0' lhsmtool_posix: 1750178864.853225 lhsmtool_posix[3149]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3' from '/tmp/arc1/sanity-hsm.test_12u//0456/0x200000401:0x57:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0433/0x200000402:0x31:0x0' lhsmtool_posix: 1750178864.853389 lhsmtool_posix[3149]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1750178864.931049 lhsmtool_posix[3178]: action=1 src=0x200000402:0x32:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4 mount_point=/mnt/lustre2 lhsmtool_posix: 1750178864.934188 lhsmtool_posix[3178]: Resolving [0x200000402:0x32:0x0] to /tmp/arc1/sanity-hsm.test_12u//0430/0x200000402:0x32:0x0 lhsmtool_posix: 1750178864.934251 lhsmtool_posix[3178]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4' from '/tmp/arc1/sanity-hsm.test_12u//0430/0x200000402:0x32:0x0' lhsmtool_posix: 1750178864.946185 lhsmtool_posix[3178]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4' from '/tmp/arc1/sanity-hsm.test_12u//0459/0x200000401:0x58:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0430/0x200000402:0x32:0x0' lhsmtool_posix: 1750178864.946254 lhsmtool_posix[3178]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1750178865.028237 lhsmtool_posix[3207]: action=1 src=0x200000402:0x33:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5 mount_point=/mnt/lustre2 lhsmtool_posix: 1750178865.030860 lhsmtool_posix[3207]: Resolving [0x200000402:0x33:0x0] to /tmp/arc1/sanity-hsm.test_12u//0431/0x200000402:0x33:0x0 lhsmtool_posix: 1750178865.030940 lhsmtool_posix[3207]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5' from '/tmp/arc1/sanity-hsm.test_12u//0431/0x200000402:0x33:0x0' lhsmtool_posix: 1750178865.041376 lhsmtool_posix[3207]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5' from '/tmp/arc1/sanity-hsm.test_12u//0458/0x200000401:0x59:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0431/0x200000402:0x33:0x0' lhsmtool_posix: 1750178865.041450 lhsmtool_posix[3207]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1750178865.117990 lhsmtool_posix[3236]: action=1 src=0x200000402:0x34:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6 mount_point=/mnt/lustre2 lhsmtool_posix: 1750178865.120898 lhsmtool_posix[3236]: Resolving [0x200000402:0x34:0x0] to /tmp/arc1/sanity-hsm.test_12u//0436/0x200000402:0x34:0x0 lhsmtool_posix: 1750178865.120972 lhsmtool_posix[3236]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6' from '/tmp/arc1/sanity-hsm.test_12u//0436/0x200000402:0x34:0x0' lhsmtool_posix: 1750178865.135115 lhsmtool_posix[3236]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6' from '/tmp/arc1/sanity-hsm.test_12u//045b/0x200000401:0x5a:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0436/0x200000402:0x34:0x0' lhsmtool_posix: 1750178865.135189 lhsmtool_posix[3236]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1750178865.218033 lhsmtool_posix[3266]: action=1 src=0x200000402:0x35:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7 mount_point=/mnt/lustre2 lhsmtool_posix: 1750178865.221475 lhsmtool_posix[3266]: Resolving [0x200000402:0x35:0x0] to /tmp/arc1/sanity-hsm.test_12u//0437/0x200000402:0x35:0x0 lhsmtool_posix: 1750178865.221620 lhsmtool_posix[3266]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7' from '/tmp/arc1/sanity-hsm.test_12u//0437/0x200000402:0x35:0x0' lhsmtool_posix: 1750178865.237458 lhsmtool_posix[3266]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7' from '/tmp/arc1/sanity-hsm.test_12u//045a/0x200000401:0x5b:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0437/0x200000402:0x35:0x0' lhsmtool_posix: 1750178865.237538 lhsmtool_posix[3266]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1750178865.321985 lhsmtool_posix[3295]: action=1 src=0x200000402:0x36:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8 mount_point=/mnt/lustre2 lhsmtool_posix: 1750178865.325133 lhsmtool_posix[3295]: Resolving [0x200000402:0x36:0x0] to /tmp/arc1/sanity-hsm.test_12u//0434/0x200000402:0x36:0x0 lhsmtool_posix: 1750178865.325203 lhsmtool_posix[3295]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8' from '/tmp/arc1/sanity-hsm.test_12u//0434/0x200000402:0x36:0x0' lhsmtool_posix: 1750178865.344316 lhsmtool_posix[3295]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8' from '/tmp/arc1/sanity-hsm.test_12u//045d/0x200000401:0x5c:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0434/0x200000402:0x36:0x0' lhsmtool_posix: 1750178865.344371 lhsmtool_posix[3295]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1750178865.427786 lhsmtool_posix[3324]: action=1 src=0x200000402:0x37:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9 mount_point=/mnt/lustre2 lhsmtool_posix: 1750178865.430656 lhsmtool_posix[3324]: Resolving [0x200000402:0x37:0x0] to /tmp/arc1/sanity-hsm.test_12u//0435/0x200000402:0x37:0x0 lhsmtool_posix: 1750178865.430719 lhsmtool_posix[3324]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9' from '/tmp/arc1/sanity-hsm.test_12u//0435/0x200000402:0x37:0x0' lhsmtool_posix: 1750178865.445331 lhsmtool_posix[3324]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9' from '/tmp/arc1/sanity-hsm.test_12u//045c/0x200000401:0x5d:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0435/0x200000402:0x37:0x0' lhsmtool_posix: 1750178865.445398 lhsmtool_posix[3324]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 12u (9s) == sanity-hsm test 13: Recursively import and restore a directory ========================================================== 12:47:48 (1750178868) lhsmtool_posix: 1750178870.372928 lhsmtool_posix[5124]: action=1 src=subdir dst=/mnt/lustre/d13.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750178870.394769 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.10' lhsmtool_posix: 1750178870.413351 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.10' from '/tmp/arc1/sanity-hsm.test_13//0460/0x200000401:0x61:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.10' lhsmtool_posix: 1750178870.413525 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.9' lhsmtool_posix: 1750178870.434363 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.9' from '/tmp/arc1/sanity-hsm.test_13//0463/0x200000401:0x62:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.9' lhsmtool_posix: 1750178870.434506 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.8' lhsmtool_posix: 1750178870.451679 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.8' from '/tmp/arc1/sanity-hsm.test_13//0462/0x200000401:0x63:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.8' lhsmtool_posix: 1750178870.451907 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.7' lhsmtool_posix: 1750178870.464465 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.7' from '/tmp/arc1/sanity-hsm.test_13//0465/0x200000401:0x64:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.7' lhsmtool_posix: 1750178870.464727 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.6' lhsmtool_posix: 1750178870.477179 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.6' from '/tmp/arc1/sanity-hsm.test_13//0464/0x200000401:0x65:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.6' lhsmtool_posix: 1750178870.477323 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.5' lhsmtool_posix: 1750178870.493530 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.5' from '/tmp/arc1/sanity-hsm.test_13//0467/0x200000401:0x66:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.5' lhsmtool_posix: 1750178870.493764 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.4' lhsmtool_posix: 1750178870.510526 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.4' from '/tmp/arc1/sanity-hsm.test_13//0466/0x200000401:0x67:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.4' lhsmtool_posix: 1750178870.510833 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.3' lhsmtool_posix: 1750178870.528125 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.3' from '/tmp/arc1/sanity-hsm.test_13//0469/0x200000401:0x68:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.3' lhsmtool_posix: 1750178870.528318 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.2' lhsmtool_posix: 1750178870.545599 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.2' from '/tmp/arc1/sanity-hsm.test_13//0468/0x200000401:0x69:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.2' lhsmtool_posix: 1750178870.545781 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.1' lhsmtool_posix: 1750178870.558490 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.1' from '/tmp/arc1/sanity-hsm.test_13//046b/0x200000401:0x6a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.1' lhsmtool_posix: 1750178870.560597 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.10' lhsmtool_posix: 1750178870.572735 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.10' from '/tmp/arc1/sanity-hsm.test_13//046d/0x200000401:0x6c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.10' lhsmtool_posix: 1750178870.572936 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.9' lhsmtool_posix: 1750178870.584145 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.9' from '/tmp/arc1/sanity-hsm.test_13//046c/0x200000401:0x6d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.9' lhsmtool_posix: 1750178870.584295 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.8' lhsmtool_posix: 1750178870.596532 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.8' from '/tmp/arc1/sanity-hsm.test_13//046f/0x200000401:0x6e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.8' lhsmtool_posix: 1750178870.596750 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.7' lhsmtool_posix: 1750178870.610098 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.7' from '/tmp/arc1/sanity-hsm.test_13//046e/0x200000401:0x6f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.7' lhsmtool_posix: 1750178870.610255 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.6' lhsmtool_posix: 1750178870.624058 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.6' from '/tmp/arc1/sanity-hsm.test_13//0471/0x200000401:0x70:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.6' lhsmtool_posix: 1750178870.624199 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.5' lhsmtool_posix: 1750178870.640082 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.5' from '/tmp/arc1/sanity-hsm.test_13//0470/0x200000401:0x71:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.5' lhsmtool_posix: 1750178870.640212 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.4' lhsmtool_posix: 1750178870.657245 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.4' from '/tmp/arc1/sanity-hsm.test_13//0473/0x200000401:0x72:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.4' lhsmtool_posix: 1750178870.657403 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.3' lhsmtool_posix: 1750178870.673042 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.3' from '/tmp/arc1/sanity-hsm.test_13//0472/0x200000401:0x73:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.3' lhsmtool_posix: 1750178870.673238 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.2' lhsmtool_posix: 1750178870.689492 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.2' from '/tmp/arc1/sanity-hsm.test_13//0475/0x200000401:0x74:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.2' lhsmtool_posix: 1750178870.689634 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.1' lhsmtool_posix: 1750178870.706782 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.1' from '/tmp/arc1/sanity-hsm.test_13//0474/0x200000401:0x75:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.1' lhsmtool_posix: 1750178870.709033 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.10' lhsmtool_posix: 1750178870.727231 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.10' from '/tmp/arc1/sanity-hsm.test_13//0476/0x200000401:0x77:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.10' lhsmtool_posix: 1750178870.727495 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.9' lhsmtool_posix: 1750178870.740521 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.9' from '/tmp/arc1/sanity-hsm.test_13//0479/0x200000401:0x78:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.9' lhsmtool_posix: 1750178870.740802 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.8' lhsmtool_posix: 1750178870.756047 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.8' from '/tmp/arc1/sanity-hsm.test_13//0478/0x200000401:0x79:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.8' lhsmtool_posix: 1750178870.756203 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.7' lhsmtool_posix: 1750178870.770595 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.7' from '/tmp/arc1/sanity-hsm.test_13//047b/0x200000401:0x7a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.7' lhsmtool_posix: 1750178870.770763 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.6' lhsmtool_posix: 1750178870.793424 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.6' from '/tmp/arc1/sanity-hsm.test_13//047a/0x200000401:0x7b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.6' lhsmtool_posix: 1750178870.793955 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.5' lhsmtool_posix: 1750178870.809946 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.5' from '/tmp/arc1/sanity-hsm.test_13//047d/0x200000401:0x7c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.5' lhsmtool_posix: 1750178870.810113 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.4' lhsmtool_posix: 1750178870.824910 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.4' from '/tmp/arc1/sanity-hsm.test_13//047c/0x200000401:0x7d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.4' lhsmtool_posix: 1750178870.825049 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.3' lhsmtool_posix: 1750178870.837340 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.3' from '/tmp/arc1/sanity-hsm.test_13//047f/0x200000401:0x7e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.3' lhsmtool_posix: 1750178870.837475 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.2' lhsmtool_posix: 1750178870.848923 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.2' from '/tmp/arc1/sanity-hsm.test_13//047e/0x200000401:0x7f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.2' lhsmtool_posix: 1750178870.849069 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.1' lhsmtool_posix: 1750178870.858447 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.1' from '/tmp/arc1/sanity-hsm.test_13//0481/0x200000401:0x80:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.1' lhsmtool_posix: 1750178870.860424 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.10' lhsmtool_posix: 1750178870.872135 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.10' from '/tmp/arc1/sanity-hsm.test_13//0483/0x200000401:0x82:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.10' lhsmtool_posix: 1750178870.872263 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.9' lhsmtool_posix: 1750178870.885210 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.9' from '/tmp/arc1/sanity-hsm.test_13//0482/0x200000401:0x83:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.9' lhsmtool_posix: 1750178870.885367 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.8' lhsmtool_posix: 1750178870.899782 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.8' from '/tmp/arc1/sanity-hsm.test_13//0485/0x200000401:0x84:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.8' lhsmtool_posix: 1750178870.899950 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.7' lhsmtool_posix: 1750178870.916036 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.7' from '/tmp/arc1/sanity-hsm.test_13//0484/0x200000401:0x85:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.7' lhsmtool_posix: 1750178870.916191 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.6' lhsmtool_posix: 1750178870.932050 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.6' from '/tmp/arc1/sanity-hsm.test_13//0487/0x200000401:0x86:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.6' lhsmtool_posix: 1750178870.932200 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.5' lhsmtool_posix: 1750178870.945705 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.5' from '/tmp/arc1/sanity-hsm.test_13//0486/0x200000401:0x87:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.5' lhsmtool_posix: 1750178870.945889 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.4' lhsmtool_posix: 1750178870.957430 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.4' from '/tmp/arc1/sanity-hsm.test_13//0489/0x200000401:0x88:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.4' lhsmtool_posix: 1750178870.957574 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.3' lhsmtool_posix: 1750178870.968422 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.3' from '/tmp/arc1/sanity-hsm.test_13//0488/0x200000401:0x89:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.3' lhsmtool_posix: 1750178870.968602 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.2' lhsmtool_posix: 1750178870.979000 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.2' from '/tmp/arc1/sanity-hsm.test_13//048b/0x200000401:0x8a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.2' lhsmtool_posix: 1750178870.979241 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.1' lhsmtool_posix: 1750178870.992185 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.1' from '/tmp/arc1/sanity-hsm.test_13//048a/0x200000401:0x8b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.1' lhsmtool_posix: 1750178870.994540 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.10' lhsmtool_posix: 1750178871.010047 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.10' from '/tmp/arc1/sanity-hsm.test_13//048c/0x200000401:0x8d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.10' lhsmtool_posix: 1750178871.010198 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.9' lhsmtool_posix: 1750178871.030928 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.9' from '/tmp/arc1/sanity-hsm.test_13//048f/0x200000401:0x8e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.9' lhsmtool_posix: 1750178871.031093 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.8' lhsmtool_posix: 1750178871.045962 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.8' from '/tmp/arc1/sanity-hsm.test_13//048e/0x200000401:0x8f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.8' lhsmtool_posix: 1750178871.046110 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.7' lhsmtool_posix: 1750178871.062373 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.7' from '/tmp/arc1/sanity-hsm.test_13//0491/0x200000401:0x90:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.7' lhsmtool_posix: 1750178871.062499 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.6' lhsmtool_posix: 1750178871.075323 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.6' from '/tmp/arc1/sanity-hsm.test_13//0490/0x200000401:0x91:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.6' lhsmtool_posix: 1750178871.075452 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.5' lhsmtool_posix: 1750178871.089735 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.5' from '/tmp/arc1/sanity-hsm.test_13//0493/0x200000401:0x92:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.5' lhsmtool_posix: 1750178871.089927 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.4' lhsmtool_posix: 1750178871.102185 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.4' from '/tmp/arc1/sanity-hsm.test_13//0492/0x200000401:0x93:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.4' lhsmtool_posix: 1750178871.102323 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.3' lhsmtool_posix: 1750178871.114446 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.3' from '/tmp/arc1/sanity-hsm.test_13//0495/0x200000401:0x94:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.3' lhsmtool_posix: 1750178871.114603 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.2' lhsmtool_posix: 1750178871.127126 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.2' from '/tmp/arc1/sanity-hsm.test_13//0494/0x200000401:0x95:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.2' lhsmtool_posix: 1750178871.127312 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.1' lhsmtool_posix: 1750178871.139833 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.1' from '/tmp/arc1/sanity-hsm.test_13//0497/0x200000401:0x96:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.1' lhsmtool_posix: 1750178871.142238 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.10' lhsmtool_posix: 1750178871.157694 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.10' from '/tmp/arc1/sanity-hsm.test_13//0499/0x200000401:0x98:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.10' lhsmtool_posix: 1750178871.157852 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.9' lhsmtool_posix: 1750178871.169036 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.9' from '/tmp/arc1/sanity-hsm.test_13//0498/0x200000401:0x99:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.9' lhsmtool_posix: 1750178871.169167 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.8' lhsmtool_posix: 1750178871.179607 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.8' from '/tmp/arc1/sanity-hsm.test_13//049b/0x200000401:0x9a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.8' lhsmtool_posix: 1750178871.179769 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.7' lhsmtool_posix: 1750178871.190685 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.7' from '/tmp/arc1/sanity-hsm.test_13//049a/0x200000401:0x9b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.7' lhsmtool_posix: 1750178871.190793 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.6' lhsmtool_posix: 1750178871.201066 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.6' from '/tmp/arc1/sanity-hsm.test_13//049d/0x200000401:0x9c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.6' lhsmtool_posix: 1750178871.201222 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.5' lhsmtool_posix: 1750178871.211910 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.5' from '/tmp/arc1/sanity-hsm.test_13//049c/0x200000401:0x9d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.5' lhsmtool_posix: 1750178871.212179 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.4' lhsmtool_posix: 1750178871.224322 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.4' from '/tmp/arc1/sanity-hsm.test_13//049f/0x200000401:0x9e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.4' lhsmtool_posix: 1750178871.224496 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.3' lhsmtool_posix: 1750178871.235698 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.3' from '/tmp/arc1/sanity-hsm.test_13//049e/0x200000401:0x9f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.3' lhsmtool_posix: 1750178871.235901 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.2' lhsmtool_posix: 1750178871.248165 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.2' from '/tmp/arc1/sanity-hsm.test_13//04a1/0x200000401:0xa0:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.2' lhsmtool_posix: 1750178871.248308 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.1' lhsmtool_posix: 1750178871.258126 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.1' from '/tmp/arc1/sanity-hsm.test_13//04a0/0x200000401:0xa1:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.1' lhsmtool_posix: 1750178871.260048 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.10' lhsmtool_posix: 1750178871.271055 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.10' from '/tmp/arc1/sanity-hsm.test_13//04a2/0x200000401:0xa3:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.10' lhsmtool_posix: 1750178871.271186 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.9' lhsmtool_posix: 1750178871.282387 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.9' from '/tmp/arc1/sanity-hsm.test_13//04a5/0x200000401:0xa4:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.9' lhsmtool_posix: 1750178871.283787 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.8' lhsmtool_posix: 1750178871.293749 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.8' from '/tmp/arc1/sanity-hsm.test_13//04a4/0x200000401:0xa5:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.8' lhsmtool_posix: 1750178871.293844 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.7' lhsmtool_posix: 1750178871.303719 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.7' from '/tmp/arc1/sanity-hsm.test_13//04a7/0x200000401:0xa6:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.7' lhsmtool_posix: 1750178871.303859 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.6' lhsmtool_posix: 1750178871.315401 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.6' from '/tmp/arc1/sanity-hsm.test_13//04a6/0x200000401:0xa7:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.6' lhsmtool_posix: 1750178871.315536 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.5' lhsmtool_posix: 1750178871.325284 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.5' from '/tmp/arc1/sanity-hsm.test_13//04a9/0x200000401:0xa8:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.5' lhsmtool_posix: 1750178871.325424 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.4' lhsmtool_posix: 1750178871.336216 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.4' from '/tmp/arc1/sanity-hsm.test_13//04a8/0x200000401:0xa9:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.4' lhsmtool_posix: 1750178871.336362 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.3' lhsmtool_posix: 1750178871.348473 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.3' from '/tmp/arc1/sanity-hsm.test_13//04ab/0x200000401:0xaa:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.3' lhsmtool_posix: 1750178871.348625 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.2' lhsmtool_posix: 1750178871.358429 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.2' from '/tmp/arc1/sanity-hsm.test_13//04aa/0x200000401:0xab:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.2' lhsmtool_posix: 1750178871.358645 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.1' lhsmtool_posix: 1750178871.369437 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.1' from '/tmp/arc1/sanity-hsm.test_13//04ad/0x200000401:0xac:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.1' lhsmtool_posix: 1750178871.371018 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.10' lhsmtool_posix: 1750178871.383007 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.10' from '/tmp/arc1/sanity-hsm.test_13//04af/0x200000401:0xae:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.10' lhsmtool_posix: 1750178871.383143 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.9' lhsmtool_posix: 1750178871.393907 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.9' from '/tmp/arc1/sanity-hsm.test_13//04ae/0x200000401:0xaf:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.9' lhsmtool_posix: 1750178871.394051 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.8' lhsmtool_posix: 1750178871.406129 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.8' from '/tmp/arc1/sanity-hsm.test_13//04b1/0x200000401:0xb0:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.8' lhsmtool_posix: 1750178871.406288 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.7' lhsmtool_posix: 1750178871.416902 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.7' from '/tmp/arc1/sanity-hsm.test_13//04b0/0x200000401:0xb1:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.7' lhsmtool_posix: 1750178871.417033 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.6' lhsmtool_posix: 1750178871.427367 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.6' from '/tmp/arc1/sanity-hsm.test_13//04b3/0x200000401:0xb2:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.6' lhsmtool_posix: 1750178871.427511 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.5' lhsmtool_posix: 1750178871.438497 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.5' from '/tmp/arc1/sanity-hsm.test_13//04b2/0x200000401:0xb3:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.5' lhsmtool_posix: 1750178871.438672 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.4' lhsmtool_posix: 1750178871.450220 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.4' from '/tmp/arc1/sanity-hsm.test_13//04b5/0x200000401:0xb4:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.4' lhsmtool_posix: 1750178871.450367 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.3' lhsmtool_posix: 1750178871.464358 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.3' from '/tmp/arc1/sanity-hsm.test_13//04b4/0x200000401:0xb5:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.3' lhsmtool_posix: 1750178871.464504 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.2' lhsmtool_posix: 1750178871.477479 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.2' from '/tmp/arc1/sanity-hsm.test_13//04b7/0x200000401:0xb6:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.2' lhsmtool_posix: 1750178871.477628 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.1' lhsmtool_posix: 1750178871.492050 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.1' from '/tmp/arc1/sanity-hsm.test_13//04b6/0x200000401:0xb7:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.1' lhsmtool_posix: 1750178871.494891 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.10' lhsmtool_posix: 1750178871.511145 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.10' from '/tmp/arc1/sanity-hsm.test_13//04b8/0x200000401:0xb9:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.10' lhsmtool_posix: 1750178871.511269 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.9' lhsmtool_posix: 1750178871.526448 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.9' from '/tmp/arc1/sanity-hsm.test_13//04bb/0x200000401:0xba:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.9' lhsmtool_posix: 1750178871.526625 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.8' lhsmtool_posix: 1750178871.539042 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.8' from '/tmp/arc1/sanity-hsm.test_13//04ba/0x200000401:0xbb:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.8' lhsmtool_posix: 1750178871.539182 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.7' lhsmtool_posix: 1750178871.549104 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.7' from '/tmp/arc1/sanity-hsm.test_13//04bd/0x200000401:0xbc:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.7' lhsmtool_posix: 1750178871.549233 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.6' lhsmtool_posix: 1750178871.558701 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.6' from '/tmp/arc1/sanity-hsm.test_13//04bc/0x200000401:0xbd:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.6' lhsmtool_posix: 1750178871.558830 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.5' lhsmtool_posix: 1750178871.569740 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.5' from '/tmp/arc1/sanity-hsm.test_13//04bf/0x200000401:0xbe:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.5' lhsmtool_posix: 1750178871.569900 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.4' lhsmtool_posix: 1750178871.579664 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.4' from '/tmp/arc1/sanity-hsm.test_13//04be/0x200000401:0xbf:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.4' lhsmtool_posix: 1750178871.579783 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.3' lhsmtool_posix: 1750178871.589381 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.3' from '/tmp/arc1/sanity-hsm.test_13//04c1/0x200000401:0xc0:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.3' lhsmtool_posix: 1750178871.589491 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.2' lhsmtool_posix: 1750178871.598801 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.2' from '/tmp/arc1/sanity-hsm.test_13//04c0/0x200000401:0xc1:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.2' lhsmtool_posix: 1750178871.598954 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.1' lhsmtool_posix: 1750178871.607411 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.1' from '/tmp/arc1/sanity-hsm.test_13//04c3/0x200000401:0xc2:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.1' lhsmtool_posix: 1750178871.609048 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.10' lhsmtool_posix: 1750178871.618541 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.10' from '/tmp/arc1/sanity-hsm.test_13//04c5/0x200000401:0xc4:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.10' lhsmtool_posix: 1750178871.618653 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.9' lhsmtool_posix: 1750178871.629373 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.9' from '/tmp/arc1/sanity-hsm.test_13//04c4/0x200000401:0xc5:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.9' lhsmtool_posix: 1750178871.629518 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.8' lhsmtool_posix: 1750178871.638570 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.8' from '/tmp/arc1/sanity-hsm.test_13//04c7/0x200000401:0xc6:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.8' lhsmtool_posix: 1750178871.638686 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.7' lhsmtool_posix: 1750178871.649390 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.7' from '/tmp/arc1/sanity-hsm.test_13//04c6/0x200000401:0xc7:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.7' lhsmtool_posix: 1750178871.649519 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.6' lhsmtool_posix: 1750178871.660621 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.6' from '/tmp/arc1/sanity-hsm.test_13//04c9/0x200000401:0xc8:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.6' lhsmtool_posix: 1750178871.660768 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.5' lhsmtool_posix: 1750178871.671137 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.5' from '/tmp/arc1/sanity-hsm.test_13//04c8/0x200000401:0xc9:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.5' lhsmtool_posix: 1750178871.671272 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.4' lhsmtool_posix: 1750178871.683312 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.4' from '/tmp/arc1/sanity-hsm.test_13//04cb/0x200000401:0xca:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.4' lhsmtool_posix: 1750178871.683486 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.3' lhsmtool_posix: 1750178871.699824 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.3' from '/tmp/arc1/sanity-hsm.test_13//04ca/0x200000401:0xcb:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.3' lhsmtool_posix: 1750178871.699985 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.2' lhsmtool_posix: 1750178871.710857 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.2' from '/tmp/arc1/sanity-hsm.test_13//04cd/0x200000401:0xcc:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.2' lhsmtool_posix: 1750178871.711007 lhsmtool_posix[5124]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.1' lhsmtool_posix: 1750178871.721384 lhsmtool_posix[5124]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.1' from '/tmp/arc1/sanity-hsm.test_13//04cc/0x200000401:0xcd:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.1' lhsmtool_posix: 1750178871.721475 lhsmtool_posix[5124]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_13/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 13 (8s) == sanity-hsm test 14: Rebind archived file to a new fid ========================================================== 12:47:56 (1750178876) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_14/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0488803 s, 21.5 MB/s 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00151991 s, 0.0 kB/s rebind 0x200000402:0xa7:0x0 to 0x200000402:0xa8:0x0 lhsmtool_posix: 1750178876.993480 lhsmtool_posix[6138]: action=2 src=0x200000402:0xa7:0x0 dst=0x200000402:0xa8:0x0 mount_point=/mnt/lustre2 lhsmtool_posix: 1750178876.994067 lhsmtool_posix[6138]: rebind [0x200000402:0xa7:0x0] to [0x200000402:0xa8:0x0] lhsmtool_posix: 1750178876.994149 lhsmtool_posix[6138]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 14 (3s) == sanity-hsm test 15: Rebind a list of files ============ 12:47:59 (1750178879) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_15/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0508081 s, 20.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0551308 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0494272 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0474597 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0445128 s, 23.6 MB/s Waiting 300s for '' pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00310219 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00200367 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00126182 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00135022 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00283794 s, 0.0 kB/s rebind list of files lhsmtool_posix: 1750178881.857159 lhsmtool_posix[6975]: action=2 src=/tmp/tmp.7258 dst=(null) mount_point=/mnt/lustre2 lhsmtool_posix: 1750178881.857881 lhsmtool_posix[6975]: rebind [0x200000402:0xab:0x0] to [0x200000402:0xb0:0x0] lhsmtool_posix: 1750178881.857974 lhsmtool_posix[6975]: rebind [0x200000402:0xac:0x0] to [0x200000402:0xb1:0x0] lhsmtool_posix: 1750178881.858011 lhsmtool_posix[6975]: rebind [0x200000402:0xad:0x0] to [0x200000402:0xb2:0x0] lhsmtool_posix: 1750178881.858054 lhsmtool_posix[6975]: rebind [0x200000402:0xae:0x0] to [0x200000402:0xb3:0x0] lhsmtool_posix: 1750178881.858093 lhsmtool_posix[6975]: rebind [0x200000402:0xaf:0x0] to [0x200000402:0xb4:0x0] lhsmtool_posix: 1750178881.858153 lhsmtool_posix[6975]: 5 lines read from '/tmp/tmp.7258', 5 rebind successful lhsmtool_posix: 1750178881.858193 lhsmtool_posix[6975]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 15 (8s) == sanity-hsm test 16: Test CT bandwith control option === 12:48:07 (1750178887) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_16/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 20+0 records in 20+0 records out 20971520 bytes (21 MB) copied, 0.0222207 s, 944 MB/s Waiting 200s for 'SUCCEED' Waiting 190s for 'SUCCEED' Waiting 180s for 'SUCCEED' Updated after 21s: want 'SUCCEED' got 'SUCCEED' PASS 16 (23s) == sanity-hsm test 20: Release is not permitted ========== 12:48:30 (1750178910) 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00192248 s, 0.0 kB/s 0x200000402:0xbc:0x0 Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted PASS 20 (2s) == sanity-hsm test 21: Simple release tests ============== 12:48:32 (1750178912) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_21/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0488355 s, 21.5 MB/s 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.0185682 s, 27.6 kB/s Waiting 200s for 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 21 (5s) == sanity-hsm test 22: Could not swap a release file ===== 12:48:37 (1750178917) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_22/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0469392 s, 22.3 MB/s Waiting 200s for 'SUCCEED' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.048789 s, 21.5 MB/s 0x200000402:0xc1:0x0 lfs swap_layouts: error: cannot swap layout between '/mnt/lustre/d22.sanity-hsm/test_swap' and '/mnt/lustre/d22.sanity-hsm/test_release': Operation not supported (95) PASS 22 (3s) == sanity-hsm test 23: Release does not change a/mtime (utime) ========================================================== 12:48:40 (1750178920) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_23/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0488802 s, 21.5 MB/s Waiting 200s for 'SUCCEED' PASS 23 (3s) == sanity-hsm test 24a: Archive, release, and restore does not change a/mtime (i/o) ========================================================== 12:48:43 (1750178923) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0494715 s, 21.2 MB/s Waiting 200s for 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Killing existing copytools on oleg229-client.virtnet copytools stopped in 0s 192.168.202.129@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg229-client.virtnet /mnt/lustre (opts:) Starting client: oleg229-client.virtnet: -o user_xattr,flock 192.168.202.129@tcp:/lustre /mnt/lustre PASS 24a (6s) == sanity-hsm test 24b: root can archive, release, and restore user files ========================================================== 12:48:50 (1750178930) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0553701 s, 18.9 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm] /mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm: (0x00000009) exists archived, archive_id:1 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [md5sum] [/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm] PASS 24b (5s) == sanity-hsm test 24c: check that user,group,other request masks work ========================================================== 12:48:54 (1750178934) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0629468 s, 16.7 MB/s 0x200000402:0xcc:0x0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0678245 s, 15.5 MB/s 0x200000402:0xcd:0x0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0565005 s, 18.6 MB/s 0x200000402:0xce:0x0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] PASS 24c (4s) == sanity-hsm test 24d: check that read-only mounts are respected ========================================================== 12:48:58 (1750178938) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0540073 s, 19.4 MB/s 0x200000402:0xd0:0x0 /mnt/lustre/d24d.sanity-hsm/f24d.sanity-hsm lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 105 0x69 0x240000400 Starting client: oleg229-client.virtnet: -o user_xattr,flock 192.168.202.129@tcp:/lustre /mnt/lustre3 Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre3"' Cannot send HSM request (use of /mnt/lustre2/d24d.sanity-hsm/f24d.sanity-hsm): Read-only file system Waiting 200s for 'SUCCEED' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.969552 s, 1.1 MB/s Cannot send HSM request (use of /mnt/lustre2/d24d.sanity-hsm/f24d.sanity-hsm): Read-only file system Stopping client oleg229-client.virtnet /mnt/lustre3 (opts:) PASS 24d (5s) == sanity-hsm test 24e: tar succeeds on HSM released files ========================================================== 12:49:03 (1750178943) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0498994 s, 21.0 MB/s /mnt/lustre/d24e.sanity-hsm/f24e.sanity-hsm: (0x0000000d) released exists archived, archive_id:1 tar: Removing leading `/' from member names PASS 24e (3s) == sanity-hsm test 24f: root can archive, release, and restore tar files ========================================================== 12:49:06 (1750178946) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 3d2fd8331483d30d32d70431b70233ef /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' f24f.sanity-hsm f24f.sanity-hsm Sum0 = 3d2fd8331483d30d32d70431b70233ef /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm, sum1 = 3d2fd8331483d30d32d70431b70233ef /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm PASS 24f (4s) == sanity-hsm test 24g: write by non-owner still sets dirty ========================================================== 12:49:10 (1750178950) RUNAS = 'runas -u 500 -g 500' Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24g/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Please listen carefully as our options have changed. Waiting 200s for 'SUCCEED' running as uid/gid/euid/egid 500/500/500/500, groups: 500 [tee] [/mnt/lustre/d24g.sanity-hsm/f24g.sanity-hsm] To be electrocuted by your telephone, press #. PASS 24g (3s) == sanity-hsm test 25a: Restore lost file (HS_LOST flag) from import ========================================================== 12:49:13 (1750178953) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_25a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1750178954.217511 lhsmtool_posix[16697]: action=1 src=d25a.sanity-hsm/f25a.sanity-hsm dst=/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750178954.220527 lhsmtool_posix[16697]: importing '/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_25a//d25a.sanity-hsm/f25a.sanity-hsm' lhsmtool_posix: 1750178954.239247 lhsmtool_posix[16697]: imported '/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_25a//0411/0x200000404:0x15:0x0'=='/tmp/arc1/sanity-hsm.test_25a//d25a.sanity-hsm/f25a.sanity-hsm' lhsmtool_posix: 1750178954.239318 lhsmtool_posix[16697]: process finished, errs: 0 major, 0 minor, rc=0 (Success) md5sum: /mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm: No data available PASS 25a (2s) == sanity-hsm test 25b: Restore lost file (HS_LOST flag) after release ========================================================== 12:49:15 (1750178955) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_25b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' md5sum: /mnt/lustre/d25b.sanity-hsm/f25b.sanity-hsm: No data available PASS 25b (3s) == sanity-hsm test 26A: Remove the archive of a valid file ========================================================== 12:49:18 (1750178958) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00195889 s, 0.0 kB/s Waiting 200s for 'SUCCEED' Waiting 200s for 'SUCCEED' PASS 26A (5s) == sanity-hsm test 26a: Remove Archive On Last Unlink (RAoLU) policy ========================================================== 12:49:23 (1750178963) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Waiting 200s for 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 8s: want 'SUCCEED' got 'SUCCEED' PASS 26a (16s) == sanity-hsm test 26b: RAoLU policy when CDT off ======== 12:49:39 (1750178979) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled Killing existing copytools on oleg229-client.virtnet copytools stopped in 0s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' PASS 26b (7s) == sanity-hsm test 26c: RAoLU effective when file closed ========================================================== 12:49:46 (1750178986) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Waiting 200s for 'SUCCEED' multiop /mnt/lustre/d26c.sanity-hsm/f26c.sanity-hsm vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7258 Waiting 200s for 'SUCCEED' Updated after 4s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 10s: want 'SUCCEED' got 'SUCCEED' PASS 26c (21s) == sanity-hsm test 26d: RAoLU when Client eviction ======= 12:50:07 (1750179007) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0577054 s, 18.2 MB/s multiop /mnt/lustre/d26d.sanity-hsm/f26d.sanity-hsm vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7258 Waiting 200s for 'SUCCEED' Updated after 5s: want 'SUCCEED' got 'SUCCEED' PASS 26d (11s) == sanity-hsm test 26e: RAoLU with a non-started coordinator ========================================================== 12:50:18 (1750179018) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0612704 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0519672 s, 20.2 MB/s Waiting 200s for 'SUCCEED' Killing existing copytools on oleg229-client.virtnet copytools stopped in 0s Failing mds1 on oleg229-server Stopping /mnt/lustre-mds1 (opts:) on oleg229-server 12:50:42 (1750179042) shut down facet: mds1 facet_host: oleg229-server facet_failover_host: oleg229-server Failover mds1 to oleg229-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg229-server: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 Started lustre-MDT0000 12:50:56 (1750179056) targets are mounted 12:50:56 (1750179056) facet_failover done oleg229-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Check cookie from RAoLU request (last: 1750178899, remove: 1750178900) mdt.lustre-MDT0000.hsm_control=enabled Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' PASS 26e (68s) == sanity-hsm test 27a: Remove the archive of an imported file (Operation not permitted) ========================================================== 12:51:27 (1750179087) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_27a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB) copied, 0.404464 s, 101 MB/s lhsmtool_posix: 1750179088.062468 lhsmtool_posix[24152]: action=1 src=d27a.sanity-hsm/f27a.sanity-hsm dst=/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750179088.064978 lhsmtool_posix[24152]: importing '/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_27a//d27a.sanity-hsm/f27a.sanity-hsm' lhsmtool_posix: 1750179088.079053 lhsmtool_posix[24152]: imported '/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_27a//0405/0x200000406:0x3:0x0'=='/tmp/arc1/sanity-hsm.test_27a//d27a.sanity-hsm/f27a.sanity-hsm' lhsmtool_posix: 1750179088.079150 lhsmtool_posix[24152]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Cannot send HSM request (use of /mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm): Operation not permitted PASS 27a (2s) == sanity-hsm test 27b: Remove the archive of a relased file (Operation not permitted) ========================================================== 12:51:29 (1750179089) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_27b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.0027945 s, 0.0 kB/s Waiting 200s for 'SUCCEED' Cannot send HSM request (use of /mnt/lustre/d27b.sanity-hsm/f27b.sanity-hsm): Operation not permitted PASS 27b (4s) == sanity-hsm test 28: Concurrent archive/file remove ==== 12:51:33 (1750179093) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_28/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00206414 s, 0.0 kB/s mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled Waiting 200s for 'SUCCEED' PASS 28 (5s) == sanity-hsm test 29a: Tests --mntpath and --archive options ========================================================== 12:51:38 (1750179098) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 7 "/mnt/lustre"' Cannot send HSM request (use of /mnt/lustre): Invalid argument hsm: '/qwerty/uyt' is not a valid FID PASS 29a (2s) == sanity-hsm test 29b: Archive/delete/remove by FID from the archive. ========================================================== 12:51:40 (1750179100) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0572158 s, 18.3 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' PASS 29b (5s) == sanity-hsm test 29c: Archive/delete/remove by FID, using a file list. ========================================================== 12:51:45 (1750179105) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0577018 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0563394 s, 18.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0556773 s, 18.8 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 29c (6s) == sanity-hsm test 29d: hsm_remove by FID with archive_id 0 for unlinked file cause ========================================================== 12:51:51 (1750179111) SKIP: sanity-hsm test_29d Need 3 or more clients, have 1 SKIP 29d (0s) == sanity-hsm test 30a: Restore at exec (import case) ==== 12:51:51 (1750179111) SKIP: sanity-hsm test_30a Need 2 or more clients, have 1 SKIP 30a (1s) == sanity-hsm test 30b: Restore at exec (release case) === 12:51:52 (1750179112) SKIP: sanity-hsm test_30b Need 2 or more clients, have 1 SKIP 30b (1s) == sanity-hsm test 30c: Update during exec of released file must fail ========================================================== 12:51:53 (1750179113) SKIP: sanity-hsm test_30c Need 2 or more clients, have 1 SKIP 30c (1s) == sanity-hsm test 31a: Import a large file and check size during restore ========================================================== 12:51:54 (1750179114) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB) copied, 0.411402 s, 99.4 MB/s lhsmtool_posix: 1750179115.137698 lhsmtool_posix[29698]: action=1 src=d31a.sanity-hsm/f31a.sanity-hsm dst=/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750179115.140739 lhsmtool_posix[29698]: importing '/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_31a//d31a.sanity-hsm/f31a.sanity-hsm' lhsmtool_posix: 1750179115.158936 lhsmtool_posix[29698]: imported '/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_31a//040b/0x200000406:0xd:0x0'=='/tmp/arc1/sanity-hsm.test_31a//d31a.sanity-hsm/f31a.sanity-hsm' lhsmtool_posix: 1750179115.159009 lhsmtool_posix[29698]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' size seen is right: 40894464 == 40894464 done PASS 31a (12s) == sanity-hsm test 31b: Restore a large unaligned file and check size during restore ========================================================== 12:52:06 (1750179126) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 39000000 bytes (39 MB) copied, 0.247204 s, 158 MB/s Waiting 200s for 'SUCCEED' size seen is right: 39000000 == 39000000 done PASS 31b (14s) == sanity-hsm test 31c: Restore a large aligned file and check size during restore ========================================================== 12:52:20 (1750179140) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB) copied, 0.249587 s, 164 MB/s Waiting 200s for 'SUCCEED' size seen is right: 40894464 == 40894464 done PASS 31c (14s) == sanity-hsm test 33: Kill a restore waiting process ==== 12:52:34 (1750179154) 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00226119 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_33/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Copytool is suspended on oleg229-client.virtnet Waiting 200s for 'STARTED' Copytool is continued on oleg229-client.virtnet /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2829: 31898 Terminated md5sum $f > /dev/null PASS 33 (5s) == sanity-hsm test 34: Remove file during restore ======== 12:52:39 (1750179159) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_34/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00170443 s, 0.0 kB/s Copytool is suspended on oleg229-client.virtnet Waiting 200s for 'STARTED' Copytool is continued on oleg229-client.virtnet /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2861: kill: (32616) - No such process PASS 34 (4s) == sanity-hsm test 35: Overwrite file during restore ===== 12:52:43 (1750179163) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_35/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00135939 s, 0.0 kB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Copytool is suspended on oleg229-client.virtnet Waiting 200s for 'STARTED' Copytool is continued on oleg229-client.virtnet /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2898: kill: (933) - No such process PASS 35 (5s) == sanity-hsm test 36: Move file during restore ========== 12:52:48 (1750179168) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_36/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00148155 s, 0.0 kB/s Copytool is suspended on oleg229-client.virtnet Waiting 200s for 'STARTED' Copytool is continued on oleg229-client.virtnet /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2934: kill: (1667) - No such process PASS 36 (4s) == sanity-hsm test 37: re-archive a dirty file =========== 12:52:52 (1750179172) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_37/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0682923 s, 15.4 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0288129 s, 36.4 MB/s Waiting 200s for 'SUCCEED' PASS 37 (66s) == sanity-hsm test 40: Parallel archive requests ========= 12:53:59 (1750179239) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_40/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=purge Wait for all requests being enqueued...100 archive requests submitted 100 archive requests submitted 100 archive requests submitted 100 archive requests submitted OK pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 PASS 40 (103s) == sanity-hsm test 50: Archive with large number of pending HSM actions ========================================================== 12:55:41 (1750179341) Filesystem Inodes IUsed IFree IUse% Mounted on 192.168.202.129@tcp:/lustre 217166 1002 216164 1% /mnt/lustre - create 2241 (time 1750179354.25 total 10.00 last 224.04) - create 4656 (time 1750179364.25 total 20.00 last 241.49) - create 6928 (time 1750179374.25 total 30.01 last 227.16) - create 9126 (time 1750179384.25 total 40.01 last 219.69) total: 10000 create in 43.99 seconds: 227.34 ops/second 10000 - unlinked 0 (time 1750179445 ; total 0 ; last 0) total: 10000 unlinks in 51 seconds: 196.078430 unlinks/second Start Phase files_num: 10000 time: 54 - create 2172 (time 1750179508.25 total 10.01 last 217.06) - create 4362 (time 1750179518.26 total 20.01 last 218.96) - create 6536 (time 1750179528.26 total 30.01 last 217.36) - create 8729 (time 1750179538.26 total 40.01 last 219.27) - create 10000 (time 1750179543.84 total 45.59 last 227.91) - create 12274 (time 1750179553.84 total 55.59 last 227.30) - create 14466 (time 1750179563.84 total 65.59 last 219.19) - create 16833 (time 1750179573.84 total 75.59 last 236.70) - create 18919 (time 1750179583.84 total 85.59 last 208.60) total: 20000 create in 90.51 seconds: 220.98 ops/second - unlinked 0 (time 1750179681 ; total 0 ; last 0) - unlinked 10000 (time 1750179719 ; total 38 ; last 38) total: 20000 unlinks in 70 seconds: 285.714294 unlinks/second Middle Phase files_num: 20000 time: 91 - create 2742 (time 1750179762.52 total 10.00 last 274.14) - create 6419 (time 1750179772.52 total 20.01 last 367.58) total: 10000 create in 27.86 seconds: 358.92 ops/second 40000 - unlinked 0 (time 1750179803 ; total 0 ; last 0) total: 10000 unlinks in 37 seconds: 270.270264 unlinks/second End Phase files_num: 10000 time: 22 40000 mdt.lustre-MDT0000.hsm_control=purge PASS 50 (506s) == sanity-hsm test 52: Opened for write file on an evicted client should be set dirty ========================================================== 13:04:07 (1750179847) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_52/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.150125 s, 7.0 MB/s multiop /mnt/lustre/d52.sanity-hsm/f52.sanity-hsm vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7258 pdsh@oleg229-client: oleg229-client: ssh exited with exit code 5 PASS 52 (9s) == sanity-hsm test 53: Opened for read file on an evicted client should not be set dirty ========================================================== 13:04:16 (1750179856) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_53/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148132 s, 7.1 MB/s multiop /mnt/lustre/d53.sanity-hsm/f53.sanity-hsm vo_c TMPPIPE=/tmp/multiop_open_wait_pipe.7258 pdsh@oleg229-client: oleg229-client: ssh exited with exit code 5 PASS 53 (10s) == sanity-hsm test 54: Write during an archive cancels it ========================================================== 13:04:27 (1750179867) 39+0 records in 39+0 records out 39000000 bytes (39 MB) copied, 0.535359 s, 72.8 MB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_54/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=+NRA Waiting 200s for 'FAILED' Updated after 35s: want 'FAILED' got 'FAILED' mdt.lustre-MDT0000.hsm.policy=-NRA PASS 54 (44s) == sanity-hsm test 55: Truncate during an archive cancels it ========================================================== 13:05:11 (1750179911) 39+0 records in 39+0 records out 39000000 bytes (39 MB) copied, 0.498486 s, 78.2 MB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_55/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=+NRA Waiting 200s for 'FAILED' Updated after 2s: want 'FAILED' got 'FAILED' mdt.lustre-MDT0000.hsm.policy=-NRA PASS 55 (8s) == sanity-hsm test 56: Setattr during an archive is ok === 13:05:18 (1750179918) 39+0 records in 39+0 records out 39000000 bytes (39 MB) copied, 0.309615 s, 126 MB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_56/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' Waiting 200s for 'STARTED' Waiting 200s for 'SUCCEED' Waiting 190s for 'SUCCEED' Waiting 170s for 'SUCCEED' Updated after 37s: want 'SUCCEED' got 'SUCCEED' PASS 56 (42s) == sanity-hsm test 57: Archive a file with dirty cache on another node ========================================================== 13:06:00 (1750179960) SKIP: sanity-hsm test_57 Need 2 or more clients, have 1 SKIP 57 (2s) == sanity-hsm test 58: Truncate a released file will trigger restore ========================================================== 13:06:02 (1750179962) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_58/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' truncate up from 1716 to 3432 Waiting 200s for 'SUCCEED' /mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2 truncate down from 1716 to 858 Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' /mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2 truncate to 0 Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' /mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2 PASS 58 (12s) == sanity-hsm test 59: Release stripeless file with non-zero size ========================================================== 13:06:14 (1750179974) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_59/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' PASS 59 (5s) == sanity-hsm test 60: Changing progress update interval from default ========================================================== 13:06:19 (1750179979) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0909511 s, 115 MB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_60/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 --update-interval 5 "/mnt/lustre2"' Waiting 100s for 'start copy' Expecting a progress update within 20 seconds... 5242880 bytes copied in 4 seconds. Wait for on going archive hsm action to complete Waiting 10s for 'copied' Updated after 4s: want 'copied' got 'copied' PASS 60 (14s) == sanity-hsm test 61: Waiting archive of a removed file should fail ========================================================== 13:06:33 (1750179993) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_61/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled PASS 61 (5s) == sanity-hsm test 70: Copytool logs JSON register/unregister events to FIFO ========================================================== 13:06:38 (1750179998) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_70/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --event-fifo /tmp/sanity-hsm.test_70.IBOZ/fifo "/mnt/lustre2"' Killing existing copytools on oleg229-client.virtnet copytools stopped in 0s Register/Unregister events look OK. PASS 70 (6s) == sanity-hsm test 71: Copytool logs JSON archive events to FIFO ========================================================== 13:06:44 (1750180004) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_71/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --update-interval 5 --event-fifo /tmp/sanity-hsm.test_71.AQah/fifo "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=-NRA 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.122554 s, 8.6 MB/s Archive events look OK. mdt.lustre-MDT0000.hsm.policy=-NRA PASS 71 (6s) == sanity-hsm test 72: Copytool logs JSON restore events to FIFO ========================================================== 13:06:50 (1750180010) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_72/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --update-interval 5 --event-fifo /tmp/sanity-hsm.test_72.8WDU/fifo "/mnt/lustre2"' 16+0 records in 16+0 records out 16000000 bytes (16 MB) copied, 0.180327 s, 88.7 MB/s lhsmtool_posix: 1750180012.857803 lhsmtool_posix[21544]: action=1 src=d72.sanity-hsm/f72.sanity-hsm dst=/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750180012.865472 lhsmtool_posix[21544]: importing '/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_72//d72.sanity-hsm/f72.sanity-hsm' lhsmtool_posix: 1750180012.899482 lhsmtool_posix[21544]: imported '/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_72//0bc8/0x200000bd2:0x1a:0x0'=='/tmp/arc1/sanity-hsm.test_72//d72.sanity-hsm/f72.sanity-hsm' lhsmtool_posix: 1750180012.899602 lhsmtool_posix[21544]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Verifying released state: Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Restore events look OK. PASS 72 (8s) == sanity-hsm test 90: Archive/restore a file list ======= 13:06:58 (1750180018) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_90/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=purge Waiting 200s for '' pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 Waiting 200s for '' Changed after 2s: from 'lrh=[type=10680000 len=136 idx=4/10058] fid=[0x200000402:0x29f:0x0] dfid=[0x200000402:0x29f:0x0] compound/cookie=0x0/0x68523a83 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10059] fid=[0x200000402:0x2a0:0x0] dfid=[0x200000402:0x2a0:0x0] compound/cookie=0x0/0x68523a84 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10060] fid=[0x200000402:0x2a1:0x0] dfid=[0x200000402:0x2a1:0x0] compound/cookie=0x0/0x68523a85 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10061] fid=[0x200000402:0x2a2:0x0] dfid=[0x200000402:0x2a2:0x0] compound/cookie=0x0/0x68523a86 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10062] fid=[0x200000402:0x2a3:0x0] dfid=[0x200000402:0x2a3:0x0] compound/cookie=0x0/0x68523a87 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10063] fid=[0x200000402:0x2a4:0x0] dfid=[0x200000402:0x2a4:0x0] compound/cookie=0x0/0x68523a88 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10064] fid=[0x200000402:0x2a5:0x0] dfid=[0x200000402:0x2a5:0x0] compound/cookie=0x0/0x68523a89 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10066] fid=[0x200000402:0x2a6:0x0] dfid=[0x200000402:0x2a6:0x0] compound/cookie=0x0/0x68523a8a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10067] fid=[0x200000402:0x2a7:0x0] dfid=[0x200000402:0x2a7:0x0] compound/cookie=0x0/0x68523a8b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10068] fid=[0x200000402:0x2a8:0x0] dfid=[0x200000402:0x2a8:0x0] compound/cookie=0x0/0x68523a8c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10069] fid=[0x200000402:0x2a9:0x0] dfid=[0x200000402:0x2a9:0x0] compound/cookie=0x0/0x68523a8d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10070] fid=[0x200000402:0x2aa:0x0] dfid=[0x200000402:0x2aa:0x0] compound/cookie=0x0/0x68523a8e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10071] fid=[0x200000402:0x2ab:0x0] dfid=[0x200000402:0x2ab:0x0] compound/cookie=0x0/0x68523a8f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10072] fid=[0x200000402:0x2ac:0x0] dfid=[0x200000402:0x2ac:0x0] compound/cookie=0x0/0x68523a90 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10073] fid=[0x200000402:0x2ad:0x0] dfid=[0x200000402:0x2ad:0x0] compound/cookie=0x0/0x68523a91 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10074] fid=[0x200000402:0x2ae:0x0] dfid=[0x200000402:0x2ae:0x0] compound/cookie=0x0/0x68523a92 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10075] fid=[0x200000402:0x2af:0x0] dfid=[0x200000402:0x2af:0x0] compound/cookie=0x0/0x68523a93 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10076] fid=[0x200000402:0x2b0:0x0] dfid=[0x200000402:0x2b0:0x0] compound/cookie=0x0/0x68523a94 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10077] fid=[0x200000402:0x2b1:0x0] dfid=[0x200000402:0x2b1:0x0] compound/cookie=0x0/0x68523a95 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10078] fid=[0x200000402:0x2b2:0x0] dfid=[0x200000402:0x2b2:0x0] compound/cookie=0x0/0x68523a96 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10079] fid=[0x200000402:0x2b3:0x0] dfid=[0x200000402:0x2b3:0x0] compound/cookie=0x0/0x68523a97 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10080] fid=[0x200000402:0x2b4:0x0] dfid=[0x200000402:0x2b4:0x0] compound/cookie=0x0/0x68523a98 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10081] fid=[0x200000402:0x2b5:0x0] dfid=[0x200000402:0x2b5:0x0] compound/cookie=0x0/0x68523a99 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10082] fid=[0x200000402:0x2b6:0x0] dfid=[0x200000402:0x2b6:0x0] compound/cookie=0x0/0x68523a9a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10083] fid=[0x200000402:0x2b7:0x0] dfid=[0x200000402:0x2b7:0x0] compound/cookie=0x0/0x68523a9b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10084] fid=[0x200000402:0x2b8:0x0] dfid=[0x200000402:0x2b8:0x0] compound/cookie=0x0/0x68523a9c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10085] fid=[0x200000402:0x2b9:0x0] dfid=[0x200000402:0x2b9:0x0] compound/cookie=0x0/0x68523a9d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10086] fid=[0x200000402:0x2ba:0x0] dfid=[0x200000402:0x2ba:0x0] compound/cookie=0x0/0x68523a9e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10087] fid=[0x200000402:0x2bb:0x0] dfid=[0x200000402:0x2bb:0x0] compound/cookie=0x0/0x68523a9f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10088] fid=[0x200000402:0x2bc:0x0] dfid=[0x200000402:0x2bc:0x0] compound/cookie=0x0/0x68523aa0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10089] fid=[0x200000402:0x2bd:0x0] dfid=[0x200000402:0x2bd:0x0] compound/cookie=0x0/0x68523aa1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10090] fid=[0x200000402:0x2be:0x0] dfid=[0x200000402:0x2be:0x0] compound/cookie=0x0/0x68523aa2 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10091] fid=[0x200000402:0x2bf:0x0] dfid=[0x200000402:0x2bf:0x0] compound/cookie=0x0/0x68523aa3 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10092] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x68523aa4 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10093] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x68523aa5 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x68523aa6 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x68523aa7 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x68523aa8 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x68523aa9 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x68523aaa action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x68523aab action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x68523aac action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x68523aad action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x68523aae action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x68523aaf action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x68523ab0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x68523ab1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x68523ab2 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x68523ab3 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x68523ab4 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x68523ab5 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/10066] fid=[0x200000402:0x2a6:0x0] dfid=[0x200000402:0x2a6:0x0] compound/cookie=0x0/0x68523a8a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10080] fid=[0x200000402:0x2b4:0x0] dfid=[0x200000402:0x2b4:0x0] compound/cookie=0x0/0x68523a98 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10083] fid=[0x200000402:0x2b7:0x0] dfid=[0x200000402:0x2b7:0x0] compound/cookie=0x0/0x68523a9b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10087] fid=[0x200000402:0x2bb:0x0] dfid=[0x200000402:0x2bb:0x0] compound/cookie=0x0/0x68523a9f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x68523aa7 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x68523aa8 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x68523aa9 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x68523aad action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x68523aae action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x68523aaf action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x68523ab0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x68523ab1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x68523ab2 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x68523ab3 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x68523ab4 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x68523ab5 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]' pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 PASS 90 (76s) == sanity-hsm test 100: Set coordinator /proc tunables === 13:08:14 (1750180094) Testing mdt.lustre-MDT0000.hsm.loop_period Set loop_period to 0 must failed oleg229-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/loop_period=0: Invalid argument oleg229-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/loop_period'='0': Invalid argument pdsh@oleg229-client: oleg229-server: ssh exited with exit code 22 Testing mdt.lustre-MDT0000.hsm.grace_delay Set grace_delay to 0 must failed oleg229-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/grace_delay=0: Invalid argument oleg229-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/grace_delay'='0': Invalid argument pdsh@oleg229-client: oleg229-server: ssh exited with exit code 22 Testing mdt.lustre-MDT0000.hsm.active_request_timeout Set active_request_timeout to 0 must failed oleg229-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/active_request_timeout=0: Invalid argument oleg229-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/active_request_timeout'='0': Invalid argument pdsh@oleg229-client: oleg229-server: ssh exited with exit code 22 Testing mdt.lustre-MDT0000.hsm.max_requests Set max_requests to 0 must failed oleg229-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=0: Invalid argument oleg229-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='0': Invalid argument pdsh@oleg229-client: oleg229-server: ssh exited with exit code 22 Testing mdt.lustre-MDT0000.hsm.default_archive_id Set default_archive_id to 0 must failed oleg229-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/default_archive_id=0: Invalid argument oleg229-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/default_archive_id'='0': Invalid argument pdsh@oleg229-client: oleg229-server: ssh exited with exit code 22 PASS 100 (13s) == sanity-hsm test 102: Verify coordinator control ======= 13:08:27 (1750180107) mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled PASS 102 (6s) == sanity-hsm test 103: Purge all requests =============== 13:08:33 (1750180113) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_103/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=purge Current requests pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 PASS 103 (5s) == sanity-hsm test 103a: Purge pending restore requests == 13:08:38 (1750180118) mdt.lustre-MDT0000.hsm.policy=-NBR Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_103a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' (0x200000402:0x319:0x0|0x200000402:0x31a:0x0|0x200000402:0x31b:0x0|0x200000402:0x31c:0x0|0x200000402:0x31d:0x0|0x200000402:0x31e:0x0|0x200000402:0x31f:0x0|0x200000402:0x320:0x0).*action=ARCHIVE.*status=SUCCEED pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 Killing existing copytools on oleg229-client.virtnet copytools stopped in 1s cat: /mnt/lustre/.lustre/fid/0x200000402:0x31b:0x0: No data available cat: /mnt/lustre/.lustre/fid/0x200000402:0x31d:0x0: No data available cat: /mnt/lustre/.lustre/fid/0x200000402:0x320:0x0: No data available cat: /mnt/lustre/.lustre/fid/0x200000402:0x31f:0x0: No data available cat: /mnt/lustre/.lustre/fid/0x200000402:0x31e:0x0: No data available cat: /mnt/lustre/.lustre/fid/0x200000402:0x319:0x0: No data available cat: /mnt/lustre/.lustre/fid/0x200000402:0x31a:0x0: No data available cat: /mnt/lustre/.lustre/fid/0x200000402:0x31c:0x0: No data available mdt.lustre-MDT0000.hsm_control=purge PASS 103a (10s) == sanity-hsm test 104: Copy tool data field ============= 13:08:48 (1750180128) 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00752765 s, 0.0 kB/s mdt.lustre-MDT0000.hsm_control=purge PASS 104 (5s) == sanity-hsm test 105: Restart of coordinator =========== 13:08:53 (1750180133) mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0000.hsm_control=purge PASS 105 (13s) == sanity-hsm test 106: Copytool register/unregister ===== 13:09:06 (1750180146) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' oleg229-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg229-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=0877c7da-23aa-4fba-b9df-806fd35fc58e archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 oleg229-client.virtnet: 28254 Killing existing copytools on oleg229-client.virtnet copytools stopped in 0s pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 uuid not found in agent list on mds1 Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' oleg229-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg229-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=0877c7da-23aa-4fba-b9df-806fd35fc58e archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 PASS 106 (13s) == sanity-hsm test 107: Copytool re-register after MDS restart ========================================================== 13:09:19 (1750180159) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_107/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Failing mds1 on oleg229-server Stopping /mnt/lustre-mds1 (opts:) on oleg229-server 13:09:25 (1750180165) shut down facet: mds1 facet_host: oleg229-server facet_failover_host: oleg229-server Failover mds1 to oleg229-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg229-server: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 Started lustre-MDT0000 13:09:41 (1750180181) targets are mounted 13:09:41 (1750180181) facet_failover done oleg229-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 107 (31s) == sanity-hsm test 109: Policy display/change ============ 13:09:50 (1750180190) mdt.lustre-MDT0000.hsm.policy=+NBR mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0000.hsm.policy=-NBR mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0000.hsm.policy=NRA NBR Next set_param must failed oleg229-server: error: set_param: setting /sys/kernel/debug/lustre/mdt/lustre-MDT0000/hsm/policy=wrong: Invalid argument oleg229-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/policy'='wrong': Invalid argument pdsh@oleg229-client: oleg229-server: ssh exited with exit code 22 Back to default policy mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0000.hsm.policy=-NBR PASS 109 (11s) == sanity-hsm test 110a: Non blocking restore policy (import case) ========================================================== 13:10:01 (1750180201) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_110a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1750180202.478483 lhsmtool_posix[32313]: action=1 src=d110a.sanity-hsm/f110a.sanity-hsm dst=/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750180202.487064 lhsmtool_posix[32313]: importing '/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_110a//d110a.sanity-hsm/f110a.sanity-hsm' lhsmtool_posix: 1750180202.520943 lhsmtool_posix[32313]: imported '/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_110a//0bba/0x200000bd2:0x68:0x0'=='/tmp/arc1/sanity-hsm.test_110a//d110a.sanity-hsm/f110a.sanity-hsm' lhsmtool_posix: 1750180202.522059 lhsmtool_posix[32313]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdt.lustre-MDT0000.hsm.policy=+NBR md5sum: /mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm: No data available Waiting 200s for 'SUCCEED' mdt.lustre-MDT0000.hsm.policy=-NBR PASS 110a (7s) == sanity-hsm test 110b: Non blocking restore policy (release case) ========================================================== 13:10:08 (1750180208) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_110b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' mdt.lustre-MDT0000.hsm.policy=+NBR md5sum: /mnt/lustre/d110b.sanity-hsm/f110b.sanity-hsm: No data available mdt.lustre-MDT0000.hsm.policy=-NBR PASS 110b (7s) == sanity-hsm test 111a: No retry policy (import case), restore will error ========================================================== 13:10:15 (1750180215) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_111a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1750180216.571150 lhsmtool_posix[1363]: action=1 src=d111a.sanity-hsm/f111a.sanity-hsm dst=/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750180216.576071 lhsmtool_posix[1363]: importing '/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_111a//d111a.sanity-hsm/f111a.sanity-hsm' lhsmtool_posix: 1750180216.615509 lhsmtool_posix[1363]: imported '/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_111a//0bbf/0x200000bd2:0x6d:0x0'=='/tmp/arc1/sanity-hsm.test_111a//d111a.sanity-hsm/f111a.sanity-hsm' lhsmtool_posix: 1750180216.615605 lhsmtool_posix[1363]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdt.lustre-MDT0000.hsm.policy=+NRA Remove from backend: 0x200000bd2:0x6d:0x0 = /tmp/arc1/sanity-hsm.test_111a/0bbf/0x200000bd2:0x6d:0x0 Waiting 200s for 'FAILED' mdt.lustre-MDT0000.hsm.policy=-NRA PASS 111a (7s) == sanity-hsm test 111b: No retry policy (release case), restore will error ========================================================== 13:10:22 (1750180222) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_111b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=+NRA Remove from backend: 0x200000402:0x329:0x0 = /tmp/arc1/sanity-hsm.test_111b/072b/0x200000402:0x329:0x0 Waiting 200s for 'FAILED' Updated after 2s: want 'FAILED' got 'FAILED' mdt.lustre-MDT0000.hsm.policy=-NRA PASS 111b (8s) == sanity-hsm test 112: State of recorded request ======== 13:10:30 (1750180230) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_112/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=disabled /mnt/lustre/d112.sanity-hsm/f112.sanity-hsm: ARCHIVE waiting (from 0 to EOF) mdt.lustre-MDT0000.hsm_control=enabled PASS 112 (8s) == sanity-hsm test 113: wrong stat after restore ========= 13:10:38 (1750180238) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0300771 s, 34.9 MB/s Starting client: oleg229-client.virtnet: -o user_xattr,flock 192.168.202.129@tcp:/lustre /mnt/lustre3 Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_113/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre3"' Verifying released state: multiop /mnt/lustre/d113.sanity-hsm/f113.sanity-hsm voO_WRONLY:O_APPEND:_w4c TMPPIPE=/tmp/multiop_open_wait_pipe.7258 File: '/mnt/lustre2/d113.sanity-hsm/f113.sanity-hsm' Size: 1048576 Blocks: 1 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115205289280301 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-06-17 13:10:39.000000000 -0400 Modify: 2025-06-17 13:10:39.000000000 -0400 Change: 2025-06-17 13:10:39.000000000 -0400 Birth: - Stopping client oleg229-client.virtnet /mnt/lustre3 (opts:) PASS 113 (7s) == sanity-hsm test 114: Incompatible request does not set other requests as STARTED ========================================================== 13:10:45 (1750180245) 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00768236 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00253764 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_114/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled PASS 114 (8s) == sanity-hsm test 200: Register/Cancel archive ========== 13:10:53 (1750180253) 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00775966 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_200/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Copytool is suspended on oleg229-client.virtnet Waiting 200s for 'STARTED' Waiting 200s for 'CANCELED' Updated after 2s: want 'CANCELED' got 'CANCELED' Copytool is continued on oleg229-client.virtnet PASS 200 (10s) == sanity-hsm test 201: Register/Cancel restore ========== 13:11:03 (1750180263) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_201/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB) copied, 0.535531 s, 76.4 MB/s lhsmtool_posix: 1750180264.805375 lhsmtool_posix[6027]: action=1 src=d201.sanity-hsm/f201.sanity-hsm dst=/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750180264.813116 lhsmtool_posix[6027]: importing '/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_201//d201.sanity-hsm/f201.sanity-hsm' lhsmtool_posix: 1750180264.844746 lhsmtool_posix[6027]: imported '/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_201//0ba5/0x200000bd2:0x77:0x0'=='/tmp/arc1/sanity-hsm.test_201//d201.sanity-hsm/f201.sanity-hsm' lhsmtool_posix: 1750180264.844825 lhsmtool_posix[6027]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled PASS 201 (8s) == sanity-hsm test 202: Register/Cancel remove =========== 13:11:11 (1750180271) 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00242443 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_202/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Copytool is suspended on oleg229-client.virtnet Waiting 200s for 'STARTED' PASS 202 (7s) == sanity-hsm test 220A: Changelog for archive =========== 13:11:18 (1750180278) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_220A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl1' Waiting 200s for 'SUCCEED' lustre-MDT0000.3 16HSM 17:11:21.363846569 2025.06.17 0x0 t=[0x200000402:0x336:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 PASS 220A (7s) == sanity-hsm test 220a: Changelog for failed archive ==== 13:11:25 (1750180285) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_220a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl2' Copytool is suspended on oleg229-client.virtnet Copytool is continued on oleg229-client.virtnet lustre-MDT0000.6 16HSM 17:11:27.668678390 2025.06.17 0x2 t=[0x200000402:0x337:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp p=[0x200000bd2:0x7a:0x0] lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0000: Deregistered changelog user #2 PASS 220a (5s) == sanity-hsm test 221: Changelog for archive canceled === 13:11:31 (1750180291) 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00319237 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_221/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl3' Copytool is suspended on oleg229-client.virtnet Waiting 200s for 'CANCELED' Updated after 2s: want 'CANCELED' got 'CANCELED' Copytool is continued on oleg229-client.virtnet lustre-MDT0000.8 16HSM 17:11:35.717829385 2025.06.17 0x7d t=[0x200000402:0x339:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000: Deregistered changelog user #3 PASS 221 (8s) == sanity-hsm test 222a: Changelog for explicit restore == 13:11:39 (1750180299) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1750180300.258096 lhsmtool_posix[9922]: action=1 src=d222a.sanity-hsm/f222a.sanity-hsm dst=/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750180300.263273 lhsmtool_posix[9922]: importing '/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222a//d222a.sanity-hsm/f222a.sanity-hsm' lhsmtool_posix: 1750180300.285506 lhsmtool_posix[9922]: imported '/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222a//0bac/0x200000bd2:0x7e:0x0'=='/tmp/arc1/sanity-hsm.test_222a//d222a.sanity-hsm/f222a.sanity-hsm' lhsmtool_posix: 1750180300.285609 lhsmtool_posix[9922]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl4' Waiting 200s for 'SUCCEED' lustre-MDT0000.11 16HSM 17:11:41.886796739 2025.06.17 0x80 t=[0x200000bd2:0x7e:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp p=[0x200000bd2:0x7a:0x0] lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 PASS 222a (7s) == sanity-hsm test 222b: Changelog for implicit restore == 13:11:46 (1750180306) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl5' Waiting 200s for 'SUCCEED' 0e339f9bf886034c50444841bff8eb5d /mnt/lustre/d222b.sanity-hsm/f222b.sanity-hsm lustre-MDT0000.20 16HSM 17:11:51.117189478 2025.06.17 0x80 t=[0x200000402:0x33b:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0000: Deregistered changelog user #5 PASS 222b (8s) == sanity-hsm test 222c: Changelog for failed explicit restore ========================================================== 13:11:54 (1750180314) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1750180315.383881 lhsmtool_posix[11534]: action=1 src=d222c.sanity-hsm/f222c.sanity-hsm dst=/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750180315.389023 lhsmtool_posix[11534]: importing '/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222c//d222c.sanity-hsm/f222c.sanity-hsm' lhsmtool_posix: 1750180315.419903 lhsmtool_posix[11534]: imported '/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222c//0b51/0x200000bd2:0x83:0x0'=='/tmp/arc1/sanity-hsm.test_222c//d222c.sanity-hsm/f222c.sanity-hsm' lhsmtool_posix: 1750180315.420004 lhsmtool_posix[11534]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl6' Copytool is suspended on oleg229-client.virtnet Waiting 200s for 'STARTED' Copytool is continued on oleg229-client.virtnet lustre-MDT0000.22 16HSM 17:11:58.495130267 2025.06.17 0x82 t=[0x200000bd2:0x83:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp p=[0x200000bd2:0x81:0x0] lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000: Deregistered changelog user #6 PASS 222c (7s) == sanity-hsm test 222d: Changelog for failed implicit restore ========================================================== 13:12:01 (1750180321) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl7' Waiting 200s for 'SUCCEED' Remove from backend: 0x200000402:0x33d:0x0 = /tmp/arc1/sanity-hsm.test_222d/073f/0x200000402:0x33d:0x0 md5sum: /mnt/lustre/d222d.sanity-hsm/f222d.sanity-hsm: No data available lustre-MDT0000.29 16HSM 17:12:05.566411519 2025.06.17 0x82 t=[0x200000402:0x33d:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp lustre-MDT0000: clear the changelog for cl7 of all records lustre-MDT0000: Deregistered changelog user #7 PASS 222d (7s) == sanity-hsm test 223a: Changelog for restore canceled (import case) ========================================================== 13:12:09 (1750180329) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_223a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB) copied, 0.49504 s, 82.6 MB/s mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl8' lhsmtool_posix: 1750180332.081046 lhsmtool_posix[13225]: action=1 src=d223a.sanity-hsm/f223a.sanity-hsm dst=/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1750180332.087035 lhsmtool_posix[13225]: importing '/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_223a//d223a.sanity-hsm/f223a.sanity-hsm' lhsmtool_posix: 1750180332.128090 lhsmtool_posix[13225]: imported '/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_223a//0b5a/0x200000bd2:0x88:0x0'=='/tmp/arc1/sanity-hsm.test_223a//d223a.sanity-hsm/f223a.sanity-hsm' lhsmtool_posix: 1750180332.128269 lhsmtool_posix[13225]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Waiting 200s for 'CANCELED' Updated after 2s: want 'CANCELED' got 'CANCELED' Waiting 200s for 'SUCCEED' Waiting 190s for 'SUCCEED' Updated after 29s: want 'SUCCEED' got 'SUCCEED' lustre-MDT0000.36 16HSM 17:12:43.046571087 2025.06.17 0xfd t=[0x200000bd2:0x88:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp lustre-MDT0000: clear the changelog for cl8 of all records lustre-MDT0000: Deregistered changelog user #8 PASS 223a (37s) == sanity-hsm test 223b: Changelog for restore canceled (release case) ========================================================== 13:12:46 (1750180366) 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00222584 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_223b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl9' Waiting 200s for 'SUCCEED' Copytool is suspended on oleg229-client.virtnet Waiting 200s for 'STARTED' Copytool is continued on oleg229-client.virtnet lustre-MDT0000.43 16HSM 17:12:52.470402516 2025.06.17 0xfd t=[0x200000402:0x341:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp p=[0x200000bd2:0x86:0x0] lustre-MDT0000: clear the changelog for cl9 of all records lustre-MDT0000: Deregistered changelog user #9 PASS 223b (9s) == sanity-hsm test 224A: Changelog for remove ============ 13:12:55 (1750180375) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_224A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl10' Waiting 200s for 'SUCCEED' lustre-MDT0000.48 16HSM 17:12:59.545929230 2025.06.17 0x200 t=[0x200000402:0x343:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp p=[0x200000bd2:0x81:0x0] lustre-MDT0000: clear the changelog for cl10 of all records lustre-MDT0000: Deregistered changelog user #10 PASS 224A (8s) == sanity-hsm test 224a: Changelog for failed remove ===== 13:13:03 (1750180383) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_224a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl11' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Remove from backend: 0x200000402:0x344:0x0 = /tmp/arc1/sanity-hsm.test_224a/0746/0x200000402:0x344:0x0 Copytool is suspended on oleg229-client.virtnet Waiting 200s for 'STARTED' Updated after 2s: want 'STARTED' got 'STARTED' Copytool is continued on oleg229-client.virtnet lustre-MDT0000.53 16HSM 17:13:10.012403478 2025.06.17 0x202 t=[0x200000402:0x344:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp p=[0x200000bd2:0x8c:0x0] lustre-MDT0000: clear the changelog for cl11 of all records lustre-MDT0000: Deregistered changelog user #11 PASS 224a (10s) == sanity-hsm test 225: Changelog for remove canceled ==== 13:13:13 (1750180393) Test disabled PASS 225 (3s) == sanity-hsm test 226: changelog for last rm/mv with exiting archive ========================================================== 13:13:16 (1750180396) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_226/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0x200000402:0x347:0x0 mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl12' Waiting 200s for 'SUCCEED' lustre-MDT0000.54 16HSM 17:13:19.012665098 2025.06.17 0x280 t=[0x200000402:0x345:0x0] ef=0x13 u=0:0 nid=0@<0:0> lustre-MDT0000.55 16HSM 17:13:19.059649738 2025.06.17 0x280 t=[0x200000402:0x345:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp lustre-MDT0000.56 16HSM 17:13:19.059802693 2025.06.17 0x0 t=[0x200000402:0x345:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp lustre-MDT0000.57 16HSM 17:13:20.061992106 2025.06.17 0x280 t=[0x200000402:0x346:0x0] ef=0x13 u=0:0 nid=0@<0:0> lustre-MDT0000.58 16HSM 17:13:20.112314266 2025.06.17 0x280 t=[0x200000402:0x346:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp p=[0x200000bd2:0x81:0x0] lustre-MDT0000.59 16HSM 17:13:20.112427676 2025.06.17 0x0 t=[0x200000402:0x346:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp p=[0x200000bd2:0x81:0x0] lustre-MDT0000.60 06UNLNK 17:13:20.198500524 2025.06.17 0x3 t=[0x200000402:0x345:0x0] j=rm.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp p=[0x200000bd2:0x8d:0x0] f226.sanity-hsm-1 lustre-MDT0000.60 06UNLNK 17:13:20.198500524 2025.06.17 0x3 t=[0x200000402:0x345:0x0] j=rm.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp p=[0x200000bd2:0x8d:0x0] f226.sanity-hsm-1 lustre-MDT0000.61 08RENME 17:13:20.377662764 2025.06.17 0x3 t=[0x200000402:0x346:0x0] j=mv.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp p=[0x200000bd2:0x8d:0x0] f226.sanity-hsm-2 s=[0x200000402:0x347:0x0] sp=[0x200000bd2:0x8d:0x0] f226.sanity-hsm-3 lustre-MDT0000: clear the changelog for cl12 of all records lustre-MDT0000: Deregistered changelog user #12 PASS 226 (7s) == sanity-hsm test 227: changelog when explicit setting of HSM flags ========================================================== 13:13:23 (1750180403) 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00275442 s, 0.0 kB/s mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl13' lustre-MDT0000: clear the changelog for cl13 of all records lustre-MDT0000: Deregistered changelog user #13 PASS 227 (6s) == sanity-hsm test 228: On released file, return extend to FIEMAP. For [cp,tar] --sparse ========================================================== 13:13:29 (1750180409) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_228/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0281624 s, 37.2 MB/s /mnt/lustre/f228.sanity-hsm: 1 extent found tar: Removing leading `/' from member names mnt/lustre/f228.sanity-hsm PASS 228 (4s) == sanity-hsm test 250: Coordinator max request ========== 13:13:33 (1750180413) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_250/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00265794 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00294429 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00284335 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00244649 s, 0.0 kB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.0022773 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00222458 s, 0.0 kB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Copytool is suspended on oleg229-client.virtnet Waiting 200s for 'STARTED' Waiting 200s for 'STARTED' Copytool is continued on oleg229-client.virtnet PASS 250 (16s) == sanity-hsm test 251: Coordinator request timeout ====== 13:13:49 (1750180429) 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00322093 s, 0.0 kB/s mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_251/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Copytool is suspended on oleg229-client.virtnet Waiting 200s for 'STARTED' Waiting 200s for 'CANCELED' PASS 251 (9s) == sanity-hsm test 252: Timeout'ed running archive of a removed file should be canceled ========================================================== 13:13:58 (1750180438) 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00300451 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_252/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Copytool is suspended on oleg229-client.virtnet Waiting 200s for 'STARTED' Waiting 200s for 'CANCELED' Copytool is continued on oleg229-client.virtnet PASS 252 (8s) == sanity-hsm test 253: Check for wrong file size after release ========================================================== 13:14:06 (1750180446) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_253/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 10+0 records in 10+0 records out 10000000 bytes (10 MB) copied, 0.116197 s, 86.1 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' fail_loc=0x807 Cannot send HSM request (use of /mnt/lustre/d253.sanity-hsm/f253.sanity-hsm): Invalid argument could not release file PASS 253 (5s) == sanity-hsm test 254a: Request counters are initialized to zero ========================================================== 13:14:11 (1750180451) PASS 254a (3s) == sanity-hsm test 254b: Request counters are correctly incremented and decremented ========================================================== 13:14:14 (1750180454) Will launch 61 requests of each type Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_254b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Checking archive requests Copytool is suspended on oleg229-client.virtnet Copytool is continued on oleg229-client.virtnet Checking restore requests Copytool is suspended on oleg229-client.virtnet Copytool is continued on oleg229-client.virtnet Checking remove requests Copytool is suspended on oleg229-client.virtnet Copytool is continued on oleg229-client.virtnet PASS 254b (22s) == sanity-hsm test 255: Copytool registration wakes the coordinator up ========================================================== 13:14:36 (1750180476) 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00406163 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_255/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Killing existing copytools on oleg229-client.virtnet copytools stopped in 0s 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00500131 s, 0.0 kB/s 0x200000402:0x3d7:0x0 mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled Waiting 200s for '' Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_255/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 255 (16s) == sanity-hsm test 260a: Restore request have priority over other requests ========================================================== 13:14:52 (1750180492) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.142989 s, 7.3 MB/s 0x200000402:0x3d9:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.162965 s, 6.4 MB/s 0x200000402:0x3da:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.161288 s, 6.5 MB/s 0x200000402:0x3db:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146604 s, 7.2 MB/s 0x200000402:0x3dc:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.170793 s, 6.1 MB/s 0x200000402:0x3dd:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.124554 s, 8.4 MB/s 0x200000402:0x3de:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.141297 s, 7.4 MB/s 0x200000402:0x3df:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131282 s, 8.0 MB/s 0x200000402:0x3e0:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0957367 s, 11.0 MB/s 0x200000402:0x3e1:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12254 s, 8.6 MB/s 0x200000402:0x3e2:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.122454 s, 8.6 MB/s 0x200000402:0x3e3:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.111499 s, 9.4 MB/s 0x200000402:0x3e4:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.13418 s, 7.8 MB/s 0x200000402:0x3e5:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.137046 s, 7.7 MB/s 0x200000402:0x3e6:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.149815 s, 7.0 MB/s 0x200000402:0x3e7:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.150441 s, 7.0 MB/s 0x200000402:0x3e8:0x0 Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Killing existing copytools on oleg229-client.virtnet copytools stopped in 0s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' ARCHIVE RESTORE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE PASS 260a (18s) == sanity-hsm test 260b: Restore request have priority over other requests ========================================================== 13:15:10 (1750180510) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0777449 s, 13.5 MB/s 0x200000402:0x3eb:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0846459 s, 12.4 MB/s 0x200000402:0x3ec:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0871354 s, 12.0 MB/s 0x200000402:0x3ed:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10512 s, 10.0 MB/s 0x200000402:0x3ee:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0906332 s, 11.6 MB/s 0x200000402:0x3ef:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.107053 s, 9.8 MB/s 0x200000402:0x3f0:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.081805 s, 12.8 MB/s 0x200000402:0x3f1:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0776726 s, 13.5 MB/s 0x200000402:0x3f2:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0975397 s, 10.8 MB/s 0x200000402:0x3f3:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0854814 s, 12.3 MB/s 0x200000402:0x3f4:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0696534 s, 15.1 MB/s 0x200000402:0x3f5:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0915058 s, 11.5 MB/s 0x200000402:0x3f6:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0858813 s, 12.2 MB/s 0x200000402:0x3f7:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0927303 s, 11.3 MB/s 0x200000402:0x3f8:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.109323 s, 9.6 MB/s 0x200000402:0x3f9:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102663 s, 10.2 MB/s 0x200000402:0x3fa:0x0 Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2 "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Killing existing copytools on oleg229-client.virtnet copytools stopped in 0s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2 "/mnt/lustre2"' Waiting 200s for 'SUCCEED' RESTORE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE PASS 260b (16s) == sanity-hsm test 260c: Requests are not reordered on the 'hot' path of the coordinator ========================================================== 13:15:26 (1750180526) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130427 s, 8.0 MB/s 0x200000402:0x3fd:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11089 s, 9.5 MB/s 0x200000402:0x3fe:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102721 s, 10.2 MB/s 0x200000402:0x3ff:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.113277 s, 9.3 MB/s 0x200000402:0x400:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.121256 s, 8.6 MB/s 0x200000402:0x401:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.13415 s, 7.8 MB/s 0x200000402:0x402:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.121614 s, 8.6 MB/s 0x200000402:0x403:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.143219 s, 7.3 MB/s 0x200000402:0x404:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.135702 s, 7.7 MB/s 0x200000402:0x405:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125132 s, 8.4 MB/s 0x200000402:0x406:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100532 s, 10.4 MB/s 0x200000402:0x407:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0999971 s, 10.5 MB/s 0x200000402:0x408:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125676 s, 8.3 MB/s 0x200000402:0x409:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12745 s, 8.2 MB/s 0x200000402:0x40a:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11469 s, 9.1 MB/s 0x200000402:0x40b:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.143786 s, 7.3 MB/s 0x200000402:0x40c:0x0 Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2 "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Killing existing copytools on oleg229-client.virtnet copytools stopped in 0s mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2 "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE RESTORE PASS 260c (22s) == sanity-hsm test 261: Report 0 bytes size after HSM release ========================================================== 13:15:48 (1750180548) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_261/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.00514277 s, 1.6 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' /mnt/lustre/d261.sanity-hsm/f261.sanity-hsm: (0x00000009) exists archived, archive_id:2 /mnt/lustre/d261.sanity-hsm/f261.sanity-hsm: (0x0000000d) released exists archived, archive_id:2 PASS 261 (5s) == sanity-hsm test 262: The client should return 1 block for HSM released files ========================================================== 13:15:54 (1750180554) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_262/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.00637316 s, 1.3 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 262 (6s) == sanity-hsm test 300: On disk coordinator state kept between MDT umount/mount ========================================================== 13:15:59 (1750180559) Stop coordinator and remove coordinator state at mount mdt.lustre-MDT0000.hsm_control=shutdown Failing mds1 on oleg229-server Stopping /mnt/lustre-mds1 (opts:) on oleg229-server 13:16:03 (1750180563) shut down facet: mds1 facet_host: oleg229-server facet_failover_host: oleg229-server Failover mds1 to oleg229-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg229-server: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 Started lustre-MDT0000 13:16:17 (1750180577) targets are mounted 13:16:17 (1750180577) facet_failover done oleg229-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Set coordinator start at mount, and start coordinator Failing mds1 on oleg229-server Stopping /mnt/lustre-mds1 (opts:) on oleg229-server 13:16:44 (1750180604) shut down facet: mds1 facet_host: oleg229-server facet_failover_host: oleg229-server Failover mds1 to oleg229-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg229-server: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 Started lustre-MDT0000 13:16:57 (1750180617) targets are mounted 13:16:57 (1750180617) facet_failover done oleg229-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 300 (65s) == sanity-hsm test 301: HSM tunnable are persistent ====== 13:17:04 (1750180624) Failing mds1 on oleg229-server Stopping /mnt/lustre-mds1 (opts:) on oleg229-server 13:17:06 (1750180626) shut down facet: mds1 facet_host: oleg229-server facet_failover_host: oleg229-server Failover mds1 to oleg229-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg229-server: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 Started lustre-MDT0000 13:17:20 (1750180640) targets are mounted 13:17:20 (1750180640) facet_failover done oleg229-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 301 (23s) == sanity-hsm test 302: HSM tunnable are persistent when CDT is off ========================================================== 13:17:27 (1750180647) mdt.lustre-MDT0000.hsm_control=shutdown Failing mds1 on oleg229-server Stopping /mnt/lustre-mds1 (opts:) on oleg229-server 13:17:30 (1750180650) shut down facet: mds1 facet_host: oleg229-server facet_failover_host: oleg229-server Failover mds1 to oleg229-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg229-server: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 Started lustre-MDT0000 13:17:44 (1750180664) targets are mounted 13:17:44 (1750180664) facet_failover done oleg229-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 302 (25s) == sanity-hsm test 400: Single request is sent to the right MDT ========================================================== 13:17:53 (1750180673) SKIP: sanity-hsm test_400 needs >= 2 MDTs SKIP 400 (2s) == sanity-hsm test 401: Compound requests split and sent to their respective MDTs ========================================================== 13:17:54 (1750180674) SKIP: sanity-hsm test_401 needs >= 2 MDTs SKIP 401 (1s) == sanity-hsm test 402a: Copytool start fails if all MDTs are inactive ========================================================== 13:17:55 (1750180675) deactivate lustre-MDT0000-mdc-ffff8800a8038800 on oleg229-client.virtnet deactivate lustre-MDT0000-mdc-ffff8800b6d0f800 on oleg229-client.virtnet Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_402a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Failed to start copytool agt1 on 'oleg229-client.virtnet' pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 uuid not found in agent list on mds1 activate lustre-MDT0000-mdc-ffff8800a8038800 on oleg229-client.virtnet activate lustre-MDT0000-mdc-ffff8800b6d0f800 on oleg229-client.virtnet PASS 402a (3s) == sanity-hsm test 402b: CDT must retry request upon slow start of CT ========================================================== 13:17:58 (1750180678) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_402b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' fail_loc=0x14d fail_loc=0 Waiting 200s for 'SUCCEED' Updated after 6s: want 'SUCCEED' got 'SUCCEED' PASS 402b (19s) == sanity-hsm test 403: Copytool starts with inactive MDT and register on reconnect ========================================================== 13:18:17 (1750180697) SKIP: sanity-hsm test_403 needs >= 2 MDTs SKIP 403 (1s) == sanity-hsm test 404: Inactive MDT does not block requests for active MDTs ========================================================== 13:18:19 (1750180699) SKIP: sanity-hsm test_404 needs >= 2 MDTs SKIP 404 (1s) == sanity-hsm test 405: archive and release under striped directory ========================================================== 13:18:20 (1750180700) SKIP: sanity-hsm test_405 needs >= 2 MDTs SKIP 405 (1s) == sanity-hsm test 406: attempting to migrate HSM archived files is safe ========================================================== 13:18:21 (1750180701) SKIP: sanity-hsm test_406 needs >= 2 MDTs SKIP 406 (2s) == sanity-hsm test 407: Check for double RESTORE records in llog ========================================================== 13:18:23 (1750180703) 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00220668 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_407/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' fail_val=5 fail_loc=0x164 Copytool is suspended on oleg229-client.virtnet mdt.lustre-MDT0000.hsm.actions= lrh=[type=10680000 len=136 idx=6/1] fid=[0x2000032e1:0x2:0x0] dfid=[0x2000032e1:0x2:0x0] compound/cookie=0x0/0x6851a338 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/2] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x6851a339 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] Failing mds1 on oleg229-server Stopping /mnt/lustre-mds1 (opts:) on oleg229-server 13:18:32 (1750180712) shut down facet: mds1 facet_host: oleg229-server facet_failover_host: oleg229-server Failover mds1 to oleg229-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg229-server: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 Started lustre-MDT0000 13:18:47 (1750180727) targets are mounted 13:18:47 (1750180727) facet_failover done oleg229-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec fail_loc=0 mdt.lustre-MDT0000.hsm.actions= lrh=[type=10680000 len=136 idx=6/1] fid=[0x2000032e1:0x2:0x0] dfid=[0x2000032e1:0x2:0x0] compound/cookie=0x0/0x6851a338 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/2] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x6851a339 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/3] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x6851a33a action=RESTORE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] Copytool is continued on oleg229-client.virtnet d41d8cd98f00b204e9800998ecf8427e /mnt/lustre/d407.sanity-hsm/f407.sanity-hsm d41d8cd98f00b204e9800998ecf8427e /mnt/lustre2/d407.sanity-hsm/f407.sanity-hsm pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 mdt.lustre-MDT0000.hsm.actions= lrh=[type=10680000 len=136 idx=6/1] fid=[0x2000032e1:0x2:0x0] dfid=[0x2000032e1:0x2:0x0] compound/cookie=0x0/0x6851a338 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/2] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x6851a339 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/3] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x3:0x0] compound/cookie=0x0/0x6851a33a action=RESTORE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] PASS 407 (36s) == sanity-hsm test 408: Verify fiemap on release file ==== 13:18:59 (1750180739) Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_408/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.0741857 s, 883 kB/s SKIP: sanity-hsm test_408 ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 408 (1s) == sanity-hsm test 409a: Coordinator should not stop when in use ========================================================== 13:19:00 (1750180740) 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00397854 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' fail_val=5 fail_loc=0x164 cat: /mnt/lustre/d409a.sanity-hsm/f409a.sanity-hsm: No data available mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled Killing existing copytools on oleg229-client.virtnet copytools stopped in 0s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' mdt.lustre-MDT0000.hsm_control=enabled PASS 409a (15s) == sanity-hsm test 409b: getattr released file with CDT stopped after remount ========================================================== 13:19:15 (1750180755) 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00193859 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Killing existing copytools on oleg229-client.virtnet copytools stopped in 0s Failing mds1 on oleg229-server Stopping /mnt/lustre-mds1 (opts:) on oleg229-server 13:19:39 (1750180779) shut down facet: mds1 facet_host: oleg229-server facet_failover_host: oleg229-server Failover mds1 to oleg229-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg229-server: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 Started lustre-MDT0000 13:19:52 (1750180792) targets are mounted 13:19:52 (1750180792) facet_failover done oleg229-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec File: '/mnt/lustre/d409b.sanity-hsm/f409b.sanity-hsm' Size: 0 Blocks: 0 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115406615871496 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-06-17 13:19:15.000000000 -0400 Modify: 2025-06-17 13:19:15.000000000 -0400 Change: 2025-06-17 13:19:15.000000000 -0400 Birth: - PASS 409b (63s) == sanity-hsm test 410: lfs data_version -s allows release of force-archived file ========================================================== 13:20:18 (1750180818) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11514 s, 9.1 MB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_410/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Cannot send HSM request (use of /mnt/lustre/d410.sanity-hsm/f410.sanity-hsm): Operation not permitted PASS 410 (4s) == sanity-hsm test 411: hsm_ops rbac role ================ 13:20:22 (1750180822) On MGS 192.168.202.129, active = nodemap.active=1 waiting 10 secs for sync On MGS 192.168.202.129, test_411.trusted_nodemap = nodemap.test_411.trusted_nodemap=1 waiting 10 secs for sync Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_411/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' /mnt/lustre/d411.sanity-hsm/fileA: (0x00000000) Waiting 200s for 'SUCCEED' Waiting 200s for 'SUCCEED' Killing existing copytools on oleg229-client.virtnet copytools stopped in 0s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_411/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' On MGS 192.168.202.129, test_411.rbac = nodemap.test_411.rbac=file_perms,dne_ops,quota_ops,byfid_ops,chlg_ops,fscrypt_admin,server_upcall,ignore_root_prjquota,local_admin waiting 10 secs for sync /mnt/lustre/d411.sanity-hsm/fileB: (0x00000000) Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Operation not permitted Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied lfs hsm_set: change hsm flags for '/mnt/lustre/d411.sanity-hsm/fileB' failed: Permission denied lfs hsm_clear: change hsm flags for '/mnt/lustre/d411.sanity-hsm/fileB' failed: Permission denied On MGS 192.168.202.129, active = nodemap.active=0 waiting 10 secs for sync oleg229-server: error: nodemap 'test_411' does not exist oleg229-server: nodemap_del: Invalid argument pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 On MGS 192.168.202.129, active = nodemap.active=0 waiting 10 secs for sync PASS 411 (67s) == sanity-hsm test 500: various LLAPI HSM tests ========== 13:21:29 (1750180889) test1 @1750180914: Register/unregister copytool 2000x to check for leaks ...... pass test2 @1750180914: Re/un-register copytool multiple times without error ....... pass test3 @1750180914: Pass bad parameters to llapi_hsm_copytool_register() ....... pass test4 @1750180914: Bad parameters to llapi_hsm_copytool_unregister() .......... pass test5 @1750180914: Test llapi_hsm_copytool_recv() in non-blocking mode ........ pass test6 @1750180914: Test llapi_hsm_copytool_recv() with bogus parameters ....... pass test7 @1750180914: Test event polling (without actual traffic) ................ pass test50 @1750180914: Test llapi_hsm_state_get()/get_fd() ....................... pass test51 @1750180914: Test llapi_hsm_state_set_fd() ............................. pass test52 @1750180914: Test llapi_hsm_current_action() ........................... pass test100 @1750180915: Simple archive creation with no progress reported. ....... pass test101 @1750180918: Simple archive creation with progress every byte. ........ pass test102 @1750180922: Archive creation with progress every byte, backwards ..... pass test103 @1750180923: Archive creation with a single progress report ........... pass test104 @1750180924: Archive creation with two progress reports ............... pass test105 @1750180925: Archive creation with one bogus progress report .......... pass test106 @1750180926: Archive creation with one empty progress report .......... pass test107 @1750180927: Archive creation with one bogus progress report .......... pass test108 @1750180930: Archive creation with same progress report each time ..... pass test109 @1750180931: Archive creation with one report, with large number ...... pass test110 @1750180932: Archive with 10 progress reports, checking progress ...... pass test111 @1750180933: Archive with 10 reports in reverse, checking progress .... pass test112 @1750180934: Archive with 10 reports, duplicated, check progress ...... pass test113 @1750180935: Archive with 9 reports, with 20% overlapping coverage .... pass PASS 500 (49s) == sanity-hsm test 600: Changelog fields 'u=' and 'nid=' ========================================================== 13:22:18 (1750180938) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl1' mdd.lustre-MDT0000.changelog_mask=ALL running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d600.sanity-hsm/f600.sanity-hsm] Got NID '192.168.202.29@tcp' lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 PASS 600 (7s) == sanity-hsm test 601: OPEN Changelog entry ============= 13:22:25 (1750180945) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl2' mdd.lustre-MDT0000.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0000.8 10OPEN 17:22:28.140833205 2025.06.17 0x1 t=[0x2000032e1:0x26:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.202.29@tcp m=r-- p=[0x2000032e1:0x25:0x0] lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0000: Deregistered changelog user #2 PASS 601 (6s) == sanity-hsm test 602: Changelog record CLOSE only if open+write or OPEN recorded ========================================================== 13:22:31 (1750180951) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl3' mdd.lustre-MDT0000.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000.13 11CLOSE 17:22:34.970784441 2025.06.17 0x1 t=[0x2000032e1:0x28:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000.14 10OPEN 17:22:35.115846951 2025.06.17 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.202.29@tcp m=-w- p=[0x2000032e1:0x27:0x0] lustre-MDT0000.15 13TRUNC 17:22:35.120470167 2025.06.17 0xe t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp p=[0x2000032e1:0x27:0x0] lustre-MDT0000.16 11CLOSE 17:22:35.133270518 2025.06.17 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp lustre-MDT0000.16 11CLOSE 17:22:35.133270518 2025.06.17 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp mdd.lustre-MDT0000.changelog_mask=-OPEN lustre-MDT0000: clear the changelog for cl3 of all records f lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000.17 13TRUNC 17:22:36.118844711 2025.06.17 0xe t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp p=[0x2000032e1:0x27:0x0] lustre-MDT0000.18 11CLOSE 17:22:36.127442732 2025.06.17 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp lustre-MDT0000.18 11CLOSE 17:22:36.127442732 2025.06.17 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000: Deregistered changelog user #3 PASS 602 (8s) == sanity-hsm test 603: GETXATTR Changelog entry ========= 13:22:39 (1750180959) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl4' mdd.lustre-MDT0000.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl4 of all records getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/d603.sanity-hsm/f603.sanity-hsm user.xattr1="value1" lustre-MDT0000.24 23GXATR 17:22:42.952546144 2025.06.17 0x0 t=[0x2000032e1:0x2a:0x0] j=getfattr.0 ef=0x1b u=0:0 nid=192.168.202.29@tcp x=user.xattr1 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 PASS 603 (7s) == sanity-hsm test 604: NOPEN Changelog entry ============ 13:22:46 (1750180966) mdd.lustre-MDT0000.changelog_deniednext=20 mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl5' mdd.lustre-MDT0000.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl5 of all records running as uid/gid/euid/egid 500/500/500/500, groups: 500 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm] cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied lustre-MDT0000.29 24NOPEN 17:22:50.072733311 2025.06.17 0x1 t=[0x2000032e1:0x2c:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.202.29@tcp m=r-- p=[0x2000032e1:0x2b:0x0] Got NID '192.168.202.29@tcp' lustre-MDT0000: clear the changelog for cl5 of all records running as uid/gid/euid/egid 500/500/500/500, groups: 500 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm] cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied lustre-MDT0000: clear the changelog for cl5 of all records running as uid/gid/euid/egid 500/500/500/500, groups: 500 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm] cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied lustre-MDT0000.30 24NOPEN 17:23:10.503231887 2025.06.17 0x1 t=[0x2000032e1:0x2c:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.202.29@tcp m=r-- Got NID '192.168.202.29@tcp' lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0000: Deregistered changelog user #5 mdd.lustre-MDT0000.changelog_deniednext=60 PASS 604 (28s) == sanity-hsm test 605: Test OPEN and CLOSE rate limit in Changelogs ========================================================== 13:23:14 (1750180994) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl6' mdd.lustre-MDT0000.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000.34 10OPEN 17:23:18.245286103 2025.06.17 0x43 t=[0x2000032e1:0x2e:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.202.29@tcp m=rw- p=[0x2000032e1:0x2d:0x0] lustre-MDT0000.34 10OPEN 17:23:18.245286103 2025.06.17 0x43 t=[0x2000032e1:0x2e:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.202.29@tcp m=rw- p=[0x2000032e1:0x2d:0x0] lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000.35 10OPEN 17:23:18.750339791 2025.06.17 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.202.29@tcp m=r-- lustre-MDT0000.36 11CLOSE 17:23:18.766577210 2025.06.17 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp lustre-MDT0000.35 10OPEN 17:23:18.750339791 2025.06.17 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.202.29@tcp m=r-- lustre-MDT0000.36 11CLOSE 17:23:18.766577210 2025.06.17 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000: clear the changelog for cl6 of all records running as uid/gid/euid/egid 500/500/500/500, groups: 500 [cat] [/mnt/lustre/d605.sanity-hsm/f605.sanity-hsm] lustre-MDT0000.37 10OPEN 17:23:19.380690814 2025.06.17 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.202.29@tcp m=r-- lustre-MDT0000.38 11CLOSE 17:23:19.387806479 2025.06.17 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.500 ef=0x13 u=500:500 nid=192.168.202.29@tcp lustre-MDT0000.37 10OPEN 17:23:19.380690814 2025.06.17 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.202.29@tcp m=r-- lustre-MDT0000.38 11CLOSE 17:23:19.387806479 2025.06.17 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.500 ef=0x13 u=500:500 nid=192.168.202.29@tcp lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000.39 11CLOSE 17:23:19.716391817 2025.06.17 0x43 t=[0x2000032e1:0x2e:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp lustre-MDT0000.39 11CLOSE 17:23:19.716391817 2025.06.17 0x43 t=[0x2000032e1:0x2e:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.29@tcp lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000: Deregistered changelog user #6 PASS 605 (9s) == sanity-hsm test 606: llog_reader groks changelog fields ========================================================== 13:23:23 (1750181003) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl7' mdd.lustre-MDT0000.changelog_mask=ALL running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d606.sanity-hsm/f606.sanity-hsm] Stopping /mnt/lustre-mds1 (opts:) on oleg229-server rec #2 type=1064553b len=64 offset 8256 Header size : 8192 llh_size : 64 Time : Tue Jun 17 13:09:38 2025 Number of records: 1 cat_idx: 1 last_idx: 2 Flags: 0x2012 Target uuid : ----------------------- #02 (064)fid=[0x1:0x3b:0x0] path=oi.1/0x1:0x3b:0x0 oleg229-server: llog_reader: The llog is corrupted, 1 errors found Got UID/GID 500:500 Got NID 192.168.202.29@tcp Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg229-server: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg229-client: oleg229-server: ssh exited with exit code 1 Started lustre-MDT0000 lustre-MDT0000: clear the changelog for cl7 of all records lustre-MDT0000: Deregistered changelog user #7 PASS 606 (24s) == sanity-hsm test 607a: release a file that was migrated after being archived ========================================================== 13:23:47 (1750181027) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.15535 s, 6.7 MB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Waiting 200s for 'SUCCEED' PASS 607a (8s) == sanity-hsm test 607b: Migrate should not change the HSM attribute of dirty files ========================================================== 13:23:55 (1750181035) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.116996 s, 9.0 MB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' llite.lustre-ffff8800a8038800.xattr_cache=0 llite.lustre-ffff8800b6d0f800.xattr_cache=0 /mnt/lustre/d607b.sanity-hsm/f607b.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:1 llite.lustre-ffff8800a8038800.xattr_cache=1 llite.lustre-ffff8800b6d0f800.xattr_cache=1 PASS 607b (6s) == sanity-hsm test 607c: 'lfs swap_layouts' should set dirty flag on HSM file ========================================================== 13:24:01 (1750181041) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102922 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.136535 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.107594 s, 9.7 MB/s Starting copytool 'agt1' on 'oleg229-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' lfs swap_layouts: error: cannot swap layout between '/mnt/lustre/d607c.sanity-hsm/f607c.sanity-hsm-1' and '/mnt/lustre/d607c.sanity-hsm/f607c.sanity-hsm-3': Operation not permitted (1) PASS 607c (9s) == sanity-hsm test complete, duration 2385 sec =========== 13:24:10 (1750181050) === sanity-hsm: start cleanup 13:24:11 (1750181051) === Stopping clients: oleg229-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg229-client.virtnet /mnt/lustre2 opts: === sanity-hsm: finish cleanup 13:24:30 (1750181070) ===