-----============= acceptance-small: sanity-hsm ============----- Wed May 20 16:52:27 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg431-server: /home/green/git/lustre-release/lustre/tests/except/sanity-hsm.ex - see MDS1_VERSION <= CLIENT_VERSION (34682136 <= 34682136) for LU-18924, go 100 105 excepting tests: === sanity-hsm: start setup 16:52:41 (1779310361) === Starting client oleg431-client.virtnet: -o user_xattr,flock 192.168.204.131@tcp:/lustre /mnt/lustre2 Mount client oleg431-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.204.131@tcp:/lustre /mnt/lustre2 Started clients oleg431-client.virtnet: 192.168.204.131@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) oleg431-client.virtnet: executing check_config_client /mnt/lustre oleg431-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg431-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8aa7c5c03800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8aa7c8977000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8aa7c5c03800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8aa7c8977000.idle_timeout=debug disable quota as required oleg431-server: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-hsm: finish setup 16:53:04 (1779310384) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f8368] nobody:x:65534: Killing existing copytools on oleg431-client.virtnet with signal TERM pkill: pidfile not valid Try `pkill --help' for more information. Set HSM on and start Set sanity-hsm HSM policy == sanity-hsm test 1A: lfs hsm flags root/non-root access ========================================================== 16:53:31 (1779310411) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_set] [--norelease] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_clear] [--norelease] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_set] [--exists] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] lfs hsm_set: change hsm flags for '/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm' failed: Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] PASS 1A (6s) == sanity-hsm test 1a: mmap & cat a HSM released file ==== 16:53:38 (1779310418) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.299638 s, 3.5 MB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Verifying released state: PASS 1a (9s) == sanity-hsm test 1b: Archive, Release and Restore composite file ========================================================== 16:53:46 (1779310426) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0470835 s, 22.3 MB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' archive /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' release /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm verify released state: pass restore /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' verify restored state: pass PASS 1b (10s) == sanity-hsm test 1c: Check setting archive-id in lfs hsm_set ========================================================== 16:53:56 (1779310436) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] verifying archive number is 32 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] verifying archive number is still 32 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] verifying archive number is 33 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] verifying archive number is 16 PASS 1c (5s) == sanity-hsm test 1d: Archive, Release and Restore DoM file ========================================================== 16:54:02 (1779310442) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318684 s, 32.9 MB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' archive /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' release /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm verify released state: pass restore /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm verify restored state: pass PASS 1d (8s) == sanity-hsm test 1e: Archive, Release and Restore SEL file ========================================================== 16:54:10 (1779310450) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0390406 s, 26.9 MB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' archive /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm Waiting 200s for 'SUCCEED' release /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm verify released state: pass restore /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' verify restored state: pass PASS 1e (10s) == sanity-hsm test 1f: DoM file release after restore ==== 16:54:20 (1779310460) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0423384 s, 24.8 MB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' archive /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm Waiting 200s for 'SUCCEED' release /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm verify released state: pass restore /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' verify restored state: pass release again /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm: (0x0000000d) released exists archived, archive_id:1 verify released state: pass PASS 1f (10s) == sanity-hsm test 2: Check file dirtyness when doing setattr ========================================================== 16:54:30 (1779310470) 0+0 records in 0+0 records out 0 bytes copied, 0.00485329 s, 0.0 kB/s 0x200000403:0x8:0x0 PASS 2 (6s) == sanity-hsm test 3: Check file dirtyness when opening for write ========================================================== 16:54:36 (1779310476) Succeed in opening file "/mnt/lustre/d3.sanity-hsm/f3.sanity-hsm"(flags=O_WRONLY) 3+0 records in 3+0 records out 3+0 records in 3+0 records out PASS 3 (5s) == sanity-hsm test 4: Useless cancel must not be registered ========================================================== 16:54:42 (1779310482) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.155762 s, 6.7 MB/s PASS 4 (5s) == sanity-hsm test 8: Test default archive number ======== 16:54:47 (1779310487) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_8/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 8 (5s) == sanity-hsm test 9A: Use of explicit archive number, with dedicated copytool ========================================================== 16:54:52 (1779310492) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_9A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 3 "/mnt/lustre2"' oleg431-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg431-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=3 requests=[current:0 ok:0 errors:0] on mds1 found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=3 requests=[current:0 ok:0 errors:0] on mds2 Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 9A (19s) == sanity-hsm test 9a: Multiple remote agents ============ 16:55:11 (1779310511) SKIP: sanity-hsm test_9a Need 3 or more clients, have 1 SKIP 9a (2s) == sanity-hsm test 10a: Archive a file =================== 16:55:13 (1779310513) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 996: warning: command substitution: ignored null byte in input Verifying content Verifying hsm state Verifying archive number is 2 PASS 10a (6s) == sanity-hsm test 10b: Archive of non dirty file must work without doing request ========================================================== 16:55:20 (1779310520) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' PASS 10b (9s) == sanity-hsm test 10c: Check forbidden archive ========== 16:55:28 (1779310528) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Cannot send HSM request (use of /mnt/lustre/d10c.sanity-hsm/f10c.sanity-hsm): Operation not permitted PASS 10c (5s) == sanity-hsm test 10d: Archive a file on the default archive id ========================================================== 16:55:33 (1779310533) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 10d (7s) == sanity-hsm test 11a: Import a file ==================== 16:55:40 (1779310540) lhsmtool_posix: 1779310542.084059 [22165]: action=1 src=d11a.sanity-hsm/f11a.sanity-hsm dst=/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779310542.095575 [22165]: importing '/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11a//d11a.sanity-hsm/f11a.sanity-hsm' lhsmtool_posix: 1779310542.137259 [22165]: imported '/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11a//0424/0x200000402:0x26:0x0'=='/tmp/arc1/sanity-hsm.test_11a//d11a.sanity-hsm/f11a.sanity-hsm' lhsmtool_posix: 1779310542.137331 [22165]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Verifying released state: Verifying imported size 158=158 Verifying released pattern: raid0,released Verifying new fid 0x200000402:0x26:0x0 in archive PASS 11a (5s) == sanity-hsm test 11b: Import a deleted file using its FID ========================================================== 16:55:45 (1779310545) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_11b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' lhsmtool_posix: 1779310549.487011 [22864]: action=1 src=0x200000403:0x11:0x0 dst=/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779310549.497676 [22864]: Resolving [0x200000403:0x11:0x0] to /tmp/arc1/sanity-hsm.test_11b//0412/0x200000403:0x11:0x0 lhsmtool_posix: 1779310549.497799 [22864]: importing '/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11b//0412/0x200000403:0x11:0x0' lhsmtool_posix: 1779310549.541040 [22864]: imported '/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11b//042a/0x200000402:0x28:0x0'=='/tmp/arc1/sanity-hsm.test_11b//0412/0x200000403:0x11:0x0' lhsmtool_posix: 1779310549.541136 [22864]: process finished, errs: 0 major, 0 minor, rc=0 (Success) /mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm: OK PASS 11b (8s) == sanity-hsm test 11c: Import a file to a directory with a pool ========================================================== 16:55:53 (1779310553) Creating new pool test_11c oleg431-server: Pool lustre.test_11c created Adding targets to pool oleg431-server: OST lustre-OST0001_UUID added to pool lustre.test_11c lhsmtool_posix: 1779310562.165517 [23579]: action=1 src=d11c.sanity-hsm/f11c.sanity-hsm dst=/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779310562.171171 [23579]: importing '/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11c//d11c.sanity-hsm/f11c.sanity-hsm' lhsmtool_posix: 1779310562.210120 [23579]: imported '/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11c//0404/0x240000402:0x6:0x0'=='/tmp/arc1/sanity-hsm.test_11c//d11c.sanity-hsm/f11c.sanity-hsm' lhsmtool_posix: 1779310562.210554 [23579]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Destroy the created pools: test_11c lustre.test_11c oleg431-server: OST lustre-OST0001_UUID removed from pool lustre.test_11c oleg431-server: Pool lustre.test_11c destroyed PASS 11c (20s) == sanity-hsm test 12a: Restore an imported file explicitly ========================================================== 16:56:13 (1779310573) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1779310575.668407 [24316]: action=1 src=d12a.sanity-hsm/f12a.sanity-hsm dst=/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779310575.677855 [24316]: importing '/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12a//d12a.sanity-hsm/f12a.sanity-hsm' lhsmtool_posix: 1779310575.756753 [24316]: imported '/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12a//0429/0x200000402:0x2b:0x0'=='/tmp/arc1/sanity-hsm.test_12a//d12a.sanity-hsm/f12a.sanity-hsm' lhsmtool_posix: 1779310575.756837 [24316]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Verifying released state: Waiting 200s for 'SUCCEED' Verifying file state: PASS 12a (9s) == sanity-hsm test 12b: Restore an imported file implicitly ========================================================== 16:56:22 (1779310582) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1779310584.170062 [25031]: action=1 src=d12b.sanity-hsm/f12b.sanity-hsm dst=/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779310584.176231 [25031]: importing '/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12b//d12b.sanity-hsm/f12b.sanity-hsm' lhsmtool_posix: 1779310584.215720 [25031]: imported '/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12b//042f/0x200000402:0x2d:0x0'=='/tmp/arc1/sanity-hsm.test_12b//d12b.sanity-hsm/f12b.sanity-hsm' lhsmtool_posix: 1779310584.215769 [25031]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Verifying released state: Verifying file state after restore: PASS 12b (6s) == sanity-hsm test 12c: Restore a file with stripe of 2 == 16:56:28 (1779310588) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 5+0 records in 5+0 records out 5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.108914 s, 48.1 MB/s /mnt/lustre/d12c.sanity-hsm/f12c.sanity-hsm: OK PASS 12c (8s) == sanity-hsm test 12d: Restore of a non archived, non released file must work ========================================================== 16:56:36 (1779310596) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' PASS 12d (9s) == sanity-hsm test 12e: Check forbidden restore ========== 16:56:45 (1779310605) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' /mnt/lustre/d12e.sanity-hsm/f12e.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:1 Cannot send HSM request (use of /mnt/lustre/d12e.sanity-hsm/f12e.sanity-hsm): Operation not permitted PASS 12e (8s) == sanity-hsm test 12f: Restore a released file explicitly ========================================================== 16:56:53 (1779310613) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Verifying file state: PASS 12f (9s) == sanity-hsm test 12g: Restore a released file implicitly ========================================================== 16:57:02 (1779310622) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12g/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 12g (7s) == sanity-hsm test 12h: Restore a released file implicitly from a second node ========================================================== 16:57:09 (1779310629) SKIP: sanity-hsm test_12h Need 2 or more clients, have 1 SKIP 12h (2s) == sanity-hsm test 12m: Archive/release/implicit restore ========================================================== 16:57:11 (1779310631) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12m/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' PASS 12m (8s) == sanity-hsm test 12n: Import/implicit restore/release == 16:57:19 (1779310639) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12n/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1779310641.510244 [29885]: action=1 src=d12n.sanity-hsm/f12n.sanity-hsm dst=/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779310641.517938 [29885]: importing '/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12n//d12n.sanity-hsm/f12n.sanity-hsm' lhsmtool_posix: 1779310641.565828 [29885]: imported '/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12n//0439/0x200000402:0x3b:0x0'=='/tmp/arc1/sanity-hsm.test_12n//d12n.sanity-hsm/f12n.sanity-hsm' lhsmtool_posix: 1779310641.566060 [29885]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 12n (7s) == sanity-hsm test 12o: Layout-swap failure during Restore leaves file released ========================================================== 16:57:26 (1779310646) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12o/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' fail_loc=0x152 mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0001.hsm.policy=+NRA diff: /mnt/lustre/d12o.sanity-hsm/f12o.sanity-hsm: No data available mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0001.hsm.policy=-NRA fail_loc=0 mdt.lustre-MDT0000.hsm_control=purge mdt.lustre-MDT0001.hsm_control=purge PASS 12o (29s) == sanity-hsm test 12p: implicit restore of a file on copytool mount point ========================================================== 16:57:55 (1779310675) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12p/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 12p (9s) == sanity-hsm test 12q: file attributes are refreshed after restore ========================================================== 16:58:05 (1779310685) Starting client: oleg431-client.virtnet: -o user_xattr,flock 192.168.204.131@tcp:/lustre /mnt/lustre3 Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12q/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre3"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.189706 s, 5.5 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Killing existing copytools on oleg431-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12q/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre3"' Stopping client oleg431-client.virtnet /mnt/lustre3 (opts:) PASS 12q (16s) == sanity-hsm test 12r: lseek restores released file ===== 16:58:21 (1779310701) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12r/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 12r (7s) == sanity-hsm test 12s: race between restore requests ==== 16:58:28 (1779310708) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12s/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' fail_loc=0x8000018b PASS 12s (15s) == sanity-hsm test 12t: Multiple parallel reads for a HSM imported file ========================================================== 16:58:43 (1779310723) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12t/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' lhsmtool_posix: 1779310727.196966 [34042]: action=1 src=0x200000403:0x2b:0x0 dst=/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779310727.205126 [34042]: Resolving [0x200000403:0x2b:0x0] to /tmp/arc1/sanity-hsm.test_12t//0428/0x200000403:0x2b:0x0 lhsmtool_posix: 1779310727.205243 [34042]: importing '/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12t//0428/0x200000403:0x2b:0x0' lhsmtool_posix: 1779310727.257609 [34042]: imported '/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12t//044b/0x200000402:0x49:0x0'=='/tmp/arc1/sanity-hsm.test_12t//0428/0x200000403:0x2b:0x0' lhsmtool_posix: 1779310727.257695 [34042]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 12t (8s) == sanity-hsm test 12u: Multiple reads on multiple HSM imported files in parallel ========================================================== 16:58:51 (1779310731) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12u/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1779310742.069400 [34919]: action=1 src=0x200000403:0x2d:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0 mount_point=/mnt/lustre2 lhsmtool_posix: 1779310742.076431 [34919]: Resolving [0x200000403:0x2d:0x0] to /tmp/arc1/sanity-hsm.test_12u//042e/0x200000403:0x2d:0x0 lhsmtool_posix: 1779310742.076504 [34919]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0' from '/tmp/arc1/sanity-hsm.test_12u//042e/0x200000403:0x2d:0x0' lhsmtool_posix: 1779310742.131861 [34919]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0' from '/tmp/arc1/sanity-hsm.test_12u//0449/0x200000402:0x4b:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042e/0x200000403:0x2d:0x0' lhsmtool_posix: 1779310742.132003 [34919]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1779310742.325482 [34948]: action=1 src=0x200000403:0x2e:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1 mount_point=/mnt/lustre2 lhsmtool_posix: 1779310742.336619 [34948]: Resolving [0x200000403:0x2e:0x0] to /tmp/arc1/sanity-hsm.test_12u//042d/0x200000403:0x2e:0x0 lhsmtool_posix: 1779310742.336746 [34948]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1' from '/tmp/arc1/sanity-hsm.test_12u//042d/0x200000403:0x2e:0x0' lhsmtool_posix: 1779310742.374573 [34948]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1' from '/tmp/arc1/sanity-hsm.test_12u//044e/0x200000402:0x4c:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042d/0x200000403:0x2e:0x0' lhsmtool_posix: 1779310742.375538 [34948]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1779310742.591827 [34977]: action=1 src=0x200000403:0x2f:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2 mount_point=/mnt/lustre2 lhsmtool_posix: 1779310742.597049 [34977]: Resolving [0x200000403:0x2f:0x0] to /tmp/arc1/sanity-hsm.test_12u//042c/0x200000403:0x2f:0x0 lhsmtool_posix: 1779310742.597130 [34977]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2' from '/tmp/arc1/sanity-hsm.test_12u//042c/0x200000403:0x2f:0x0' lhsmtool_posix: 1779310742.644051 [34977]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2' from '/tmp/arc1/sanity-hsm.test_12u//044f/0x200000402:0x4d:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042c/0x200000403:0x2f:0x0' lhsmtool_posix: 1779310742.644520 [34977]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1779310742.822299 [35006]: action=1 src=0x200000403:0x30:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3 mount_point=/mnt/lustre2 lhsmtool_posix: 1779310742.832355 [35006]: Resolving [0x200000403:0x30:0x0] to /tmp/arc1/sanity-hsm.test_12u//0433/0x200000403:0x30:0x0 lhsmtool_posix: 1779310742.832455 [35006]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3' from '/tmp/arc1/sanity-hsm.test_12u//0433/0x200000403:0x30:0x0' lhsmtool_posix: 1779310742.873421 [35006]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3' from '/tmp/arc1/sanity-hsm.test_12u//044c/0x200000402:0x4e:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0433/0x200000403:0x30:0x0' lhsmtool_posix: 1779310742.873487 [35006]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1779310743.072756 [35035]: action=1 src=0x200000403:0x31:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4 mount_point=/mnt/lustre2 lhsmtool_posix: 1779310743.079812 [35035]: Resolving [0x200000403:0x31:0x0] to /tmp/arc1/sanity-hsm.test_12u//0432/0x200000403:0x31:0x0 lhsmtool_posix: 1779310743.080040 [35035]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4' from '/tmp/arc1/sanity-hsm.test_12u//0432/0x200000403:0x31:0x0' lhsmtool_posix: 1779310743.124098 [35035]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4' from '/tmp/arc1/sanity-hsm.test_12u//044d/0x200000402:0x4f:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0432/0x200000403:0x31:0x0' lhsmtool_posix: 1779310743.124394 [35035]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1779310743.333184 [35064]: action=1 src=0x200000403:0x32:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5 mount_point=/mnt/lustre2 lhsmtool_posix: 1779310743.339403 [35064]: Resolving [0x200000403:0x32:0x0] to /tmp/arc1/sanity-hsm.test_12u//0431/0x200000403:0x32:0x0 lhsmtool_posix: 1779310743.340049 [35064]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5' from '/tmp/arc1/sanity-hsm.test_12u//0431/0x200000403:0x32:0x0' lhsmtool_posix: 1779310743.387225 [35064]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5' from '/tmp/arc1/sanity-hsm.test_12u//0452/0x200000402:0x50:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0431/0x200000403:0x32:0x0' lhsmtool_posix: 1779310743.387279 [35064]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1779310743.548633 [35093]: action=1 src=0x200000403:0x33:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6 mount_point=/mnt/lustre2 lhsmtool_posix: 1779310743.556515 [35093]: Resolving [0x200000403:0x33:0x0] to /tmp/arc1/sanity-hsm.test_12u//0430/0x200000403:0x33:0x0 lhsmtool_posix: 1779310743.556609 [35093]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6' from '/tmp/arc1/sanity-hsm.test_12u//0430/0x200000403:0x33:0x0' lhsmtool_posix: 1779310743.593786 [35093]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6' from '/tmp/arc1/sanity-hsm.test_12u//0453/0x200000402:0x51:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0430/0x200000403:0x33:0x0' lhsmtool_posix: 1779310743.593846 [35093]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1779310743.814955 [35122]: action=1 src=0x200000403:0x34:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7 mount_point=/mnt/lustre2 lhsmtool_posix: 1779310743.823145 [35122]: Resolving [0x200000403:0x34:0x0] to /tmp/arc1/sanity-hsm.test_12u//0437/0x200000403:0x34:0x0 lhsmtool_posix: 1779310743.823236 [35122]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7' from '/tmp/arc1/sanity-hsm.test_12u//0437/0x200000403:0x34:0x0' lhsmtool_posix: 1779310743.859762 [35122]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7' from '/tmp/arc1/sanity-hsm.test_12u//0450/0x200000402:0x52:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0437/0x200000403:0x34:0x0' lhsmtool_posix: 1779310743.859834 [35122]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1779310744.078075 [35151]: action=1 src=0x200000403:0x35:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8 mount_point=/mnt/lustre2 lhsmtool_posix: 1779310744.083475 [35151]: Resolving [0x200000403:0x35:0x0] to /tmp/arc1/sanity-hsm.test_12u//0436/0x200000403:0x35:0x0 lhsmtool_posix: 1779310744.083603 [35151]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8' from '/tmp/arc1/sanity-hsm.test_12u//0436/0x200000403:0x35:0x0' lhsmtool_posix: 1779310744.126468 [35151]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8' from '/tmp/arc1/sanity-hsm.test_12u//0451/0x200000402:0x53:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0436/0x200000403:0x35:0x0' lhsmtool_posix: 1779310744.126546 [35151]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1779310744.326663 [35180]: action=1 src=0x200000403:0x36:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9 mount_point=/mnt/lustre2 lhsmtool_posix: 1779310744.333659 [35180]: Resolving [0x200000403:0x36:0x0] to /tmp/arc1/sanity-hsm.test_12u//0435/0x200000403:0x36:0x0 lhsmtool_posix: 1779310744.333750 [35180]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9' from '/tmp/arc1/sanity-hsm.test_12u//0435/0x200000403:0x36:0x0' lhsmtool_posix: 1779310744.367148 [35180]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9' from '/tmp/arc1/sanity-hsm.test_12u//0456/0x200000402:0x54:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0435/0x200000403:0x36:0x0' lhsmtool_posix: 1779310744.367206 [35180]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 12u (19s) == sanity-hsm test 13: Recursively import and restore a directory ========================================================== 16:59:10 (1779310750) lhsmtool_posix: 1779310757.486455 [36936]: action=1 src=subdir dst=/mnt/lustre/d13.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779310757.627143 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.10' lhsmtool_posix: 1779310757.761633 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.10' from '/tmp/arc1/sanity-hsm.test_13//0409/0x240000402:0xb:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.10' lhsmtool_posix: 1779310757.763184 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.9' lhsmtool_posix: 1779310757.804272 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.9' from '/tmp/arc1/sanity-hsm.test_13//040e/0x240000402:0xc:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.9' lhsmtool_posix: 1779310757.804800 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.8' lhsmtool_posix: 1779310757.864743 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.8' from '/tmp/arc1/sanity-hsm.test_13//040f/0x240000402:0xd:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.8' lhsmtool_posix: 1779310757.865920 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.7' lhsmtool_posix: 1779310757.923094 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.7' from '/tmp/arc1/sanity-hsm.test_13//040c/0x240000402:0xe:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.7' lhsmtool_posix: 1779310757.923301 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.6' lhsmtool_posix: 1779310757.976532 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.6' from '/tmp/arc1/sanity-hsm.test_13//040d/0x240000402:0xf:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.6' lhsmtool_posix: 1779310757.983109 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.5' lhsmtool_posix: 1779310758.040746 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.5' from '/tmp/arc1/sanity-hsm.test_13//0412/0x240000402:0x10:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.5' lhsmtool_posix: 1779310758.044303 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.4' lhsmtool_posix: 1779310758.084488 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.4' from '/tmp/arc1/sanity-hsm.test_13//0413/0x240000402:0x11:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.4' lhsmtool_posix: 1779310758.084705 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.3' lhsmtool_posix: 1779310758.117269 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.3' from '/tmp/arc1/sanity-hsm.test_13//0410/0x240000402:0x12:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.3' lhsmtool_posix: 1779310758.119906 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.2' lhsmtool_posix: 1779310758.166350 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.2' from '/tmp/arc1/sanity-hsm.test_13//0411/0x240000402:0x13:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.2' lhsmtool_posix: 1779310758.166623 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.1' lhsmtool_posix: 1779310758.213606 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.1' from '/tmp/arc1/sanity-hsm.test_13//0416/0x240000402:0x14:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.1' lhsmtool_posix: 1779310758.231173 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.10' lhsmtool_posix: 1779310758.329244 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.10' from '/tmp/arc1/sanity-hsm.test_13//0414/0x240000402:0x16:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.10' lhsmtool_posix: 1779310758.329927 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.9' lhsmtool_posix: 1779310758.378452 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.9' from '/tmp/arc1/sanity-hsm.test_13//0415/0x240000402:0x17:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.9' lhsmtool_posix: 1779310758.378695 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.8' lhsmtool_posix: 1779310758.428960 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.8' from '/tmp/arc1/sanity-hsm.test_13//041a/0x240000402:0x18:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.8' lhsmtool_posix: 1779310758.429237 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.7' lhsmtool_posix: 1779310758.482743 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.7' from '/tmp/arc1/sanity-hsm.test_13//041b/0x240000402:0x19:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.7' lhsmtool_posix: 1779310758.483297 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.6' lhsmtool_posix: 1779310758.530848 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.6' from '/tmp/arc1/sanity-hsm.test_13//0418/0x240000402:0x1a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.6' lhsmtool_posix: 1779310758.531196 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.5' lhsmtool_posix: 1779310758.585270 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.5' from '/tmp/arc1/sanity-hsm.test_13//0419/0x240000402:0x1b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.5' lhsmtool_posix: 1779310758.585509 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.4' lhsmtool_posix: 1779310758.625234 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.4' from '/tmp/arc1/sanity-hsm.test_13//041e/0x240000402:0x1c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.4' lhsmtool_posix: 1779310758.626138 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.3' lhsmtool_posix: 1779310758.665528 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.3' from '/tmp/arc1/sanity-hsm.test_13//041f/0x240000402:0x1d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.3' lhsmtool_posix: 1779310758.666380 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.2' lhsmtool_posix: 1779310758.710207 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.2' from '/tmp/arc1/sanity-hsm.test_13//041c/0x240000402:0x1e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.2' lhsmtool_posix: 1779310758.710459 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.1' lhsmtool_posix: 1779310758.779796 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.1' from '/tmp/arc1/sanity-hsm.test_13//041d/0x240000402:0x1f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.1' lhsmtool_posix: 1779310758.816516 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.10' lhsmtool_posix: 1779310758.911596 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.10' from '/tmp/arc1/sanity-hsm.test_13//0423/0x240000402:0x21:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.10' lhsmtool_posix: 1779310758.911840 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.9' lhsmtool_posix: 1779310758.960289 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.9' from '/tmp/arc1/sanity-hsm.test_13//0420/0x240000402:0x22:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.9' lhsmtool_posix: 1779310758.960536 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.8' lhsmtool_posix: 1779310759.013279 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.8' from '/tmp/arc1/sanity-hsm.test_13//0421/0x240000402:0x23:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.8' lhsmtool_posix: 1779310759.019753 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.7' lhsmtool_posix: 1779310759.081221 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.7' from '/tmp/arc1/sanity-hsm.test_13//0426/0x240000402:0x24:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.7' lhsmtool_posix: 1779310759.081449 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.6' lhsmtool_posix: 1779310759.148943 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.6' from '/tmp/arc1/sanity-hsm.test_13//0427/0x240000402:0x25:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.6' lhsmtool_posix: 1779310759.149228 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.5' lhsmtool_posix: 1779310759.188162 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.5' from '/tmp/arc1/sanity-hsm.test_13//0424/0x240000402:0x26:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.5' lhsmtool_posix: 1779310759.188397 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.4' lhsmtool_posix: 1779310759.258410 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.4' from '/tmp/arc1/sanity-hsm.test_13//0425/0x240000402:0x27:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.4' lhsmtool_posix: 1779310759.259235 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.3' lhsmtool_posix: 1779310759.321982 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.3' from '/tmp/arc1/sanity-hsm.test_13//042a/0x240000402:0x28:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.3' lhsmtool_posix: 1779310759.322293 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.2' lhsmtool_posix: 1779310759.385239 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.2' from '/tmp/arc1/sanity-hsm.test_13//042b/0x240000402:0x29:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.2' lhsmtool_posix: 1779310759.386440 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.1' lhsmtool_posix: 1779310759.460296 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.1' from '/tmp/arc1/sanity-hsm.test_13//0428/0x240000402:0x2a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.1' lhsmtool_posix: 1779310759.487906 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.10' lhsmtool_posix: 1779310759.626362 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.10' from '/tmp/arc1/sanity-hsm.test_13//042e/0x240000402:0x2c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.10' lhsmtool_posix: 1779310759.629825 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.9' lhsmtool_posix: 1779310759.683644 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.9' from '/tmp/arc1/sanity-hsm.test_13//042f/0x240000402:0x2d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.9' lhsmtool_posix: 1779310759.683967 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.8' lhsmtool_posix: 1779310759.730332 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.8' from '/tmp/arc1/sanity-hsm.test_13//042c/0x240000402:0x2e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.8' lhsmtool_posix: 1779310759.731199 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.7' lhsmtool_posix: 1779310759.770493 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.7' from '/tmp/arc1/sanity-hsm.test_13//042d/0x240000402:0x2f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.7' lhsmtool_posix: 1779310759.770833 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.6' lhsmtool_posix: 1779310759.822298 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.6' from '/tmp/arc1/sanity-hsm.test_13//0432/0x240000402:0x30:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.6' lhsmtool_posix: 1779310759.822551 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.5' lhsmtool_posix: 1779310759.907010 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.5' from '/tmp/arc1/sanity-hsm.test_13//0433/0x240000402:0x31:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.5' lhsmtool_posix: 1779310759.907255 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.4' lhsmtool_posix: 1779310759.961015 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.4' from '/tmp/arc1/sanity-hsm.test_13//0430/0x240000402:0x32:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.4' lhsmtool_posix: 1779310759.961389 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.3' lhsmtool_posix: 1779310760.016492 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.3' from '/tmp/arc1/sanity-hsm.test_13//0431/0x240000402:0x33:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.3' lhsmtool_posix: 1779310760.016729 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.2' lhsmtool_posix: 1779310760.065988 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.2' from '/tmp/arc1/sanity-hsm.test_13//0436/0x240000402:0x34:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.2' lhsmtool_posix: 1779310760.066600 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.1' lhsmtool_posix: 1779310760.105191 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.1' from '/tmp/arc1/sanity-hsm.test_13//0437/0x240000402:0x35:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.1' lhsmtool_posix: 1779310760.116002 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.10' lhsmtool_posix: 1779310760.170297 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.10' from '/tmp/arc1/sanity-hsm.test_13//045a/0x200000402:0x58:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.10' lhsmtool_posix: 1779310760.170542 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.9' lhsmtool_posix: 1779310760.214141 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.9' from '/tmp/arc1/sanity-hsm.test_13//045b/0x200000402:0x59:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.9' lhsmtool_posix: 1779310760.214982 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.8' lhsmtool_posix: 1779310760.274547 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.8' from '/tmp/arc1/sanity-hsm.test_13//0458/0x200000402:0x5a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.8' lhsmtool_posix: 1779310760.274809 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.7' lhsmtool_posix: 1779310760.352405 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.7' from '/tmp/arc1/sanity-hsm.test_13//0459/0x200000402:0x5b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.7' lhsmtool_posix: 1779310760.352680 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.6' lhsmtool_posix: 1779310760.429055 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.6' from '/tmp/arc1/sanity-hsm.test_13//045e/0x200000402:0x5c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.6' lhsmtool_posix: 1779310760.429435 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.5' lhsmtool_posix: 1779310760.483307 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.5' from '/tmp/arc1/sanity-hsm.test_13//045f/0x200000402:0x5d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.5' lhsmtool_posix: 1779310760.484529 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.4' lhsmtool_posix: 1779310760.525602 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.4' from '/tmp/arc1/sanity-hsm.test_13//045c/0x200000402:0x5e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.4' lhsmtool_posix: 1779310760.526515 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.3' lhsmtool_posix: 1779310760.569162 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.3' from '/tmp/arc1/sanity-hsm.test_13//045d/0x200000402:0x5f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.3' lhsmtool_posix: 1779310760.569790 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.2' lhsmtool_posix: 1779310760.613136 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.2' from '/tmp/arc1/sanity-hsm.test_13//0462/0x200000402:0x60:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.2' lhsmtool_posix: 1779310760.613385 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.1' lhsmtool_posix: 1779310760.679771 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.1' from '/tmp/arc1/sanity-hsm.test_13//0463/0x200000402:0x61:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.1' lhsmtool_posix: 1779310760.697293 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.10' lhsmtool_posix: 1779310760.832134 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.10' from '/tmp/arc1/sanity-hsm.test_13//0435/0x240000402:0x37:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.10' lhsmtool_posix: 1779310760.833291 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.9' lhsmtool_posix: 1779310760.871535 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.9' from '/tmp/arc1/sanity-hsm.test_13//043a/0x240000402:0x38:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.9' lhsmtool_posix: 1779310760.871785 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.8' lhsmtool_posix: 1779310760.912015 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.8' from '/tmp/arc1/sanity-hsm.test_13//043b/0x240000402:0x39:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.8' lhsmtool_posix: 1779310760.912958 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.7' lhsmtool_posix: 1779310760.976046 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.7' from '/tmp/arc1/sanity-hsm.test_13//0438/0x240000402:0x3a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.7' lhsmtool_posix: 1779310760.976295 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.6' lhsmtool_posix: 1779310761.032538 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.6' from '/tmp/arc1/sanity-hsm.test_13//0439/0x240000402:0x3b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.6' lhsmtool_posix: 1779310761.032810 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.5' lhsmtool_posix: 1779310761.076170 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.5' from '/tmp/arc1/sanity-hsm.test_13//043e/0x240000402:0x3c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.5' lhsmtool_posix: 1779310761.076712 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.4' lhsmtool_posix: 1779310761.119706 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.4' from '/tmp/arc1/sanity-hsm.test_13//043f/0x240000402:0x3d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.4' lhsmtool_posix: 1779310761.120464 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.3' lhsmtool_posix: 1779310761.160116 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.3' from '/tmp/arc1/sanity-hsm.test_13//043c/0x240000402:0x3e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.3' lhsmtool_posix: 1779310761.160572 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.2' lhsmtool_posix: 1779310761.193812 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.2' from '/tmp/arc1/sanity-hsm.test_13//043d/0x240000402:0x3f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.2' lhsmtool_posix: 1779310761.194188 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.1' lhsmtool_posix: 1779310761.237264 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.1' from '/tmp/arc1/sanity-hsm.test_13//0442/0x240000402:0x40:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.1' lhsmtool_posix: 1779310761.244060 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.10' lhsmtool_posix: 1779310761.296294 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.10' from '/tmp/arc1/sanity-hsm.test_13//0461/0x200000402:0x63:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.10' lhsmtool_posix: 1779310761.297369 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.9' lhsmtool_posix: 1779310761.364440 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.9' from '/tmp/arc1/sanity-hsm.test_13//0466/0x200000402:0x64:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.9' lhsmtool_posix: 1779310761.366263 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.8' lhsmtool_posix: 1779310761.414682 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.8' from '/tmp/arc1/sanity-hsm.test_13//0467/0x200000402:0x65:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.8' lhsmtool_posix: 1779310761.415313 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.7' lhsmtool_posix: 1779310761.465650 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.7' from '/tmp/arc1/sanity-hsm.test_13//0464/0x200000402:0x66:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.7' lhsmtool_posix: 1779310761.469808 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.6' lhsmtool_posix: 1779310761.516584 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.6' from '/tmp/arc1/sanity-hsm.test_13//0465/0x200000402:0x67:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.6' lhsmtool_posix: 1779310761.517574 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.5' lhsmtool_posix: 1779310761.592557 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.5' from '/tmp/arc1/sanity-hsm.test_13//046a/0x200000402:0x68:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.5' lhsmtool_posix: 1779310761.596653 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.4' lhsmtool_posix: 1779310761.695207 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.4' from '/tmp/arc1/sanity-hsm.test_13//046b/0x200000402:0x69:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.4' lhsmtool_posix: 1779310761.695687 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.3' lhsmtool_posix: 1779310761.742664 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.3' from '/tmp/arc1/sanity-hsm.test_13//0468/0x200000402:0x6a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.3' lhsmtool_posix: 1779310761.743154 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.2' lhsmtool_posix: 1779310761.798574 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.2' from '/tmp/arc1/sanity-hsm.test_13//0469/0x200000402:0x6b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.2' lhsmtool_posix: 1779310761.798809 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.1' lhsmtool_posix: 1779310761.861373 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.1' from '/tmp/arc1/sanity-hsm.test_13//046e/0x200000402:0x6c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.1' lhsmtool_posix: 1779310761.885405 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.10' lhsmtool_posix: 1779310761.972290 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.10' from '/tmp/arc1/sanity-hsm.test_13//0440/0x240000402:0x42:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.10' lhsmtool_posix: 1779310761.972551 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.9' lhsmtool_posix: 1779310762.032117 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.9' from '/tmp/arc1/sanity-hsm.test_13//0441/0x240000402:0x43:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.9' lhsmtool_posix: 1779310762.033137 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.8' lhsmtool_posix: 1779310762.091324 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.8' from '/tmp/arc1/sanity-hsm.test_13//0446/0x240000402:0x44:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.8' lhsmtool_posix: 1779310762.092137 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.7' lhsmtool_posix: 1779310762.136708 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.7' from '/tmp/arc1/sanity-hsm.test_13//0447/0x240000402:0x45:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.7' lhsmtool_posix: 1779310762.137545 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.6' lhsmtool_posix: 1779310762.170777 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.6' from '/tmp/arc1/sanity-hsm.test_13//0444/0x240000402:0x46:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.6' lhsmtool_posix: 1779310762.171099 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.5' lhsmtool_posix: 1779310762.223014 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.5' from '/tmp/arc1/sanity-hsm.test_13//0445/0x240000402:0x47:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.5' lhsmtool_posix: 1779310762.227096 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.4' lhsmtool_posix: 1779310762.305119 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.4' from '/tmp/arc1/sanity-hsm.test_13//044a/0x240000402:0x48:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.4' lhsmtool_posix: 1779310762.305749 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.3' lhsmtool_posix: 1779310762.362358 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.3' from '/tmp/arc1/sanity-hsm.test_13//044b/0x240000402:0x49:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.3' lhsmtool_posix: 1779310762.362598 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.2' lhsmtool_posix: 1779310762.409220 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.2' from '/tmp/arc1/sanity-hsm.test_13//0448/0x240000402:0x4a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.2' lhsmtool_posix: 1779310762.409459 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.1' lhsmtool_posix: 1779310762.443193 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.1' from '/tmp/arc1/sanity-hsm.test_13//0449/0x240000402:0x4b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.1' lhsmtool_posix: 1779310762.449496 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.10' lhsmtool_posix: 1779310762.505105 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.10' from '/tmp/arc1/sanity-hsm.test_13//046c/0x200000402:0x6e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.10' lhsmtool_posix: 1779310762.505363 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.9' lhsmtool_posix: 1779310762.547144 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.9' from '/tmp/arc1/sanity-hsm.test_13//046d/0x200000402:0x6f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.9' lhsmtool_posix: 1779310762.547709 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.8' lhsmtool_posix: 1779310762.599824 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.8' from '/tmp/arc1/sanity-hsm.test_13//0472/0x200000402:0x70:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.8' lhsmtool_posix: 1779310762.600149 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.7' lhsmtool_posix: 1779310762.657798 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.7' from '/tmp/arc1/sanity-hsm.test_13//0473/0x200000402:0x71:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.7' lhsmtool_posix: 1779310762.659322 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.6' lhsmtool_posix: 1779310762.711684 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.6' from '/tmp/arc1/sanity-hsm.test_13//0470/0x200000402:0x72:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.6' lhsmtool_posix: 1779310762.712854 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.5' lhsmtool_posix: 1779310762.759787 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.5' from '/tmp/arc1/sanity-hsm.test_13//0471/0x200000402:0x73:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.5' lhsmtool_posix: 1779310762.760175 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.4' lhsmtool_posix: 1779310762.820841 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.4' from '/tmp/arc1/sanity-hsm.test_13//0476/0x200000402:0x74:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.4' lhsmtool_posix: 1779310762.822689 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.3' lhsmtool_posix: 1779310762.882253 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.3' from '/tmp/arc1/sanity-hsm.test_13//0477/0x200000402:0x75:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.3' lhsmtool_posix: 1779310762.882452 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.2' lhsmtool_posix: 1779310762.940472 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.2' from '/tmp/arc1/sanity-hsm.test_13//0474/0x200000402:0x76:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.2' lhsmtool_posix: 1779310762.941103 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.1' lhsmtool_posix: 1779310762.999497 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.1' from '/tmp/arc1/sanity-hsm.test_13//0475/0x200000402:0x77:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.1' lhsmtool_posix: 1779310763.005677 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.10' lhsmtool_posix: 1779310763.077247 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.10' from '/tmp/arc1/sanity-hsm.test_13//047b/0x200000402:0x79:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.10' lhsmtool_posix: 1779310763.077622 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.9' lhsmtool_posix: 1779310763.139218 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.9' from '/tmp/arc1/sanity-hsm.test_13//0478/0x200000402:0x7a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.9' lhsmtool_posix: 1779310763.139509 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.8' lhsmtool_posix: 1779310763.202407 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.8' from '/tmp/arc1/sanity-hsm.test_13//0479/0x200000402:0x7b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.8' lhsmtool_posix: 1779310763.202659 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.7' lhsmtool_posix: 1779310763.246718 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.7' from '/tmp/arc1/sanity-hsm.test_13//047e/0x200000402:0x7c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.7' lhsmtool_posix: 1779310763.247089 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.6' lhsmtool_posix: 1779310763.304767 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.6' from '/tmp/arc1/sanity-hsm.test_13//047f/0x200000402:0x7d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.6' lhsmtool_posix: 1779310763.306299 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.5' lhsmtool_posix: 1779310763.354618 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.5' from '/tmp/arc1/sanity-hsm.test_13//047c/0x200000402:0x7e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.5' lhsmtool_posix: 1779310763.355220 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.4' lhsmtool_posix: 1779310763.395802 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.4' from '/tmp/arc1/sanity-hsm.test_13//047d/0x200000402:0x7f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.4' lhsmtool_posix: 1779310763.396801 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.3' lhsmtool_posix: 1779310763.461158 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.3' from '/tmp/arc1/sanity-hsm.test_13//0482/0x200000402:0x80:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.3' lhsmtool_posix: 1779310763.461424 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.2' lhsmtool_posix: 1779310763.516352 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.2' from '/tmp/arc1/sanity-hsm.test_13//0483/0x200000402:0x81:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.2' lhsmtool_posix: 1779310763.517432 [36936]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.1' lhsmtool_posix: 1779310763.562844 [36936]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.1' from '/tmp/arc1/sanity-hsm.test_13//0480/0x200000402:0x82:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.1' lhsmtool_posix: 1779310763.563313 [36936]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_13/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 13 (28s) == sanity-hsm test 14: Rebind archived file to a new fid ========================================================== 16:59:38 (1779310778) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_14/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113078 s, 9.3 MB/s Waiting 200s for 'SUCCEED' 0+0 records in 0+0 records out 0 bytes copied, 0.00672051 s, 0.0 kB/s rebind 0x200000403:0x69:0x0 to 0x200000403:0x6a:0x0 lhsmtool_posix: 1779310782.659424 [37897]: action=2 src=0x200000403:0x69:0x0 dst=0x200000403:0x6a:0x0 mount_point=/mnt/lustre2 lhsmtool_posix: 1779310782.661296 [37897]: rebind [0x200000403:0x69:0x0] to [0x200000403:0x6a:0x0] lhsmtool_posix: 1779310782.663749 [37897]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 14 (8s) == sanity-hsm test 15: Rebind a list of files ============ 16:59:46 (1779310786) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_15/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.121363 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151379 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119671 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122586 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128674 s, 8.1 MB/s Waiting 300s for '' pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 0+0 records in 0+0 records out 0 bytes copied, 0.00386528 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00483221 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00394649 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00356553 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00599696 s, 0.0 kB/s rebind list of files lhsmtool_posix: 1779310792.541377 [38691]: action=2 src=/tmp/tmp.8368 dst=(null) mount_point=/mnt/lustre2 lhsmtool_posix: 1779310792.542531 [38691]: rebind [0x200000403:0x6c:0x0] to [0x200000403:0x71:0x0] lhsmtool_posix: 1779310792.542667 [38691]: rebind [0x200000403:0x6d:0x0] to [0x200000403:0x72:0x0] lhsmtool_posix: 1779310792.542716 [38691]: rebind [0x200000403:0x6e:0x0] to [0x200000403:0x73:0x0] lhsmtool_posix: 1779310792.542774 [38691]: rebind [0x200000403:0x6f:0x0] to [0x200000403:0x74:0x0] lhsmtool_posix: 1779310792.542958 [38691]: rebind [0x200000403:0x70:0x0] to [0x200000403:0x75:0x0] lhsmtool_posix: 1779310792.543036 [38691]: 5 lines read from '/tmp/tmp.8368', 5 rebind successful lhsmtool_posix: 1779310792.543054 [38691]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 15 (16s) == sanity-hsm test 16: Test CT bandwith control option === 17:00:02 (1779310802) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_16/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 20+0 records in 20+0 records out 20971520 bytes (21 MB, 20 MiB) copied, 0.0489287 s, 429 MB/s Waiting 200s for 'SUCCEED' Changed after 1s: from 'WAITING' to 'STARTED' Waiting 190s for 'SUCCEED' Updated after 21s: want 'SUCCEED' got 'SUCCEED' PASS 16 (27s) == sanity-hsm test 20: Release is not permitted ========== 17:00:29 (1779310829) 0+0 records in 0+0 records out 0 bytes copied, 0.00719957 s, 0.0 kB/s 0x200000403:0x7d:0x0 Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted PASS 20 (5s) == sanity-hsm test 21: Simple release tests ============== 17:00:34 (1779310834) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_21/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157347 s, 6.7 MB/s 1+0 records in 1+0 records out 512 bytes copied, 0.0722424 s, 7.1 kB/s Waiting 200s for 'SUCCEED' Waiting 200s for 'SUCCEED' PASS 21 (9s) == sanity-hsm test 22: Could not swap a release file ===== 17:00:43 (1779310843) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_22/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.142424 s, 7.4 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119757 s, 8.8 MB/s 0x200000403:0x80:0x0 lfs swap_layouts: error: cannot swap layout between '/mnt/lustre/d22.sanity-hsm/test_swap' and '/mnt/lustre/d22.sanity-hsm/test_release': Operation not supported (95) PASS 22 (8s) == sanity-hsm test 23: Release does not change a/mtime (utime) ========================================================== 17:00:51 (1779310851) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_23/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.202904 s, 5.2 MB/s PASS 23 (5s) == sanity-hsm test 24a: Archive, release, and restore does not change a/mtime (i/o) ========================================================== 17:00:57 (1779310857) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.127289 s, 8.2 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Killing existing copytools on oleg431-client.virtnet with signal TERM copytools stopped in 1s 192.168.204.131@tcp:/lustre /mnt/lustre lustre rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg431-client.virtnet /mnt/lustre (opts:) Starting client: oleg431-client.virtnet: -o user_xattr,flock 192.168.204.131@tcp:/lustre /mnt/lustre PASS 24a (10s) == sanity-hsm test 24b: root can archive, release, and restore user files ========================================================== 17:01:07 (1779310867) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143195 s, 7.3 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm] /mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm: (0x00000009) exists archived, archive_id:1 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [md5sum] [/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm] PASS 24b (10s) == sanity-hsm test 24c: check that user,group,other request masks work ========================================================== 17:01:17 (1779310877) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154084 s, 6.8 MB/s 0x200000403:0x88:0x0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.174959 s, 6.0 MB/s 0x200000403:0x89:0x0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133811 s, 7.8 MB/s 0x200000403:0x8a:0x0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] PASS 24c (15s) == sanity-hsm test 24d: check that read-only mounts are respected ========================================================== 17:01:32 (1779310892) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.166798 s, 6.3 MB/s 0x200000403:0x8b:0x0 /mnt/lustre/d24d.sanity-hsm/f24d.sanity-hsm lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 75 0x4b 0x280000401 Starting client: oleg431-client.virtnet: -o user_xattr,flock 192.168.204.131@tcp:/lustre /mnt/lustre3 Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre3"' Cannot send HSM request (use of /mnt/lustre2/d24d.sanity-hsm/f24d.sanity-hsm): Read-only file system Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.930614 s, 1.1 MB/s Cannot send HSM request (use of /mnt/lustre2/d24d.sanity-hsm/f24d.sanity-hsm): Read-only file system Stopping client oleg431-client.virtnet /mnt/lustre3 (opts:) PASS 24d (13s) == sanity-hsm test 24e: tar succeeds on HSM released files ========================================================== 17:01:46 (1779310906) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.172218 s, 6.1 MB/s /mnt/lustre/d24e.sanity-hsm/f24e.sanity-hsm: (0x0000000d) released exists archived, archive_id:1 tar: Removing leading `/' from member names PASS 24e (6s) == sanity-hsm test 24f: root can archive, release, and restore tar files ========================================================== 17:01:52 (1779310912) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 54fb6627dbaa37721048e4549db3224d /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm Waiting 200s for 'SUCCEED' f24f.sanity-hsm f24f.sanity-hsm Sum0 = 54fb6627dbaa37721048e4549db3224d /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm, sum1 = 54fb6627dbaa37721048e4549db3224d /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm PASS 24f (8s) == sanity-hsm test 24g: write by non-owner still sets dirty ========================================================== 17:02:00 (1779310920) RUNAS = 'runas -u 500 -g 500' Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24g/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Please listen carefully as our options have changed. Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' running as uid/gid/euid/egid 500/500/500/500, groups: 500 [tee] [/mnt/lustre/d24g.sanity-hsm/f24g.sanity-hsm] To be electrocuted by your telephone, press #. PASS 24g (7s) == sanity-hsm test 25a: Restore lost file (HS_LOST flag) from import ========================================================== 17:02:07 (1779310927) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_25a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1779310928.683451 [47776]: action=1 src=d25a.sanity-hsm/f25a.sanity-hsm dst=/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779310928.691459 [47776]: importing '/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_25a//d25a.sanity-hsm/f25a.sanity-hsm' lhsmtool_posix: 1779310928.733848 [47776]: imported '/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_25a//0410/0x200000405:0x15:0x0'=='/tmp/arc1/sanity-hsm.test_25a//d25a.sanity-hsm/f25a.sanity-hsm' lhsmtool_posix: 1779310928.733997 [47776]: process finished, errs: 0 major, 0 minor, rc=0 (Success) md5sum: /mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm: No data available PASS 25a (5s) == sanity-hsm test 25b: Restore lost file (HS_LOST flag) after release ========================================================== 17:02:12 (1779310932) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_25b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' md5sum: /mnt/lustre/d25b.sanity-hsm/f25b.sanity-hsm: No data available PASS 25b (5s) == sanity-hsm test 26A: Remove the archive of a valid file ========================================================== 17:02:17 (1779310937) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.00588167 s, 0.0 kB/s Waiting 200s for 'SUCCEED' PASS 26A (7s) == sanity-hsm test 26a: Remove Archive On Last Unlink (RAoLU) policy ========================================================== 17:02:24 (1779310944) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 5s: want 'SUCCEED' got 'SUCCEED' PASS 26a (24s) == sanity-hsm test 26b: RAoLU policy when CDT off ======== 17:02:49 (1779310969) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled Killing existing copytools on oleg431-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 26b (18s) == sanity-hsm test 26c: RAoLU effective when file closed ========================================================== 17:03:07 (1779310987) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' multiop /mnt/lustre/d26c.sanity-hsm/f26c.sanity-hsm vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.8368 Waiting 200s for 'SUCCEED' Updated after 5s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 8s: want 'SUCCEED' got 'SUCCEED' PASS 26c (30s) == sanity-hsm test 26d: RAoLU when Client eviction ======= 17:03:37 (1779311017) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152871 s, 6.9 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' multiop /mnt/lustre/d26d.sanity-hsm/f26d.sanity-hsm vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.8368 Waiting 200s for 'SUCCEED' Updated after 3s: want 'SUCCEED' got 'SUCCEED' PASS 26d (21s) == sanity-hsm test 26e: RAoLU with a non-started coordinator ========================================================== 17:03:58 (1779311038) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.194005 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.162988 s, 6.4 MB/s Killing existing copytools on oleg431-client.virtnet with signal TERM copytools stopped in 0s Failing mds1 on oleg431-server Stopping /mnt/lustre-mds1 (opts:) on oleg431-server 17:04:27 (1779311067) shut down facet: mds1 facet_host: oleg431-server facet_failover_host: oleg431-server Failover mds1 to oleg431-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg431-server: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 Started lustre-MDT0000 17:04:43 (1779311083) targets are mounted 17:04:43 (1779311083) facet_failover done oleg431-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Check cookie from RAoLU request (last: 1779310541, remove: 1779310542) mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' PASS 26e (83s) == sanity-hsm test 27a: Remove the archive of an imported file (Operation not permitted) ========================================================== 17:05:21 (1779311121) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_27a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB, 39 MiB) copied, 0.569784 s, 71.8 MB/s lhsmtool_posix: 1779311123.613908 [54873]: action=1 src=d27a.sanity-hsm/f27a.sanity-hsm dst=/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779311123.618122 [54873]: importing '/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_27a//d27a.sanity-hsm/f27a.sanity-hsm' lhsmtool_posix: 1779311123.750748 [54873]: imported '/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_27a//0406/0x240000404:0x2:0x0'=='/tmp/arc1/sanity-hsm.test_27a//d27a.sanity-hsm/f27a.sanity-hsm' lhsmtool_posix: 1779311123.751277 [54873]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Cannot send HSM request (use of /mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm): Operation not permitted PASS 27a (5s) == sanity-hsm test 27b: Remove the archive of a relased file (Operation not permitted) ========================================================== 17:05:26 (1779311126) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_27b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.00308403 s, 0.0 kB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Cannot send HSM request (use of /mnt/lustre/d27b.sanity-hsm/f27b.sanity-hsm): Operation not permitted PASS 27b (6s) == sanity-hsm test 28: Concurrent archive/file remove ==== 17:05:32 (1779311132) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_28/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.00351456 s, 0.0 kB/s Waiting 200s for 'SUCCEED' mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled PASS 28 (9s) == sanity-hsm test 29a: Tests --mntpath and --archive options ========================================================== 17:05:41 (1779311141) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 7 "/mnt/lustre"' Cannot send HSM request (use of /mnt/lustre): Invalid argument hsm: '/qwerty/uyt' is not a valid FID PASS 29a (4s) == sanity-hsm test 29b: Archive/delete/remove by FID from the archive. ========================================================== 17:05:45 (1779311145) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12492 s, 8.4 MB/s Waiting 200s for 'SUCCEED' Waiting 200s for 'SUCCEED' PASS 29b (9s) == sanity-hsm test 29c: Archive/delete/remove by FID, using a file list. ========================================================== 17:05:54 (1779311154) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124177 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151706 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.10321 s, 10.2 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 29c (10s) == sanity-hsm test 29d: hsm_remove by FID with archive_id 0 for unlinked file cause ========================================================== 17:06:04 (1779311164) SKIP: sanity-hsm test_29d Need 3 or more clients, have 1 SKIP 29d (2s) == sanity-hsm test 30a: Restore at exec (import case) ==== 17:06:06 (1779311166) SKIP: sanity-hsm test_30a Need 2 or more clients, have 1 SKIP 30a (2s) == sanity-hsm test 30b: Restore at exec (release case) === 17:06:08 (1779311168) SKIP: sanity-hsm test_30b Need 2 or more clients, have 1 SKIP 30b (2s) == sanity-hsm test 30c: Update during exec of released file must fail ========================================================== 17:06:11 (1779311171) SKIP: sanity-hsm test_30c Need 2 or more clients, have 1 SKIP 30c (2s) == sanity-hsm test 31a: Import a large file and check size during restore ========================================================== 17:06:13 (1779311173) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB, 39 MiB) copied, 0.566273 s, 72.2 MB/s lhsmtool_posix: 1779311175.230831 [60061]: action=1 src=d31a.sanity-hsm/f31a.sanity-hsm dst=/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779311175.239252 [60061]: importing '/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_31a//d31a.sanity-hsm/f31a.sanity-hsm' lhsmtool_posix: 1779311175.280384 [60061]: imported '/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_31a//040d/0x200000407:0xa:0x0'=='/tmp/arc1/sanity-hsm.test_31a//d31a.sanity-hsm/f31a.sanity-hsm' lhsmtool_posix: 1779311175.280442 [60061]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' size seen is right: 40894464 == 40894464 done PASS 31a (15s) == sanity-hsm test 31b: Restore a large unaligned file and check size during restore ========================================================== 17:06:29 (1779311189) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 39000000 bytes (39 MB, 37 MiB) copied, 0.483091 s, 80.7 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' size seen is right: 39000000 == 39000000 done PASS 31b (17s) == sanity-hsm test 31c: Restore a large aligned file and check size during restore ========================================================== 17:06:46 (1779311206) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB, 39 MiB) copied, 0.520785 s, 78.5 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' size seen is right: 40894464 == 40894464 done PASS 31c (17s) == sanity-hsm test 33: Kill a restore waiting process ==== 17:07:03 (1779311223) 0+0 records in 0+0 records out 0 bytes copied, 0.00345732 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_33/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Copytool is suspended on oleg431-client.virtnet Copytool is continued on oleg431-client.virtnet /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2893: 62097 Terminated md5sum $f > /dev/null PASS 33 (7s) == sanity-hsm test 34: Remove file during restore ======== 17:07:10 (1779311230) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_34/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.0030914 s, 0.0 kB/s Waiting 200s for 'SUCCEED' Copytool is suspended on oleg431-client.virtnet Waiting 200s for 'STARTED' Copytool is continued on oleg431-client.virtnet /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2925: kill: (62766) - No such process PASS 34 (9s) == sanity-hsm test 35: Overwrite file during restore ===== 17:07:19 (1779311239) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_35/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.00401871 s, 0.0 kB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Copytool is suspended on oleg431-client.virtnet Waiting 200s for 'STARTED' Updated after 2s: want 'STARTED' got 'STARTED' Copytool is continued on oleg431-client.virtnet /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2962: kill: (63458) - No such process PASS 35 (8s) == sanity-hsm test 36: Move file during restore ========== 17:07:27 (1779311247) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_36/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.00346427 s, 0.0 kB/s Copytool is suspended on oleg431-client.virtnet Waiting 200s for 'STARTED' Copytool is continued on oleg431-client.virtnet /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2998: kill: (64140) - No such process PASS 36 (7s) == sanity-hsm test 37: re-archive a dirty file =========== 17:07:34 (1779311254) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_37/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.140611 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249346 s, 42.1 MB/s Waiting 200s for 'SUCCEED' Changed after 2s: from 'SUCCEED WAITING' to 'SUCCEED SUCCEED' Updated after 6s: want 'SUCCEED' got 'SUCCEED' PASS 37 (72s) == sanity-hsm test 40: Parallel archive requests ========= 17:08:46 (1779311326) oleg431-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=1152921504606846976: Cannot allocate memory oleg431-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='1152921504606846976': Cannot allocate memory pdsh@oleg431-client: oleg431-server: ssh exited with exit code 12 oleg431-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/max_requests=1152921504606846976: Cannot allocate memory oleg431-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/max_requests'='1152921504606846976': Cannot allocate memory pdsh@oleg431-client: oleg431-server: ssh exited with exit code 12 set max_requests=1152921504606846976 failed with 12 [ 1219.310073] Lustre: lustre-MDT0000: No more memory to set HSM max_requests=1152921504606846976 (max request memory: 461MB, current total 6/975940): rc = -12 Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_40/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=purge mdt.lustre-MDT0001.hsm_control=purge Wait for all requests being enqueued...100 archive requests submitted 100 archive requests submitted 100 archive requests submitted 100 archive requests submitted OK pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 PASS 40 (105s) == sanity-hsm test 50: Archive with large number of pending HSM actions ========================================================== 17:10:31 (1779311431) oleg431-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=1000000: Cannot allocate memory oleg431-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='1000000': Cannot allocate memory pdsh@oleg431-client: oleg431-server: ssh exited with exit code 12 oleg431-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/max_requests=1000000: Cannot allocate memory oleg431-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/max_requests'='1000000': Cannot allocate memory pdsh@oleg431-client: oleg431-server: ssh exited with exit code 12 Filesystem Inodes IUsed IFree IUse% Mounted on 192.168.204.131@tcp:/lustre 236392 1320 235072 1% /mnt/lustre - create 1806 (time 1779311446.08 total 10.00 last 180.54) - create 3659 (time 1779311456.08 total 20.00 last 185.30) - create 5625 (time 1779311466.08 total 30.01 last 196.57) - create 7484 (time 1779311476.09 total 40.01 last 185.83) - create 9693 (time 1779311486.09 total 50.01 last 220.88) total: 10000 create in 51.52 seconds: 194.11 ops/second 0 - unlinked 0 (time 1779311542 ; total 0 ; last 0) total: 10000 unlinks in 44 seconds: 227.272720 unlinks/second Start Phase files_num: 10000 time: 52 - create 2430 (time 1779311598.23 total 10.00 last 242.95) - create 4459 (time 1779311608.24 total 20.00 last 202.87) - create 6556 (time 1779311618.24 total 30.01 last 209.65) - create 9028 (time 1779311628.24 total 40.01 last 247.18) - create 10000 (time 1779311631.26 total 43.03 last 321.99) - create 13078 (time 1779311641.26 total 53.03 last 307.72) - create 15264 (time 1779311651.26 total 63.03 last 218.51) - create 15880 (time 1779311661.29 total 73.05 last 61.47) - create 16598 (time 1779311671.29 total 83.05 last 71.79) - create 17446 (time 1779311681.29 total 93.06 last 84.75) - create 18297 (time 1779311691.32 total 103.09 last 84.87) - create 18982 (time 1779311701.33 total 113.09 last 68.47) total: 20000 create in 123.08 seconds: 162.49 ops/second - unlinked 0 (time 1779311893 ; total 0 ; last 0) - unlinked 10000 (time 1779311985 ; total 92 ; last 92) total: 20000 unlinks in 185 seconds: 108.108109 unlinks/second Middle Phase files_num: 20000 time: 178 - create 1253 (time 1779312092.44 total 10.00 last 125.25) - create 2396 (time 1779312102.45 total 20.02 last 114.17) - create 3545 (time 1779312112.45 total 30.02 last 114.86) - create 4736 (time 1779312122.46 total 40.03 last 119.02) - create 5977 (time 1779312132.46 total 50.03 last 124.10) - create 7073 (time 1779312142.46 total 60.03 last 109.58) - create 8142 (time 1779312152.47 total 70.04 last 106.82) - create 9263 (time 1779312162.47 total 80.04 last 112.06) total: 10000 create in 85.77 seconds: 116.60 ops/second 0 - unlinked 0 (time 1779312251 ; total 0 ; last 0) total: 10000 unlinks in 83 seconds: 120.481926 unlinks/second End Phase files_num: 10000 time: 79 0 mdt.lustre-MDT0000.hsm_control=purge mdt.lustre-MDT0001.hsm_control=purge PASS 50 (924s) == sanity-hsm test 52: Opened for write file on an evicted client should be set dirty ========================================================== 17:25:55 (1779312355) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_52/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.396951 s, 2.6 MB/s multiop /mnt/lustre/d52.sanity-hsm/f52.sanity-hsm vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.8368 pdsh@oleg431-client: oleg431-client: ssh exited with exit code 5 PASS 52 (18s) == sanity-hsm test 53: Opened for read file on an evicted client should not be set dirty ========================================================== 17:26:13 (1779312373) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_53/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.219668 s, 4.8 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' multiop /mnt/lustre/d53.sanity-hsm/f53.sanity-hsm vo_c TMPPIPE=/tmp/multiop_open_wait_pipe.8368 pdsh@oleg431-client: oleg431-client: ssh exited with exit code 5 PASS 53 (15s) == sanity-hsm test 54: Write during an archive cancels it ========================================================== 17:26:28 (1779312388) 39+0 records in 39+0 records out 39000000 bytes (39 MB, 37 MiB) copied, 1.13301 s, 34.4 MB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_54/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0001.hsm.policy=+NRA Waiting 200s for 'FAILED' Waiting 190s for 'FAILED' Waiting 180s for 'FAILED' Updated after 36s: want 'FAILED' got 'FAILED' mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0001.hsm.policy=-NRA PASS 54 (50s) == sanity-hsm test 55: Truncate during an archive cancels it ========================================================== 17:27:18 (1779312438) 39+0 records in 39+0 records out 39000000 bytes (39 MB, 37 MiB) copied, 1.09479 s, 35.6 MB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_55/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0001.hsm.policy=+NRA mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0001.hsm.policy=-NRA PASS 55 (14s) == sanity-hsm test 56: Setattr during an archive is ok === 17:27:32 (1779312452) 39+0 records in 39+0 records out 39000000 bytes (39 MB, 37 MiB) copied, 1.01424 s, 38.5 MB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_56/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Waiting 180s for 'SUCCEED' Waiting 170s for 'SUCCEED' Updated after 39s: want 'SUCCEED' got 'SUCCEED' PASS 56 (47s) == sanity-hsm test 57: Archive a file with dirty cache on another node ========================================================== 17:28:20 (1779312500) SKIP: sanity-hsm test_57 Need 2 or more clients, have 1 SKIP 57 (3s) == sanity-hsm test 58: Truncate a released file will trigger restore ========================================================== 17:28:22 (1779312502) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_58/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' truncate up from 1516 to 3032 /mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2 truncate down from 1516 to 758 Waiting 200s for 'SUCCEED' /mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2 truncate to 0 /mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2 PASS 58 (19s) == sanity-hsm test 59: Release stripeless file with non-zero size ========================================================== 17:28:41 (1779312521) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_59/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 59 (9s) == sanity-hsm test 60: Changing progress update interval from default ========================================================== 17:28:50 (1779312530) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.308799 s, 34.0 MB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_60/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 --update-interval 5 "/mnt/lustre2"' Waiting 100s for 'start copy' Expecting a progress update within 20 seconds... 5242880 bytes copied in 2 seconds. Wait for on going archive hsm action to complete Waiting 10s for 'copied' Updated after 4s: want 'copied' got 'copied' PASS 60 (22s) == sanity-hsm test 61: Waiting archive of a removed file should fail ========================================================== 17:29:12 (1779312552) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_61/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled PASS 61 (14s) == sanity-hsm test 70: Copytool logs JSON register/unregister events to FIFO ========================================================== 17:29:26 (1779312566) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_70/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --event-fifo /tmp/sanity-hsm.test_70.2jVx/fifo "/mnt/lustre2"' Killing existing copytools on oleg431-client.virtnet with signal TERM copytools stopped in 0s Register/Unregister events look OK. PASS 70 (9s) == sanity-hsm test 71: Copytool logs JSON archive events to FIFO ========================================================== 17:29:35 (1779312575) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_71/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --update-interval 5 --event-fifo /tmp/sanity-hsm.test_71.9SNb/fifo "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0001.hsm.policy=-NRA 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.177841 s, 5.9 MB/s Archive events look OK. mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0001.hsm.policy=-NRA PASS 71 (20s) == sanity-hsm test 72: Copytool logs JSON restore events to FIFO ========================================================== 17:29:55 (1779312595) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_72/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --update-interval 5 --event-fifo /tmp/sanity-hsm.test_72.NJWi/fifo "/mnt/lustre2"' 16+0 records in 16+0 records out 16000000 bytes (16 MB, 15 MiB) copied, 0.594774 s, 26.9 MB/s lhsmtool_posix: 1779312600.188430 [83015]: action=1 src=d72.sanity-hsm/f72.sanity-hsm dst=/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779312600.194386 [83015]: importing '/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_72//d72.sanity-hsm/f72.sanity-hsm' lhsmtool_posix: 1779312600.237327 [83015]: imported '/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_72//0bca/0x200000bd2:0x18:0x0'=='/tmp/arc1/sanity-hsm.test_72//d72.sanity-hsm/f72.sanity-hsm' lhsmtool_posix: 1779312600.237388 [83015]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Verifying released state: Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Restore events look OK. PASS 72 (17s) == sanity-hsm test 90: Archive/restore a file list ======= 17:30:12 (1779312612) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_90/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=purge mdt.lustre-MDT0001.hsm_control=purge Waiting 200s for '' pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 Waiting 200s for '' Changed after 1s: from 'lrh=[type=10680000 len=136 idx=2/100] fid=[0x200000403:0xc5:0x0] dfid=[0x200000403:0xc5:0x0] compound/cookie=0x0/0x6a0e2030 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=2/101] fid=[0x200000403:0xc6:0x0] dfid=[0x200000403:0xc6:0x0] compound/cookie=0x0/0x6a0e2031 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=2/102] fid=[0x200000403:0xc7:0x0] dfid=[0x200000403:0xc7:0x0] compound/cookie=0x0/0x6a0e2032 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=2/103] fid=[0x200000403:0xc8:0x0] dfid=[0x200000403:0xc8:0x0] compound/cookie=0x0/0x6a0e2033 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/104] fid=[0x200000403:0xc9:0x0] dfid=[0x200000403:0xc9:0x0] compound/cookie=0x0/0x6a0e2034 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/105] fid=[0x200000403:0xca:0x0] dfid=[0x200000403:0xca:0x0] compound/cookie=0x0/0x6a0e2035 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/106] fid=[0x200000403:0xcb:0x0] dfid=[0x200000403:0xcb:0x0] compound/cookie=0x0/0x6a0e2036 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/107] fid=[0x200000403:0xcc:0x0] dfid=[0x200000403:0xcc:0x0] compound/cookie=0x0/0x6a0e2037 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/108] fid=[0x200000403:0xcd:0x0] dfid=[0x200000403:0xcd:0x0] compound/cookie=0x0/0x6a0e2038 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/109] fid=[0x200000403:0xce:0x0] dfid=[0x200000403:0xce:0x0] compound/cookie=0x0/0x6a0e2039 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/110] fid=[0x200000403:0xcf:0x0] dfid=[0x200000403:0xcf:0x0] compound/cookie=0x0/0x6a0e203a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/111] fid=[0x200000403:0xd0:0x0] dfid=[0x200000403:0xd0:0x0] compound/cookie=0x0/0x6a0e203b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/112] fid=[0x200000403:0xd1:0x0] dfid=[0x200000403:0xd1:0x0] compound/cookie=0x0/0x6a0e203c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/113] fid=[0x200000403:0xd2:0x0] dfid=[0x200000403:0xd2:0x0] compound/cookie=0x0/0x6a0e203d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/114] fid=[0x200000403:0xd3:0x0] dfid=[0x200000403:0xd3:0x0] compound/cookie=0x0/0x6a0e203e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/115] fid=[0x200000403:0xd4:0x0] dfid=[0x200000403:0xd4:0x0] compound/cookie=0x0/0x6a0e203f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/116] fid=[0x200000403:0xd5:0x0] dfid=[0x200000403:0xd5:0x0] compound/cookie=0x0/0x6a0e2040 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/117] fid=[0x200000403:0xd6:0x0] dfid=[0x200000403:0xd6:0x0] compound/cookie=0x0/0x6a0e2041 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/118] fid=[0x200000403:0xd7:0x0] dfid=[0x200000403:0xd7:0x0] compound/cookie=0x0/0x6a0e2042 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/119] fid=[0x200000403:0xd8:0x0] dfid=[0x200000403:0xd8:0x0] compound/cookie=0x0/0x6a0e2043 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/120] fid=[0x200000403:0xd9:0x0] dfid=[0x200000403:0xd9:0x0] compound/cookie=0x0/0x6a0e2044 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/121] fid=[0x200000403:0xda:0x0] dfid=[0x200000403:0xda:0x0] compound/cookie=0x0/0x6a0e2045 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/123] fid=[0x200000403:0xdb:0x0] dfid=[0x200000403:0xdb:0x0] compound/cookie=0x0/0x6a0e2046 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/124] fid=[0x200000403:0xdc:0x0] dfid=[0x200000403:0xdc:0x0] compound/cookie=0x0/0x6a0e2047 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/125] fid=[0x200000403:0xdd:0x0] dfid=[0x200000403:0xdd:0x0] compound/cookie=0x0/0x6a0e2048 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/126] fid=[0x200000403:0xde:0x0] dfid=[0x200000403:0xde:0x0] compound/cookie=0x0/0x6a0e2049 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/127] fid=[0x200000403:0xdf:0x0] dfid=[0x200000403:0xdf:0x0] compound/cookie=0x0/0x6a0e204a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/128] fid=[0x200000403:0xe0:0x0] dfid=[0x200000403:0xe0:0x0] compound/cookie=0x0/0x6a0e204b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/129] fid=[0x200000403:0xe1:0x0] dfid=[0x200000403:0xe1:0x0] compound/cookie=0x0/0x6a0e204c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/130] fid=[0x200000403:0xe2:0x0] dfid=[0x200000403:0xe2:0x0] compound/cookie=0x0/0x6a0e204d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/131] fid=[0x200000403:0xe3:0x0] dfid=[0x200000403:0xe3:0x0] compound/cookie=0x0/0x6a0e204e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/132] fid=[0x200000403:0xe4:0x0] dfid=[0x200000403:0xe4:0x0] compound/cookie=0x0/0x6a0e204f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/133] fid=[0x200000403:0xe5:0x0] dfid=[0x200000403:0xe5:0x0] compound/cookie=0x0/0x6a0e2050 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/134] fid=[0x200000403:0xe6:0x0] dfid=[0x200000403:0xe6:0x0] compound/cookie=0x0/0x6a0e2051 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/135] fid=[0x200000403:0xe7:0x0] dfid=[0x200000403:0xe7:0x0] compound/cookie=0x0/0x6a0e2052 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/136] fid=[0x200000403:0xe8:0x0] dfid=[0x200000403:0xe8:0x0] compound/cookie=0x0/0x6a0e2053 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/137] fid=[0x200000403:0xe9:0x0] dfid=[0x200000403:0xe9:0x0] compound/cookie=0x0/0x6a0e2054 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/138] fid=[0x200000403:0xea:0x0] dfid=[0x200000403:0xea:0x0] compound/cookie=0x0/0x6a0e2055 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/139] fid=[0x200000403:0xeb:0x0] dfid=[0x200000403:0xeb:0x0] compound/cookie=0x0/0x6a0e2056 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/140] fid=[0x200000403:0xec:0x0] dfid=[0x200000403:0xec:0x0] compound/cookie=0x0/0x6a0e2057 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/141] fid=[0x200000403:0xed:0x0] dfid=[0x200000403:0xed:0x0] compound/cookie=0x0/0x6a0e2058 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/142] fid=[0x200000403:0xee:0x0] dfid=[0x200000403:0xee:0x0] compound/cookie=0x0/0x6a0e2059 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/143] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a0e205a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/144] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a0e205b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/145] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a0e205c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/146] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a0e205d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/147] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a0e205e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/148] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a0e205f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=2/112] fid=[0x200000403:0xd1:0x0] dfid=[0x200000403:0xd1:0x0] compound/cookie=0x0/0x6a0e203c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=2/113] fid=[0x200000403:0xd2:0x0] dfid=[0x200000403:0xd2:0x0] compound/cookie=0x0/0x6a0e203d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=2/114] fid=[0x200000403:0xd3:0x0] dfid=[0x200000403:0xd3:0x0] compound/cookie=0x0/0x6a0e203e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=2/115] fid=[0x200000403:0xd4:0x0] dfid=[0x200000403:0xd4:0x0] compound/cookie=0x0/0x6a0e203f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/116] fid=[0x200000403:0xd5:0x0] dfid=[0x200000403:0xd5:0x0] compound/cookie=0x0/0x6a0e2040 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/117] fid=[0x200000403:0xd6:0x0] dfid=[0x200000403:0xd6:0x0] compound/cookie=0x0/0x6a0e2041 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/118] fid=[0x200000403:0xd7:0x0] dfid=[0x200000403:0xd7:0x0] compound/cookie=0x0/0x6a0e2042 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/119] fid=[0x200000403:0xd8:0x0] dfid=[0x200000403:0xd8:0x0] compound/cookie=0x0/0x6a0e2043 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/120] fid=[0x200000403:0xd9:0x0] dfid=[0x200000403:0xd9:0x0] compound/cookie=0x0/0x6a0e2044 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/121] fid=[0x200000403:0xda:0x0] dfid=[0x200000403:0xda:0x0] compound/cookie=0x0/0x6a0e2045 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/123] fid=[0x200000403:0xdb:0x0] dfid=[0x200000403:0xdb:0x0] compound/cookie=0x0/0x6a0e2046 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/124] fid=[0x200000403:0xdc:0x0] dfid=[0x200000403:0xdc:0x0] compound/cookie=0x0/0x6a0e2047 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/125] fid=[0x200000403:0xdd:0x0] dfid=[0x200000403:0xdd:0x0] compound/cookie=0x0/0x6a0e2048 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/126] fid=[0x200000403:0xde:0x0] dfid=[0x200000403:0xde:0x0] compound/cookie=0x0/0x6a0e2049 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/127] fid=[0x200000403:0xdf:0x0] dfid=[0x200000403:0xdf:0x0] compound/cookie=0x0/0x6a0e204a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/128] fid=[0x200000403:0xe0:0x0] dfid=[0x200000403:0xe0:0x0] compound/cookie=0x0/0x6a0e204b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/129] fid=[0x200000403:0xe1:0x0] dfid=[0x200000403:0xe1:0x0] compound/cookie=0x0/0x6a0e204c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/130] fid=[0x200000403:0xe2:0x0] dfid=[0x200000403:0xe2:0x0] compound/cookie=0x0/0x6a0e204d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/131] fid=[0x200000403:0xe3:0x0] dfid=[0x200000403:0xe3:0x0] compound/cookie=0x0/0x6a0e204e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/132] fid=[0x200000403:0xe4:0x0] dfid=[0x200000403:0xe4:0x0] compound/cookie=0x0/0x6a0e204f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/133] fid=[0x200000403:0xe5:0x0] dfid=[0x200000403:0xe5:0x0] compound/cookie=0x0/0x6a0e2050 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/134] fid=[0x200000403:0xe6:0x0] dfid=[0x200000403:0xe6:0x0] compound/cookie=0x0/0x6a0e2051 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/135] fid=[0x200000403:0xe7:0x0] dfid=[0x200000403:0xe7:0x0] compound/cookie=0x0/0x6a0e2052 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/136] fid=[0x200000403:0xe8:0x0] dfid=[0x200000403:0xe8:0x0] compound/cookie=0x0/0x6a0e2053 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/137] fid=[0x200000403:0xe9:0x0] dfid=[0x200000403:0xe9:0x0] compound/cookie=0x0/0x6a0e2054 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/138] fid=[0x200000403:0xea:0x0] dfid=[0x200000403:0xea:0x0] compound/cookie=0x0/0x6a0e2055 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/139] fid=[0x200000403:0xeb:0x0] dfid=[0x200000403:0xeb:0x0] compound/cookie=0x0/0x6a0e2056 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/140] fid=[0x200000403:0xec:0x0] dfid=[0x200000403:0xec:0x0] compound/cookie=0x0/0x6a0e2057 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/141] fid=[0x200000403:0xed:0x0] dfid=[0x200000403:0xed:0x0] compound/cookie=0x0/0x6a0e2058 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/142] fid=[0x200000403:0xee:0x0] dfid=[0x200000403:0xee:0x0] compound/cookie=0x0/0x6a0e2059 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/143] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a0e205a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/144] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a0e205b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/145] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a0e205c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/146] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a0e205d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/147] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a0e205e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/148] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a0e205f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' Changed after 3s: from 'lrh=[type=10680000 len=136 idx=2/112] fid=[0x200000403:0xd1:0x0] dfid=[0x200000403:0xd1:0x0] compound/cookie=0x0/0x6a0e203c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=2/113] fid=[0x200000403:0xd2:0x0] dfid=[0x200000403:0xd2:0x0] compound/cookie=0x0/0x6a0e203d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=2/114] fid=[0x200000403:0xd3:0x0] dfid=[0x200000403:0xd3:0x0] compound/cookie=0x0/0x6a0e203e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=2/115] fid=[0x200000403:0xd4:0x0] dfid=[0x200000403:0xd4:0x0] compound/cookie=0x0/0x6a0e203f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/116] fid=[0x200000403:0xd5:0x0] dfid=[0x200000403:0xd5:0x0] compound/cookie=0x0/0x6a0e2040 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/117] fid=[0x200000403:0xd6:0x0] dfid=[0x200000403:0xd6:0x0] compound/cookie=0x0/0x6a0e2041 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/118] fid=[0x200000403:0xd7:0x0] dfid=[0x200000403:0xd7:0x0] compound/cookie=0x0/0x6a0e2042 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/119] fid=[0x200000403:0xd8:0x0] dfid=[0x200000403:0xd8:0x0] compound/cookie=0x0/0x6a0e2043 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/120] fid=[0x200000403:0xd9:0x0] dfid=[0x200000403:0xd9:0x0] compound/cookie=0x0/0x6a0e2044 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/121] fid=[0x200000403:0xda:0x0] dfid=[0x200000403:0xda:0x0] compound/cookie=0x0/0x6a0e2045 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/123] fid=[0x200000403:0xdb:0x0] dfid=[0x200000403:0xdb:0x0] compound/cookie=0x0/0x6a0e2046 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/124] fid=[0x200000403:0xdc:0x0] dfid=[0x200000403:0xdc:0x0] compound/cookie=0x0/0x6a0e2047 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/125] fid=[0x200000403:0xdd:0x0] dfid=[0x200000403:0xdd:0x0] compound/cookie=0x0/0x6a0e2048 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/126] fid=[0x200000403:0xde:0x0] dfid=[0x200000403:0xde:0x0] compound/cookie=0x0/0x6a0e2049 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/127] fid=[0x200000403:0xdf:0x0] dfid=[0x200000403:0xdf:0x0] compound/cookie=0x0/0x6a0e204a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/128] fid=[0x200000403:0xe0:0x0] dfid=[0x200000403:0xe0:0x0] compound/cookie=0x0/0x6a0e204b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/129] fid=[0x200000403:0xe1:0x0] dfid=[0x200000403:0xe1:0x0] compound/cookie=0x0/0x6a0e204c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/130] fid=[0x200000403:0xe2:0x0] dfid=[0x200000403:0xe2:0x0] compound/cookie=0x0/0x6a0e204d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/131] fid=[0x200000403:0xe3:0x0] dfid=[0x200000403:0xe3:0x0] compound/cookie=0x0/0x6a0e204e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/132] fid=[0x200000403:0xe4:0x0] dfid=[0x200000403:0xe4:0x0] compound/cookie=0x0/0x6a0e204f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/133] fid=[0x200000403:0xe5:0x0] dfid=[0x200000403:0xe5:0x0] compound/cookie=0x0/0x6a0e2050 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/134] fid=[0x200000403:0xe6:0x0] dfid=[0x200000403:0xe6:0x0] compound/cookie=0x0/0x6a0e2051 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/135] fid=[0x200000403:0xe7:0x0] dfid=[0x200000403:0xe7:0x0] compound/cookie=0x0/0x6a0e2052 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/136] fid=[0x200000403:0xe8:0x0] dfid=[0x200000403:0xe8:0x0] compound/cookie=0x0/0x6a0e2053 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/137] fid=[0x200000403:0xe9:0x0] dfid=[0x200000403:0xe9:0x0] compound/cookie=0x0/0x6a0e2054 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/138] fid=[0x200000403:0xea:0x0] dfid=[0x200000403:0xea:0x0] compound/cookie=0x0/0x6a0e2055 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/139] fid=[0x200000403:0xeb:0x0] dfid=[0x200000403:0xeb:0x0] compound/cookie=0x0/0x6a0e2056 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/140] fid=[0x200000403:0xec:0x0] dfid=[0x200000403:0xec:0x0] compound/cookie=0x0/0x6a0e2057 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/141] fid=[0x200000403:0xed:0x0] dfid=[0x200000403:0xed:0x0] compound/cookie=0x0/0x6a0e2058 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/142] fid=[0x200000403:0xee:0x0] dfid=[0x200000403:0xee:0x0] compound/cookie=0x0/0x6a0e2059 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/143] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a0e205a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/144] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a0e205b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/145] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a0e205c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/146] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a0e205d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/147] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a0e205e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/148] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a0e205f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=2/127] fid=[0x200000403:0xdf:0x0] dfid=[0x200000403:0xdf:0x0] compound/cookie=0x0/0x6a0e204a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=2/128] fid=[0x200000403:0xe0:0x0] dfid=[0x200000403:0xe0:0x0] compound/cookie=0x0/0x6a0e204b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/129] fid=[0x200000403:0xe1:0x0] dfid=[0x200000403:0xe1:0x0] compound/cookie=0x0/0x6a0e204c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/130] fid=[0x200000403:0xe2:0x0] dfid=[0x200000403:0xe2:0x0] compound/cookie=0x0/0x6a0e204d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/131] fid=[0x200000403:0xe3:0x0] dfid=[0x200000403:0xe3:0x0] compound/cookie=0x0/0x6a0e204e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/132] fid=[0x200000403:0xe4:0x0] dfid=[0x200000403:0xe4:0x0] compound/cookie=0x0/0x6a0e204f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/133] fid=[0x200000403:0xe5:0x0] dfid=[0x200000403:0xe5:0x0] compound/cookie=0x0/0x6a0e2050 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/134] fid=[0x200000403:0xe6:0x0] dfid=[0x200000403:0xe6:0x0] compound/cookie=0x0/0x6a0e2051 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/135] fid=[0x200000403:0xe7:0x0] dfid=[0x200000403:0xe7:0x0] compound/cookie=0x0/0x6a0e2052 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/136] fid=[0x200000403:0xe8:0x0] dfid=[0x200000403:0xe8:0x0] compound/cookie=0x0/0x6a0e2053 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/137] fid=[0x200000403:0xe9:0x0] dfid=[0x200000403:0xe9:0x0] compound/cookie=0x0/0x6a0e2054 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/138] fid=[0x200000403:0xea:0x0] dfid=[0x200000403:0xea:0x0] compound/cookie=0x0/0x6a0e2055 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/139] fid=[0x200000403:0xeb:0x0] dfid=[0x200000403:0xeb:0x0] compound/cookie=0x0/0x6a0e2056 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/140] fid=[0x200000403:0xec:0x0] dfid=[0x200000403:0xec:0x0] compound/cookie=0x0/0x6a0e2057 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/141] fid=[0x200000403:0xed:0x0] dfid=[0x200000403:0xed:0x0] compound/cookie=0x0/0x6a0e2058 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/142] fid=[0x200000403:0xee:0x0] dfid=[0x200000403:0xee:0x0] compound/cookie=0x0/0x6a0e2059 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/143] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a0e205a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/144] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a0e205b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/145] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a0e205c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/146] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a0e205d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/147] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a0e205e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/148] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a0e205f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' Changed after 5s: from 'lrh=[type=10680000 len=136 idx=2/127] fid=[0x200000403:0xdf:0x0] dfid=[0x200000403:0xdf:0x0] compound/cookie=0x0/0x6a0e204a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=2/128] fid=[0x200000403:0xe0:0x0] dfid=[0x200000403:0xe0:0x0] compound/cookie=0x0/0x6a0e204b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/129] fid=[0x200000403:0xe1:0x0] dfid=[0x200000403:0xe1:0x0] compound/cookie=0x0/0x6a0e204c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/130] fid=[0x200000403:0xe2:0x0] dfid=[0x200000403:0xe2:0x0] compound/cookie=0x0/0x6a0e204d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/131] fid=[0x200000403:0xe3:0x0] dfid=[0x200000403:0xe3:0x0] compound/cookie=0x0/0x6a0e204e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/132] fid=[0x200000403:0xe4:0x0] dfid=[0x200000403:0xe4:0x0] compound/cookie=0x0/0x6a0e204f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/133] fid=[0x200000403:0xe5:0x0] dfid=[0x200000403:0xe5:0x0] compound/cookie=0x0/0x6a0e2050 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/134] fid=[0x200000403:0xe6:0x0] dfid=[0x200000403:0xe6:0x0] compound/cookie=0x0/0x6a0e2051 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/135] fid=[0x200000403:0xe7:0x0] dfid=[0x200000403:0xe7:0x0] compound/cookie=0x0/0x6a0e2052 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/136] fid=[0x200000403:0xe8:0x0] dfid=[0x200000403:0xe8:0x0] compound/cookie=0x0/0x6a0e2053 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/137] fid=[0x200000403:0xe9:0x0] dfid=[0x200000403:0xe9:0x0] compound/cookie=0x0/0x6a0e2054 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/138] fid=[0x200000403:0xea:0x0] dfid=[0x200000403:0xea:0x0] compound/cookie=0x0/0x6a0e2055 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/139] fid=[0x200000403:0xeb:0x0] dfid=[0x200000403:0xeb:0x0] compound/cookie=0x0/0x6a0e2056 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/140] fid=[0x200000403:0xec:0x0] dfid=[0x200000403:0xec:0x0] compound/cookie=0x0/0x6a0e2057 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/141] fid=[0x200000403:0xed:0x0] dfid=[0x200000403:0xed:0x0] compound/cookie=0x0/0x6a0e2058 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/142] fid=[0x200000403:0xee:0x0] dfid=[0x200000403:0xee:0x0] compound/cookie=0x0/0x6a0e2059 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/143] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a0e205a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/144] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a0e205b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/145] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a0e205c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/146] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a0e205d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/147] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a0e205e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/148] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a0e205f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=2/140] fid=[0x200000403:0xec:0x0] dfid=[0x200000403:0xec:0x0] compound/cookie=0x0/0x6a0e2057 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=2/141] fid=[0x200000403:0xed:0x0] dfid=[0x200000403:0xed:0x0] compound/cookie=0x0/0x6a0e2058 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=2/142] fid=[0x200000403:0xee:0x0] dfid=[0x200000403:0xee:0x0] compound/cookie=0x0/0x6a0e2059 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=2/143] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a0e205a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/144] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a0e205b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/145] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a0e205c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/146] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a0e205d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/147] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a0e205e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=2/148] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a0e205f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 PASS 90 (94s) == sanity-hsm test 100: Set coordinator /proc tunables === 17:31:46 (1779312706) Testing mdt.lustre-MDT0000.hsm.loop_period Set loop_period to 0 must failed oleg431-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/loop_period=0: Invalid argument oleg431-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/loop_period'='0': Invalid argument pdsh@oleg431-client: oleg431-server: ssh exited with exit code 22 oleg431-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/loop_period=0: Invalid argument oleg431-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/loop_period'='0': Invalid argument pdsh@oleg431-client: oleg431-server: ssh exited with exit code 22 Testing mdt.lustre-MDT0000.hsm.grace_delay Set grace_delay to 0 must failed oleg431-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/grace_delay=0: Invalid argument oleg431-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/grace_delay'='0': Invalid argument pdsh@oleg431-client: oleg431-server: ssh exited with exit code 22 oleg431-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/grace_delay=0: Invalid argument oleg431-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/grace_delay'='0': Invalid argument pdsh@oleg431-client: oleg431-server: ssh exited with exit code 22 Testing mdt.lustre-MDT0000.hsm.active_request_timeout Set active_request_timeout to 0 must failed oleg431-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/active_request_timeout=0: Invalid argument oleg431-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/active_request_timeout'='0': Invalid argument pdsh@oleg431-client: oleg431-server: ssh exited with exit code 22 oleg431-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/active_request_timeout=0: Invalid argument oleg431-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/active_request_timeout'='0': Invalid argument pdsh@oleg431-client: oleg431-server: ssh exited with exit code 22 Testing mdt.lustre-MDT0000.hsm.max_requests Set max_requests to 0 must failed oleg431-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=0: Invalid argument oleg431-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='0': Invalid argument pdsh@oleg431-client: oleg431-server: ssh exited with exit code 22 oleg431-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/max_requests=0: Invalid argument oleg431-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/max_requests'='0': Invalid argument pdsh@oleg431-client: oleg431-server: ssh exited with exit code 22 Testing mdt.lustre-MDT0000.hsm.default_archive_id Set default_archive_id to 0 must failed oleg431-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/default_archive_id=0: Invalid argument oleg431-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/default_archive_id'='0': Invalid argument pdsh@oleg431-client: oleg431-server: ssh exited with exit code 22 oleg431-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/default_archive_id=0: Invalid argument oleg431-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/default_archive_id'='0': Invalid argument pdsh@oleg431-client: oleg431-server: ssh exited with exit code 22 PASS 100 (49s) == sanity-hsm test 102: Verify coordinator control ======= 17:32:36 (1779312756) mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled PASS 102 (19s) == sanity-hsm test 103: Purge all requests =============== 17:32:55 (1779312775) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_103/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=purge mdt.lustre-MDT0001.hsm_control=purge Current requests pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 PASS 103 (18s) == sanity-hsm test 103a: Purge pending restore requests == 17:33:13 (1779312793) mdt.lustre-MDT0000.hsm.policy=-NBR mdt.lustre-MDT0001.hsm.policy=-NBR Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_103a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' (0x200000403:0x128:0x0|0x200000403:0x129:0x0|0x200000403:0x12a:0x0|0x200000403:0x12b:0x0|0x200000403:0x12c:0x0|0x200000403:0x12d:0x0|0x200000403:0x12e:0x0|0x200000403:0x12f:0x0).*action=ARCHIVE.*status=SUCCEED pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 Killing existing copytools on oleg431-client.virtnet with signal TERM copytools stopped in 0s cat: '/mnt/lustre/.lustre/fid/0x200000403:0x12c:0x0': No data available cat: cat: '/mnt/lustre/.lustre/fid/0x200000403:0x129:0x0''/mnt/lustre/.lustre/fid/0x200000403:0x128:0x0': No data available : No data available cat: '/mnt/lustre/.lustre/fid/0x200000403:0x12a:0x0': No data available cat: '/mnt/lustre/.lustre/fid/0x200000403:0x12b:0x0': No data available cat: '/mnt/lustre/.lustre/fid/0x200000403:0x12d:0x0': No data available cat: '/mnt/lustre/.lustre/fid/0x200000403:0x12e:0x0': No data available cat: '/mnt/lustre/.lustre/fid/0x200000403:0x12f:0x0': No data available mdt.lustre-MDT0000.hsm_control=purge mdt.lustre-MDT0001.hsm_control=purge PASS 103a (23s) == sanity-hsm test 104: Copy tool data field ============= 17:33:36 (1779312816) 0+0 records in 0+0 records out 0 bytes copied, 0.0061014 s, 0.0 kB/s mdt.lustre-MDT0000.hsm_control=purge mdt.lustre-MDT0001.hsm_control=purge PASS 104 (13s) == sanity-hsm test 105: Restart of coordinator =========== 17:33:50 (1779312830) mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled mdt.lustre-MDT0000.hsm_control=purge mdt.lustre-MDT0001.hsm_control=purge PASS 105 (42s) == sanity-hsm test 106a: Copytool register/unregister ==== 17:34:32 (1779312872) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' oleg431-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg431-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2 oleg431-client.virtnet: 89821 Killing existing copytools on oleg431-client.virtnet with signal TERM copytools stopped in 0s pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 uuid not found in agent list on mds1 pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 uuid not found in agent list on mds2 Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' oleg431-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg431-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2 PASS 106a (31s) == sanity-hsm test 106b: Unregister agent after a copytool crash ========================================================== 17:35:03 (1779312903) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' oleg431-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg431-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2 oleg431-client.virtnet: 91471 Killing existing copytools on oleg431-client.virtnet with signal KILL copytools stopped in 0s pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 uuid not found in agent list on mds1 pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 uuid not found in agent list on mds2 Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2 PASS 106b (22s) == sanity-hsm test 106c: Unregister copytool on client eviction ========================================================== 17:35:25 (1779312925) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' oleg431-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg431-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2 oleg431-client.virtnet: 92663 oleg431-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg431-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg431-client.virtnet: executing get_client_uuid /mnt/lustre2 mdc.lustre-MDT0000-mdc-ffff8aa7c8977000.active=0 mdc.lustre-MDT0001-mdc-ffff8aa7c8977000.active=0 mdt.lustre-MDT0000.evict_client=3f2fec88-484c-4f29-89b0-69185c9867fe mdt.lustre-MDT0001.evict_client=3f2fec88-484c-4f29-89b0-69185c9867fe pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 uuid not found in agent list on mds1 pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 uuid not found in agent list on mds2 mdc.lustre-MDT0000-mdc-ffff8aa7c8977000.active=1 mdc.lustre-MDT0001-mdc-ffff8aa7c8977000.active=1 oleg431-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2 mdc.lustre-MDT0000-mdc-ffff8aa7c8977000.active=1 mdc.lustre-MDT0001-mdc-ffff8aa7c8977000.active=1 PASS 106c (49s) == sanity-hsm test 107: Copytool re-register after MDS restart ========================================================== 17:36:14 (1779312974) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_107/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Failing mds1 on oleg431-server Stopping /mnt/lustre-mds1 (opts:) on oleg431-server 17:36:23 (1779312983) shut down facet: mds1 facet_host: oleg431-server facet_failover_host: oleg431-server Failover mds1 to oleg431-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg431-server: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 Started lustre-MDT0000 17:36:49 (1779313009) targets are mounted 17:36:49 (1779313009) facet_failover done oleg431-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 107 (53s) == sanity-hsm test 109: Policy display/change ============ 17:37:07 (1779313027) mdt.lustre-MDT0000.hsm.policy=+NBR mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0000.hsm.policy=-NBR mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0000.hsm.policy=NRA NBR Next set_param must failed oleg431-server: error: set_param: setting /sys/kernel/debug/lustre/mdt/lustre-MDT0000/hsm/policy=wrong: Invalid argument oleg431-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/policy'='wrong': Invalid argument pdsh@oleg431-client: oleg431-server: ssh exited with exit code 22 Back to default policy mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0001.hsm.policy=+NRA mdt.lustre-MDT0000.hsm.policy=-NBR mdt.lustre-MDT0001.hsm.policy=-NBR PASS 109 (22s) == sanity-hsm test 110a: Non blocking restore policy (import case) ========================================================== 17:37:29 (1779313049) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_110a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1779313051.724471 [97119]: action=1 src=d110a.sanity-hsm/f110a.sanity-hsm dst=/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779313051.733711 [97119]: importing '/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_110a//d110a.sanity-hsm/f110a.sanity-hsm' lhsmtool_posix: 1779313051.789025 [97119]: imported '/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_110a//0bb6/0x200000bd2:0x64:0x0'=='/tmp/arc1/sanity-hsm.test_110a//d110a.sanity-hsm/f110a.sanity-hsm' lhsmtool_posix: 1779313051.789098 [97119]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdt.lustre-MDT0000.hsm.policy=+NBR mdt.lustre-MDT0001.hsm.policy=+NBR md5sum: /mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm: No data available mdt.lustre-MDT0000.hsm.policy=-NBR mdt.lustre-MDT0001.hsm.policy=-NBR PASS 110a (10s) == sanity-hsm test 110b: Non blocking restore policy (release case) ========================================================== 17:37:39 (1779313059) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_110b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=+NBR mdt.lustre-MDT0001.hsm.policy=+NBR md5sum: /mnt/lustre/d110b.sanity-hsm/f110b.sanity-hsm: No data available mdt.lustre-MDT0000.hsm.policy=-NBR mdt.lustre-MDT0001.hsm.policy=-NBR PASS 110b (12s) == sanity-hsm test 111a: No retry policy (import case), restore will error ========================================================== 17:37:51 (1779313071) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_111a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1779313073.259386 [98509]: action=1 src=d111a.sanity-hsm/f111a.sanity-hsm dst=/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779313073.266118 [98509]: importing '/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_111a//d111a.sanity-hsm/f111a.sanity-hsm' lhsmtool_posix: 1779313073.317842 [98509]: imported '/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_111a//0bbb/0x200000bd2:0x69:0x0'=='/tmp/arc1/sanity-hsm.test_111a//d111a.sanity-hsm/f111a.sanity-hsm' lhsmtool_posix: 1779313073.318761 [98509]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0001.hsm.policy=+NRA Remove from backend: 0x200000bd2:0x69:0x0 = /tmp/arc1/sanity-hsm.test_111a/0bbb/0x200000bd2:0x69:0x0 mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0001.hsm.policy=-NRA PASS 111a (11s) == sanity-hsm test 111b: No retry policy (release case), restore will error ========================================================== 17:38:02 (1779313082) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_111b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0001.hsm.policy=+NRA Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Remove from backend: 0x200000bd3:0x7:0x0 = /tmp/arc1/sanity-hsm.test_111b/0bd4/0x200000bd3:0x7:0x0 mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0001.hsm.policy=-NRA PASS 111b (14s) == sanity-hsm test 112: State of recorded request ======== 17:38:16 (1779313096) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_112/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled /mnt/lustre/d112.sanity-hsm/f112.sanity-hsm: ARCHIVE waiting (from 0 to EOF) mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled PASS 112 (13s) == sanity-hsm test 113: wrong stat after restore ========= 17:38:29 (1779313109) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.069226 s, 15.1 MB/s Starting client: oleg431-client.virtnet: -o user_xattr,flock 192.168.204.131@tcp:/lustre /mnt/lustre3 Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_113/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre3"' Verifying released state: multiop /mnt/lustre/d113.sanity-hsm/f113.sanity-hsm voO_WRONLY:O_APPEND:_w4c TMPPIPE=/tmp/multiop_open_wait_pipe.8368 File: /mnt/lustre2/d113.sanity-hsm/f113.sanity-hsm Size: 1048576 Blocks: 1 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115238860488715 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-05-20 17:38:31.000000000 -0400 Modify: 2026-05-20 17:38:31.000000000 -0400 Change: 2026-05-20 17:38:31.000000000 -0400 Birth: 2026-05-20 17:38:30.000000000 -0400 Stopping client oleg431-client.virtnet /mnt/lustre3 (opts:) PASS 113 (13s) == sanity-hsm test 114: Incompatible request does not set other requests as STARTED ========================================================== 17:38:42 (1779313122) 0+0 records in 0+0 records out 0 bytes copied, 0.0041177 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.0198283 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_114/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled PASS 114 (15s) == sanity-hsm test 200: Register/Cancel archive ========== 17:38:57 (1779313137) 0+0 records in 0+0 records out 0 bytes copied, 0.00519287 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_200/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Copytool is suspended on oleg431-client.virtnet Copytool is continued on oleg431-client.virtnet PASS 200 (8s) == sanity-hsm test 201: Register/Cancel restore ========== 17:39:06 (1779313146) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_201/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB, 39 MiB) copied, 1.05535 s, 38.7 MB/s lhsmtool_posix: 1779313148.955491 [102899]: action=1 src=d201.sanity-hsm/f201.sanity-hsm dst=/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779313148.963742 [102899]: importing '/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_201//d201.sanity-hsm/f201.sanity-hsm' lhsmtool_posix: 1779313149.017480 [102899]: imported '/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_201//0ba0/0x200000bd2:0x72:0x0'=='/tmp/arc1/sanity-hsm.test_201//d201.sanity-hsm/f201.sanity-hsm' lhsmtool_posix: 1779313149.023354 [102899]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled PASS 201 (17s) == sanity-hsm test 202: Register/Cancel remove =========== 17:39:23 (1779313163) 0+0 records in 0+0 records out 0 bytes copied, 0.00503926 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_202/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Copytool is suspended on oleg431-client.virtnet PASS 202 (9s) == sanity-hsm test 220A: Changelog for archive =========== 17:39:32 (1779313172) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_220A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Waiting 200s for 'SUCCEED' lustre-MDT0000.3 16HSM 21:39:39.490337267 2026.05.20 0x0 t=[0x200000bd3:0x12:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 PASS 220A (22s) == sanity-hsm test 220a: Changelog for failed archive ==== 17:39:54 (1779313194) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_220a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl2 cl2' Copytool is suspended on oleg431-client.virtnet Waiting 200s for 'STARTED' Updated after 2s: want 'STARTED' got 'STARTED' Copytool is continued on oleg431-client.virtnet lustre-MDT0000.6 16HSM 21:40:04.361764602 2026.05.20 0x2 t=[0x200000bd3:0x13:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0001: clear the changelog for cl2 of all records lustre-MDT0001: Deregistered changelog user #2 lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0000: Deregistered changelog user #2 PASS 220a (21s) == sanity-hsm test 221: Changelog for archive canceled === 17:40:16 (1779313216) 0+0 records in 0+0 records out 0 bytes copied, 0.00602965 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_221/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl3 cl3' Copytool is suspended on oleg431-client.virtnet Waiting 200s for 'CANCELED' Updated after 2s: want 'CANCELED' got 'CANCELED' Copytool is continued on oleg431-client.virtnet lustre-MDT0000.8 16HSM 21:40:26.682722099 2026.05.20 0x7d t=[0x200000bd3:0x14:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0001: clear the changelog for cl3 of all records lustre-MDT0001: Deregistered changelog user #3 lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000: Deregistered changelog user #3 PASS 221 (22s) == sanity-hsm test 222a: Changelog for explicit restore == 17:40:38 (1779313238) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1779313240.190617 [106761]: action=1 src=d222a.sanity-hsm/f222a.sanity-hsm dst=/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779313240.198527 [106761]: importing '/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222a//d222a.sanity-hsm/f222a.sanity-hsm' lhsmtool_posix: 1779313240.244395 [106761]: imported '/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222a//0bab/0x200000bd2:0x79:0x0'=='/tmp/arc1/sanity-hsm.test_222a//d222a.sanity-hsm/f222a.sanity-hsm' lhsmtool_posix: 1779313240.245478 [106761]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl4 cl4' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' lustre-MDT0000.11 16HSM 21:40:45.515878898 2026.05.20 0x80 t=[0x200000bd2:0x79:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0001: clear the changelog for cl4 of all records lustre-MDT0001: Deregistered changelog user #4 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 PASS 222a (20s) == sanity-hsm test 222b: Changelog for implicit restore == 17:40:58 (1779313258) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl5 cl5' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' 4ef076ad20e5d4a2f4729d6ed41a3bf9 /mnt/lustre/d222b.sanity-hsm/f222b.sanity-hsm lustre-MDT0000.20 16HSM 21:41:10.857254464 2026.05.20 0x80 t=[0x200000bd3:0x16:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0001: clear the changelog for cl5 of all records lustre-MDT0001: Deregistered changelog user #5 lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0000: Deregistered changelog user #5 PASS 222b (25s) == sanity-hsm test 222c: Changelog for failed explicit restore ========================================================== 17:41:23 (1779313283) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1779313285.299297 [108406]: action=1 src=d222c.sanity-hsm/f222c.sanity-hsm dst=/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779313285.312301 [108406]: importing '/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222c//d222c.sanity-hsm/f222c.sanity-hsm' lhsmtool_posix: 1779313285.380591 [108406]: imported '/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222c//0baf/0x200000bd2:0x7d:0x0'=='/tmp/arc1/sanity-hsm.test_222c//d222c.sanity-hsm/f222c.sanity-hsm' lhsmtool_posix: 1779313285.383070 [108406]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl6 cl6' Copytool is suspended on oleg431-client.virtnet Copytool is continued on oleg431-client.virtnet lustre-MDT0000.22 16HSM 21:41:30.607997564 2026.05.20 0x82 t=[0x200000bd2:0x7d:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0001: clear the changelog for cl6 of all records lustre-MDT0001: Deregistered changelog user #6 lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000: Deregistered changelog user #6 PASS 222c (18s) == sanity-hsm test 222d: Changelog for failed implicit restore ========================================================== 17:41:41 (1779313301) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl7 cl7' Waiting 200s for 'SUCCEED' Remove from backend: 0x200000bd3:0x18:0x0 = /tmp/arc1/sanity-hsm.test_222d/0bcb/0x200000bd3:0x18:0x0 md5sum: /mnt/lustre/d222d.sanity-hsm/f222d.sanity-hsm: No data available lustre-MDT0000.29 16HSM 21:41:50.285662740 2026.05.20 0x82 t=[0x200000bd3:0x18:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp p=[0x200000bd2:0x7c:0x0] lustre-MDT0001: clear the changelog for cl7 of all records lustre-MDT0001: Deregistered changelog user #7 lustre-MDT0000: clear the changelog for cl7 of all records lustre-MDT0000: Deregistered changelog user #7 PASS 222d (18s) == sanity-hsm test 223a: Changelog for restore canceled (import case) ========================================================== 17:41:59 (1779313319) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_223a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB, 39 MiB) copied, 0.709236 s, 57.7 MB/s mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl8 cl8' lhsmtool_posix: 1779313326.423960 [110158]: action=1 src=d223a.sanity-hsm/f223a.sanity-hsm dst=/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1779313326.432489 [110158]: importing '/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_223a//d223a.sanity-hsm/f223a.sanity-hsm' lhsmtool_posix: 1779313326.492971 [110158]: imported '/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_223a//0b50/0x200000bd2:0x82:0x0'=='/tmp/arc1/sanity-hsm.test_223a//d223a.sanity-hsm/f223a.sanity-hsm' lhsmtool_posix: 1779313326.493712 [110158]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Waiting 200s for 'STARTED' Updated after 2s: want 'STARTED' got 'STARTED' Waiting 200s for 'SUCCEED' Updated after 27s: want 'SUCCEED' got 'SUCCEED' lustre-MDT0000.36 16HSM 21:42:36.578210662 2026.05.20 0xfd t=[0x200000bd2:0x82:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0001: clear the changelog for cl8 of all records lustre-MDT0001: Deregistered changelog user #8 lustre-MDT0000: clear the changelog for cl8 of all records lustre-MDT0000: Deregistered changelog user #8 PASS 223a (46s) == sanity-hsm test 223b: Changelog for restore canceled (release case) ========================================================== 17:42:45 (1779313365) 0+0 records in 0+0 records out 0 bytes copied, 0.00531771 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_223b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl9 cl9' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Copytool is suspended on oleg431-client.virtnet Copytool is continued on oleg431-client.virtnet lustre-MDT0000.43 16HSM 21:42:56.243681603 2026.05.20 0xfd t=[0x200000bd3:0x1b:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0001: clear the changelog for cl9 of all records lustre-MDT0001: Deregistered changelog user #9 lustre-MDT0000: clear the changelog for cl9 of all records lustre-MDT0000: Deregistered changelog user #9 PASS 223b (26s) == sanity-hsm test 224A: Changelog for remove ============ 17:43:11 (1779313391) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_224A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl10 cl10' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' lustre-MDT0000.48 16HSM 21:43:23.081564910 2026.05.20 0x200 t=[0x200000bd3:0x1d:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp p=[0x200000bd2:0x7c:0x0] lustre-MDT0001: clear the changelog for cl10 of all records lustre-MDT0001: Deregistered changelog user #10 lustre-MDT0000: clear the changelog for cl10 of all records lustre-MDT0000: Deregistered changelog user #10 PASS 224A (23s) == sanity-hsm test 224a: Changelog for failed remove ===== 17:43:34 (1779313414) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_224a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl11 cl11' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Remove from backend: 0x200000bd3:0x1e:0x0 = /tmp/arc1/sanity-hsm.test_224a/0bcd/0x200000bd3:0x1e:0x0 Copytool is suspended on oleg431-client.virtnet Copytool is continued on oleg431-client.virtnet lustre-MDT0000.53 16HSM 21:43:45.861232033 2026.05.20 0x202 t=[0x200000bd3:0x1e:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0001: clear the changelog for cl11 of all records lustre-MDT0001: Deregistered changelog user #11 lustre-MDT0000: clear the changelog for cl11 of all records lustre-MDT0000: Deregistered changelog user #11 PASS 224a (23s) == sanity-hsm test 225: Changelog for remove canceled ==== 17:43:58 (1779313438) Test disabled PASS 225 (6s) == sanity-hsm test 226: changelog for last rm/mv with exiting archive ========================================================== 17:44:04 (1779313444) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_226/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0x200000bd3:0x21:0x0 mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl12 cl12' lustre-MDT0000.54 16HSM 21:44:11.503042301 2026.05.20 0x280 t=[0x200000bd3:0x1f:0x0] ef=0x13 u=0:0 nid=0@<0:0> lustre-MDT0000.55 16HSM 21:44:11.638854452 2026.05.20 0x280 t=[0x200000bd3:0x1f:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0000.56 16HSM 21:44:11.639031012 2026.05.20 0x0 t=[0x200000bd3:0x1f:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0000.57 16HSM 21:44:12.664906617 2026.05.20 0x280 t=[0x200000bd3:0x20:0x0] ef=0x13 u=0:0 nid=0@<0:0> lustre-MDT0000.58 16HSM 21:44:12.799550052 2026.05.20 0x280 t=[0x200000bd3:0x20:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp p=[0x200000bd2:0x86:0x0] lustre-MDT0000.59 16HSM 21:44:12.801389127 2026.05.20 0x0 t=[0x200000bd3:0x20:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp p=[0x200000bd2:0x86:0x0] lustre-MDT0000.60 06UNLNK 21:44:13.110691672 2026.05.20 0x3 t=[0x200000bd3:0x1f:0x0] j=rm.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp p=[0x200000bd2:0x87:0x0] f226.sanity-hsm-1 lustre-MDT0000.60 06UNLNK 21:44:13.110691672 2026.05.20 0x3 t=[0x200000bd3:0x1f:0x0] j=rm.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp p=[0x200000bd2:0x87:0x0] f226.sanity-hsm-1 lustre-MDT0000.61 08RENME 21:44:13.643747927 2026.05.20 0x3 t=[0x200000bd3:0x20:0x0] j=mv.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp p=[0x200000bd2:0x87:0x0] f226.sanity-hsm-2 s=[0x200000bd3:0x21:0x0] sp=[0x200000bd2:0x87:0x0] f226.sanity-hsm-3 lustre-MDT0001: clear the changelog for cl12 of all records lustre-MDT0001: Deregistered changelog user #12 lustre-MDT0000: clear the changelog for cl12 of all records lustre-MDT0000: Deregistered changelog user #12 PASS 226 (19s) == sanity-hsm test 227: changelog when explicit setting of HSM flags ========================================================== 17:44:23 (1779313463) 0+0 records in 0+0 records out 0 bytes copied, 0.00382116 s, 0.0 kB/s mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl13 cl13' lustre-MDT0001: clear the changelog for cl13 of all records lustre-MDT0001: Deregistered changelog user #13 lustre-MDT0000: clear the changelog for cl13 of all records lustre-MDT0000: Deregistered changelog user #13 PASS 227 (19s) == sanity-hsm test 228: On released file, return extend to FIEMAP. For [cp,tar] --sparse ========================================================== 17:44:42 (1779313482) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_228/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0427839 s, 24.5 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' /mnt/lustre/f228.sanity-hsm: 1 extent found tar: Removing leading `/' from member names mnt/lustre/f228.sanity-hsm PASS 228 (13s) == sanity-hsm test 250: Coordinator max request ========== 17:44:55 (1779313495) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_250/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.00869717 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.0058696 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00693651 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.0443811 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00303632 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00447399 s, 0.0 kB/s Copytool is suspended on oleg431-client.virtnet Copytool is continued on oleg431-client.virtnet PASS 250 (32s) == sanity-hsm test 251: Coordinator request timeout ====== 17:45:27 (1779313527) 0+0 records in 0+0 records out 0 bytes copied, 0.00796244 s, 0.0 kB/s mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_251/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Copytool is suspended on oleg431-client.virtnet Waiting 200s for 'STARTED' Updated after 2s: want 'STARTED' got 'STARTED' PASS 251 (31s) == sanity-hsm test 252: Timeout'ed running archive of a removed file should be canceled ========================================================== 17:45:58 (1779313558) 0+0 records in 0+0 records out 0 bytes copied, 0.00654277 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_252/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Copytool is suspended on oleg431-client.virtnet Copytool is continued on oleg431-client.virtnet PASS 252 (21s) == sanity-hsm test 253: Check for wrong file size after release ========================================================== 17:46:19 (1779313579) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_253/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 10+0 records in 10+0 records out 10000000 bytes (10 MB, 9.5 MiB) copied, 0.237344 s, 42.1 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' fail_loc=0x807 Cannot send HSM request (use of /mnt/lustre/d253.sanity-hsm/f253.sanity-hsm): Invalid argument could not release file PASS 253 (11s) == sanity-hsm test 254a: Request counters are initialized to zero ========================================================== 17:46:30 (1779313590) PASS 254a (7s) == sanity-hsm test 254b: Request counters are correctly incremented and decremented ========================================================== 17:46:37 (1779313597) Will launch 39 requests of each type Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_254b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Checking archive requests Copytool is suspended on oleg431-client.virtnet Copytool is continued on oleg431-client.virtnet Checking restore requests Copytool is suspended on oleg431-client.virtnet Copytool is continued on oleg431-client.virtnet Checking remove requests Copytool is suspended on oleg431-client.virtnet Copytool is continued on oleg431-client.virtnet PASS 254b (42s) == sanity-hsm test 255: Copytool registration wakes the coordinator up ========================================================== 17:47:19 (1779313639) 0+0 records in 0+0 records out 0 bytes copied, 0.00598591 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_255/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Killing existing copytools on oleg431-client.virtnet with signal TERM copytools stopped in 1s 0+0 records in 0+0 records out 0 bytes copied, 0.0121394 s, 0.0 kB/s 0x200000bd3:0x83:0x0 mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_255/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' PASS 255 (26s) == sanity-hsm test 260a: Restore request have priority over other requests ========================================================== 17:47:45 (1779313665) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.165008 s, 6.4 MB/s 0x200000bd3:0x84:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.203669 s, 5.1 MB/s 0x200000bd3:0x85:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.213368 s, 4.9 MB/s 0x200000bd3:0x86:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.201633 s, 5.2 MB/s 0x200000bd3:0x87:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.243791 s, 4.3 MB/s 0x200000bd3:0x88:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.195193 s, 5.4 MB/s 0x200000bd3:0x89:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.232433 s, 4.5 MB/s 0x200000bd3:0x8a:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.190129 s, 5.5 MB/s 0x200000bd3:0x8b:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.214885 s, 4.9 MB/s 0x200000bd3:0x8c:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.272016 s, 3.9 MB/s 0x200000bd3:0x8d:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.258298 s, 4.1 MB/s 0x200000bd3:0x8e:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.22293 s, 4.7 MB/s 0x200000bd3:0x8f:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141616 s, 7.4 MB/s 0x200000bd3:0x90:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.260098 s, 4.0 MB/s 0x200000bd3:0x91:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.234257 s, 4.5 MB/s 0x200000bd3:0x92:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.226522 s, 4.6 MB/s 0x200000bd3:0x93:0x0 Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Killing existing copytools on oleg431-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' ARCHIVE RESTORE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE PASS 260a (37s) == sanity-hsm test 260b: Restore request have priority over other requests ========================================================== 17:48:22 (1779313702) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.368428 s, 2.8 MB/s 0x200000bd3:0x96:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.466167 s, 2.2 MB/s 0x200000bd3:0x97:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.319947 s, 3.3 MB/s 0x200000bd3:0x98:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.314094 s, 3.3 MB/s 0x200000bd3:0x99:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.220715 s, 4.8 MB/s 0x200000bd3:0x9a:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.332742 s, 3.2 MB/s 0x200000bd3:0x9b:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.182178 s, 5.8 MB/s 0x200000bd3:0x9c:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.238715 s, 4.4 MB/s 0x200000bd3:0x9d:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.223762 s, 4.7 MB/s 0x200000bd3:0x9e:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.203792 s, 5.1 MB/s 0x200000bd3:0x9f:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.23689 s, 4.4 MB/s 0x200000bd3:0xa0:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.23892 s, 4.4 MB/s 0x200000bd3:0xa1:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.140037 s, 7.5 MB/s 0x200000bd3:0xa2:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.251489 s, 4.2 MB/s 0x200000bd3:0xa3:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.269289 s, 3.9 MB/s 0x200000bd3:0xa4:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.248348 s, 4.2 MB/s 0x200000bd3:0xa5:0x0 Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2 "/mnt/lustre2"' Killing existing copytools on oleg431-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2 "/mnt/lustre2"' RESTORE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE PASS 260b (49s) == sanity-hsm test 260c: Requests are not reordered on the 'hot' path of the coordinator ========================================================== 17:49:11 (1779313751) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.241058 s, 4.3 MB/s 0x200000bd3:0xa7:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.201961 s, 5.2 MB/s 0x200000bd3:0xa8:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.297433 s, 3.5 MB/s 0x200000bd3:0xa9:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.268492 s, 3.9 MB/s 0x200000bd3:0xaa:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.237419 s, 4.4 MB/s 0x200000bd3:0xab:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.35224 s, 3.0 MB/s 0x200000bd3:0xac:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.432154 s, 2.4 MB/s 0x200000bd3:0xad:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.446017 s, 2.4 MB/s 0x200000bd3:0xae:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.346905 s, 3.0 MB/s 0x200000bd3:0xaf:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.417968 s, 2.5 MB/s 0x200000bd3:0xb0:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.320509 s, 3.3 MB/s 0x200000bd3:0xb1:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.255533 s, 4.1 MB/s 0x200000bd3:0xb2:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.353336 s, 3.0 MB/s 0x200000bd3:0xb3:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.222793 s, 4.7 MB/s 0x200000bd3:0xb4:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.435575 s, 2.4 MB/s 0x200000bd3:0xb5:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.204122 s, 5.1 MB/s 0x200000bd3:0xb6:0x0 Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2 "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Killing existing copytools on oleg431-client.virtnet with signal TERM copytools stopped in 0s mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2 "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE RESTORE PASS 260c (54s) == sanity-hsm test 261: Report 0 bytes size after HSM release ========================================================== 17:50:06 (1779313806) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_261/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 2+0 records in 2+0 records out 8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0154879 s, 529 kB/s Waiting 200s for 'SUCCEED' /mnt/lustre/d261.sanity-hsm/f261.sanity-hsm: (0x00000009) exists archived, archive_id:2 Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' /mnt/lustre/d261.sanity-hsm/f261.sanity-hsm: (0x0000000d) released exists archived, archive_id:2 PASS 261 (14s) == sanity-hsm test 262: The client should return 1 block for HSM released files ========================================================== 17:50:20 (1779313820) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_262/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 2+0 records in 2+0 records out 8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0114131 s, 718 kB/s PASS 262 (9s) == sanity-hsm test 300: On disk coordinator state kept between MDT umount/mount ========================================================== 17:50:28 (1779313828) Stop coordinator and remove coordinator state at mount mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=shutdown Failing mds1 on oleg431-server Stopping /mnt/lustre-mds1 (opts:) on oleg431-server 17:50:41 (1779313841) shut down facet: mds1 facet_host: oleg431-server facet_failover_host: oleg431-server Failover mds1 to oleg431-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg431-server: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 Started lustre-MDT0000 17:51:11 (1779313871) targets are mounted 17:51:11 (1779313871) facet_failover done oleg431-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Set coordinator start at mount, and start coordinator Failing mds1 on oleg431-server Stopping /mnt/lustre-mds1 (opts:) on oleg431-server 17:51:50 (1779313910) shut down facet: mds1 facet_host: oleg431-server facet_failover_host: oleg431-server Failover mds1 to oleg431-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg431-server: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 Started lustre-MDT0000 17:52:13 (1779313933) targets are mounted 17:52:13 (1779313933) facet_failover done oleg431-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 300 (128s) == sanity-hsm test 301: HSM tunnable are persistent ====== 17:52:36 (1779313956) Failing mds1 on oleg431-server Stopping /mnt/lustre-mds1 (opts:) on oleg431-server 17:52:45 (1779313965) shut down facet: mds1 facet_host: oleg431-server facet_failover_host: oleg431-server Failover mds1 to oleg431-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg431-server: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 Started lustre-MDT0000 17:53:08 (1779313988) targets are mounted 17:53:08 (1779313988) facet_failover done oleg431-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 301 (49s) == sanity-hsm test 302: HSM tunnable are persistent when CDT is off ========================================================== 17:53:25 (1779314005) mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=shutdown Failing mds1 on oleg431-server Stopping /mnt/lustre-mds1 (opts:) on oleg431-server 17:53:40 (1779314020) shut down facet: mds1 facet_host: oleg431-server facet_failover_host: oleg431-server Failover mds1 to oleg431-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg431-server: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 Started lustre-MDT0000 17:54:03 (1779314043) targets are mounted 17:54:03 (1779314043) facet_failover done oleg431-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Failing mds2 on oleg431-server Stopping /mnt/lustre-mds2 (opts:) on oleg431-server 17:54:17 (1779314057) shut down facet: mds2 facet_host: oleg431-server facet_failover_host: oleg431-server Failover mds2 to oleg431-server mount facets: mds2 Start mds2: mount -t lustre -o localrecov lustre-mdt2/mdt2 /mnt/lustre-mds2 oleg431-server: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 Started lustre-MDT0001 17:54:37 (1779314077) targets are mounted 17:54:37 (1779314077) facet_failover done oleg431-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 302 (90s) == sanity-hsm test 400: Single request is sent to the right MDT ========================================================== 17:54:55 (1779314095) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_400/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.212893 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.225409 s, 4.7 MB/s archive successful on mdt0 archive successful on mdt1 PASS 400 (10s) == sanity-hsm test 401: Compound requests split and sent to their respective MDTs ========================================================== 17:55:05 (1779314105) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_401/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.17738 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.201085 s, 5.2 MB/s Waiting 200s for 'SUCCEED' archive successful on mdt0 archive successful on mdt1 PASS 401 (10s) == sanity-hsm test 402a: Copytool start fails if all MDTs are inactive ========================================================== 17:55:15 (1779314115) deactivate lustre-MDT0000-mdc-ffff8aa7c8f8c800 on oleg431-client.virtnet deactivate lustre-MDT0001-mdc-ffff8aa7c8f8c800 on oleg431-client.virtnet deactivate lustre-MDT0000-mdc-ffff8aa7c8977000 on oleg431-client.virtnet deactivate lustre-MDT0001-mdc-ffff8aa7c8977000 on oleg431-client.virtnet Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_402a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Failed to start copytool agt1 on 'oleg431-client.virtnet' pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 uuid not found in agent list on mds1 pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 uuid not found in agent list on mds2 activate lustre-MDT0000-mdc-ffff8aa7c8f8c800 on oleg431-client.virtnet activate lustre-MDT0001-mdc-ffff8aa7c8f8c800 on oleg431-client.virtnet activate lustre-MDT0000-mdc-ffff8aa7c8977000 on oleg431-client.virtnet activate lustre-MDT0001-mdc-ffff8aa7c8977000 on oleg431-client.virtnet PASS 402a (8s) == sanity-hsm test 402b: CDT must retry request upon slow start of CT ========================================================== 17:55:23 (1779314123) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_402b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' fail_loc=0x14d fail_loc=0 Waiting 200s for 'SUCCEED' PASS 402b (20s) == sanity-hsm test 403: Copytool starts with inactive MDT and register on reconnect ========================================================== 17:55:43 (1779314143) deactivate lustre-MDT0001-mdc-ffff8aa7c8f8c800 on oleg431-client.virtnet deactivate lustre-MDT0001-mdc-ffff8aa7c8977000 on oleg431-client.virtnet Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_403/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' oleg431-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg431-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 uuid not found in agent list on mds2 oleg431-client.virtnet: 136298 activate lustre-MDT0001-mdc-ffff8aa7c8f8c800 on oleg431-client.virtnet activate lustre-MDT0001-mdc-ffff8aa7c8977000 on oleg431-client.virtnet found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 found agent uuid=3f2fec88-484c-4f29-89b0-69185c9867fe archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2 PASS 403 (15s) == sanity-hsm test 404: Inactive MDT does not block requests for active MDTs ========================================================== 17:55:58 (1779314158) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_404/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156531 s, 6.7 MB/s deactivate lustre-MDT0001-mdc-ffff8aa7c8f8c800 on oleg431-client.virtnet deactivate lustre-MDT0001-mdc-ffff8aa7c8977000 on oleg431-client.virtnet archive successful on mdt0 activate lustre-MDT0001-mdc-ffff8aa7c8f8c800 on oleg431-client.virtnet activate lustre-MDT0001-mdc-ffff8aa7c8977000 on oleg431-client.virtnet PASS 404 (8s) == sanity-hsm test 405: archive and release under striped directory ========================================================== 17:56:06 (1779314166) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_405/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0549906 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0471021 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0763553 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0510252 s, 20.6 MB/s archive successful on 0x240000bd2:0x1:0x0 archive successful on 0x240000bd2:0x2:0x0 archive successful on 0x240000bd2:0x3:0x0 archive successful on 0x2000032e3:0x6:0x0 PASS 405 (16s) == sanity-hsm test 406: attempting to migrate HSM archived files is safe ========================================================== 17:56:22 (1779314182) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.165128 s, 6.4 MB/s old fid 0x2000032e3:0x9:0x0 Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_406/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' lfs migrate: /mnt/lustre/d406.sanity-hsm/f406.sanity-hsm migrate failed: Operation not supported (95) lfs migrate: cb_migrate_mdt_fini: error completing migration of /mnt/lustre/d406.sanity-hsm: Directory not empty (39) Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' new fid 0x240000bd3:0x7:0x0 debug=+trace Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 406 (19s) == sanity-hsm test 407: Check for double RESTORE records in llog ========================================================== 17:56:41 (1779314201) 0+0 records in 0+0 records out 0 bytes copied, 0.00584845 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_407/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' fail_val=5 fail_loc=0x164 Copytool is suspended on oleg431-client.virtnet mdt.lustre-MDT0000.hsm.actions= lrh=[type=10680000 len=136 idx=4/3] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x6a0e2d78 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=4/4] fid=[0x2000032e3:0x3:0x0] dfid=[0x2000032e3:0x3:0x0] compound/cookie=0x0/0x6a0e2d79 action=ARCHIVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=4/5] fid=[0x2000032e3:0x6:0x0] dfid=[0x2000032e3:0x6:0x0] compound/cookie=0x0/0x6a0e2d7a action=ARCHIVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=4/6] fid=[0x2000032e3:0x6:0x0] dfid=[0x2000032e3:0x7:0x0] compound/cookie=0x0/0x6a0e2d7b action=RESTORE archive#=3 flags=0x4 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=4/7] fid=[0x2000032e3:0x9:0x0] dfid=[0x2000032e3:0x9:0x0] compound/cookie=0x0/0x6a0e2d7c action=ARCHIVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=4/8] fid=[0x2000032e3:0x9:0x0] dfid=[0x2000032e3:0xa:0x0] compound/cookie=0x0/0x6a0e2d7d action=RESTORE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=4/9] fid=[0x2000032e3:0x9:0x0] dfid=[0x2000032e3:0x9:0x0] compound/cookie=0x0/0x6a0e2d7e action=REMOVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=4/10] fid=[0x2000032e3:0xb:0x0] dfid=[0x2000032e3:0xb:0x0] compound/cookie=0x0/0x6a0e2d7f action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] Failing mds1 on oleg431-server Stopping /mnt/lustre-mds1 (opts:) on oleg431-server 17:56:53 (1779314213) shut down facet: mds1 facet_host: oleg431-server facet_failover_host: oleg431-server Failover mds1 to oleg431-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg431-server: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 Started lustre-MDT0000 17:57:13 (1779314233) targets are mounted 17:57:13 (1779314233) facet_failover done oleg431-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdt.lustre-MDT0000.hsm.actions= lrh=[type=10680000 len=136 idx=4/7] fid=[0x2000032e3:0x9:0x0] dfid=[0x2000032e3:0x9:0x0] compound/cookie=0x0/0x6a0e2d7c action=ARCHIVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=4/8] fid=[0x2000032e3:0x9:0x0] dfid=[0x2000032e3:0xa:0x0] compound/cookie=0x0/0x6a0e2d7d action=RESTORE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=4/9] fid=[0x2000032e3:0x9:0x0] dfid=[0x2000032e3:0x9:0x0] compound/cookie=0x0/0x6a0e2d7e action=REMOVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=4/10] fid=[0x2000032e3:0xb:0x0] dfid=[0x2000032e3:0xb:0x0] compound/cookie=0x0/0x6a0e2d7f action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=4/11] fid=[0x2000032e3:0xb:0x0] dfid=[0x2000032e3:0xb:0x0] compound/cookie=0x0/0x6a0e2d80 action=RESTORE archive#=2 flags=0x4 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec fail_loc=0 mdt.lustre-MDT0000.hsm.actions= lrh=[type=10680000 len=136 idx=4/7] fid=[0x2000032e3:0x9:0x0] dfid=[0x2000032e3:0x9:0x0] compound/cookie=0x0/0x6a0e2d7c action=ARCHIVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=4/8] fid=[0x2000032e3:0x9:0x0] dfid=[0x2000032e3:0xa:0x0] compound/cookie=0x0/0x6a0e2d7d action=RESTORE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=4/9] fid=[0x2000032e3:0x9:0x0] dfid=[0x2000032e3:0x9:0x0] compound/cookie=0x0/0x6a0e2d7e action=REMOVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=4/10] fid=[0x2000032e3:0xb:0x0] dfid=[0x2000032e3:0xb:0x0] compound/cookie=0x0/0x6a0e2d7f action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=4/11] fid=[0x2000032e3:0xb:0x0] dfid=[0x2000032e3:0xb:0x0] compound/cookie=0x0/0x6a0e2d80 action=RESTORE archive#=2 flags=0x4 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] Copytool is continued on oleg431-client.virtnet d41d8cd98f00b204e9800998ecf8427e /mnt/lustre/d407.sanity-hsm/f407.sanity-hsm d41d8cd98f00b204e9800998ecf8427e /mnt/lustre2/d407.sanity-hsm/f407.sanity-hsm pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 PASS 407 (51s) == sanity-hsm test 408: Verify fiemap on release file ==== 17:57:32 (1779314252) Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_408/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.144222 s, 454 kB/s SKIP: sanity-hsm test_408 ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 408 (3s) == sanity-hsm test 409a: Coordinator should not stop when in use ========================================================== 17:57:36 (1779314256) 0+0 records in 0+0 records out 0 bytes copied, 0.00820496 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' fail_val=5 fail_loc=0x164 cat: /mnt/lustre/d409a.sanity-hsm/f409a.sanity-hsm: No data available mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled Killing existing copytools on oleg431-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled PASS 409a (25s) == sanity-hsm test 409b: getattr released file with CDT stopped after remount ========================================================== 17:58:01 (1779314281) 0+0 records in 0+0 records out 0 bytes copied, 0.00366088 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Killing existing copytools on oleg431-client.virtnet with signal TERM copytools stopped in 0s Failing mds1 on oleg431-server Stopping /mnt/lustre-mds1 (opts:) on oleg431-server 17:58:31 (1779314311) shut down facet: mds1 facet_host: oleg431-server facet_failover_host: oleg431-server Failover mds1 to oleg431-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg431-server: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 Started lustre-MDT0000 17:58:49 (1779314329) targets are mounted 17:58:49 (1779314329) facet_failover done oleg431-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec File: /mnt/lustre/d409b.sanity-hsm/f409b.sanity-hsm Size: 0 Blocks: 0 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115406632648719 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-05-20 17:58:03.000000000 -0400 Modify: 2026-05-20 17:58:03.000000000 -0400 Change: 2026-05-20 17:58:03.000000000 -0400 Birth: 2026-05-20 17:58:02.000000000 -0400 PASS 409b (86s) == sanity-hsm test 410: lfs data_version -s allows release of force-archived file ========================================================== 17:59:27 (1779314367) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.197064 s, 5.3 MB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_410/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Cannot send HSM request (use of /mnt/lustre/d410.sanity-hsm/f410.sanity-hsm): Operation not permitted PASS 410 (5s) == sanity-hsm test 411: hsm_ops rbac role ================ 17:59:32 (1779314372) On MGS 192.168.204.131, active = nodemap.active=1 On MGS 192.168.204.131, test_411.trusted_nodemap = nodemap.test_411.trusted_nodemap=1 Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_411/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' /mnt/lustre/d411.sanity-hsm/fileA: (0x00000000) Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Killing existing copytools on oleg431-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_411/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' On MGS 192.168.204.131, test_411.rbac = nodemap.test_411.rbac=file_perms,dne_ops,quota_ops,byfid_ops,chlg_ops,fscrypt_admin,server_upcall,ignore_root_prjquota,local_admin,pool_quota_ops,lqa_quota_ops,projid_set,foreign_ops /mnt/lustre/d411.sanity-hsm/fileB: (0x00000000) Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Operation not permitted Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied lfs hsm_set: change hsm flags for '/mnt/lustre/d411.sanity-hsm/fileB' failed: Permission denied lfs hsm_clear: change hsm flags for '/mnt/lustre/d411.sanity-hsm/fileB' failed: Permission denied On MGS 192.168.204.131, active = nodemap.active=0 oleg431-server: error: nodemap 'test_411' does not exist oleg431-server: nodemap_del: Invalid argument pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 On MGS 192.168.204.131, active = nodemap.active=0 PASS 411 (34s) == sanity-hsm test 500: various LLAPI HSM tests ========== 18:00:06 (1779314406) striped dir -i0 -c2 -H crush /mnt/lustre/d500.sanity-hsm test1 @1779314491: Register/unregister copytool 2000x to check for leaks ...... pass test2 @1779314491: Re/un-register copytool multiple times without error ....... pass llapi_hsm_test: NULL archive numbers llapi_hsm_test: NULL archive numbers llapi_hsm_test: -1 requested when archive id >= 0 is supported test3 @1779314491: Pass bad parameters to llapi_hsm_copytool_register() ....... pass test4 @1779314491: Bad parameters to llapi_hsm_copytool_unregister() .......... pass test5 @1779314491: Test llapi_hsm_copytool_recv() in non-blocking mode ........ pass test6 @1779314491: Test llapi_hsm_copytool_recv() with bogus parameters ....... pass test7 @1779314491: Test event polling (without actual traffic) ................ pass test50 @1779314491: Test llapi_hsm_state_get()/get_fd() ....................... pass test51 @1779314492: Test llapi_hsm_state_set_fd() ............................. pass test52 @1779314492: Test llapi_hsm_current_action() ........................... pass test100 @1779314493: Simple archive creation with no progress reported. ....... pass test101 @1779314499: Simple archive creation with progress every byte. ........ pass test102 @1779314505: Archive creation with progress every byte, backwards ..... pass test103 @1779314506: Archive creation with a single progress report ........... pass test104 @1779314507: Archive creation with two progress reports ............... pass test105 @1779314508: Archive creation with one bogus progress report .......... pass test106 @1779314509: Archive creation with one empty progress report .......... pass test107 @1779314510: Archive creation with one bogus progress report .......... pass test108 @1779314516: Archive creation with same progress report each time ..... pass test109 @1779314517: Archive creation with one report, with large number ...... pass test110 @1779314519: Archive with 10 progress reports, checking progress ...... pass test111 @1779314520: Archive with 10 reports in reverse, checking progress .... pass test112 @1779314521: Archive with 10 reports, duplicated, check progress ...... pass test113 @1779314522: Archive with 9 reports, with 20% overlapping coverage .... pass PASS 500 (120s) == sanity-hsm test 600: Changelog fields 'u=' and 'nid=' ========================================================== 18:02:06 (1779314526) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d600.sanity-hsm/f600.sanity-hsm] Got NID '192.168.204.31@tcp' lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 PASS 600 (16s) == sanity-hsm test 601: OPEN Changelog entry ============= 18:02:22 (1779314542) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl2 cl2' mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0001: clear the changelog for cl2 of all records lustre-MDT0000.8 10OPEN 22:02:30.214070914 2026.05.20 0x1 t=[0x2000032e2:0x1c:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.204.31@tcp m=r-- lustre-MDT0001: clear the changelog for cl2 of all records lustre-MDT0001: Deregistered changelog user #2 lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0000: Deregistered changelog user #2 PASS 601 (16s) == sanity-hsm test 602: Changelog record CLOSE only if open+write or OPEN recorded ========================================================== 18:02:38 (1779314558) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl3 cl3' mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0001: clear the changelog for cl3 of all records lustre-MDT0001.5 11CLOSE 22:02:44.428197966 2026.05.20 0x1 t=[0x240000bd3:0x1b:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0001: clear the changelog for cl3 of all records lustre-MDT0001.6 10OPEN 22:02:44.937832967 2026.05.20 0x242 t=[0x240000bd3:0x1b:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.204.31@tcp m=-w- p=[0x200000bd2:0x7c:0x0] lustre-MDT0001.7 13TRUNC 22:02:44.964659118 2026.05.20 0xe t=[0x240000bd3:0x1b:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp p=[0x240000bd3:0x1a:0x0] lustre-MDT0001.8 11CLOSE 22:02:44.996198300 2026.05.20 0x242 t=[0x240000bd3:0x1b:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0001.8 11CLOSE 22:02:44.996198300 2026.05.20 0x242 t=[0x240000bd3:0x1b:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp mdd.lustre-MDT0000.changelog_mask=-OPEN mdd.lustre-MDT0001.changelog_mask=-OPEN lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0001: clear the changelog for cl3 of all records f lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0001: clear the changelog for cl3 of all records lustre-MDT0001.9 13TRUNC 22:02:47.606315048 2026.05.20 0xe t=[0x240000bd3:0x1b:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp p=[0x240000bd3:0x1a:0x0] lustre-MDT0001.10 11CLOSE 22:02:47.628711242 2026.05.20 0x242 t=[0x240000bd3:0x1b:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0001.10 11CLOSE 22:02:47.628711242 2026.05.20 0x242 t=[0x240000bd3:0x1b:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0001: clear the changelog for cl3 of all records lustre-MDT0001: Deregistered changelog user #3 lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000: Deregistered changelog user #3 PASS 602 (21s) == sanity-hsm test 603: GETXATTR Changelog entry ========= 18:02:59 (1779314579) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl4 cl4' mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0001: clear the changelog for cl4 of all records getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/d603.sanity-hsm/f603.sanity-hsm user.xattr1="value1" lustre-MDT0001.16 23GXATR 22:03:08.085281955 2026.05.20 0x0 t=[0x240000bd3:0x1d:0x0] j=getfattr.0 ef=0x1b u=0:0 nid=192.168.204.31@tcp x=user.xattr1 lustre-MDT0001: clear the changelog for cl4 of all records lustre-MDT0001: Deregistered changelog user #4 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 PASS 603 (19s) == sanity-hsm test 604: NOPEN Changelog entry ============ 18:03:18 (1779314598) mdd.lustre-MDT0000.changelog_deniednext=20 mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl5 cl5' mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0001: clear the changelog for cl5 of all records running as uid/gid/euid/egid 500/500/500/500, groups: 500 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm] cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied lustre-MDT0000.14 24NOPEN 22:03:27.940078682 2026.05.20 0x1 t=[0x2000032e2:0x1e:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.204.31@tcp m=r-- p=[0x2000032e2:0x1d:0x0] Got NID '192.168.204.31@tcp' lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0001: clear the changelog for cl5 of all records running as uid/gid/euid/egid 500/500/500/500, groups: 500 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm] cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0001: clear the changelog for cl5 of all records running as uid/gid/euid/egid 500/500/500/500, groups: 500 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm] cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied lustre-MDT0000.15 24NOPEN 22:03:49.135586761 2026.05.20 0x1 t=[0x2000032e2:0x1e:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.204.31@tcp m=r-- p=[0x200000bd2:0x7c:0x0] Got NID '192.168.204.31@tcp' lustre-MDT0001: clear the changelog for cl5 of all records lustre-MDT0001: Deregistered changelog user #5 lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0000: Deregistered changelog user #5 mdd.lustre-MDT0000.changelog_deniednext=60 PASS 604 (42s) == sanity-hsm test 605: Test OPEN and CLOSE rate limit in Changelogs ========================================================== 18:04:00 (1779314640) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl6 cl6' mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0001: clear the changelog for cl6 of all records lustre-MDT0000.19 10OPEN 22:04:07.672027767 2026.05.20 0x43 t=[0x2000032e2:0x20:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.204.31@tcp m=rw- lustre-MDT0000.19 10OPEN 22:04:07.672027767 2026.05.20 0x43 t=[0x2000032e2:0x20:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.204.31@tcp m=rw- lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0001: clear the changelog for cl6 of all records lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0001: clear the changelog for cl6 of all records lustre-MDT0000.20 10OPEN 22:04:08.746624614 2026.05.20 0x1 t=[0x2000032e2:0x20:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.204.31@tcp m=r-- p=[0x200000bd2:0x86:0x0] lustre-MDT0000.21 11CLOSE 22:04:08.766640384 2026.05.20 0x1 t=[0x2000032e2:0x20:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0000.20 10OPEN 22:04:08.746624614 2026.05.20 0x1 t=[0x2000032e2:0x20:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.204.31@tcp m=r-- p=[0x200000bd2:0x86:0x0] lustre-MDT0000.21 11CLOSE 22:04:08.766640384 2026.05.20 0x1 t=[0x2000032e2:0x20:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0001: clear the changelog for cl6 of all records lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0001: clear the changelog for cl6 of all records running as uid/gid/euid/egid 500/500/500/500, groups: 500 [cat] [/mnt/lustre/d605.sanity-hsm/f605.sanity-hsm] lustre-MDT0000.22 10OPEN 22:04:10.125146707 2026.05.20 0x1 t=[0x2000032e2:0x20:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.204.31@tcp m=r-- lustre-MDT0000.23 11CLOSE 22:04:10.137828899 2026.05.20 0x1 t=[0x2000032e2:0x20:0x0] j=cat.500 ef=0x13 u=500:500 nid=192.168.204.31@tcp lustre-MDT0000.22 10OPEN 22:04:10.125146707 2026.05.20 0x1 t=[0x2000032e2:0x20:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.204.31@tcp m=r-- lustre-MDT0000.23 11CLOSE 22:04:10.137828899 2026.05.20 0x1 t=[0x2000032e2:0x20:0x0] j=cat.500 ef=0x13 u=500:500 nid=192.168.204.31@tcp lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0001: clear the changelog for cl6 of all records lustre-MDT0000.24 11CLOSE 22:04:10.968202080 2026.05.20 0x43 t=[0x2000032e2:0x20:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0000.24 11CLOSE 22:04:10.968202080 2026.05.20 0x43 t=[0x2000032e2:0x20:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.204.31@tcp lustre-MDT0001: clear the changelog for cl6 of all records lustre-MDT0001: Deregistered changelog user #6 lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000: Deregistered changelog user #6 PASS 605 (20s) == sanity-hsm test 606: llog_reader groks changelog fields ========================================================== 18:04:20 (1779314660) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl7 cl7' mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d606.sanity-hsm/f606.sanity-hsm] Stopping /mnt/lustre-mds1 (opts:) on oleg431-server rec #2 type=1064553b len=64 offset 8256 Header size : 8192 llh_size : 64 Time : Wed May 20 17:36:39 2026 Number of records: 1 cat_idx: 0 last_idx: 2 Flags: 0x2012 Target uuid : ----------------------- #02 (064)fid=[0x1:0x3a:0x0] path=oi.1/0x1:0x3a:0x0 Got UID/GID 500:500 Got NID 192.168.204.31@tcp Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg431-server: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg431-client: oleg431-server: ssh exited with exit code 1 Started lustre-MDT0000 lustre-MDT0001: clear the changelog for cl7 of all records lustre-MDT0001: Deregistered changelog user #7 lustre-MDT0000: clear the changelog for cl7 of all records lustre-MDT0000: Deregistered changelog user #7 PASS 606 (65s) == sanity-hsm test 607a: release file migrated after archive (non-blocking migrate) ========================================================== 18:05:26 (1779314726) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.434236 s, 2.4 MB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 607a (13s) == sanity-hsm test 607b: Migrate should not change the HSM attribute of dirty files ========================================================== 18:05:39 (1779314739) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.343925 s, 3.0 MB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' llite.lustre-ffff8aa7c8977000.xattr_cache=0 llite.lustre-ffff8aa7c8f8c800.xattr_cache=0 /mnt/lustre/d607b.sanity-hsm/f607b.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:1 llite.lustre-ffff8aa7c8977000.xattr_cache=1 llite.lustre-ffff8aa7c8f8c800.xattr_cache=1 PASS 607b (13s) == sanity-hsm test 607c: 'lfs swap_layouts' should set dirty flag on HSM file ========================================================== 18:05:52 (1779314752) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.333154 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.375798 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.302627 s, 3.5 MB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' lfs swap_layouts: error: cannot swap layout between '/mnt/lustre/d607c.sanity-hsm/f607c.sanity-hsm-1' and '/mnt/lustre/d607c.sanity-hsm/f607c.sanity-hsm-3': Operation not permitted (1) PASS 607c (15s) == sanity-hsm test 607d: Migrate should not set HSM dirty flag for an empty file ========================================================== 18:06:07 (1779314767) 0+0 records in 0+0 records out 0 bytes copied, 0.00370907 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 607d (14s) == sanity-hsm test 607e: release file migrated after archive (blocking migrate) ========================================================== 18:06:21 (1779314781) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.549868 s, 1.9 MB/s Starting copytool 'agt1' on 'oleg431-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 607e (15s) == sanity-hsm test complete, duration 4448 sec =========== 18:06:36 (1779314796) === sanity-hsm: start cleanup 18:06:38 (1779314798) === Stopping clients: oleg431-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg431-client.virtnet /mnt/lustre2 opts: === sanity-hsm: finish cleanup 18:07:24 (1779314844) ===