-----============= acceptance-small: sanity-hsm ============----- Mon Mar  2 12:10:52 EST 2026
mgs: Rocky Linux release 8.10 (Green Obsidian)
MGS_OS_ID_LIKE=rhel centos fedora rocky
MGS_OS_VERSION_ID=8.10
MGS_OS_ID=rocky
MGS_OS_VERSION_CODE=134873088
mds1: Rocky Linux release 8.10 (Green Obsidian)
MDS1_OS_VERSION_ID=8.10
MDS1_OS_VERSION_CODE=134873088
MDS1_OS_ID_LIKE=rhel centos fedora rocky
MDS1_OS_ID=rocky
ost1: Rocky Linux release 8.10 (Green Obsidian)
OST1_OS_VERSION_CODE=134873088
OST1_OS_ID_LIKE=rhel centos fedora rocky
OST1_OS_VERSION_ID=8.10
OST1_OS_ID=rocky
client: Rocky Linux release 8.10 (Green Obsidian)
CLIENT_OS_ID=rocky
CLIENT_OS_VERSION_CODE=134873088
CLIENT_OS_VERSION_ID=8.10
CLIENT_OS_ID_LIKE=rhel centos fedora rocky
oleg205-server: /home/green/git/lustre-release/lustre/tests/except/sanity-hsm.ex
- see MDS1_VERSION <= CLIENT_VERSION (34681540 <= 34681540) for LU-18924, go 100 105
excepting tests: 
=== sanity-hsm: start setup 12:11:17 (1772471477) ===
Starting client oleg205-client.virtnet:  -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2
Mount client oleg205-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2
Started clients oleg205-client.virtnet: 
192.168.202.105@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
oleg205-client.virtnet: executing check_config_client /mnt/lustre
oleg205-client.virtnet: Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients oleg205-client.virtnet environments
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff945548485800.idle_timeout=debug
osc.lustre-OST0000-osc-ffff945558575800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff945548485800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff945558575800.idle_timeout=debug
disable quota as required
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
=== sanity-hsm: finish setup 12:11:55 (1772471515) ===
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [true]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d0_runas_test/f7584]
nobody:x:65534:
Killing existing copytools on oleg205-client.virtnet
pkill: pidfile not valid
Try `pkill --help' for more information.
Set HSM on and start
Set sanity-hsm HSM policy

== sanity-hsm test 1A: lfs hsm flags root/non-root access ========================================================== 12:12:24 (1772471544)
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_set] [--norelease] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_clear] [--norelease] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_set] [--exists] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
lfs hsm_set: change hsm flags for '/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm' failed: Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
PASS 1A (9s)

== sanity-hsm test 1a: mmap & cat a HSM released file ==== 12:12:33 (1772471553)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.244419 s, 4.3 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Verifying released state: PASS 1a (11s)

== sanity-hsm test 1b: Archive, Release and Restore composite file ========================================================== 12:12:44 (1772471564)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0574932 s, 18.2 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
archive /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
release /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm
verify released state: 
pass
restore /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
verify restored state: 
pass
PASS 1b (16s)

== sanity-hsm test 1c: Check setting archive-id in lfs hsm_set ========================================================== 12:13:01 (1772471581)
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm]
verifying archive number is 32
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm]
verifying archive number is still 32
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm]
verifying archive number is 33
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm]
verifying archive number is 16
PASS 1c (9s)

== sanity-hsm test 1d: Archive, Release and Restore DoM file ========================================================== 12:13:10 (1772471590)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342863 s, 30.6 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
archive /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm
release /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm
verify released state: 
pass
restore /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm
verify restored state: 
pass
PASS 1d (10s)

== sanity-hsm test 1e: Archive, Release and Restore SEL file ========================================================== 12:13:20 (1772471600)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0648631 s, 16.2 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
archive /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm
release /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm
verify released state: 
pass
restore /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
verify restored state: 
pass
PASS 1e (14s)

== sanity-hsm test 1f: DoM file release after restore ==== 12:13:34 (1772471614)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0991704 s, 10.6 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
archive /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
release /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm
verify released state: 
pass
restore /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
verify restored state: 
pass
release again /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm
/mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm: (0x0000000d) released exists archived, archive_id:1
verify released state: 
pass
PASS 1f (16s)

== sanity-hsm test 2: Check file dirtyness when doing setattr ========================================================== 12:13:50 (1772471630)
0+0 records in
0+0 records out
0 bytes copied, 0.012383 s, 0.0 kB/s
0x200000402:0x9:0x0
PASS 2 (8s)

== sanity-hsm test 3: Check file dirtyness when opening for write ========================================================== 12:13:58 (1772471638)
Succeed in opening file "/mnt/lustre/d3.sanity-hsm/f3.sanity-hsm"(flags=O_WRONLY)
3+0 records in
3+0 records out
3+0 records in
3+0 records out
PASS 3 (10s)

== sanity-hsm test 4: Useless cancel must not be registered ========================================================== 12:14:09 (1772471649)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.259058 s, 4.0 MB/s
PASS 4 (9s)

== sanity-hsm test 8: Test default archive number ======== 12:14:18 (1772471658)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_8/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 8 (9s)

== sanity-hsm test 9A: Use of explicit archive number, with dedicated copytool ========================================================== 12:14:27 (1772471667)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_9A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 3  "/mnt/lustre2"'
oleg205-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg205-client.virtnet: executing get_client_uuid /mnt/lustre2
found agent uuid=c269473a-0d4b-490c-8965-e5ab530a0043 archive_id=3 requests=[current:0 ok:0 errors:0] on mds1
PASS 9A (22s)

== sanity-hsm test 9a: Multiple remote agents ============ 12:14:49 (1772471689)

 SKIP: sanity-hsm test_9a Need 3 or more clients, have 1
SKIP 9a (3s)

== sanity-hsm test 10a: Archive a file =================== 12:14:52 (1772471692)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
/home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 938: warning: command substitution: ignored null byte in input
Verifying content
Verifying hsm state 
Verifying archive number is 2
PASS 10a (11s)

== sanity-hsm test 10b: Archive of non dirty file must work without doing request ========================================================== 12:15:03 (1772471703)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
PASS 10b (12s)

== sanity-hsm test 10c: Check forbidden archive ========== 12:15:15 (1772471715)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Cannot send HSM request (use of /mnt/lustre/d10c.sanity-hsm/f10c.sanity-hsm): Operation not permitted
PASS 10c (8s)

== sanity-hsm test 10d: Archive a file on the default archive id ========================================================== 12:15:23 (1772471723)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 10d (10s)

== sanity-hsm test 11a: Import a file ==================== 12:15:33 (1772471733)
lhsmtool_posix: 1772471736.051182 [21090]: action=1 src=d11a.sanity-hsm/f11a.sanity-hsm dst=/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772471736.067098 [21090]: importing '/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11a//d11a.sanity-hsm/f11a.sanity-hsm'
lhsmtool_posix: 1772471736.175825 [21090]: imported '/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11a//042b/0x200000401:0x2a:0x0'=='/tmp/arc1/sanity-hsm.test_11a//d11a.sanity-hsm/f11a.sanity-hsm'
lhsmtool_posix: 1772471736.175887 [21090]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Verifying released state: Verifying imported size 158=158
Verifying released pattern: raid0,released
Verifying new fid 0x200000401:0x2a:0x0 in archive
PASS 11a (9s)

== sanity-hsm test 11b: Import a deleted file using its FID ========================================================== 12:15:43 (1772471743)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_11b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1772471747.493590 [21774]: action=1 src=0x200000402:0x12:0x0 dst=/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772471747.537176 [21774]: Resolving [0x200000402:0x12:0x0] to /tmp/arc1/sanity-hsm.test_11b//0410/0x200000402:0x12:0x0
lhsmtool_posix: 1772471747.537683 [21774]: importing '/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11b//0410/0x200000402:0x12:0x0'
lhsmtool_posix: 1772471747.614956 [21774]: imported '/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11b//042d/0x200000401:0x2c:0x0'=='/tmp/arc1/sanity-hsm.test_11b//0410/0x200000402:0x12:0x0'
lhsmtool_posix: 1772471747.615044 [21774]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm: OK
PASS 11b (13s)

== sanity-hsm test 11c: Import a file to a directory with a pool ========================================================== 12:15:55 (1772471755)
Creating new pool test_11c
oleg205-server: Pool lustre.test_11c created
Adding targets to pool
oleg205-server: OST lustre-OST0001_UUID added to pool lustre.test_11c
lhsmtool_posix: 1772471764.368737 [22462]: action=1 src=d11c.sanity-hsm/f11c.sanity-hsm dst=/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772471764.380744 [22462]: importing '/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11c//d11c.sanity-hsm/f11c.sanity-hsm'
lhsmtool_posix: 1772471764.452394 [22462]: imported '/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11c//042e/0x200000401:0x2f:0x0'=='/tmp/arc1/sanity-hsm.test_11c//d11c.sanity-hsm/f11c.sanity-hsm'
lhsmtool_posix: 1772471764.452451 [22462]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Destroy the created pools: test_11c
lustre.test_11c
oleg205-server: OST lustre-OST0001_UUID removed from pool lustre.test_11c
oleg205-server: Pool lustre.test_11c destroyed
PASS 11c (23s)

== sanity-hsm test 12a: Restore an imported file explicitly ========================================================== 12:16:19 (1772471779)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1772471781.900293 [23184]: action=1 src=d12a.sanity-hsm/f12a.sanity-hsm dst=/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772471781.919304 [23184]: importing '/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12a//d12a.sanity-hsm/f12a.sanity-hsm'
lhsmtool_posix: 1772471782.001632 [23184]: imported '/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12a//0433/0x200000401:0x32:0x0'=='/tmp/arc1/sanity-hsm.test_12a//d12a.sanity-hsm/f12a.sanity-hsm'
lhsmtool_posix: 1772471782.002341 [23184]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Verifying released state: 
Verifying file state: 
PASS 12a (9s)

== sanity-hsm test 12b: Restore an imported file implicitly ========================================================== 12:16:28 (1772471788)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1772471790.894171 [23883]: action=1 src=d12b.sanity-hsm/f12b.sanity-hsm dst=/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772471790.906359 [23883]: importing '/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12b//d12b.sanity-hsm/f12b.sanity-hsm'
lhsmtool_posix: 1772471790.963822 [23883]: imported '/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12b//0434/0x200000401:0x35:0x0'=='/tmp/arc1/sanity-hsm.test_12b//d12b.sanity-hsm/f12b.sanity-hsm'
lhsmtool_posix: 1772471790.964211 [23883]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Verifying released state: 
Verifying file state after restore: 
PASS 12b (9s)

== sanity-hsm test 12c: Restore a file with stripe of 2 == 12:16:37 (1772471797)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
5+0 records in
5+0 records out
5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.182654 s, 28.7 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
/mnt/lustre/d12c.sanity-hsm/f12c.sanity-hsm: OK
PASS 12c (12s)

== sanity-hsm test 12d: Restore of a non archived, non released file must work ========================================================== 12:16:49 (1772471809)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 12d (11s)

== sanity-hsm test 12e: Check forbidden restore ========== 12:17:00 (1772471820)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
/mnt/lustre/d12e.sanity-hsm/f12e.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:1
Cannot send HSM request (use of /mnt/lustre/d12e.sanity-hsm/f12e.sanity-hsm): Operation not permitted
PASS 12e (10s)

== sanity-hsm test 12f: Restore a released file explicitly ========================================================== 12:17:10 (1772471830)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Verifying file state: PASS 12f (15s)

== sanity-hsm test 12g: Restore a released file implicitly ========================================================== 12:17:25 (1772471845)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12g/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 12g (11s)

== sanity-hsm test 12h: Restore a released file implicitly from a second node ========================================================== 12:17:36 (1772471856)

 SKIP: sanity-hsm test_12h Need 2 or more clients, have 1
SKIP 12h (4s)

== sanity-hsm test 12m: Archive/release/implicit restore ========================================================== 12:17:40 (1772471860)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12m/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 12m (10s)

== sanity-hsm test 12n: Import/implicit restore/release == 12:17:50 (1772471870)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12n/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1772471874.717415 [28663]: action=1 src=d12n.sanity-hsm/f12n.sanity-hsm dst=/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772471874.732836 [28663]: importing '/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12n//d12n.sanity-hsm/f12n.sanity-hsm'
lhsmtool_posix: 1772471874.823624 [28663]: imported '/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12n//0445/0x200000401:0x44:0x0'=='/tmp/arc1/sanity-hsm.test_12n//d12n.sanity-hsm/f12n.sanity-hsm'
lhsmtool_posix: 1772471874.831902 [28663]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
PASS 12n (12s)

== sanity-hsm test 12o: Layout-swap failure during Restore leaves file released ========================================================== 12:18:02 (1772471882)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12o/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
fail_loc=0x152
mdt.lustre-MDT0000.hsm.policy=+NRA
diff: /mnt/lustre/d12o.sanity-hsm/f12o.sanity-hsm: No data available
mdt.lustre-MDT0000.hsm.policy=-NRA
fail_loc=0
mdt.lustre-MDT0000.hsm_control=purge
PASS 12o (32s)

== sanity-hsm test 12p: implicit restore of a file on copytool mount point ========================================================== 12:18:34 (1772471914)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12p/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 12p (11s)

== sanity-hsm test 12q: file attributes are refreshed after restore ========================================================== 12:18:45 (1772471925)
Starting client: oleg205-client.virtnet:  -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre3
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12q/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre3"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.423454 s, 2.5 MB/s
Killing existing copytools on oleg205-client.virtnet
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12q/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre3"'
Stopping client oleg205-client.virtnet /mnt/lustre3 (opts:)
PASS 12q (19s)

== sanity-hsm test 12r: lseek restores released file ===== 12:19:04 (1772471944)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12r/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
PASS 12r (13s)

== sanity-hsm test 12s: race between restore requests ==== 12:19:17 (1772471957)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12s/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
fail_loc=0x8000018b
PASS 12s (17s)

== sanity-hsm test 12t: Multiple parallel reads for a HSM imported file ========================================================== 12:19:34 (1772471974)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12t/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
lhsmtool_posix: 1772471980.563904 [32736]: action=1 src=0x200000402:0x2c:0x0 dst=/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772471980.572127 [32736]: Resolving [0x200000402:0x2c:0x0] to /tmp/arc1/sanity-hsm.test_12t//042e/0x200000402:0x2c:0x0
lhsmtool_posix: 1772471980.572537 [32736]: importing '/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12t//042e/0x200000402:0x2c:0x0'
lhsmtool_posix: 1772471980.612956 [32736]: imported '/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12t//0453/0x200000401:0x52:0x0'=='/tmp/arc1/sanity-hsm.test_12t//042e/0x200000402:0x2c:0x0'
lhsmtool_posix: 1772471980.613028 [32736]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
PASS 12t (13s)

== sanity-hsm test 12u: Multiple reads on multiple HSM imported files in parallel ========================================================== 12:19:47 (1772471987)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12u/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1772472001.282426 [33601]: action=1 src=0x200000402:0x2e:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0 mount_point=/mnt/lustre2
lhsmtool_posix: 1772472001.290286 [33601]: Resolving [0x200000402:0x2e:0x0] to /tmp/arc1/sanity-hsm.test_12u//042c/0x200000402:0x2e:0x0
lhsmtool_posix: 1772472001.290377 [33601]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0' from '/tmp/arc1/sanity-hsm.test_12u//042c/0x200000402:0x2e:0x0'
lhsmtool_posix: 1772472001.334712 [33601]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0' from '/tmp/arc1/sanity-hsm.test_12u//0455/0x200000401:0x54:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042c/0x200000402:0x2e:0x0'
lhsmtool_posix: 1772472001.335744 [33601]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1772472001.585716 [33630]: action=1 src=0x200000402:0x2f:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1 mount_point=/mnt/lustre2
lhsmtool_posix: 1772472001.591574 [33630]: Resolving [0x200000402:0x2f:0x0] to /tmp/arc1/sanity-hsm.test_12u//042d/0x200000402:0x2f:0x0
lhsmtool_posix: 1772472001.591647 [33630]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1' from '/tmp/arc1/sanity-hsm.test_12u//042d/0x200000402:0x2f:0x0'
lhsmtool_posix: 1772472001.630476 [33630]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1' from '/tmp/arc1/sanity-hsm.test_12u//0454/0x200000401:0x55:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042d/0x200000402:0x2f:0x0'
lhsmtool_posix: 1772472001.632430 [33630]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1772472001.942953 [33660]: action=1 src=0x200000402:0x30:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2 mount_point=/mnt/lustre2
lhsmtool_posix: 1772472001.951634 [33660]: Resolving [0x200000402:0x30:0x0] to /tmp/arc1/sanity-hsm.test_12u//0432/0x200000402:0x30:0x0
lhsmtool_posix: 1772472001.951791 [33660]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2' from '/tmp/arc1/sanity-hsm.test_12u//0432/0x200000402:0x30:0x0'
lhsmtool_posix: 1772472002.003953 [33660]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2' from '/tmp/arc1/sanity-hsm.test_12u//0457/0x200000401:0x56:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0432/0x200000402:0x30:0x0'
lhsmtool_posix: 1772472002.004805 [33660]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1772472002.286899 [33689]: action=1 src=0x200000402:0x31:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3 mount_point=/mnt/lustre2
lhsmtool_posix: 1772472002.309063 [33689]: Resolving [0x200000402:0x31:0x0] to /tmp/arc1/sanity-hsm.test_12u//0433/0x200000402:0x31:0x0
lhsmtool_posix: 1772472002.310838 [33689]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3' from '/tmp/arc1/sanity-hsm.test_12u//0433/0x200000402:0x31:0x0'
lhsmtool_posix: 1772472002.387241 [33689]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3' from '/tmp/arc1/sanity-hsm.test_12u//0456/0x200000401:0x57:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0433/0x200000402:0x31:0x0'
lhsmtool_posix: 1772472002.387306 [33689]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1772472002.696671 [33718]: action=1 src=0x200000402:0x32:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4 mount_point=/mnt/lustre2
lhsmtool_posix: 1772472002.709221 [33718]: Resolving [0x200000402:0x32:0x0] to /tmp/arc1/sanity-hsm.test_12u//0430/0x200000402:0x32:0x0
lhsmtool_posix: 1772472002.709605 [33718]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4' from '/tmp/arc1/sanity-hsm.test_12u//0430/0x200000402:0x32:0x0'
lhsmtool_posix: 1772472002.747659 [33718]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4' from '/tmp/arc1/sanity-hsm.test_12u//0459/0x200000401:0x58:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0430/0x200000402:0x32:0x0'
lhsmtool_posix: 1772472002.747724 [33718]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1772472002.989266 [33747]: action=1 src=0x200000402:0x33:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5 mount_point=/mnt/lustre2
lhsmtool_posix: 1772472002.999453 [33747]: Resolving [0x200000402:0x33:0x0] to /tmp/arc1/sanity-hsm.test_12u//0431/0x200000402:0x33:0x0
lhsmtool_posix: 1772472002.999905 [33747]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5' from '/tmp/arc1/sanity-hsm.test_12u//0431/0x200000402:0x33:0x0'
lhsmtool_posix: 1772472003.055934 [33747]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5' from '/tmp/arc1/sanity-hsm.test_12u//0458/0x200000401:0x59:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0431/0x200000402:0x33:0x0'
lhsmtool_posix: 1772472003.056683 [33747]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1772472003.318599 [33776]: action=1 src=0x200000402:0x34:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6 mount_point=/mnt/lustre2
lhsmtool_posix: 1772472003.323581 [33776]: Resolving [0x200000402:0x34:0x0] to /tmp/arc1/sanity-hsm.test_12u//0436/0x200000402:0x34:0x0
lhsmtool_posix: 1772472003.323674 [33776]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6' from '/tmp/arc1/sanity-hsm.test_12u//0436/0x200000402:0x34:0x0'
lhsmtool_posix: 1772472003.368473 [33776]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6' from '/tmp/arc1/sanity-hsm.test_12u//045b/0x200000401:0x5a:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0436/0x200000402:0x34:0x0'
lhsmtool_posix: 1772472003.368535 [33776]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1772472003.805878 [33805]: action=1 src=0x200000402:0x35:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7 mount_point=/mnt/lustre2
lhsmtool_posix: 1772472003.820856 [33805]: Resolving [0x200000402:0x35:0x0] to /tmp/arc1/sanity-hsm.test_12u//0437/0x200000402:0x35:0x0
lhsmtool_posix: 1772472003.820941 [33805]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7' from '/tmp/arc1/sanity-hsm.test_12u//0437/0x200000402:0x35:0x0'
lhsmtool_posix: 1772472003.922136 [33805]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7' from '/tmp/arc1/sanity-hsm.test_12u//045a/0x200000401:0x5b:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0437/0x200000402:0x35:0x0'
lhsmtool_posix: 1772472003.922464 [33805]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1772472004.283343 [33834]: action=1 src=0x200000402:0x36:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8 mount_point=/mnt/lustre2
lhsmtool_posix: 1772472004.294538 [33834]: Resolving [0x200000402:0x36:0x0] to /tmp/arc1/sanity-hsm.test_12u//0434/0x200000402:0x36:0x0
lhsmtool_posix: 1772472004.294959 [33834]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8' from '/tmp/arc1/sanity-hsm.test_12u//0434/0x200000402:0x36:0x0'
lhsmtool_posix: 1772472004.346568 [33834]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8' from '/tmp/arc1/sanity-hsm.test_12u//045d/0x200000401:0x5c:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0434/0x200000402:0x36:0x0'
lhsmtool_posix: 1772472004.346640 [33834]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1772472004.640321 [33863]: action=1 src=0x200000402:0x37:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9 mount_point=/mnt/lustre2
lhsmtool_posix: 1772472004.662333 [33863]: Resolving [0x200000402:0x37:0x0] to /tmp/arc1/sanity-hsm.test_12u//0435/0x200000402:0x37:0x0
lhsmtool_posix: 1772472004.662452 [33863]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9' from '/tmp/arc1/sanity-hsm.test_12u//0435/0x200000402:0x37:0x0'
lhsmtool_posix: 1772472004.761270 [33863]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9' from '/tmp/arc1/sanity-hsm.test_12u//045c/0x200000401:0x5d:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0435/0x200000402:0x37:0x0'
lhsmtool_posix: 1772472004.761684 [33863]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
PASS 12u (29s)

== sanity-hsm test 13: Recursively import and restore a directory ========================================================== 12:20:16 (1772472016)
lhsmtool_posix: 1772472025.934505 [35605]: action=1 src=subdir dst=/mnt/lustre/d13.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772472026.009285 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.10'
lhsmtool_posix: 1772472026.075505 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.10' from '/tmp/arc1/sanity-hsm.test_13//0460/0x200000401:0x61:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.10'
lhsmtool_posix: 1772472026.076563 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.9'
lhsmtool_posix: 1772472026.118726 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.9' from '/tmp/arc1/sanity-hsm.test_13//0463/0x200000401:0x62:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.9'
lhsmtool_posix: 1772472026.120231 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.8'
lhsmtool_posix: 1772472026.157530 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.8' from '/tmp/arc1/sanity-hsm.test_13//0462/0x200000401:0x63:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.8'
lhsmtool_posix: 1772472026.157726 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.7'
lhsmtool_posix: 1772472026.212507 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.7' from '/tmp/arc1/sanity-hsm.test_13//0465/0x200000401:0x64:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.7'
lhsmtool_posix: 1772472026.213506 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.6'
lhsmtool_posix: 1772472026.263244 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.6' from '/tmp/arc1/sanity-hsm.test_13//0464/0x200000401:0x65:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.6'
lhsmtool_posix: 1772472026.263734 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.5'
lhsmtool_posix: 1772472026.302399 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.5' from '/tmp/arc1/sanity-hsm.test_13//0467/0x200000401:0x66:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.5'
lhsmtool_posix: 1772472026.302608 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.4'
lhsmtool_posix: 1772472026.348209 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.4' from '/tmp/arc1/sanity-hsm.test_13//0466/0x200000401:0x67:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.4'
lhsmtool_posix: 1772472026.348412 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.3'
lhsmtool_posix: 1772472026.388341 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.3' from '/tmp/arc1/sanity-hsm.test_13//0469/0x200000401:0x68:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.3'
lhsmtool_posix: 1772472026.388898 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.2'
lhsmtool_posix: 1772472026.438181 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.2' from '/tmp/arc1/sanity-hsm.test_13//0468/0x200000401:0x69:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.2'
lhsmtool_posix: 1772472026.439376 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.1'
lhsmtool_posix: 1772472026.475429 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.1' from '/tmp/arc1/sanity-hsm.test_13//046b/0x200000401:0x6a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.1'
lhsmtool_posix: 1772472026.480935 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.10'
lhsmtool_posix: 1772472026.523227 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.10' from '/tmp/arc1/sanity-hsm.test_13//046d/0x200000401:0x6c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.10'
lhsmtool_posix: 1772472026.523420 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.9'
lhsmtool_posix: 1772472026.553905 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.9' from '/tmp/arc1/sanity-hsm.test_13//046c/0x200000401:0x6d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.9'
lhsmtool_posix: 1772472026.554123 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.8'
lhsmtool_posix: 1772472026.584266 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.8' from '/tmp/arc1/sanity-hsm.test_13//046f/0x200000401:0x6e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.8'
lhsmtool_posix: 1772472026.584476 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.7'
lhsmtool_posix: 1772472026.616727 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.7' from '/tmp/arc1/sanity-hsm.test_13//046e/0x200000401:0x6f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.7'
lhsmtool_posix: 1772472026.618718 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.6'
lhsmtool_posix: 1772472026.647708 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.6' from '/tmp/arc1/sanity-hsm.test_13//0471/0x200000401:0x70:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.6'
lhsmtool_posix: 1772472026.648271 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.5'
lhsmtool_posix: 1772472026.688738 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.5' from '/tmp/arc1/sanity-hsm.test_13//0470/0x200000401:0x71:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.5'
lhsmtool_posix: 1772472026.689227 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.4'
lhsmtool_posix: 1772472026.720434 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.4' from '/tmp/arc1/sanity-hsm.test_13//0473/0x200000401:0x72:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.4'
lhsmtool_posix: 1772472026.720623 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.3'
lhsmtool_posix: 1772472026.759621 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.3' from '/tmp/arc1/sanity-hsm.test_13//0472/0x200000401:0x73:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.3'
lhsmtool_posix: 1772472026.761856 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.2'
lhsmtool_posix: 1772472026.810161 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.2' from '/tmp/arc1/sanity-hsm.test_13//0475/0x200000401:0x74:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.2'
lhsmtool_posix: 1772472026.810374 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.1'
lhsmtool_posix: 1772472026.844342 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.1' from '/tmp/arc1/sanity-hsm.test_13//0474/0x200000401:0x75:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.1'
lhsmtool_posix: 1772472026.849489 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.10'
lhsmtool_posix: 1772472026.895241 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.10' from '/tmp/arc1/sanity-hsm.test_13//0476/0x200000401:0x77:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.10'
lhsmtool_posix: 1772472026.895753 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.9'
lhsmtool_posix: 1772472026.936649 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.9' from '/tmp/arc1/sanity-hsm.test_13//0479/0x200000401:0x78:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.9'
lhsmtool_posix: 1772472026.937350 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.8'
lhsmtool_posix: 1772472026.980270 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.8' from '/tmp/arc1/sanity-hsm.test_13//0478/0x200000401:0x79:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.8'
lhsmtool_posix: 1772472026.980478 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.7'
lhsmtool_posix: 1772472027.020626 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.7' from '/tmp/arc1/sanity-hsm.test_13//047b/0x200000401:0x7a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.7'
lhsmtool_posix: 1772472027.020958 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.6'
lhsmtool_posix: 1772472027.069534 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.6' from '/tmp/arc1/sanity-hsm.test_13//047a/0x200000401:0x7b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.6'
lhsmtool_posix: 1772472027.070577 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.5'
lhsmtool_posix: 1772472027.118434 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.5' from '/tmp/arc1/sanity-hsm.test_13//047d/0x200000401:0x7c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.5'
lhsmtool_posix: 1772472027.119003 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.4'
lhsmtool_posix: 1772472027.161460 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.4' from '/tmp/arc1/sanity-hsm.test_13//047c/0x200000401:0x7d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.4'
lhsmtool_posix: 1772472027.162986 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.3'
lhsmtool_posix: 1772472027.207689 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.3' from '/tmp/arc1/sanity-hsm.test_13//047f/0x200000401:0x7e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.3'
lhsmtool_posix: 1772472027.208660 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.2'
lhsmtool_posix: 1772472027.250530 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.2' from '/tmp/arc1/sanity-hsm.test_13//047e/0x200000401:0x7f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.2'
lhsmtool_posix: 1772472027.252560 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.1'
lhsmtool_posix: 1772472027.300481 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.1' from '/tmp/arc1/sanity-hsm.test_13//0481/0x200000401:0x80:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.1'
lhsmtool_posix: 1772472027.308912 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.10'
lhsmtool_posix: 1772472027.360354 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.10' from '/tmp/arc1/sanity-hsm.test_13//0483/0x200000401:0x82:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.10'
lhsmtool_posix: 1772472027.361398 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.9'
lhsmtool_posix: 1772472027.404622 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.9' from '/tmp/arc1/sanity-hsm.test_13//0482/0x200000401:0x83:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.9'
lhsmtool_posix: 1772472027.406034 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.8'
lhsmtool_posix: 1772472027.450323 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.8' from '/tmp/arc1/sanity-hsm.test_13//0485/0x200000401:0x84:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.8'
lhsmtool_posix: 1772472027.450541 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.7'
lhsmtool_posix: 1772472027.495644 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.7' from '/tmp/arc1/sanity-hsm.test_13//0484/0x200000401:0x85:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.7'
lhsmtool_posix: 1772472027.496531 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.6'
lhsmtool_posix: 1772472027.537741 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.6' from '/tmp/arc1/sanity-hsm.test_13//0487/0x200000401:0x86:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.6'
lhsmtool_posix: 1772472027.538380 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.5'
lhsmtool_posix: 1772472027.584411 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.5' from '/tmp/arc1/sanity-hsm.test_13//0486/0x200000401:0x87:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.5'
lhsmtool_posix: 1772472027.584968 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.4'
lhsmtool_posix: 1772472027.625369 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.4' from '/tmp/arc1/sanity-hsm.test_13//0489/0x200000401:0x88:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.4'
lhsmtool_posix: 1772472027.625586 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.3'
lhsmtool_posix: 1772472027.684215 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.3' from '/tmp/arc1/sanity-hsm.test_13//0488/0x200000401:0x89:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.3'
lhsmtool_posix: 1772472027.684424 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.2'
lhsmtool_posix: 1772472027.728274 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.2' from '/tmp/arc1/sanity-hsm.test_13//048b/0x200000401:0x8a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.2'
lhsmtool_posix: 1772472027.728503 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.1'
lhsmtool_posix: 1772472027.776272 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.1' from '/tmp/arc1/sanity-hsm.test_13//048a/0x200000401:0x8b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.1'
lhsmtool_posix: 1772472027.784572 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.10'
lhsmtool_posix: 1772472027.833628 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.10' from '/tmp/arc1/sanity-hsm.test_13//048c/0x200000401:0x8d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.10'
lhsmtool_posix: 1772472027.834358 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.9'
lhsmtool_posix: 1772472027.886536 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.9' from '/tmp/arc1/sanity-hsm.test_13//048f/0x200000401:0x8e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.9'
lhsmtool_posix: 1772472027.887639 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.8'
lhsmtool_posix: 1772472027.934466 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.8' from '/tmp/arc1/sanity-hsm.test_13//048e/0x200000401:0x8f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.8'
lhsmtool_posix: 1772472027.935548 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.7'
lhsmtool_posix: 1772472027.990589 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.7' from '/tmp/arc1/sanity-hsm.test_13//0491/0x200000401:0x90:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.7'
lhsmtool_posix: 1772472027.991623 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.6'
lhsmtool_posix: 1772472028.041101 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.6' from '/tmp/arc1/sanity-hsm.test_13//0490/0x200000401:0x91:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.6'
lhsmtool_posix: 1772472028.041349 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.5'
lhsmtool_posix: 1772472028.086255 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.5' from '/tmp/arc1/sanity-hsm.test_13//0493/0x200000401:0x92:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.5'
lhsmtool_posix: 1772472028.086461 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.4'
lhsmtool_posix: 1772472028.137239 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.4' from '/tmp/arc1/sanity-hsm.test_13//0492/0x200000401:0x93:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.4'
lhsmtool_posix: 1772472028.138711 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.3'
lhsmtool_posix: 1772472028.181666 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.3' from '/tmp/arc1/sanity-hsm.test_13//0495/0x200000401:0x94:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.3'
lhsmtool_posix: 1772472028.182007 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.2'
lhsmtool_posix: 1772472028.230685 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.2' from '/tmp/arc1/sanity-hsm.test_13//0494/0x200000401:0x95:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.2'
lhsmtool_posix: 1772472028.230968 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.1'
lhsmtool_posix: 1772472028.275637 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.1' from '/tmp/arc1/sanity-hsm.test_13//0497/0x200000401:0x96:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.1'
lhsmtool_posix: 1772472028.287137 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.10'
lhsmtool_posix: 1772472028.338698 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.10' from '/tmp/arc1/sanity-hsm.test_13//0499/0x200000401:0x98:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.10'
lhsmtool_posix: 1772472028.338980 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.9'
lhsmtool_posix: 1772472028.380250 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.9' from '/tmp/arc1/sanity-hsm.test_13//0498/0x200000401:0x99:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.9'
lhsmtool_posix: 1772472028.380447 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.8'
lhsmtool_posix: 1772472028.431648 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.8' from '/tmp/arc1/sanity-hsm.test_13//049b/0x200000401:0x9a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.8'
lhsmtool_posix: 1772472028.431915 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.7'
lhsmtool_posix: 1772472028.477209 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.7' from '/tmp/arc1/sanity-hsm.test_13//049a/0x200000401:0x9b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.7'
lhsmtool_posix: 1772472028.477424 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.6'
lhsmtool_posix: 1772472028.525152 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.6' from '/tmp/arc1/sanity-hsm.test_13//049d/0x200000401:0x9c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.6'
lhsmtool_posix: 1772472028.525359 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.5'
lhsmtool_posix: 1772472028.565620 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.5' from '/tmp/arc1/sanity-hsm.test_13//049c/0x200000401:0x9d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.5'
lhsmtool_posix: 1772472028.566589 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.4'
lhsmtool_posix: 1772472028.610600 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.4' from '/tmp/arc1/sanity-hsm.test_13//049f/0x200000401:0x9e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.4'
lhsmtool_posix: 1772472028.611287 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.3'
lhsmtool_posix: 1772472028.654315 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.3' from '/tmp/arc1/sanity-hsm.test_13//049e/0x200000401:0x9f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.3'
lhsmtool_posix: 1772472028.654888 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.2'
lhsmtool_posix: 1772472028.694688 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.2' from '/tmp/arc1/sanity-hsm.test_13//04a1/0x200000401:0xa0:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.2'
lhsmtool_posix: 1772472028.695657 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.1'
lhsmtool_posix: 1772472028.769657 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.1' from '/tmp/arc1/sanity-hsm.test_13//04a0/0x200000401:0xa1:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.1'
lhsmtool_posix: 1772472028.777423 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.10'
lhsmtool_posix: 1772472028.870947 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.10' from '/tmp/arc1/sanity-hsm.test_13//04a2/0x200000401:0xa3:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.10'
lhsmtool_posix: 1772472028.871199 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.9'
lhsmtool_posix: 1772472028.929215 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.9' from '/tmp/arc1/sanity-hsm.test_13//04a5/0x200000401:0xa4:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.9'
lhsmtool_posix: 1772472028.929444 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.8'
lhsmtool_posix: 1772472028.999470 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.8' from '/tmp/arc1/sanity-hsm.test_13//04a4/0x200000401:0xa5:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.8'
lhsmtool_posix: 1772472028.999691 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.7'
lhsmtool_posix: 1772472029.033878 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.7' from '/tmp/arc1/sanity-hsm.test_13//04a7/0x200000401:0xa6:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.7'
lhsmtool_posix: 1772472029.034430 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.6'
lhsmtool_posix: 1772472029.073624 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.6' from '/tmp/arc1/sanity-hsm.test_13//04a6/0x200000401:0xa7:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.6'
lhsmtool_posix: 1772472029.074561 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.5'
lhsmtool_posix: 1772472029.105990 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.5' from '/tmp/arc1/sanity-hsm.test_13//04a9/0x200000401:0xa8:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.5'
lhsmtool_posix: 1772472029.106223 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.4'
lhsmtool_posix: 1772472029.145967 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.4' from '/tmp/arc1/sanity-hsm.test_13//04a8/0x200000401:0xa9:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.4'
lhsmtool_posix: 1772472029.146305 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.3'
lhsmtool_posix: 1772472029.190440 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.3' from '/tmp/arc1/sanity-hsm.test_13//04ab/0x200000401:0xaa:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.3'
lhsmtool_posix: 1772472029.190720 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.2'
lhsmtool_posix: 1772472029.224642 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.2' from '/tmp/arc1/sanity-hsm.test_13//04aa/0x200000401:0xab:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.2'
lhsmtool_posix: 1772472029.225255 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.1'
lhsmtool_posix: 1772472029.270650 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.1' from '/tmp/arc1/sanity-hsm.test_13//04ad/0x200000401:0xac:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.1'
lhsmtool_posix: 1772472029.278705 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.10'
lhsmtool_posix: 1772472029.333633 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.10' from '/tmp/arc1/sanity-hsm.test_13//04af/0x200000401:0xae:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.10'
lhsmtool_posix: 1772472029.334374 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.9'
lhsmtool_posix: 1772472029.384567 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.9' from '/tmp/arc1/sanity-hsm.test_13//04ae/0x200000401:0xaf:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.9'
lhsmtool_posix: 1772472029.384981 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.8'
lhsmtool_posix: 1772472029.442500 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.8' from '/tmp/arc1/sanity-hsm.test_13//04b1/0x200000401:0xb0:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.8'
lhsmtool_posix: 1772472029.442732 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.7'
lhsmtool_posix: 1772472029.489675 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.7' from '/tmp/arc1/sanity-hsm.test_13//04b0/0x200000401:0xb1:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.7'
lhsmtool_posix: 1772472029.490668 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.6'
lhsmtool_posix: 1772472029.533717 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.6' from '/tmp/arc1/sanity-hsm.test_13//04b3/0x200000401:0xb2:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.6'
lhsmtool_posix: 1772472029.533998 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.5'
lhsmtool_posix: 1772472029.573292 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.5' from '/tmp/arc1/sanity-hsm.test_13//04b2/0x200000401:0xb3:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.5'
lhsmtool_posix: 1772472029.573500 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.4'
lhsmtool_posix: 1772472029.612044 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.4' from '/tmp/arc1/sanity-hsm.test_13//04b5/0x200000401:0xb4:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.4'
lhsmtool_posix: 1772472029.612263 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.3'
lhsmtool_posix: 1772472029.653655 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.3' from '/tmp/arc1/sanity-hsm.test_13//04b4/0x200000401:0xb5:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.3'
lhsmtool_posix: 1772472029.654681 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.2'
lhsmtool_posix: 1772472029.691163 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.2' from '/tmp/arc1/sanity-hsm.test_13//04b7/0x200000401:0xb6:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.2'
lhsmtool_posix: 1772472029.691368 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.1'
lhsmtool_posix: 1772472029.729647 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.1' from '/tmp/arc1/sanity-hsm.test_13//04b6/0x200000401:0xb7:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.1'
lhsmtool_posix: 1772472029.736565 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.10'
lhsmtool_posix: 1772472029.795344 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.10' from '/tmp/arc1/sanity-hsm.test_13//04b8/0x200000401:0xb9:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.10'
lhsmtool_posix: 1772472029.795552 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.9'
lhsmtool_posix: 1772472029.881729 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.9' from '/tmp/arc1/sanity-hsm.test_13//04bb/0x200000401:0xba:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.9'
lhsmtool_posix: 1772472029.881983 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.8'
lhsmtool_posix: 1772472029.921534 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.8' from '/tmp/arc1/sanity-hsm.test_13//04ba/0x200000401:0xbb:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.8'
lhsmtool_posix: 1772472029.922445 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.7'
lhsmtool_posix: 1772472029.968359 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.7' from '/tmp/arc1/sanity-hsm.test_13//04bd/0x200000401:0xbc:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.7'
lhsmtool_posix: 1772472029.968560 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.6'
lhsmtool_posix: 1772472030.006502 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.6' from '/tmp/arc1/sanity-hsm.test_13//04bc/0x200000401:0xbd:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.6'
lhsmtool_posix: 1772472030.006714 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.5'
lhsmtool_posix: 1772472030.045835 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.5' from '/tmp/arc1/sanity-hsm.test_13//04bf/0x200000401:0xbe:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.5'
lhsmtool_posix: 1772472030.046050 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.4'
lhsmtool_posix: 1772472030.076753 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.4' from '/tmp/arc1/sanity-hsm.test_13//04be/0x200000401:0xbf:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.4'
lhsmtool_posix: 1772472030.077458 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.3'
lhsmtool_posix: 1772472030.118119 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.3' from '/tmp/arc1/sanity-hsm.test_13//04c1/0x200000401:0xc0:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.3'
lhsmtool_posix: 1772472030.118326 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.2'
lhsmtool_posix: 1772472030.154274 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.2' from '/tmp/arc1/sanity-hsm.test_13//04c0/0x200000401:0xc1:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.2'
lhsmtool_posix: 1772472030.154476 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.1'
lhsmtool_posix: 1772472030.195682 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.1' from '/tmp/arc1/sanity-hsm.test_13//04c3/0x200000401:0xc2:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.1'
lhsmtool_posix: 1772472030.200488 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.10'
lhsmtool_posix: 1772472030.243581 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.10' from '/tmp/arc1/sanity-hsm.test_13//04c5/0x200000401:0xc4:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.10'
lhsmtool_posix: 1772472030.244468 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.9'
lhsmtool_posix: 1772472030.281478 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.9' from '/tmp/arc1/sanity-hsm.test_13//04c4/0x200000401:0xc5:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.9'
lhsmtool_posix: 1772472030.281689 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.8'
lhsmtool_posix: 1772472030.320622 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.8' from '/tmp/arc1/sanity-hsm.test_13//04c7/0x200000401:0xc6:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.8'
lhsmtool_posix: 1772472030.321132 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.7'
lhsmtool_posix: 1772472030.365153 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.7' from '/tmp/arc1/sanity-hsm.test_13//04c6/0x200000401:0xc7:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.7'
lhsmtool_posix: 1772472030.366451 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.6'
lhsmtool_posix: 1772472030.408579 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.6' from '/tmp/arc1/sanity-hsm.test_13//04c9/0x200000401:0xc8:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.6'
lhsmtool_posix: 1772472030.409171 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.5'
lhsmtool_posix: 1772472030.450514 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.5' from '/tmp/arc1/sanity-hsm.test_13//04c8/0x200000401:0xc9:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.5'
lhsmtool_posix: 1772472030.451203 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.4'
lhsmtool_posix: 1772472030.488141 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.4' from '/tmp/arc1/sanity-hsm.test_13//04cb/0x200000401:0xca:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.4'
lhsmtool_posix: 1772472030.488357 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.3'
lhsmtool_posix: 1772472030.527619 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.3' from '/tmp/arc1/sanity-hsm.test_13//04ca/0x200000401:0xcb:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.3'
lhsmtool_posix: 1772472030.529032 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.2'
lhsmtool_posix: 1772472030.573647 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.2' from '/tmp/arc1/sanity-hsm.test_13//04cd/0x200000401:0xcc:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.2'
lhsmtool_posix: 1772472030.574293 [35605]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.1'
lhsmtool_posix: 1772472030.621635 [35605]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.1' from '/tmp/arc1/sanity-hsm.test_13//04cc/0x200000401:0xcd:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.1'
lhsmtool_posix: 1772472030.622366 [35605]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_13/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 13 (39s)

== sanity-hsm test 14: Rebind archived file to a new fid ========================================================== 12:20:55 (1772472055)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_14/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.223208 s, 4.7 MB/s
Waiting 200s for 'SUCCEED'
0+0 records in
0+0 records out
0 bytes copied, 0.00751377 s, 0.0 kB/s
rebind 0x200000402:0xa7:0x0 to 0x200000402:0xa8:0x0
lhsmtool_posix: 1772472061.457222 [36572]: action=2 src=0x200000402:0xa7:0x0 dst=0x200000402:0xa8:0x0 mount_point=/mnt/lustre2
lhsmtool_posix: 1772472061.459336 [36572]: rebind [0x200000402:0xa7:0x0] to [0x200000402:0xa8:0x0]
lhsmtool_posix: 1772472061.467095 [36572]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
PASS 14 (12s)

== sanity-hsm test 15: Rebind a list of files ============ 12:21:07 (1772472067)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_15/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.267555 s, 3.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.300715 s, 3.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.189968 s, 5.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.320626 s, 3.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.236336 s, 4.4 MB/s
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
0+0 records in
0+0 records out
0 bytes copied, 0.0119542 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00396351 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00677102 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00931827 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00767818 s, 0.0 kB/s
rebind list of files
lhsmtool_posix: 1772472076.384585 [37349]: action=2 src=/tmp/tmp.7584 dst=(null) mount_point=/mnt/lustre2
lhsmtool_posix: 1772472076.387937 [37349]: rebind [0x200000402:0xab:0x0] to [0x200000402:0xb0:0x0]
lhsmtool_posix: 1772472076.389569 [37349]: rebind [0x200000402:0xac:0x0] to [0x200000402:0xb1:0x0]
lhsmtool_posix: 1772472076.391480 [37349]: rebind [0x200000402:0xad:0x0] to [0x200000402:0xb2:0x0]
lhsmtool_posix: 1772472076.392088 [37349]: rebind [0x200000402:0xae:0x0] to [0x200000402:0xb3:0x0]
lhsmtool_posix: 1772472076.395899 [37349]: rebind [0x200000402:0xaf:0x0] to [0x200000402:0xb4:0x0]
lhsmtool_posix: 1772472076.397030 [37349]: 5 lines read from '/tmp/tmp.7584', 5 rebind successful
lhsmtool_posix: 1772472076.398108 [37349]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
PASS 15 (21s)

== sanity-hsm test 16: Test CT bandwith control option === 12:21:28 (1772472088)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_16/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
20+0 records in
20+0 records out
20971520 bytes (21 MB, 20 MiB) copied, 0.155716 s, 135 MB/s
Waiting 200s for 'SUCCEED'
Updated after 21s: want 'SUCCEED' got 'SUCCEED'
PASS 16 (32s)

== sanity-hsm test 20: Release is not permitted ========== 12:22:00 (1772472120)
0+0 records in
0+0 records out
0 bytes copied, 0.0291096 s, 0.0 kB/s
0x200000402:0xbc:0x0
Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted
Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted
Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted
Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted
PASS 20 (7s)

== sanity-hsm test 21: Simple release tests ============== 12:22:07 (1772472127)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_21/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161743 s, 6.5 MB/s
1+0 records in
1+0 records out
512 bytes copied, 0.0887829 s, 5.8 kB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
PASS 21 (14s)

== sanity-hsm test 22: Could not swap a release file ===== 12:22:21 (1772472141)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_22/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.232348 s, 4.5 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.194692 s, 5.4 MB/s
0x200000402:0xc1:0x0
lfs swap_layouts: error: cannot swap layout between '/mnt/lustre/d22.sanity-hsm/test_swap' and '/mnt/lustre/d22.sanity-hsm/test_release': Operation not supported (95)
PASS 22 (11s)

== sanity-hsm test 23: Release does not change a/mtime (utime) ========================================================== 12:22:32 (1772472152)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_23/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.309435 s, 3.4 MB/s
PASS 23 (10s)

== sanity-hsm test 24a: Archive, release, and restore does not change a/mtime (i/o) ========================================================== 12:22:42 (1772472162)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141959 s, 7.4 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Killing existing copytools on oleg205-client.virtnet
copytools stopped in 0s
192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg205-client.virtnet /mnt/lustre (opts:)
Starting client: oleg205-client.virtnet:  -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre
PASS 24a (20s)

== sanity-hsm test 24b: root can archive, release, and restore user files ========================================================== 12:23:02 (1772472182)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.310183 s, 3.4 MB/s
Waiting 200s for 'SUCCEED'
Updated after 3s: want 'SUCCEED' got 'SUCCEED'
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm]
/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm: (0x00000009) exists archived, archive_id:1
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [md5sum] [/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm]
PASS 24b (18s)

== sanity-hsm test 24c: check that user,group,other request masks work ========================================================== 12:23:20 (1772472200)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.21521 s, 4.9 MB/s
0x200000402:0xcc:0x0
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.162675 s, 6.4 MB/s
0x200000402:0xcd:0x0
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.239931 s, 4.4 MB/s
0x200000402:0xce:0x0
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
PASS 24c (18s)

== sanity-hsm test 24d: check that read-only mounts are respected ========================================================== 12:23:38 (1772472218)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.373123 s, 2.8 MB/s
0x200000402:0xd0:0x0
/mnt/lustre/d24d.sanity-hsm/f24d.sanity-hsm
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 1
	obdidx		 objid		 objid		 group
	     1	           106	         0x6a	   0x280000400

Starting client: oleg205-client.virtnet:  -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre3
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre3"'
Cannot send HSM request (use of /mnt/lustre2/d24d.sanity-hsm/f24d.sanity-hsm): Read-only file system
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.804934 s, 1.3 MB/s
Cannot send HSM request (use of /mnt/lustre2/d24d.sanity-hsm/f24d.sanity-hsm): Read-only file system
Stopping client oleg205-client.virtnet /mnt/lustre3 (opts:)
PASS 24d (16s)

== sanity-hsm test 24e: tar succeeds on HSM released files ========================================================== 12:23:54 (1772472234)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.228049 s, 4.6 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
/mnt/lustre/d24e.sanity-hsm/f24e.sanity-hsm: (0x0000000d) released exists archived, archive_id:1
tar: Removing leading `/' from member names
PASS 24e (13s)

== sanity-hsm test 24f: root can archive, release, and restore tar files ========================================================== 12:24:07 (1772472247)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
54fb6627dbaa37721048e4549db3224d /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
f24f.sanity-hsm
f24f.sanity-hsm
Sum0 = 54fb6627dbaa37721048e4549db3224d  /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm, sum1 = 54fb6627dbaa37721048e4549db3224d  /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm
PASS 24f (12s)

== sanity-hsm test 24g: write by non-owner still sets dirty ========================================================== 12:24:20 (1772472260)
RUNAS = 'runas -u 500 -g 500'
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24g/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Please listen carefully as our options have changed.
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [tee] [/mnt/lustre/d24g.sanity-hsm/f24g.sanity-hsm]
To be electrocuted by your telephone, press #.
PASS 24g (8s)

== sanity-hsm test 25a: Restore lost file (HS_LOST flag) from import ========================================================== 12:24:28 (1772472268)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_25a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1772472271.122462 [46247]: action=1 src=d25a.sanity-hsm/f25a.sanity-hsm dst=/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772472271.130441 [46247]: importing '/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_25a//d25a.sanity-hsm/f25a.sanity-hsm'
lhsmtool_posix: 1772472271.216463 [46247]: imported '/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_25a//0411/0x200000404:0x15:0x0'=='/tmp/arc1/sanity-hsm.test_25a//d25a.sanity-hsm/f25a.sanity-hsm'
lhsmtool_posix: 1772472271.224842 [46247]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
md5sum: /mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm: No data available
PASS 25a (8s)

== sanity-hsm test 25b: Restore lost file (HS_LOST flag) after release ========================================================== 12:24:36 (1772472276)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_25b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
md5sum: /mnt/lustre/d25b.sanity-hsm/f25b.sanity-hsm: No data available
PASS 25b (10s)

== sanity-hsm test 26A: Remove the archive of a valid file ========================================================== 12:24:46 (1772472286)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.00811205 s, 0.0 kB/s
PASS 26A (10s)

== sanity-hsm test 26a: Remove Archive On Last Unlink (RAoLU) policy ========================================================== 12:24:56 (1772472296)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 5s: want 'SUCCEED' got 'SUCCEED'
PASS 26a (28s)

== sanity-hsm test 26b: RAoLU policy when CDT off ======== 12:25:24 (1772472324)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
Killing existing copytools on oleg205-client.virtnet
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 26b (20s)

== sanity-hsm test 26c: RAoLU effective when file closed ========================================================== 12:25:44 (1772472344)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
multiop /mnt/lustre/d26c.sanity-hsm/f26c.sanity-hsm vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.7584
Waiting 200s for 'SUCCEED'
Updated after 4s: want 'SUCCEED' got 'SUCCEED'
Waiting 200s for 'SUCCEED'
Updated after 8s: want 'SUCCEED' got 'SUCCEED'
PASS 26c (32s)

== sanity-hsm test 26d: RAoLU when Client eviction ======= 12:26:16 (1772472376)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.212715 s, 4.9 MB/s
multiop /mnt/lustre/d26d.sanity-hsm/f26d.sanity-hsm vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.7584
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
PASS 26d (21s)

== sanity-hsm test 26e: RAoLU with a non-started coordinator ========================================================== 12:26:38 (1772472398)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.199052 s, 5.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.198898 s, 5.3 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Killing existing copytools on oleg205-client.virtnet
copytools stopped in 0s
Failing mds1 on oleg205-server
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
12:27:12 (1772472432) shut down
facet: mds1 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds1 to oleg205-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
12:27:45 (1772472465) targets are mounted
12:27:45 (1772472465) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
Check cookie from RAoLU request (last: 1772471734, remove: 1772471735)
mdt.lustre-MDT0000.hsm_control=enabled
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 26e (117s)

== sanity-hsm test 27a: Remove the archive of an imported file (Operation not permitted) ========================================================== 12:28:35 (1772472515)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_27a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
39+0 records in
39+0 records out
40894464 bytes (41 MB, 39 MiB) copied, 1.67005 s, 24.5 MB/s
lhsmtool_posix: 1772472521.530367 [52957]: action=1 src=d27a.sanity-hsm/f27a.sanity-hsm dst=/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772472521.551035 [52957]: importing '/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_27a//d27a.sanity-hsm/f27a.sanity-hsm'
lhsmtool_posix: 1772472521.658200 [52957]: imported '/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_27a//0405/0x200000406:0x3:0x0'=='/tmp/arc1/sanity-hsm.test_27a//d27a.sanity-hsm/f27a.sanity-hsm'
lhsmtool_posix: 1772472521.664507 [52957]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Cannot send HSM request (use of /mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm): Operation not permitted
PASS 27a (12s)

== sanity-hsm test 27b: Remove the archive of a relased file (Operation not permitted) ========================================================== 12:28:47 (1772472527)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_27b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.0112096 s, 0.0 kB/s
Cannot send HSM request (use of /mnt/lustre/d27b.sanity-hsm/f27b.sanity-hsm): Operation not permitted
PASS 27b (8s)

== sanity-hsm test 28: Concurrent archive/file remove ==== 12:28:55 (1772472535)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_28/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.0165419 s, 0.0 kB/s
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
PASS 28 (13s)

== sanity-hsm test 29a: Tests --mntpath and --archive options ========================================================== 12:29:08 (1772472548)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 7  "/mnt/lustre"'
Cannot send HSM request (use of /mnt/lustre): Invalid argument
hsm: '/qwerty/uyt' is not a valid FID
PASS 29a (7s)

== sanity-hsm test 29b: Archive/delete/remove by FID from the archive. ========================================================== 12:29:15 (1772472555)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.348474 s, 3.0 MB/s
PASS 29b (9s)

== sanity-hsm test 29c: Archive/delete/remove by FID, using a file list. ========================================================== 12:29:24 (1772472564)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.404175 s, 2.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.207948 s, 5.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.300822 s, 3.5 MB/s
PASS 29c (15s)

== sanity-hsm test 29d: hsm_remove by FID with archive_id 0 for unlinked file cause ========================================================== 12:29:39 (1772472579)

 SKIP: sanity-hsm test_29d Need 3 or more clients, have 1
SKIP 29d (3s)

== sanity-hsm test 30a: Restore at exec (import case) ==== 12:29:43 (1772472583)

 SKIP: sanity-hsm test_30a Need 2 or more clients, have 1
SKIP 30a (3s)

== sanity-hsm test 30b: Restore at exec (release case) === 12:29:46 (1772472586)

 SKIP: sanity-hsm test_30b Need 2 or more clients, have 1
SKIP 30b (3s)

== sanity-hsm test 30c: Update during exec of released file must fail ========================================================== 12:29:49 (1772472589)

 SKIP: sanity-hsm test_30c Need 2 or more clients, have 1
SKIP 30c (3s)

== sanity-hsm test 31a: Import a large file and check size during restore ========================================================== 12:29:53 (1772472593)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
39+0 records in
39+0 records out
40894464 bytes (41 MB, 39 MiB) copied, 1.46032 s, 28.0 MB/s
lhsmtool_posix: 1772472596.904459 [58001]: action=1 src=d31a.sanity-hsm/f31a.sanity-hsm dst=/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772472596.909412 [58001]: importing '/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_31a//d31a.sanity-hsm/f31a.sanity-hsm'
lhsmtool_posix: 1772472596.972535 [58001]: imported '/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_31a//040b/0x200000406:0xd:0x0'=='/tmp/arc1/sanity-hsm.test_31a//d31a.sanity-hsm/f31a.sanity-hsm'
lhsmtool_posix: 1772472596.972581 [58001]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
size seen is right: 40894464 == 40894464
 done
PASS 31a (21s)

== sanity-hsm test 31b: Restore a large unaligned file and check size during restore ========================================================== 12:30:14 (1772472614)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
39+0 records in
39+0 records out
39000000 bytes (39 MB, 37 MiB) copied, 1.07345 s, 36.3 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
size seen is right: 39000000 == 39000000
 done
PASS 31b (24s)

== sanity-hsm test 31c: Restore a large aligned file and check size during restore ========================================================== 12:30:38 (1772472638)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
39+0 records in
39+0 records out
40894464 bytes (41 MB, 39 MiB) copied, 1.11992 s, 36.5 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
size seen is right: 40894464 == 40894464
 done
PASS 31c (24s)

== sanity-hsm test 33: Kill a restore waiting process ==== 12:31:02 (1772472662)
0+0 records in
0+0 records out
0 bytes copied, 0.0215073 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_33/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
/home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2829: 60005 Terminated              md5sum $f > /dev/null
PASS 33 (13s)

== sanity-hsm test 34: Remove file during restore ======== 12:31:15 (1772472675)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_34/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.0033747 s, 0.0 kB/s
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
/home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2861: kill: (60658) - No such process
PASS 34 (13s)

== sanity-hsm test 35: Overwrite file during restore ===== 12:31:28 (1772472688)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_35/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.00408048 s, 0.0 kB/s
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
/home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2898: kill: (61328) - No such process
PASS 35 (12s)

== sanity-hsm test 36: Move file during restore ========== 12:31:40 (1772472700)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_36/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.00365353 s, 0.0 kB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Copytool is suspended on oleg205-client.virtnet
Waiting 200s for 'STARTED'
Updated after 2s: want 'STARTED' got 'STARTED'
Copytool is continued on oleg205-client.virtnet
/home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2934: kill: (62003) - No such process
PASS 36 (15s)

== sanity-hsm test 37: re-archive a dirty file =========== 12:31:55 (1772472715)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_37/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.177394 s, 5.9 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0927336 s, 11.3 MB/s
Waiting 200s for 'SUCCEED'
Updated after 3s: want 'SUCCEED' got 'SUCCEED'
PASS 37 (78s)

== sanity-hsm test 40: Parallel archive requests ========= 12:33:13 (1772472793)
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=1152921504606846976: Cannot allocate memory
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='1152921504606846976': Cannot allocate memory
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 12
set max_requests=1152921504606846976 failed with 12
[ 1679.274939] Lustre: lustre-MDT0000: No more memory to set HSM max_requests=1152921504606846976 (max request memory: 461MB, current total 3/975941): rc = -12
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_40/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=purge
Wait for all requests being enqueued...100 archive requests submitted
100 archive requests submitted
100 archive requests submitted
100 archive requests submitted
OK
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
PASS 40 (152s)

== sanity-hsm test 50: Archive with large number of pending HSM actions ========================================================== 12:35:45 (1772472945)
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=1000000: Cannot allocate memory
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='1000000': Cannot allocate memory
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 12
Filesystem                  Inodes IUsed  IFree IUse% Mounted on
192.168.202.105@tcp:/lustre 231306  1002 230304    1% /mnt/lustre
 - create 1367 (time 1772472961.99 total 10.00 last 136.68)
 - create 2826 (time 1772472971.99 total 20.01 last 145.82)
 - create 4157 (time 1772472982.00 total 30.02 last 132.96)
 - create 5340 (time 1772472992.01 total 40.02 last 118.22)
 - create 6582 (time 1772473002.01 total 50.03 last 124.18)
 - create 7879 (time 1772473012.02 total 60.04 last 129.56)
 - create 9226 (time 1772473022.02 total 70.04 last 134.70)
total: 10000 create in 76.40 seconds: 130.90 ops/second
10000
 - unlinked 0 (time 1772473115 ; total 0 ; last 0)
total: 10000 unlinks in 83 seconds: 120.481926 unlinks/second
Start Phase files_num: 10000 time: 79
 - create 1280 (time 1772473213.14 total 10.00 last 127.95)
 - create 2486 (time 1772473223.14 total 20.00 last 120.60)
 - create 3867 (time 1772473233.15 total 30.01 last 138.03)
 - create 5005 (time 1772473243.15 total 40.01 last 113.78)
 - create 6422 (time 1772473253.16 total 50.02 last 141.58)
 - create 7795 (time 1772473263.16 total 60.02 last 137.30)
 - create 9298 (time 1772473273.16 total 70.02 last 150.24)
 - create 10000 (time 1772473278.99 total 75.85 last 120.38)
 - create 11235 (time 1772473289.01 total 85.88 last 123.24)
 - create 12531 (time 1772473299.03 total 95.89 last 129.44)
 - create 13906 (time 1772473309.03 total 105.89 last 137.43)
 - create 15374 (time 1772473319.03 total 115.90 last 146.76)
 - create 16578 (time 1772473329.03 total 125.90 last 120.38)
 - create 17705 (time 1772473339.04 total 135.90 last 112.67)
 - create 18927 (time 1772473349.04 total 145.91 last 122.14)
total: 20000 create in 153.37 seconds: 130.41 ops/second
 - unlinked 0 (time 1772473524 ; total 0 ; last 0)
 - unlinked 10000 (time 1772473583 ; total 59 ; last 59)
total: 20000 unlinks in 119 seconds: 168.067230 unlinks/second
Middle Phase files_num: 20000 time: 163
 - create 1841 (time 1772473656.62 total 10.00 last 184.04)
 - create 3593 (time 1772473666.63 total 20.01 last 175.12)
 - create 5453 (time 1772473676.63 total 30.01 last 185.98)
 - create 7274 (time 1772473686.63 total 40.01 last 182.05)
 - create 9038 (time 1772473696.64 total 50.02 last 176.30)
total: 10000 create in 55.95 seconds: 178.72 ops/second
40000
 - unlinked 0 (time 1772473774 ; total 0 ; last 0)
total: 10000 unlinks in 57 seconds: 175.438599 unlinks/second
End Phase files_num: 10000 time: 67
40000
mdt.lustre-MDT0000.hsm_control=purge
PASS 50 (896s)

== sanity-hsm test 52: Opened for write file on an evicted client should be set dirty ========================================================== 12:50:41 (1772473841)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_52/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139993 s, 7.5 MB/s
multiop /mnt/lustre/d52.sanity-hsm/f52.sanity-hsm vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.7584
pdsh@oleg205-client: oleg205-client: ssh exited with exit code 5
PASS 52 (11s)

== sanity-hsm test 53: Opened for read file on an evicted client should not be set dirty ========================================================== 12:50:53 (1772473853)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_53/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122049 s, 8.6 MB/s
multiop /mnt/lustre/d53.sanity-hsm/f53.sanity-hsm vo_c
TMPPIPE=/tmp/multiop_open_wait_pipe.7584
pdsh@oleg205-client: oleg205-client: ssh exited with exit code 5
PASS 53 (10s)

== sanity-hsm test 54: Write during an archive cancels it ========================================================== 12:51:04 (1772473864)
39+0 records in
39+0 records out
39000000 bytes (39 MB, 37 MiB) copied, 0.703775 s, 55.4 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_54/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm.policy=+NRA
Waiting 200s for 'FAILED'
Waiting 180s for 'FAILED'
Updated after 37s: want 'FAILED' got 'FAILED'
mdt.lustre-MDT0000.hsm.policy=-NRA
PASS 54 (46s)

== sanity-hsm test 55: Truncate during an archive cancels it ========================================================== 12:51:50 (1772473910)
39+0 records in
39+0 records out
39000000 bytes (39 MB, 37 MiB) copied, 0.562461 s, 69.3 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_55/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm.policy=+NRA
mdt.lustre-MDT0000.hsm.policy=-NRA
PASS 55 (7s)

== sanity-hsm test 56: Setattr during an archive is ok === 12:51:57 (1772473917)
39+0 records in
39+0 records out
39000000 bytes (39 MB, 37 MiB) copied, 0.714334 s, 54.6 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_56/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
Waiting 200s for 'STARTED'
Updated after 2s: want 'STARTED' got 'STARTED'
Waiting 200s for 'SUCCEED'
Waiting 170s for 'SUCCEED'
Updated after 35s: want 'SUCCEED' got 'SUCCEED'
PASS 56 (44s)

== sanity-hsm test 57: Archive a file with dirty cache on another node ========================================================== 12:52:41 (1772473961)

 SKIP: sanity-hsm test_57 Need 2 or more clients, have 1
SKIP 57 (2s)

== sanity-hsm test 58: Truncate a released file will trigger restore ========================================================== 12:52:43 (1772473963)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_58/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
truncate up from 1516 to 3032
/mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2
truncate down from 1516 to 758
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
/mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2
truncate to 0
/mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2
PASS 58 (14s)

== sanity-hsm test 59: Release stripeless file with non-zero size ========================================================== 12:52:58 (1772473978)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_59/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
PASS 59 (6s)

== sanity-hsm test 60: Changing progress update interval from default ========================================================== 12:53:04 (1772473984)
10+0 records in
10+0 records out
10485760 bytes (10 MB, 10 MiB) copied, 0.163203 s, 64.2 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_60/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 --update-interval 5 "/mnt/lustre2"'
Waiting 100s for 'start copy'
Expecting a progress update within 20 seconds... 5242880 bytes copied in 3 seconds.
Wait for on going archive hsm action to complete
Waiting 10s for 'copied'
Updated after 5s: want 'copied' got 'copied'
PASS 60 (17s)

== sanity-hsm test 61: Waiting archive of a removed file should fail ========================================================== 12:53:21 (1772474001)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_61/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
PASS 61 (9s)

== sanity-hsm test 70: Copytool logs JSON register/unregister events to FIFO ========================================================== 12:53:30 (1772474010)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_70/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --event-fifo /tmp/sanity-hsm.test_70.GORc/fifo "/mnt/lustre2"'
Killing existing copytools on oleg205-client.virtnet
copytools stopped in 0s
Register/Unregister events look OK.
PASS 70 (7s)

== sanity-hsm test 71: Copytool logs JSON archive events to FIFO ========================================================== 12:53:38 (1772474018)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_71/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --update-interval 5 --event-fifo /tmp/sanity-hsm.test_71.zINA/fifo "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm.policy=-NRA
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107009 s, 9.8 MB/s
Archive events look OK.
mdt.lustre-MDT0000.hsm.policy=-NRA
PASS 71 (11s)

== sanity-hsm test 72: Copytool logs JSON restore events to FIFO ========================================================== 12:53:49 (1772474029)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_72/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --update-interval 5 --event-fifo /tmp/sanity-hsm.test_72.lunA/fifo "/mnt/lustre2"'
16+0 records in
16+0 records out
16000000 bytes (16 MB, 15 MiB) copied, 0.438981 s, 36.4 MB/s
lhsmtool_posix: 1772474033.166695 [80774]: action=1 src=d72.sanity-hsm/f72.sanity-hsm dst=/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772474033.175736 [80774]: importing '/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_72//d72.sanity-hsm/f72.sanity-hsm'
lhsmtool_posix: 1772474033.239678 [80774]: imported '/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_72//0bc8/0x200000bd2:0x1a:0x0'=='/tmp/arc1/sanity-hsm.test_72//d72.sanity-hsm/f72.sanity-hsm'
lhsmtool_posix: 1772474033.245550 [80774]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Verifying released state: 
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Restore events look OK.
PASS 72 (13s)

== sanity-hsm test 90: Archive/restore a file list ======= 12:54:02 (1772474042)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_90/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=purge
Waiting 200s for ''
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Waiting 200s for ''
Changed after 2s: from 'lrh=[type=10680000 len=136 idx=4/10058] fid=[0x200000402:0x29f:0x0] dfid=[0x200000402:0x29f:0x0] compound/cookie=0x0/0x69a663e6 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10059] fid=[0x200000402:0x2a0:0x0] dfid=[0x200000402:0x2a0:0x0] compound/cookie=0x0/0x69a663e7 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10060] fid=[0x200000402:0x2a1:0x0] dfid=[0x200000402:0x2a1:0x0] compound/cookie=0x0/0x69a663e8 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10061] fid=[0x200000402:0x2a2:0x0] dfid=[0x200000402:0x2a2:0x0] compound/cookie=0x0/0x69a663e9 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10062] fid=[0x200000402:0x2a3:0x0] dfid=[0x200000402:0x2a3:0x0] compound/cookie=0x0/0x69a663ea action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10063] fid=[0x200000402:0x2a4:0x0] dfid=[0x200000402:0x2a4:0x0] compound/cookie=0x0/0x69a663eb action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10064] fid=[0x200000402:0x2a5:0x0] dfid=[0x200000402:0x2a5:0x0] compound/cookie=0x0/0x69a663ec action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10066] fid=[0x200000402:0x2a6:0x0] dfid=[0x200000402:0x2a6:0x0] compound/cookie=0x0/0x69a663ed action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10067] fid=[0x200000402:0x2a7:0x0] dfid=[0x200000402:0x2a7:0x0] compound/cookie=0x0/0x69a663ee action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10068] fid=[0x200000402:0x2a8:0x0] dfid=[0x200000402:0x2a8:0x0] compound/cookie=0x0/0x69a663ef action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10069] fid=[0x200000402:0x2a9:0x0] dfid=[0x200000402:0x2a9:0x0] compound/cookie=0x0/0x69a663f0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10070] fid=[0x200000402:0x2aa:0x0] dfid=[0x200000402:0x2aa:0x0] compound/cookie=0x0/0x69a663f1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10071] fid=[0x200000402:0x2ab:0x0] dfid=[0x200000402:0x2ab:0x0] compound/cookie=0x0/0x69a663f2 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10072] fid=[0x200000402:0x2ac:0x0] dfid=[0x200000402:0x2ac:0x0] compound/cookie=0x0/0x69a663f3 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10073] fid=[0x200000402:0x2ad:0x0] dfid=[0x200000402:0x2ad:0x0] compound/cookie=0x0/0x69a663f4 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10074] fid=[0x200000402:0x2ae:0x0] dfid=[0x200000402:0x2ae:0x0] compound/cookie=0x0/0x69a663f5 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10075] fid=[0x200000402:0x2af:0x0] dfid=[0x200000402:0x2af:0x0] compound/cookie=0x0/0x69a663f6 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10076] fid=[0x200000402:0x2b0:0x0] dfid=[0x200000402:0x2b0:0x0] compound/cookie=0x0/0x69a663f7 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10077] fid=[0x200000402:0x2b1:0x0] dfid=[0x200000402:0x2b1:0x0] compound/cookie=0x0/0x69a663f8 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10078] fid=[0x200000402:0x2b2:0x0] dfid=[0x200000402:0x2b2:0x0] compound/cookie=0x0/0x69a663f9 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10079] fid=[0x200000402:0x2b3:0x0] dfid=[0x200000402:0x2b3:0x0] compound/cookie=0x0/0x69a663fa action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10080] fid=[0x200000402:0x2b4:0x0] dfid=[0x200000402:0x2b4:0x0] compound/cookie=0x0/0x69a663fb action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10081] fid=[0x200000402:0x2b5:0x0] dfid=[0x200000402:0x2b5:0x0] compound/cookie=0x0/0x69a663fc action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10082] fid=[0x200000402:0x2b6:0x0] dfid=[0x200000402:0x2b6:0x0] compound/cookie=0x0/0x69a663fd action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10083] fid=[0x200000402:0x2b7:0x0] dfid=[0x200000402:0x2b7:0x0] compound/cookie=0x0/0x69a663fe action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10084] fid=[0x200000402:0x2b8:0x0] dfid=[0x200000402:0x2b8:0x0] compound/cookie=0x0/0x69a663ff action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10085] fid=[0x200000402:0x2b9:0x0] dfid=[0x200000402:0x2b9:0x0] compound/cookie=0x0/0x69a66400 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10086] fid=[0x200000402:0x2ba:0x0] dfid=[0x200000402:0x2ba:0x0] compound/cookie=0x0/0x69a66401 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10087] fid=[0x200000402:0x2bb:0x0] dfid=[0x200000402:0x2bb:0x0] compound/cookie=0x0/0x69a66402 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10088] fid=[0x200000402:0x2bc:0x0] dfid=[0x200000402:0x2bc:0x0] compound/cookie=0x0/0x69a66403 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10089] fid=[0x200000402:0x2bd:0x0] dfid=[0x200000402:0x2bd:0x0] compound/cookie=0x0/0x69a66404 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10090] fid=[0x200000402:0x2be:0x0] dfid=[0x200000402:0x2be:0x0] compound/cookie=0x0/0x69a66405 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10091] fid=[0x200000402:0x2bf:0x0] dfid=[0x200000402:0x2bf:0x0] compound/cookie=0x0/0x69a66406 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10092] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x69a66407 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10093] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x69a66408 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x69a66409 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x69a6640a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x69a6640b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x69a6640c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x69a6640d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x69a6640e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x69a6640f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x69a66410 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x69a66411 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x69a66412 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x69a66413 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x69a66414 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x69a66415 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x69a66416 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x69a66417 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x69a66418 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/10077] fid=[0x200000402:0x2b1:0x0] dfid=[0x200000402:0x2b1:0x0] compound/cookie=0x0/0x69a663f8 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10078] fid=[0x200000402:0x2b2:0x0] dfid=[0x200000402:0x2b2:0x0] compound/cookie=0x0/0x69a663f9 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10079] fid=[0x200000402:0x2b3:0x0] dfid=[0x200000402:0x2b3:0x0] compound/cookie=0x0/0x69a663fa action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10080] fid=[0x200000402:0x2b4:0x0] dfid=[0x200000402:0x2b4:0x0] compound/cookie=0x0/0x69a663fb action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10081] fid=[0x200000402:0x2b5:0x0] dfid=[0x200000402:0x2b5:0x0] compound/cookie=0x0/0x69a663fc action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10082] fid=[0x200000402:0x2b6:0x0] dfid=[0x200000402:0x2b6:0x0] compound/cookie=0x0/0x69a663fd action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10083] fid=[0x200000402:0x2b7:0x0] dfid=[0x200000402:0x2b7:0x0] compound/cookie=0x0/0x69a663fe action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10084] fid=[0x200000402:0x2b8:0x0] dfid=[0x200000402:0x2b8:0x0] compound/cookie=0x0/0x69a663ff action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10085] fid=[0x200000402:0x2b9:0x0] dfid=[0x200000402:0x2b9:0x0] compound/cookie=0x0/0x69a66400 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10086] fid=[0x200000402:0x2ba:0x0] dfid=[0x200000402:0x2ba:0x0] compound/cookie=0x0/0x69a66401 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10087] fid=[0x200000402:0x2bb:0x0] dfid=[0x200000402:0x2bb:0x0] compound/cookie=0x0/0x69a66402 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10088] fid=[0x200000402:0x2bc:0x0] dfid=[0x200000402:0x2bc:0x0] compound/cookie=0x0/0x69a66403 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10089] fid=[0x200000402:0x2bd:0x0] dfid=[0x200000402:0x2bd:0x0] compound/cookie=0x0/0x69a66404 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10090] fid=[0x200000402:0x2be:0x0] dfid=[0x200000402:0x2be:0x0] compound/cookie=0x0/0x69a66405 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10091] fid=[0x200000402:0x2bf:0x0] dfid=[0x200000402:0x2bf:0x0] compound/cookie=0x0/0x69a66406 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10092] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x69a66407 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10093] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x69a66408 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x69a66409 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x69a6640a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x69a6640b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x69a6640c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x69a6640d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x69a6640e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x69a6640f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x69a66410 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x69a66411 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x69a66412 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x69a66413 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x69a66414 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x69a66415 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x69a66416 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x69a66417 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x69a66418 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]'
Changed after 4s: from 'lrh=[type=10680000 len=136 idx=4/10077] fid=[0x200000402:0x2b1:0x0] dfid=[0x200000402:0x2b1:0x0] compound/cookie=0x0/0x69a663f8 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10078] fid=[0x200000402:0x2b2:0x0] dfid=[0x200000402:0x2b2:0x0] compound/cookie=0x0/0x69a663f9 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10079] fid=[0x200000402:0x2b3:0x0] dfid=[0x200000402:0x2b3:0x0] compound/cookie=0x0/0x69a663fa action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10080] fid=[0x200000402:0x2b4:0x0] dfid=[0x200000402:0x2b4:0x0] compound/cookie=0x0/0x69a663fb action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10081] fid=[0x200000402:0x2b5:0x0] dfid=[0x200000402:0x2b5:0x0] compound/cookie=0x0/0x69a663fc action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10082] fid=[0x200000402:0x2b6:0x0] dfid=[0x200000402:0x2b6:0x0] compound/cookie=0x0/0x69a663fd action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10083] fid=[0x200000402:0x2b7:0x0] dfid=[0x200000402:0x2b7:0x0] compound/cookie=0x0/0x69a663fe action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10084] fid=[0x200000402:0x2b8:0x0] dfid=[0x200000402:0x2b8:0x0] compound/cookie=0x0/0x69a663ff action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10085] fid=[0x200000402:0x2b9:0x0] dfid=[0x200000402:0x2b9:0x0] compound/cookie=0x0/0x69a66400 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10086] fid=[0x200000402:0x2ba:0x0] dfid=[0x200000402:0x2ba:0x0] compound/cookie=0x0/0x69a66401 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10087] fid=[0x200000402:0x2bb:0x0] dfid=[0x200000402:0x2bb:0x0] compound/cookie=0x0/0x69a66402 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10088] fid=[0x200000402:0x2bc:0x0] dfid=[0x200000402:0x2bc:0x0] compound/cookie=0x0/0x69a66403 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10089] fid=[0x200000402:0x2bd:0x0] dfid=[0x200000402:0x2bd:0x0] compound/cookie=0x0/0x69a66404 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10090] fid=[0x200000402:0x2be:0x0] dfid=[0x200000402:0x2be:0x0] compound/cookie=0x0/0x69a66405 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10091] fid=[0x200000402:0x2bf:0x0] dfid=[0x200000402:0x2bf:0x0] compound/cookie=0x0/0x69a66406 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10092] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x69a66407 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10093] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x69a66408 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x69a66409 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x69a6640a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x69a6640b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x69a6640c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x69a6640d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x69a6640e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x69a6640f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x69a66410 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x69a66411 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x69a66412 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x69a66413 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x69a66414 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x69a66415 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x69a66416 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x69a66417 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x69a66418 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x69a6640a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x69a6640b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x69a6640c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x69a6640d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x69a6640e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x69a6640f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x69a66410 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x69a66411 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x69a66412 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x69a66413 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x69a66414 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x69a66415 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x69a66416 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x69a66417 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x69a66418 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]'
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
PASS 90 (82s)

== sanity-hsm test 100: Set coordinator /proc tunables === 12:55:24 (1772474124)
Testing mdt.lustre-MDT0000.hsm.loop_period
Set loop_period to 0 must failed
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/loop_period=0: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/loop_period'='0': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
Testing mdt.lustre-MDT0000.hsm.grace_delay
Set grace_delay to 0 must failed
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/grace_delay=0: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/grace_delay'='0': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
Testing mdt.lustre-MDT0000.hsm.active_request_timeout
Set active_request_timeout to 0 must failed
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/active_request_timeout=0: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/active_request_timeout'='0': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
Testing mdt.lustre-MDT0000.hsm.max_requests
Set max_requests to 0 must failed
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=0: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='0': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
Testing mdt.lustre-MDT0000.hsm.default_archive_id
Set default_archive_id to 0 must failed
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/default_archive_id=0: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/default_archive_id'='0': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
PASS 100 (23s)

== sanity-hsm test 102: Verify coordinator control ======= 12:55:47 (1772474147)
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
PASS 102 (9s)

== sanity-hsm test 103: Purge all requests =============== 12:55:56 (1772474156)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_103/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=purge
Current requests
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
PASS 103 (8s)

== sanity-hsm test 103a: Purge pending restore requests == 12:56:04 (1772474164)
mdt.lustre-MDT0000.hsm.policy=-NBR
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_103a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
(0x200000402:0x319:0x0|0x200000402:0x31a:0x0|0x200000402:0x31b:0x0|0x200000402:0x31c:0x0|0x200000402:0x31d:0x0|0x200000402:0x31e:0x0|0x200000402:0x31f:0x0|0x200000402:0x320:0x0).*action=ARCHIVE.*status=SUCCEED
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Killing existing copytools on oleg205-client.virtnet
copytools stopped in 0s
cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31d:0x0': No data available
cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31a:0x0': No data available
cat: '/mnt/lustre/.lustre/fid/0x200000402:0x319:0x0': No data available
cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31e:0x0': No data available
cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31b:0x0': No data available
cat: '/mnt/lustre/.lustre/fid/0x200000402:0x320:0x0': No data available
cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31f:0x0': No data available
cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31c:0x0': No data available
mdt.lustre-MDT0000.hsm_control=purge
PASS 103a (13s)

== sanity-hsm test 104: Copy tool data field ============= 12:56:17 (1772474177)
0+0 records in
0+0 records out
0 bytes copied, 0.0024008 s, 0.0 kB/s
mdt.lustre-MDT0000.hsm_control=purge
PASS 104 (6s)

== sanity-hsm test 105: Restart of coordinator =========== 12:56:23 (1772474183)
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0000.hsm_control=purge
PASS 105 (17s)

== sanity-hsm test 106: Copytool register/unregister ===== 12:56:40 (1772474200)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
oleg205-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg205-client.virtnet: executing get_client_uuid /mnt/lustre2
found agent uuid=c269473a-0d4b-490c-8965-e5ab530a0043 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1
oleg205-client.virtnet: 87040
Killing existing copytools on oleg205-client.virtnet
copytools stopped in 1s
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
uuid not found in agent list on mds1
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
oleg205-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg205-client.virtnet: executing get_client_uuid /mnt/lustre2
found agent uuid=c269473a-0d4b-490c-8965-e5ab530a0043 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1
PASS 106 (17s)

== sanity-hsm test 107: Copytool re-register after MDS restart ========================================================== 12:56:58 (1772474218)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_107/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Failing mds1 on oleg205-server
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
12:57:02 (1772474222) shut down
facet: mds1 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds1 to oleg205-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
12:57:21 (1772474241) targets are mounted
12:57:21 (1772474241) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
PASS 107 (33s)

== sanity-hsm test 109: Policy display/change ============ 12:57:32 (1772474252)
mdt.lustre-MDT0000.hsm.policy=+NBR
mdt.lustre-MDT0000.hsm.policy=+NRA
mdt.lustre-MDT0000.hsm.policy=-NBR
mdt.lustre-MDT0000.hsm.policy=-NRA
mdt.lustre-MDT0000.hsm.policy=NRA NBR
Next set_param must failed
oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mdt/lustre-MDT0000/hsm/policy=wrong: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/policy'='wrong': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
Back to default policy
mdt.lustre-MDT0000.hsm.policy=+NRA
mdt.lustre-MDT0000.hsm.policy=-NBR
PASS 109 (15s)

== sanity-hsm test 110a: Non blocking restore policy (import case) ========================================================== 12:57:46 (1772474266)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_110a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1772474268.342166 [90804]: action=1 src=d110a.sanity-hsm/f110a.sanity-hsm dst=/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772474268.348394 [90804]: importing '/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_110a//d110a.sanity-hsm/f110a.sanity-hsm'
lhsmtool_posix: 1772474268.399145 [90804]: imported '/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_110a//0bba/0x200000bd2:0x68:0x0'=='/tmp/arc1/sanity-hsm.test_110a//d110a.sanity-hsm/f110a.sanity-hsm'
lhsmtool_posix: 1772474268.399204 [90804]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
mdt.lustre-MDT0000.hsm.policy=+NBR
md5sum: /mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm: No data available
Waiting 200s for 'SUCCEED'
mdt.lustre-MDT0000.hsm.policy=-NBR
PASS 110a (8s)

== sanity-hsm test 110b: Non blocking restore policy (release case) ========================================================== 12:57:54 (1772474274)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_110b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
mdt.lustre-MDT0000.hsm.policy=+NBR
md5sum: /mnt/lustre/d110b.sanity-hsm/f110b.sanity-hsm: No data available
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
mdt.lustre-MDT0000.hsm.policy=-NBR
PASS 110b (10s)

== sanity-hsm test 111a: No retry policy (import case), restore will error ========================================================== 12:58:04 (1772474284)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_111a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1772474285.490583 [92169]: action=1 src=d111a.sanity-hsm/f111a.sanity-hsm dst=/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772474285.497590 [92169]: importing '/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_111a//d111a.sanity-hsm/f111a.sanity-hsm'
lhsmtool_posix: 1772474285.530918 [92169]: imported '/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_111a//0bbf/0x200000bd2:0x6d:0x0'=='/tmp/arc1/sanity-hsm.test_111a//d111a.sanity-hsm/f111a.sanity-hsm'
lhsmtool_posix: 1772474285.531254 [92169]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
mdt.lustre-MDT0000.hsm.policy=+NRA
Remove from backend: 0x200000bd2:0x6d:0x0 = /tmp/arc1/sanity-hsm.test_111a/0bbf/0x200000bd2:0x6d:0x0
mdt.lustre-MDT0000.hsm.policy=-NRA
PASS 111a (6s)

== sanity-hsm test 111b: No retry policy (release case), restore will error ========================================================== 12:58:10 (1772474290)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_111b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm.policy=+NRA
Remove from backend: 0x200000402:0x329:0x0 = /tmp/arc1/sanity-hsm.test_111b/072b/0x200000402:0x329:0x0
mdt.lustre-MDT0000.hsm.policy=-NRA
PASS 111b (7s)

== sanity-hsm test 112: State of recorded request ======== 12:58:18 (1772474298)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_112/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=disabled
/mnt/lustre/d112.sanity-hsm/f112.sanity-hsm: ARCHIVE waiting (from 0 to EOF)
mdt.lustre-MDT0000.hsm_control=enabled
PASS 112 (8s)

== sanity-hsm test 113: wrong stat after restore ========= 12:58:25 (1772474305)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0369322 s, 28.4 MB/s
Starting client: oleg205-client.virtnet:  -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre3
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_113/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre3"'
Verifying released state: 
multiop /mnt/lustre/d113.sanity-hsm/f113.sanity-hsm voO_WRONLY:O_APPEND:_w4c
TMPPIPE=/tmp/multiop_open_wait_pipe.7584
  File: /mnt/lustre2/d113.sanity-hsm/f113.sanity-hsm
  Size: 1048576   	Blocks: 1          IO Block: 4194304 regular file
Device: 2c54f966h/743766374d	Inode: 144115205289280301  Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2026-03-02 12:58:26.000000000 -0500
Modify: 2026-03-02 12:58:26.000000000 -0500
Change: 2026-03-02 12:58:26.000000000 -0500
 Birth: 2026-03-02 12:58:26.000000000 -0500
Stopping client oleg205-client.virtnet /mnt/lustre3 (opts:)
PASS 113 (8s)

== sanity-hsm test 114: Incompatible request does not set other requests as STARTED ========================================================== 12:58:33 (1772474313)
0+0 records in
0+0 records out
0 bytes copied, 0.00770872 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00471778 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_114/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
PASS 114 (8s)

== sanity-hsm test 200: Register/Cancel archive ========== 12:58:41 (1772474321)
0+0 records in
0+0 records out
0 bytes copied, 0.00485483 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_200/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Copytool is suspended on oleg205-client.virtnet
Waiting 200s for 'STARTED'
Waiting 200s for 'CANCELED'
Updated after 2s: want 'CANCELED' got 'CANCELED'
Copytool is continued on oleg205-client.virtnet
PASS 200 (10s)

== sanity-hsm test 201: Register/Cancel restore ========== 12:58:52 (1772474332)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_201/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
39+0 records in
39+0 records out
40894464 bytes (41 MB, 39 MiB) copied, 0.878099 s, 46.6 MB/s
lhsmtool_posix: 1772474334.490338 [96406]: action=1 src=d201.sanity-hsm/f201.sanity-hsm dst=/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772474334.496069 [96406]: importing '/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_201//d201.sanity-hsm/f201.sanity-hsm'
lhsmtool_posix: 1772474334.562189 [96406]: imported '/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_201//0ba5/0x200000bd2:0x77:0x0'=='/tmp/arc1/sanity-hsm.test_201//d201.sanity-hsm/f201.sanity-hsm'
lhsmtool_posix: 1772474334.562247 [96406]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
PASS 201 (10s)

== sanity-hsm test 202: Register/Cancel remove =========== 12:59:02 (1772474342)
0+0 records in
0+0 records out
0 bytes copied, 0.00334221 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_202/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Copytool is suspended on oleg205-client.virtnet
Waiting 200s for 'STARTED'
Updated after 2s: want 'STARTED' got 'STARTED'
Waiting 200s for 'CANCELED'
Updated after 2s: want 'CANCELED' got 'CANCELED'
PASS 202 (10s)

== sanity-hsm test 220A: Changelog for archive =========== 12:59:12 (1772474352)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_220A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl1'
Waiting 200s for 'SUCCEED'
lustre-MDT0000.3 16HSM   17:59:15.919137166 2026.03.02 0x0 t=[0x200000402:0x336:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000: clear the changelog for cl1 of all records
lustre-MDT0000: Deregistered changelog user #1
PASS 220A (12s)

== sanity-hsm test 220a: Changelog for failed archive ==== 12:59:24 (1772474364)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_220a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl2'
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
lustre-MDT0000.6 16HSM   17:59:27.848180077 2026.03.02 0x2 t=[0x200000402:0x337:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000: clear the changelog for cl2 of all records
lustre-MDT0000: Deregistered changelog user #2
PASS 220a (10s)

== sanity-hsm test 221: Changelog for archive canceled === 12:59:34 (1772474374)
0+0 records in
0+0 records out
0 bytes copied, 0.00454956 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_221/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl3'
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
lustre-MDT0000.8 16HSM   17:59:38.275606062 2026.03.02 0x7d t=[0x200000402:0x339:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000: clear the changelog for cl3 of all records
lustre-MDT0000: Deregistered changelog user #3
PASS 221 (11s)

== sanity-hsm test 222a: Changelog for explicit restore == 12:59:45 (1772474385)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1772474386.898008 [99982]: action=1 src=d222a.sanity-hsm/f222a.sanity-hsm dst=/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772474386.904648 [99982]: importing '/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222a//d222a.sanity-hsm/f222a.sanity-hsm'
lhsmtool_posix: 1772474386.948422 [99982]: imported '/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222a//0bac/0x200000bd2:0x7e:0x0'=='/tmp/arc1/sanity-hsm.test_222a//d222a.sanity-hsm/f222a.sanity-hsm'
lhsmtool_posix: 1772474386.948469 [99982]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl4'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
lustre-MDT0000.11 16HSM   17:59:48.733332713 2026.03.02 0x80 t=[0x200000bd2:0x7e:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000: clear the changelog for cl4 of all records
lustre-MDT0000: Deregistered changelog user #4
PASS 222a (11s)

== sanity-hsm test 222b: Changelog for implicit restore == 12:59:56 (1772474396)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl5'
Waiting 200s for 'SUCCEED'
4ef076ad20e5d4a2f4729d6ed41a3bf9  /mnt/lustre/d222b.sanity-hsm/f222b.sanity-hsm
lustre-MDT0000.20 16HSM   18:00:02.359700001 2026.03.02 0x80 t=[0x200000402:0x33b:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x7a:0x0]
lustre-MDT0000: clear the changelog for cl5 of all records
lustre-MDT0000: Deregistered changelog user #5
PASS 222b (12s)

== sanity-hsm test 222c: Changelog for failed explicit restore ========================================================== 13:00:08 (1772474408)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1772474410.456609 [101471]: action=1 src=d222c.sanity-hsm/f222c.sanity-hsm dst=/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772474410.460859 [101471]: importing '/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222c//d222c.sanity-hsm/f222c.sanity-hsm'
lhsmtool_posix: 1772474410.499233 [101471]: imported '/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222c//0b51/0x200000bd2:0x83:0x0'=='/tmp/arc1/sanity-hsm.test_222c//d222c.sanity-hsm/f222c.sanity-hsm'
lhsmtool_posix: 1772474410.499960 [101471]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl6'
Copytool is suspended on oleg205-client.virtnet
Waiting 200s for 'STARTED'
Updated after 2s: want 'STARTED' got 'STARTED'
Copytool is continued on oleg205-client.virtnet
lustre-MDT0000.22 16HSM   18:00:14.134059164 2026.03.02 0x82 t=[0x200000bd2:0x83:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x81:0x0]
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0000: Deregistered changelog user #6
PASS 222c (13s)

== sanity-hsm test 222d: Changelog for failed implicit restore ========================================================== 13:00:21 (1772474421)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl7'
Remove from backend: 0x200000402:0x33d:0x0 = /tmp/arc1/sanity-hsm.test_222d/073f/0x200000402:0x33d:0x0
md5sum: /mnt/lustre/d222d.sanity-hsm/f222d.sanity-hsm: No data available
lustre-MDT0000.29 16HSM   18:00:25.669639051 2026.03.02 0x82 t=[0x200000402:0x33d:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x81:0x0]
lustre-MDT0000: clear the changelog for cl7 of all records
lustre-MDT0000: Deregistered changelog user #7
PASS 222d (11s)

== sanity-hsm test 223a: Changelog for restore canceled (import case) ========================================================== 13:00:32 (1772474432)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_223a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
39+0 records in
39+0 records out
40894464 bytes (41 MB, 39 MiB) copied, 0.709173 s, 57.7 MB/s
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl8'
lhsmtool_posix: 1772474437.202618 [103031]: action=1 src=d223a.sanity-hsm/f223a.sanity-hsm dst=/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1772474437.207989 [103031]: importing '/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_223a//d223a.sanity-hsm/f223a.sanity-hsm'
lhsmtool_posix: 1772474437.261473 [103031]: imported '/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_223a//0b5a/0x200000bd2:0x88:0x0'=='/tmp/arc1/sanity-hsm.test_223a//d223a.sanity-hsm/f223a.sanity-hsm'
lhsmtool_posix: 1772474437.262383 [103031]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Waiting 200s for 'CANCELED'
Waiting 200s for 'SUCCEED'
Waiting 190s for 'SUCCEED'
Updated after 27s: want 'SUCCEED' got 'SUCCEED'
lustre-MDT0000.36 16HSM   18:01:06.814955812 2026.03.02 0xfd t=[0x200000bd2:0x88:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x86:0x0]
lustre-MDT0000: clear the changelog for cl8 of all records
lustre-MDT0000: Deregistered changelog user #8
PASS 223a (41s)

== sanity-hsm test 223b: Changelog for restore canceled (release case) ========================================================== 13:01:13 (1772474473)
0+0 records in
0+0 records out
0 bytes copied, 0.00393058 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_223b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl9'
Waiting 200s for 'SUCCEED'
Copytool is suspended on oleg205-client.virtnet
Waiting 200s for 'CANCELED'
Updated after 2s: want 'CANCELED' got 'CANCELED'
Copytool is continued on oleg205-client.virtnet
lustre-MDT0000.43 16HSM   18:01:21.009448985 2026.03.02 0xfd t=[0x200000402:0x341:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000: clear the changelog for cl9 of all records
lustre-MDT0000: Deregistered changelog user #9
PASS 223b (14s)

== sanity-hsm test 224A: Changelog for remove ============ 13:01:28 (1772474488)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_224A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl10'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
lustre-MDT0000.48 16HSM   18:01:33.438735516 2026.03.02 0x200 t=[0x200000402:0x343:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x86:0x0]
lustre-MDT0000: clear the changelog for cl10 of all records
lustre-MDT0000: Deregistered changelog user #10
PASS 224A (12s)

== sanity-hsm test 224a: Changelog for failed remove ===== 13:01:39 (1772474499)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_224a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl11'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Remove from backend: 0x200000402:0x344:0x0 = /tmp/arc1/sanity-hsm.test_224a/0746/0x200000402:0x344:0x0
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
lustre-MDT0000.53 16HSM   18:01:45.285407500 2026.03.02 0x202 t=[0x200000402:0x344:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x8c:0x0]
lustre-MDT0000: clear the changelog for cl11 of all records
lustre-MDT0000: Deregistered changelog user #11
PASS 224a (13s)

== sanity-hsm test 225: Changelog for remove canceled ==== 13:01:52 (1772474512)
Test disabled
PASS 225 (3s)

== sanity-hsm test 226: changelog for last rm/mv with exiting archive ========================================================== 13:01:55 (1772474515)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_226/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
0x200000402:0x347:0x0
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl12'
lustre-MDT0000.54 16HSM   18:01:58.626930839 2026.03.02 0x280 t=[0x200000402:0x345:0x0] ef=0x13 u=0:0 nid=0@<0:0>
lustre-MDT0000.55 16HSM   18:01:58.716678772 2026.03.02 0x280 t=[0x200000402:0x345:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x86:0x0]
lustre-MDT0000.56 16HSM   18:01:58.716843454 2026.03.02 0x0 t=[0x200000402:0x345:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x86:0x0]
lustre-MDT0000.57 16HSM   18:01:59.772204269 2026.03.02 0x280 t=[0x200000402:0x346:0x0] ef=0x13 u=0:0 nid=0@<0:0>
lustre-MDT0000.58 16HSM   18:01:59.873193250 2026.03.02 0x280 t=[0x200000402:0x346:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x7a:0x0]
lustre-MDT0000.59 16HSM   18:01:59.874070114 2026.03.02 0x0 t=[0x200000402:0x346:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x7a:0x0]
lustre-MDT0000.60 06UNLNK 18:01:59.973850972 2026.03.02 0x3 t=[0x200000402:0x345:0x0] j=rm.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x8d:0x0] f226.sanity-hsm-1
lustre-MDT0000.60 06UNLNK 18:01:59.973850972 2026.03.02 0x3 t=[0x200000402:0x345:0x0] j=rm.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x8d:0x0] f226.sanity-hsm-1
lustre-MDT0000.61 08RENME 18:02:00.317267896 2026.03.02 0x3 t=[0x200000402:0x346:0x0] j=mv.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x8d:0x0] f226.sanity-hsm-2 s=[0x200000402:0x347:0x0] sp=[0x200000bd2:0x8d:0x0] f226.sanity-hsm-3
lustre-MDT0000: clear the changelog for cl12 of all records
lustre-MDT0000: Deregistered changelog user #12
PASS 226 (11s)

== sanity-hsm test 227: changelog when explicit setting of HSM flags ========================================================== 13:02:06 (1772474526)
0+0 records in
0+0 records out
0 bytes copied, 0.00686469 s, 0.0 kB/s
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl13'
lustre-MDT0000: clear the changelog for cl13 of all records
lustre-MDT0000: Deregistered changelog user #13
PASS 227 (12s)

== sanity-hsm test 228: On released file, return extend to FIEMAP. For [cp,tar] --sparse ========================================================== 13:02:18 (1772474538)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_228/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0441934 s, 23.7 MB/s
/mnt/lustre/f228.sanity-hsm: 1 extent found
tar: Removing leading `/' from member names
mnt/lustre/f228.sanity-hsm
PASS 228 (8s)

== sanity-hsm test 250: Coordinator max request ========== 13:02:26 (1772474546)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_250/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.00232315 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00496977 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00337856 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.0047693 s, 0.0 kB/s
Waiting 200s for 'SUCCEED'
0+0 records in
0+0 records out
0 bytes copied, 0.0030285 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00359226 s, 0.0 kB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Copytool is suspended on oleg205-client.virtnet
Waiting 200s for 'STARTED'
Updated after 2s: want 'STARTED' got 'STARTED'
Waiting 200s for 'STARTED'
Updated after 2s: want 'STARTED' got 'STARTED'
Copytool is continued on oleg205-client.virtnet
PASS 250 (22s)

== sanity-hsm test 251: Coordinator request timeout ====== 13:02:48 (1772474568)
0+0 records in
0+0 records out
0 bytes copied, 0.00470401 s, 0.0 kB/s
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_251/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Copytool is suspended on oleg205-client.virtnet
Waiting 200s for 'STARTED'
Updated after 3s: want 'STARTED' got 'STARTED'
Waiting 200s for 'CANCELED'
PASS 251 (18s)

== sanity-hsm test 252: Timeout'ed running archive of a removed file should be canceled ========================================================== 13:03:06 (1772474586)
0+0 records in
0+0 records out
0 bytes copied, 0.00349332 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_252/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
PASS 252 (10s)

== sanity-hsm test 253: Check for wrong file size after release ========================================================== 13:03:16 (1772474596)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_253/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
10+0 records in
10+0 records out
10000000 bytes (10 MB, 9.5 MiB) copied, 0.170542 s, 58.6 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
fail_loc=0x807
Cannot send HSM request (use of /mnt/lustre/d253.sanity-hsm/f253.sanity-hsm): Invalid argument
could not release file
PASS 253 (8s)

== sanity-hsm test 254a: Request counters are initialized to zero ========================================================== 13:03:24 (1772474604)
PASS 254a (7s)

== sanity-hsm test 254b: Request counters are correctly incremented and decremented ========================================================== 13:03:31 (1772474611)
Will launch 59 requests of each type
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_254b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Checking archive requests
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
Checking restore requests
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
Checking remove requests
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
PASS 254b (32s)

== sanity-hsm test 255: Copytool registration wakes the coordinator up ========================================================== 13:04:03 (1772474643)
0+0 records in
0+0 records out
0 bytes copied, 0.00665164 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_255/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Killing existing copytools on oleg205-client.virtnet
copytools stopped in 0s
0+0 records in
0+0 records out
0 bytes copied, 0.00843787 s, 0.0 kB/s
0x200000402:0x3d3:0x0
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_255/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
PASS 255 (19s)

== sanity-hsm test 260a: Restore request have priority over other requests ========================================================== 13:04:22 (1772474662)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157728 s, 6.6 MB/s
0x200000402:0x3d5:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14199 s, 7.4 MB/s
0x200000402:0x3d6:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125119 s, 8.4 MB/s
0x200000402:0x3d7:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137847 s, 7.6 MB/s
0x200000402:0x3d8:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119945 s, 8.7 MB/s
0x200000402:0x3d9:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117131 s, 9.0 MB/s
0x200000402:0x3da:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104304 s, 10.1 MB/s
0x200000402:0x3db:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161307 s, 6.5 MB/s
0x200000402:0x3dc:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.171112 s, 6.1 MB/s
0x200000402:0x3dd:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11769 s, 8.9 MB/s
0x200000402:0x3de:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.126192 s, 8.3 MB/s
0x200000402:0x3df:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.216352 s, 4.8 MB/s
0x200000402:0x3e0:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.222603 s, 4.7 MB/s
0x200000402:0x3e1:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118532 s, 8.8 MB/s
0x200000402:0x3e2:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119703 s, 8.8 MB/s
0x200000402:0x3e3:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105406 s, 9.9 MB/s
0x200000402:0x3e4:0x0
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Killing existing copytools on oleg205-client.virtnet
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
ARCHIVE
RESTORE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
PASS 260a (26s)

== sanity-hsm test 260b: Restore request have priority over other requests ========================================================== 13:04:48 (1772474688)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.136046 s, 7.7 MB/s
0x200000402:0x3e7:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139693 s, 7.5 MB/s
0x200000402:0x3e8:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.114165 s, 9.2 MB/s
0x200000402:0x3e9:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.114127 s, 9.2 MB/s
0x200000402:0x3ea:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0978891 s, 10.7 MB/s
0x200000402:0x3eb:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117835 s, 8.9 MB/s
0x200000402:0x3ec:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154933 s, 6.8 MB/s
0x200000402:0x3ed:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0912405 s, 11.5 MB/s
0x200000402:0x3ee:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0994328 s, 10.5 MB/s
0x200000402:0x3ef:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143986 s, 7.3 MB/s
0x200000402:0x3f0:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.108297 s, 9.7 MB/s
0x200000402:0x3f1:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111753 s, 9.4 MB/s
0x200000402:0x3f2:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117483 s, 8.9 MB/s
0x200000402:0x3f3:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.140299 s, 7.5 MB/s
0x200000402:0x3f4:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139516 s, 7.5 MB/s
0x200000402:0x3f5:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.171294 s, 6.1 MB/s
0x200000402:0x3f6:0x0
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Killing existing copytools on oleg205-client.virtnet
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
RESTORE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
PASS 260b (26s)

== sanity-hsm test 260c: Requests are not reordered on the 'hot' path of the coordinator ========================================================== 13:05:14 (1772474714)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115931 s, 9.0 MB/s
0x200000402:0x3f9:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151586 s, 6.9 MB/s
0x200000402:0x3fa:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123972 s, 8.5 MB/s
0x200000402:0x3fb:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161254 s, 6.5 MB/s
0x200000402:0x3fc:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0948981 s, 11.0 MB/s
0x200000402:0x3fd:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141057 s, 7.4 MB/s
0x200000402:0x3fe:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.138827 s, 7.6 MB/s
0x200000402:0x3ff:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143991 s, 7.3 MB/s
0x200000402:0x400:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104419 s, 10.0 MB/s
0x200000402:0x401:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11798 s, 8.9 MB/s
0x200000402:0x402:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0998516 s, 10.5 MB/s
0x200000402:0x403:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135573 s, 7.7 MB/s
0x200000402:0x404:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.158765 s, 6.6 MB/s
0x200000402:0x405:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143001 s, 7.3 MB/s
0x200000402:0x406:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0897084 s, 11.7 MB/s
0x200000402:0x407:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135466 s, 7.7 MB/s
0x200000402:0x408:0x0
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre2"'
Killing existing copytools on oleg205-client.virtnet
copytools stopped in 0s
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
RESTORE
PASS 260c (28s)

== sanity-hsm test 261: Report 0 bytes size after HSM release ========================================================== 13:05:42 (1772474742)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_261/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
2+0 records in
2+0 records out
8192 bytes (8.2 kB, 8.0 KiB) copied, 0.00707847 s, 1.2 MB/s
/mnt/lustre/d261.sanity-hsm/f261.sanity-hsm: (0x00000009) exists archived, archive_id:2
Waiting 200s for 'SUCCEED'
/mnt/lustre/d261.sanity-hsm/f261.sanity-hsm: (0x0000000d) released exists archived, archive_id:2
PASS 261 (9s)

== sanity-hsm test 262: The client should return 1 block for HSM released files ========================================================== 13:05:51 (1772474751)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_262/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
2+0 records in
2+0 records out
8192 bytes (8.2 kB, 8.0 KiB) copied, 0.00926393 s, 884 kB/s
PASS 262 (6s)

== sanity-hsm test 300: On disk coordinator state kept between MDT umount/mount ========================================================== 13:05:57 (1772474757)
Stop coordinator and remove coordinator state at mount
mdt.lustre-MDT0000.hsm_control=shutdown
Failing mds1 on oleg205-server
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
13:06:03 (1772474763) shut down
facet: mds1 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds1 to oleg205-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
13:06:20 (1772474780) targets are mounted
13:06:20 (1772474780) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
Set coordinator start at mount, and start coordinator
Failing mds1 on oleg205-server
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
13:06:51 (1772474811) shut down
facet: mds1 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds1 to oleg205-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
13:07:08 (1772474828) targets are mounted
13:07:08 (1772474828) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
PASS 300 (81s)

== sanity-hsm test 301: HSM tunnable are persistent ====== 13:07:18 (1772474838)
Failing mds1 on oleg205-server
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
13:07:23 (1772474843) shut down
facet: mds1 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds1 to oleg205-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
13:07:40 (1772474860) targets are mounted
13:07:40 (1772474860) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
PASS 301 (32s)

== sanity-hsm test 302: HSM tunnable are persistent when CDT is off ========================================================== 13:07:50 (1772474870)
mdt.lustre-MDT0000.hsm_control=shutdown
Failing mds1 on oleg205-server
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
13:07:57 (1772474877) shut down
facet: mds1 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds1 to oleg205-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
13:08:15 (1772474895) targets are mounted
13:08:15 (1772474895) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
PASS 302 (35s)

== sanity-hsm test 400: Single request is sent to the right MDT ========================================================== 13:08:26 (1772474906)

 SKIP: sanity-hsm test_400 needs >= 2 MDTs
SKIP 400 (1s)

== sanity-hsm test 401: Compound requests split and sent to their respective MDTs ========================================================== 13:08:28 (1772474908)

 SKIP: sanity-hsm test_401 needs >= 2 MDTs
SKIP 401 (1s)

== sanity-hsm test 402a: Copytool start fails if all MDTs are inactive ========================================================== 13:08:30 (1772474910)
deactivate lustre-MDT0000-mdc-ffff94554458d000 on oleg205-client.virtnet
deactivate lustre-MDT0000-mdc-ffff945558575800 on oleg205-client.virtnet
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_402a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Failed to start copytool agt1 on 'oleg205-client.virtnet'
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
uuid not found in agent list on mds1
activate lustre-MDT0000-mdc-ffff94554458d000 on oleg205-client.virtnet
activate lustre-MDT0000-mdc-ffff945558575800 on oleg205-client.virtnet
PASS 402a (5s)

== sanity-hsm test 402b: CDT must retry request upon slow start of CT ========================================================== 13:08:35 (1772474915)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_402b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
fail_loc=0x14d
fail_loc=0
Waiting 200s for 'SUCCEED'
Updated after 4s: want 'SUCCEED' got 'SUCCEED'
PASS 402b (21s)

== sanity-hsm test 403: Copytool starts with inactive MDT and register on reconnect ========================================================== 13:08:56 (1772474936)

 SKIP: sanity-hsm test_403 needs >= 2 MDTs
SKIP 403 (3s)

== sanity-hsm test 404: Inactive MDT does not block requests for active MDTs ========================================================== 13:08:59 (1772474939)

 SKIP: sanity-hsm test_404 needs >= 2 MDTs
SKIP 404 (2s)

== sanity-hsm test 405: archive and release under striped directory ========================================================== 13:09:01 (1772474941)

 SKIP: sanity-hsm test_405 needs >= 2 MDTs
SKIP 405 (2s)

== sanity-hsm test 406: attempting to migrate HSM archived files is safe ========================================================== 13:09:03 (1772474943)

 SKIP: sanity-hsm test_406 needs >= 2 MDTs
SKIP 406 (2s)

== sanity-hsm test 407: Check for double RESTORE records in llog ========================================================== 13:09:05 (1772474945)
0+0 records in
0+0 records out
0 bytes copied, 0.00357192 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_407/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
fail_val=5
fail_loc=0x164
Copytool is suspended on oleg205-client.virtnet
mdt.lustre-MDT0000.hsm.actions=
lrh=[type=10680000 len=136 idx=6/1] fid=[0x2000032e1:0x2:0x0] dfid=[0x2000032e1:0x2:0x0] compound/cookie=0x0/0x69a5d20c action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/2] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x69a5d20d action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
Failing mds1 on oleg205-server
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
13:09:15 (1772474955) shut down
facet: mds1 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds1 to oleg205-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
13:09:32 (1772474972) targets are mounted
13:09:32 (1772474972) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
fail_loc=0
mdt.lustre-MDT0000.hsm.actions=
lrh=[type=10680000 len=136 idx=6/1] fid=[0x2000032e1:0x2:0x0] dfid=[0x2000032e1:0x2:0x0] compound/cookie=0x0/0x69a5d20c action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/2] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x69a5d20d action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/3] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x69a5d20e action=RESTORE archive#=2 flags=0x4 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
Copytool is continued on oleg205-client.virtnet
d41d8cd98f00b204e9800998ecf8427e  /mnt/lustre/d407.sanity-hsm/f407.sanity-hsm
d41d8cd98f00b204e9800998ecf8427e  /mnt/lustre2/d407.sanity-hsm/f407.sanity-hsm
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
mdt.lustre-MDT0000.hsm.actions=
lrh=[type=10680000 len=136 idx=6/1] fid=[0x2000032e1:0x2:0x0] dfid=[0x2000032e1:0x2:0x0] compound/cookie=0x0/0x69a5d20c action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/2] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x69a5d20d action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/3] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x3:0x0] compound/cookie=0x0/0x69a5d20e action=RESTORE archive#=2 flags=0x4 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
PASS 407 (38s)

== sanity-hsm test 408: Verify fiemap on release file ==== 13:09:43 (1772474983)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_408/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
65536 bytes (66 kB, 64 KiB) copied, 0.0939036 s, 698 kB/s

 SKIP: sanity-hsm test_408 ORI-366/LU-1941: FIEMAP unimplemented on ZFS
SKIP 408 (3s)

== sanity-hsm test 409a: Coordinator should not stop when in use ========================================================== 13:09:46 (1772474986)
0+0 records in
0+0 records out
0 bytes copied, 0.00253769 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
fail_val=5
fail_loc=0x164
cat: /mnt/lustre/d409a.sanity-hsm/f409a.sanity-hsm: No data available
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
Killing existing copytools on oleg205-client.virtnet
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=enabled
PASS 409a (16s)

== sanity-hsm test 409b: getattr released file with CDT stopped after remount ========================================================== 13:10:02 (1772475002)
0+0 records in
0+0 records out
0 bytes copied, 0.00504811 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Killing existing copytools on oleg205-client.virtnet
copytools stopped in 0s
Failing mds1 on oleg205-server
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
13:10:30 (1772475030) shut down
facet: mds1 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds1 to oleg205-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
13:10:48 (1772475048) targets are mounted
13:10:48 (1772475048) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
  File: /mnt/lustre/d409b.sanity-hsm/f409b.sanity-hsm
  Size: 0         	Blocks: 0          IO Block: 4194304 regular empty file
Device: 2c54f966h/743766374d	Inode: 144115406615871496  Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2026-03-02 13:10:03.000000000 -0500
Modify: 2026-03-02 13:10:03.000000000 -0500
Change: 2026-03-02 13:10:03.000000000 -0500
 Birth: 2026-03-02 13:10:03.000000000 -0500
PASS 409b (77s)

== sanity-hsm test 410: lfs data_version -s allows release of force-archived file ========================================================== 13:11:19 (1772475079)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118493 s, 8.8 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_410/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Cannot send HSM request (use of /mnt/lustre/d410.sanity-hsm/f410.sanity-hsm): Operation not permitted
PASS 410 (5s)

== sanity-hsm test 411: hsm_ops rbac role ================ 13:11:24 (1772475084)
On MGS 192.168.202.105, active = nodemap.active=1
On MGS 192.168.202.105, test_411.trusted_nodemap = nodemap.test_411.trusted_nodemap=1
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_411/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
/mnt/lustre/d411.sanity-hsm/fileA: (0x00000000)
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Killing existing copytools on oleg205-client.virtnet
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_411/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
On MGS 192.168.202.105, test_411.rbac = nodemap.test_411.rbac=file_perms,dne_ops,quota_ops,byfid_ops,chlg_ops,fscrypt_admin,server_upcall,ignore_root_prjquota,local_admin,pool_quota_ops
/mnt/lustre/d411.sanity-hsm/fileB: (0x00000000)
Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied
Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Operation not permitted
Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied
Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied
lfs hsm_set: change hsm flags for '/mnt/lustre/d411.sanity-hsm/fileB' failed: Permission denied
lfs hsm_clear: change hsm flags for '/mnt/lustre/d411.sanity-hsm/fileB' failed: Permission denied
On MGS 192.168.202.105, active = nodemap.active=0
oleg205-server: error: nodemap 'test_411' does not exist
oleg205-server: nodemap_del: Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
On MGS 192.168.202.105, active = nodemap.active=0
PASS 411 (22s)

== sanity-hsm test 500: various LLAPI HSM tests ========== 13:11:47 (1772475107)
 test1 @1772475136: Register/unregister copytool 2000x to check for leaks ...... pass
 test2 @1772475136: Re/un-register copytool multiple times without error ....... pass
 test3 @1772475136: Pass bad parameters to llapi_hsm_copytool_register() ....... pass
 test4 @1772475136: Bad parameters to llapi_hsm_copytool_unregister() .......... pass
 test5 @1772475136: Test llapi_hsm_copytool_recv() in non-blocking mode ........ pass
 test6 @1772475136: Test llapi_hsm_copytool_recv() with bogus parameters ....... pass
 test7 @1772475136: Test event polling (without actual traffic) ................ pass
 test50 @1772475136: Test llapi_hsm_state_get()/get_fd() ....................... pass
 test51 @1772475137: Test llapi_hsm_state_set_fd() ............................. pass
 test52 @1772475137: Test llapi_hsm_current_action() ........................... pass
 test100 @1772475137: Simple archive creation with no progress reported. ....... pass
 test101 @1772475141: Simple archive creation with progress every byte. ........ pass
 test102 @1772475144: Archive creation with progress every byte, backwards ..... pass
 test103 @1772475145: Archive creation with a single progress report ........... pass
 test104 @1772475146: Archive creation with two progress reports ............... pass
 test105 @1772475147: Archive creation with one bogus progress report .......... pass
 test106 @1772475148: Archive creation with one empty progress report .......... pass
 test107 @1772475149: Archive creation with one bogus progress report .......... pass
 test108 @1772475152: Archive creation with same progress report each time ..... pass
 test109 @1772475153: Archive creation with one report, with large number ...... pass
 test110 @1772475154: Archive with 10 progress reports, checking progress ...... pass
 test111 @1772475155: Archive with 10 reports in reverse, checking progress .... pass
 test112 @1772475156: Archive with 10 reports, duplicated, check progress ...... pass
 test113 @1772475158: Archive with 9 reports, with 20% overlapping coverage .... pass
PASS 500 (54s)

== sanity-hsm test 600: Changelog fields 'u=' and 'nid=' ========================================================== 13:12:40 (1772475160)
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl1'
mdd.lustre-MDT0000.changelog_mask=ALL
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d600.sanity-hsm/f600.sanity-hsm]
Got NID '192.168.202.5@tcp'
lustre-MDT0000: clear the changelog for cl1 of all records
lustre-MDT0000: Deregistered changelog user #1
PASS 600 (8s)

== sanity-hsm test 601: OPEN Changelog entry ============= 13:12:48 (1772475168)
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl2'
mdd.lustre-MDT0000.changelog_mask=ALL
lustre-MDT0000: clear the changelog for cl2 of all records
lustre-MDT0000.8 10OPEN  18:12:50.381097798 2026.03.02 0x1 t=[0x2000032e1:0x26:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.202.5@tcp m=r-- p=[0x2000032e1:0x25:0x0]
lustre-MDT0000: clear the changelog for cl2 of all records
lustre-MDT0000: Deregistered changelog user #2
PASS 601 (7s)

== sanity-hsm test 602: Changelog record CLOSE only if open+write or OPEN recorded ========================================================== 13:12:55 (1772475175)
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl3'
mdd.lustre-MDT0000.changelog_mask=ALL
lustre-MDT0000: clear the changelog for cl3 of all records
lustre-MDT0000.13 11CLOSE 18:12:56.938967170 2026.03.02 0x1 t=[0x2000032e1:0x28:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000: clear the changelog for cl3 of all records
lustre-MDT0000.14 10OPEN  18:12:57.083454280 2026.03.02 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.202.5@tcp m=-w-
lustre-MDT0000.15 13TRUNC 18:12:57.086298047 2026.03.02 0xe t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x2000032e1:0x27:0x0]
lustre-MDT0000.16 11CLOSE 18:12:57.096272099 2026.03.02 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000.16 11CLOSE 18:12:57.096272099 2026.03.02 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
mdd.lustre-MDT0000.changelog_mask=-OPEN
lustre-MDT0000: clear the changelog for cl3 of all records
f
lustre-MDT0000: clear the changelog for cl3 of all records
lustre-MDT0000.17 13TRUNC 18:12:57.974455227 2026.03.02 0xe t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x2000032e1:0x27:0x0]
lustre-MDT0000.18 11CLOSE 18:12:57.978457930 2026.03.02 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000.18 11CLOSE 18:12:57.978457930 2026.03.02 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000: clear the changelog for cl3 of all records
lustre-MDT0000: Deregistered changelog user #3
PASS 602 (7s)

== sanity-hsm test 603: GETXATTR Changelog entry ========= 13:13:02 (1772475182)
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl4'
mdd.lustre-MDT0000.changelog_mask=ALL
lustre-MDT0000: clear the changelog for cl4 of all records
getfattr: Removing leading '/' from absolute path names
# file: mnt/lustre/d603.sanity-hsm/f603.sanity-hsm
user.xattr1="value1"

lustre-MDT0000.24 23GXATR 18:13:04.027296744 2026.03.02 0x0 t=[0x2000032e1:0x2a:0x0] j=getfattr.0 ef=0x1b u=0:0 nid=192.168.202.5@tcp x=user.xattr1
lustre-MDT0000: clear the changelog for cl4 of all records
lustre-MDT0000: Deregistered changelog user #4
PASS 603 (6s)

== sanity-hsm test 604: NOPEN Changelog entry ============ 13:13:08 (1772475188)
mdd.lustre-MDT0000.changelog_deniednext=20
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl5'
mdd.lustre-MDT0000.changelog_mask=ALL
lustre-MDT0000: clear the changelog for cl5 of all records
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm]
cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied
lustre-MDT0000.29 24NOPEN 18:13:11.285088917 2026.03.02 0x1 t=[0x2000032e1:0x2c:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.202.5@tcp m=r--
Got NID '192.168.202.5@tcp'
lustre-MDT0000: clear the changelog for cl5 of all records
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm]
cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied
lustre-MDT0000: clear the changelog for cl5 of all records
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm]
cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied
lustre-MDT0000.30 24NOPEN 18:13:31.621816270 2026.03.02 0x1 t=[0x2000032e1:0x2c:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.202.5@tcp m=r-- p=[0x2000032e1:0x27:0x0]
Got NID '192.168.202.5@tcp'
lustre-MDT0000: clear the changelog for cl5 of all records
lustre-MDT0000: Deregistered changelog user #5
mdd.lustre-MDT0000.changelog_deniednext=60
PASS 604 (29s)

== sanity-hsm test 605: Test OPEN and CLOSE rate limit in Changelogs ========================================================== 13:13:37 (1772475217)
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl6'
mdd.lustre-MDT0000.changelog_mask=ALL
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0000.34 10OPEN  18:13:39.335376497 2026.03.02 0x43 t=[0x2000032e1:0x2e:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.202.5@tcp m=rw-
lustre-MDT0000.34 10OPEN  18:13:39.335376497 2026.03.02 0x43 t=[0x2000032e1:0x2e:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.202.5@tcp m=rw-
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0000.35 10OPEN  18:13:39.905122440 2026.03.02 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.202.5@tcp m=r--
lustre-MDT0000.36 11CLOSE 18:13:39.923694040 2026.03.02 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000.35 10OPEN  18:13:39.905122440 2026.03.02 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.202.5@tcp m=r--
lustre-MDT0000.36 11CLOSE 18:13:39.923694040 2026.03.02 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0000: clear the changelog for cl6 of all records
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [cat] [/mnt/lustre/d605.sanity-hsm/f605.sanity-hsm]
lustre-MDT0000.37 10OPEN  18:13:40.624148994 2026.03.02 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.202.5@tcp m=r-- p=[0x2000032e1:0x27:0x0]
lustre-MDT0000.38 11CLOSE 18:13:40.627795071 2026.03.02 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.500 ef=0x13 u=500:500 nid=192.168.202.5@tcp
lustre-MDT0000.37 10OPEN  18:13:40.624148994 2026.03.02 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.202.5@tcp m=r-- p=[0x2000032e1:0x27:0x0]
lustre-MDT0000.38 11CLOSE 18:13:40.627795071 2026.03.02 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.500 ef=0x13 u=500:500 nid=192.168.202.5@tcp
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0000.39 11CLOSE 18:13:40.924068702 2026.03.02 0x43 t=[0x2000032e1:0x2e:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000.39 11CLOSE 18:13:40.924068702 2026.03.02 0x43 t=[0x2000032e1:0x2e:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0000: Deregistered changelog user #6
PASS 605 (9s)

== sanity-hsm test 606: llog_reader groks changelog fields ========================================================== 13:13:46 (1772475226)
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl7'
mdd.lustre-MDT0000.changelog_mask=ALL
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d606.sanity-hsm/f606.sanity-hsm]
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
rec #2 type=1064553b len=64 offset 8256
Header size : 8192	 llh_size : 64
Time : Mon Mar  2 12:57:15 2026
Number of records: 1	cat_idx: 0	last_idx: 2
Flags: 0x2012
Target uuid : 
-----------------------
#02 (064)fid=[0x1:0x3b:0x0] path=oi.1/0x1:0x3b:0x0
oleg205-server: llog_reader: The llog is corrupted, 1 errors found
Got UID/GID 500:500
Got NID 192.168.202.5@tcp
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
lustre-MDT0000: clear the changelog for cl7 of all records
lustre-MDT0000: Deregistered changelog user #7
PASS 606 (22s)

== sanity-hsm test 607a: release a file that was migrated after being archived ========================================================== 13:14:08 (1772475248)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120357 s, 8.7 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Waiting 200s for 'SUCCEED'
PASS 607a (8s)

== sanity-hsm test 607b: Migrate should not change the HSM attribute of dirty files ========================================================== 13:14:16 (1772475256)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107959 s, 9.7 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
llite.lustre-ffff94554458d000.xattr_cache=0
llite.lustre-ffff945558575800.xattr_cache=0
/mnt/lustre/d607b.sanity-hsm/f607b.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:1
llite.lustre-ffff94554458d000.xattr_cache=1
llite.lustre-ffff945558575800.xattr_cache=1
PASS 607b (6s)

== sanity-hsm test 607c: 'lfs swap_layouts' should set dirty flag on HSM file ========================================================== 13:14:22 (1772475262)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0720407 s, 14.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.074254 s, 14.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0822013 s, 12.8 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
lfs swap_layouts: error: cannot swap layout between '/mnt/lustre/d607c.sanity-hsm/f607c.sanity-hsm-1' and '/mnt/lustre/d607c.sanity-hsm/f607c.sanity-hsm-3': Operation not permitted (1)
PASS 607c (5s)
== sanity-hsm test complete, duration 3813 sec =========== 13:14:27 (1772475267)
=== sanity-hsm: start cleanup 13:14:28 (1772475268) ===
Stopping clients: oleg205-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg205-client.virtnet /mnt/lustre2 opts:
=== sanity-hsm: finish cleanup 13:14:40 (1772475280) ===