-----============= acceptance-small: sanity-hsm ============----- Thu Aug  6 12:38:31 EDT 2026
MGS_OS_ID_LIKE=rhel centos fedora rocky
MGS_OS_VERSION_ID=8.10
MGS_OS_ID=rocky
MGS_OS_VERSION_CODE=134873088
MDS1_OS_VERSION_ID=8.10
MDS1_OS_VERSION_CODE=134873088
MDS1_OS_ID_LIKE=rhel centos fedora rocky
MDS1_OS_ID=rocky
OST1_OS_VERSION_CODE=134873088
OST1_OS_ID_LIKE=rhel centos fedora rocky
OST1_OS_VERSION_ID=8.10
OST1_OS_ID=rocky
CLIENT_OS_ID=rocky
CLIENT_OS_VERSION_CODE=134873088
CLIENT_OS_VERSION_ID=8.10
CLIENT_OS_ID_LIKE=rhel centos fedora rocky
oleg205-server: /home/green/git/lustre-release/lustre/tests/except/sanity-hsm.ex
- see MDS1_VERSION <= CLIENT_VERSION (34682933 <= 34682933) for LU-18924, go 100 105
excepting tests: 
=== sanity-hsm: start setup 12:38:55 (1786034335) ===
Starting client oleg205-client.virtnet:  -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2
Mount client oleg205-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre2
Started clients oleg205-client.virtnet: 
192.168.202.105@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose)
oleg205-client.virtnet: executing check_config_client /mnt/lustre
oleg205-client.virtnet: Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients oleg205-client.virtnet environments
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff989ec9222000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff989ee02a8800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff989ec9222000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff989ee02a8800.idle_timeout=debug
disable quota as required
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
osd-ldiskfs.track_declares_assert=1
=== sanity-hsm: finish setup 12:39:44 (1786034384) ===
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [true]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d0_runas_test/f8224]
nobody:x:65534:
Killing existing copytools on oleg205-client.virtnet with signal TERM
pkill: pidfile not valid
Try `pkill --help' for more information.
Set HSM on and start
Set sanity-hsm HSM policy

== sanity-hsm test 1A: lfs hsm flags root/non-root access ========================================================== 12:40:14 (1786034414)
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_set] [--norelease] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_clear] [--norelease] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_set] [--exists] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
lfs hsm_set: change hsm flags for '/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm' failed: Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
PASS 1A (9s)

== sanity-hsm test 1a: mmap & cat a HSM released file ==== 12:40:23 (1786034423)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.249041 s, 4.2 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Verifying released state: PASS 1a (14s)

== sanity-hsm test 1b: Archive, Release and Restore composite file ========================================================== 12:40:37 (1786034437)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0940941 s, 11.1 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
archive /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm
release /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm
verify released state: 
pass
restore /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm
verify restored state: 
pass
PASS 1b (12s)

== sanity-hsm test 1c: Check setting archive-id in lfs hsm_set ========================================================== 12:40:49 (1786034449)
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm]
verifying archive number is 32
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm]
verifying archive number is still 32
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm]
verifying archive number is 33
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm]
verifying archive number is 16
PASS 1c (8s)

== sanity-hsm test 1d: Archive, Release and Restore DoM file ========================================================== 12:40:57 (1786034457)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0756315 s, 13.9 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
archive /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm
release /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm
verify released state: 
pass
restore /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm
verify restored state: 
pass
PASS 1d (10s)

== sanity-hsm test 1e: Archive, Release and Restore SEL file ========================================================== 12:41:07 (1786034467)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0837712 s, 12.5 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
archive /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm
release /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm
verify released state: 
pass
restore /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm
verify restored state: 
pass
PASS 1e (11s)

== sanity-hsm test 1f: DoM file release after restore ==== 12:41:18 (1786034478)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0745687 s, 14.1 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
archive /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
release /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm
verify released state: 
pass
restore /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
verify restored state: 
pass
release again /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm
/mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm: (0x0000000d) released exists archived, archive_id:1
verify released state: 
pass
PASS 1f (16s)

== sanity-hsm test 2: Check file dirtyness when doing setattr ========================================================== 12:41:34 (1786034494)
0+0 records in
0+0 records out
0 bytes copied, 0.021537 s, 0.0 kB/s
0x200000403:0x8:0x0
PASS 2 (9s)

== sanity-hsm test 3: Check file dirtyness when opening for write ========================================================== 12:41:43 (1786034503)
Succeed in opening file "/mnt/lustre/d3.sanity-hsm/f3.sanity-hsm"(flags=O_WRONLY)
3+0 records in
3+0 records out
3+0 records in
3+0 records out
PASS 3 (9s)

== sanity-hsm test 4: Useless cancel must not be registered ========================================================== 12:41:52 (1786034512)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.146516 s, 7.2 MB/s
PASS 4 (8s)

== sanity-hsm test 8: Test default archive number ======== 12:42:01 (1786034521)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_8/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 8 (10s)

== sanity-hsm test 9A: Use of explicit archive number, with dedicated copytool ========================================================== 12:42:12 (1786034532)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_9A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 3  "/mnt/lustre2"'
oleg205-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg205-client.virtnet: executing get_client_uuid /mnt/lustre2
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=3 requests=[current:0 ok:0 errors:0] on mds1
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=3 requests=[current:0 ok:0 errors:0] on mds2
PASS 9A (32s)

== sanity-hsm test 9a: Multiple remote agents ============ 12:42:43 (1786034563)

 SKIP: sanity-hsm test_9a Need 3 or more clients, have 1
SKIP 9a (3s)

== sanity-hsm test 10a: Archive a file =================== 12:42:46 (1786034566)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
/home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 996: warning: command substitution: ignored null byte in input
Verifying content
Verifying hsm state 
Verifying archive number is 2
PASS 10a (12s)

== sanity-hsm test 10b: Archive of non dirty file must work without doing request ========================================================== 12:42:59 (1786034579)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 10b (13s)

== sanity-hsm test 10c: Check forbidden archive ========== 12:43:11 (1786034591)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Cannot send HSM request (use of /mnt/lustre/d10c.sanity-hsm/f10c.sanity-hsm): Operation not permitted
PASS 10c (9s)

== sanity-hsm test 10d: Archive a file on the default archive id ========================================================== 12:43:20 (1786034600)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 10d (11s)

== sanity-hsm test 11a: Import a file ==================== 12:43:31 (1786034611)
lhsmtool_posix: 1786034615.114827 [22142]: action=1 src=d11a.sanity-hsm/f11a.sanity-hsm dst=/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786034615.124164 [22142]: importing '/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11a//d11a.sanity-hsm/f11a.sanity-hsm'
lhsmtool_posix: 1786034615.207363 [22142]: imported '/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11a//0424/0x200000402:0x26:0x0'=='/tmp/arc1/sanity-hsm.test_11a//d11a.sanity-hsm/f11a.sanity-hsm'
lhsmtool_posix: 1786034615.207436 [22142]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Verifying released state: Verifying imported size 158=158
Verifying released pattern: raid0,released
Verifying new fid 0x200000402:0x26:0x0 in archive
PASS 11a (10s)

== sanity-hsm test 11b: Import a deleted file using its FID ========================================================== 12:43:41 (1786034621)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_11b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1786034627.018447 [22834]: action=1 src=0x200000403:0x11:0x0 dst=/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786034627.036366 [22834]: Resolving [0x200000403:0x11:0x0] to /tmp/arc1/sanity-hsm.test_11b//0412/0x200000403:0x11:0x0
lhsmtool_posix: 1786034627.036500 [22834]: importing '/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11b//0412/0x200000403:0x11:0x0'
lhsmtool_posix: 1786034627.106329 [22834]: imported '/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11b//042a/0x200000402:0x28:0x0'=='/tmp/arc1/sanity-hsm.test_11b//0412/0x200000403:0x11:0x0'
lhsmtool_posix: 1786034627.106398 [22834]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm: OK
PASS 11b (13s)

== sanity-hsm test 11c: Import a file to a directory with a pool ========================================================== 12:43:54 (1786034634)
Creating new pool test_11c
oleg205-server: Pool lustre.test_11c created
Adding targets to pool
oleg205-server: OST lustre-OST0001_UUID added to pool lustre.test_11c
lhsmtool_posix: 1786034645.843069 [23552]: action=1 src=d11c.sanity-hsm/f11c.sanity-hsm dst=/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786034645.853389 [23552]: importing '/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11c//d11c.sanity-hsm/f11c.sanity-hsm'
lhsmtool_posix: 1786034645.902571 [23552]: imported '/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11c//0428/0x200000402:0x2a:0x0'=='/tmp/arc1/sanity-hsm.test_11c//d11c.sanity-hsm/f11c.sanity-hsm'
lhsmtool_posix: 1786034645.902975 [23552]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Destroy the created pools: test_11c
lustre.test_11c
oleg205-server: OST lustre-OST0001_UUID removed from pool lustre.test_11c
oleg205-server: Pool lustre.test_11c destroyed
PASS 11c (28s)

== sanity-hsm test 12a: Restore an imported file explicitly ========================================================== 12:44:22 (1786034662)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1786034664.562549 [24291]: action=1 src=d12a.sanity-hsm/f12a.sanity-hsm dst=/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786034664.569414 [24291]: importing '/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12a//d12a.sanity-hsm/f12a.sanity-hsm'
lhsmtool_posix: 1786034664.602458 [24291]: imported '/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12a//042f/0x200000402:0x2d:0x0'=='/tmp/arc1/sanity-hsm.test_12a//d12a.sanity-hsm/f12a.sanity-hsm'
lhsmtool_posix: 1786034664.603128 [24291]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Verifying released state: 
Verifying file state: 
PASS 12a (10s)

== sanity-hsm test 12b: Restore an imported file implicitly ========================================================== 12:44:33 (1786034673)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1786034676.018238 [24997]: action=1 src=d12b.sanity-hsm/f12b.sanity-hsm dst=/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786034676.026391 [24997]: importing '/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12b//d12b.sanity-hsm/f12b.sanity-hsm'
lhsmtool_posix: 1786034676.111094 [24997]: imported '/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12b//042d/0x200000402:0x2f:0x0'=='/tmp/arc1/sanity-hsm.test_12b//d12b.sanity-hsm/f12b.sanity-hsm'
lhsmtool_posix: 1786034676.111147 [24997]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Verifying released state: 
Verifying file state after restore: 
PASS 12b (10s)

== sanity-hsm test 12c: Restore a file with stripe of 2 == 12:44:42 (1786034682)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
5+0 records in
5+0 records out
5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.1795 s, 29.2 MB/s
/mnt/lustre/d12c.sanity-hsm/f12c.sanity-hsm: OK
PASS 12c (12s)

== sanity-hsm test 12d: Restore of a non archived, non released file must work ========================================================== 12:44:55 (1786034695)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
PASS 12d (14s)

== sanity-hsm test 12e: Check forbidden restore ========== 12:45:09 (1786034709)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
/mnt/lustre/d12e.sanity-hsm/f12e.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:1
Cannot send HSM request (use of /mnt/lustre/d12e.sanity-hsm/f12e.sanity-hsm): Operation not permitted
PASS 12e (11s)

== sanity-hsm test 12f: Restore a released file explicitly ========================================================== 12:45:20 (1786034720)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Verifying file state: PASS 12f (10s)

== sanity-hsm test 12g: Restore a released file implicitly ========================================================== 12:45:30 (1786034730)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12g/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 12g (13s)

== sanity-hsm test 12h: Restore a released file implicitly from a second node ========================================================== 12:45:43 (1786034743)

 SKIP: sanity-hsm test_12h Need 2 or more clients, have 1
SKIP 12h (4s)

== sanity-hsm test 12m: Archive/release/implicit restore ========================================================== 12:45:47 (1786034747)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12m/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 12m (9s)

== sanity-hsm test 12n: Import/implicit restore/release == 12:45:56 (1786034756)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12n/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1786034759.089661 [29839]: action=1 src=d12n.sanity-hsm/f12n.sanity-hsm dst=/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786034759.099322 [29839]: importing '/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12n//d12n.sanity-hsm/f12n.sanity-hsm'
lhsmtool_posix: 1786034759.158244 [29839]: imported '/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12n//043f/0x200000402:0x3d:0x0'=='/tmp/arc1/sanity-hsm.test_12n//d12n.sanity-hsm/f12n.sanity-hsm'
lhsmtool_posix: 1786034759.164065 [29839]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
PASS 12n (10s)

== sanity-hsm test 12o: Layout-swap failure during Restore leaves file released ========================================================== 12:46:06 (1786034766)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12o/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
fail_loc=0x152
mdt.lustre-MDT0000.hsm.policy=+NRA
mdt.lustre-MDT0001.hsm.policy=+NRA
diff: /mnt/lustre/d12o.sanity-hsm/f12o.sanity-hsm: No data available
mdt.lustre-MDT0000.hsm.policy=-NRA
mdt.lustre-MDT0001.hsm.policy=-NRA
fail_loc=0
mdt.lustre-MDT0000.hsm_control=purge
mdt.lustre-MDT0001.hsm_control=purge
PASS 12o (41s)

== sanity-hsm test 12p: implicit restore of a file on copytool mount point ========================================================== 12:46:47 (1786034807)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12p/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 12p (13s)

== sanity-hsm test 12q: file attributes are refreshed after restore ========================================================== 12:47:00 (1786034820)
Starting client: oleg205-client.virtnet:  -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre3
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12q/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre3"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0919654 s, 11.4 MB/s
Killing existing copytools on oleg205-client.virtnet with signal TERM
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12q/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre3"'
Stopping client oleg205-client.virtnet /mnt/lustre3 (opts:)
PASS 12q (19s)

== sanity-hsm test 12r: lseek restores released file ===== 12:47:19 (1786034839)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12r/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 12r (13s)

== sanity-hsm test 12s: race between restore requests ==== 12:47:33 (1786034853)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12s/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
fail_loc=0x8000018b
PASS 12s (17s)

== sanity-hsm test 12t: Multiple parallel reads for a HSM imported file ========================================================== 12:47:50 (1786034870)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12t/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1786034874.501367 [33981]: action=1 src=0x200000403:0x2a:0x0 dst=/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786034874.508370 [33981]: Resolving [0x200000403:0x2a:0x0] to /tmp/arc1/sanity-hsm.test_12t//0429/0x200000403:0x2a:0x0
lhsmtool_posix: 1786034874.508486 [33981]: importing '/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12t//0429/0x200000403:0x2a:0x0'
lhsmtool_posix: 1786034874.554135 [33981]: imported '/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12t//0449/0x200000402:0x4b:0x0'=='/tmp/arc1/sanity-hsm.test_12t//0429/0x200000403:0x2a:0x0'
lhsmtool_posix: 1786034874.554207 [33981]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
PASS 12t (12s)

== sanity-hsm test 12u: Multiple reads on multiple HSM imported files in parallel ========================================================== 12:48:03 (1786034883)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12u/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1786034899.659570 [34861]: action=1 src=0x200000403:0x2c:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0 mount_point=/mnt/lustre2
lhsmtool_posix: 1786034899.675213 [34861]: Resolving [0x200000403:0x2c:0x0] to /tmp/arc1/sanity-hsm.test_12u//042f/0x200000403:0x2c:0x0
lhsmtool_posix: 1786034899.675322 [34861]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0' from '/tmp/arc1/sanity-hsm.test_12u//042f/0x200000403:0x2c:0x0'
lhsmtool_posix: 1786034899.740272 [34861]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0' from '/tmp/arc1/sanity-hsm.test_12u//044f/0x200000402:0x4d:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042f/0x200000403:0x2c:0x0'
lhsmtool_posix: 1786034899.740972 [34861]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1786034900.312593 [34890]: action=1 src=0x200000403:0x2d:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1 mount_point=/mnt/lustre2
lhsmtool_posix: 1786034900.351095 [34890]: Resolving [0x200000403:0x2d:0x0] to /tmp/arc1/sanity-hsm.test_12u//042e/0x200000403:0x2d:0x0
lhsmtool_posix: 1786034900.351228 [34890]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1' from '/tmp/arc1/sanity-hsm.test_12u//042e/0x200000403:0x2d:0x0'
lhsmtool_posix: 1786034900.444789 [34890]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1' from '/tmp/arc1/sanity-hsm.test_12u//044c/0x200000402:0x4e:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042e/0x200000403:0x2d:0x0'
lhsmtool_posix: 1786034900.444869 [34890]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1786034901.267212 [34919]: action=1 src=0x200000403:0x2e:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2 mount_point=/mnt/lustre2
lhsmtool_posix: 1786034901.278149 [34919]: Resolving [0x200000403:0x2e:0x0] to /tmp/arc1/sanity-hsm.test_12u//042d/0x200000403:0x2e:0x0
lhsmtool_posix: 1786034901.278291 [34919]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2' from '/tmp/arc1/sanity-hsm.test_12u//042d/0x200000403:0x2e:0x0'
lhsmtool_posix: 1786034901.365001 [34919]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2' from '/tmp/arc1/sanity-hsm.test_12u//044d/0x200000402:0x4f:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042d/0x200000403:0x2e:0x0'
lhsmtool_posix: 1786034901.369888 [34919]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1786034901.853427 [34948]: action=1 src=0x200000403:0x2f:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3 mount_point=/mnt/lustre2
lhsmtool_posix: 1786034901.866425 [34948]: Resolving [0x200000403:0x2f:0x0] to /tmp/arc1/sanity-hsm.test_12u//042c/0x200000403:0x2f:0x0
lhsmtool_posix: 1786034901.866547 [34948]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3' from '/tmp/arc1/sanity-hsm.test_12u//042c/0x200000403:0x2f:0x0'
lhsmtool_posix: 1786034901.926383 [34948]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3' from '/tmp/arc1/sanity-hsm.test_12u//0452/0x200000402:0x50:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042c/0x200000403:0x2f:0x0'
lhsmtool_posix: 1786034901.927851 [34948]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1786034902.317210 [34977]: action=1 src=0x200000403:0x30:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4 mount_point=/mnt/lustre2
lhsmtool_posix: 1786034902.325238 [34977]: Resolving [0x200000403:0x30:0x0] to /tmp/arc1/sanity-hsm.test_12u//0433/0x200000403:0x30:0x0
lhsmtool_posix: 1786034902.325340 [34977]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4' from '/tmp/arc1/sanity-hsm.test_12u//0433/0x200000403:0x30:0x0'
lhsmtool_posix: 1786034902.399480 [34977]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4' from '/tmp/arc1/sanity-hsm.test_12u//0453/0x200000402:0x51:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0433/0x200000403:0x30:0x0'
lhsmtool_posix: 1786034902.399561 [34977]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1786034903.037923 [35007]: action=1 src=0x200000403:0x31:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5 mount_point=/mnt/lustre2
lhsmtool_posix: 1786034903.057253 [35007]: Resolving [0x200000403:0x31:0x0] to /tmp/arc1/sanity-hsm.test_12u//0432/0x200000403:0x31:0x0
lhsmtool_posix: 1786034903.057371 [35007]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5' from '/tmp/arc1/sanity-hsm.test_12u//0432/0x200000403:0x31:0x0'
lhsmtool_posix: 1786034903.131880 [35007]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5' from '/tmp/arc1/sanity-hsm.test_12u//0450/0x200000402:0x52:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0432/0x200000403:0x31:0x0'
lhsmtool_posix: 1786034903.131952 [35007]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1786034903.827750 [35036]: action=1 src=0x200000403:0x32:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6 mount_point=/mnt/lustre2
lhsmtool_posix: 1786034903.836947 [35036]: Resolving [0x200000403:0x32:0x0] to /tmp/arc1/sanity-hsm.test_12u//0431/0x200000403:0x32:0x0
lhsmtool_posix: 1786034903.837084 [35036]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6' from '/tmp/arc1/sanity-hsm.test_12u//0431/0x200000403:0x32:0x0'
lhsmtool_posix: 1786034903.916427 [35036]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6' from '/tmp/arc1/sanity-hsm.test_12u//0451/0x200000402:0x53:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0431/0x200000403:0x32:0x0'
lhsmtool_posix: 1786034903.917562 [35036]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1786034904.474510 [35065]: action=1 src=0x200000403:0x33:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7 mount_point=/mnt/lustre2
lhsmtool_posix: 1786034904.500066 [35065]: Resolving [0x200000403:0x33:0x0] to /tmp/arc1/sanity-hsm.test_12u//0430/0x200000403:0x33:0x0
lhsmtool_posix: 1786034904.510291 [35065]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7' from '/tmp/arc1/sanity-hsm.test_12u//0430/0x200000403:0x33:0x0'
lhsmtool_posix: 1786034904.597437 [35065]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7' from '/tmp/arc1/sanity-hsm.test_12u//0456/0x200000402:0x54:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0430/0x200000403:0x33:0x0'
lhsmtool_posix: 1786034904.602249 [35065]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1786034905.066175 [35094]: action=1 src=0x200000403:0x34:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8 mount_point=/mnt/lustre2
lhsmtool_posix: 1786034905.072506 [35094]: Resolving [0x200000403:0x34:0x0] to /tmp/arc1/sanity-hsm.test_12u//0437/0x200000403:0x34:0x0
lhsmtool_posix: 1786034905.072580 [35094]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8' from '/tmp/arc1/sanity-hsm.test_12u//0437/0x200000403:0x34:0x0'
lhsmtool_posix: 1786034905.126775 [35094]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8' from '/tmp/arc1/sanity-hsm.test_12u//0457/0x200000402:0x55:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0437/0x200000403:0x34:0x0'
lhsmtool_posix: 1786034905.126877 [35094]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1786034905.467834 [35123]: action=1 src=0x200000403:0x35:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9 mount_point=/mnt/lustre2
lhsmtool_posix: 1786034905.473846 [35123]: Resolving [0x200000403:0x35:0x0] to /tmp/arc1/sanity-hsm.test_12u//0436/0x200000403:0x35:0x0
lhsmtool_posix: 1786034905.474943 [35123]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9' from '/tmp/arc1/sanity-hsm.test_12u//0436/0x200000403:0x35:0x0'
lhsmtool_posix: 1786034905.536183 [35123]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9' from '/tmp/arc1/sanity-hsm.test_12u//0454/0x200000402:0x56:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0436/0x200000403:0x35:0x0'
lhsmtool_posix: 1786034905.536275 [35123]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
PASS 12u (35s)

== sanity-hsm test 13: Recursively import and restore a directory ========================================================== 12:48:37 (1786034917)
lhsmtool_posix: 1786034928.688048 [36882]: action=1 src=subdir dst=/mnt/lustre/d13.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786034928.944817 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.10'
lhsmtool_posix: 1786034929.158427 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.10' from '/tmp/arc1/sanity-hsm.test_13//045b/0x200000402:0x59:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.10'
lhsmtool_posix: 1786034929.158714 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.9'
lhsmtool_posix: 1786034929.270249 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.9' from '/tmp/arc1/sanity-hsm.test_13//0458/0x200000402:0x5a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.9'
lhsmtool_posix: 1786034929.270988 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.8'
lhsmtool_posix: 1786034929.361236 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.8' from '/tmp/arc1/sanity-hsm.test_13//0459/0x200000402:0x5b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.8'
lhsmtool_posix: 1786034929.361859 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.7'
lhsmtool_posix: 1786034929.485238 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.7' from '/tmp/arc1/sanity-hsm.test_13//045e/0x200000402:0x5c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.7'
lhsmtool_posix: 1786034929.502247 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.6'
lhsmtool_posix: 1786034929.674784 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.6' from '/tmp/arc1/sanity-hsm.test_13//045f/0x200000402:0x5d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.6'
lhsmtool_posix: 1786034929.675648 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.5'
lhsmtool_posix: 1786034929.795315 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.5' from '/tmp/arc1/sanity-hsm.test_13//045c/0x200000402:0x5e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.5'
lhsmtool_posix: 1786034929.796136 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.4'
lhsmtool_posix: 1786034929.847339 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.4' from '/tmp/arc1/sanity-hsm.test_13//045d/0x200000402:0x5f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.4'
lhsmtool_posix: 1786034929.850628 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.3'
lhsmtool_posix: 1786034929.900409 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.3' from '/tmp/arc1/sanity-hsm.test_13//0462/0x200000402:0x60:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.3'
lhsmtool_posix: 1786034929.900734 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.2'
lhsmtool_posix: 1786034929.956461 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.2' from '/tmp/arc1/sanity-hsm.test_13//0463/0x200000402:0x61:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.2'
lhsmtool_posix: 1786034929.956793 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.1'
lhsmtool_posix: 1786034930.008345 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.1' from '/tmp/arc1/sanity-hsm.test_13//0460/0x200000402:0x62:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.1'
lhsmtool_posix: 1786034930.014466 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.10'
lhsmtool_posix: 1786034930.060221 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.10' from '/tmp/arc1/sanity-hsm.test_13//0408/0x240000402:0xa:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.10'
lhsmtool_posix: 1786034930.060960 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.9'
lhsmtool_posix: 1786034930.103774 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.9' from '/tmp/arc1/sanity-hsm.test_13//0409/0x240000402:0xb:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.9'
lhsmtool_posix: 1786034930.104061 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.8'
lhsmtool_posix: 1786034930.173270 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.8' from '/tmp/arc1/sanity-hsm.test_13//040e/0x240000402:0xc:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.8'
lhsmtool_posix: 1786034930.173881 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.7'
lhsmtool_posix: 1786034930.279515 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.7' from '/tmp/arc1/sanity-hsm.test_13//040f/0x240000402:0xd:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.7'
lhsmtool_posix: 1786034930.281983 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.6'
lhsmtool_posix: 1786034930.372273 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.6' from '/tmp/arc1/sanity-hsm.test_13//040c/0x240000402:0xe:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.6'
lhsmtool_posix: 1786034930.372648 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.5'
lhsmtool_posix: 1786034930.425926 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.5' from '/tmp/arc1/sanity-hsm.test_13//040d/0x240000402:0xf:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.5'
lhsmtool_posix: 1786034930.426274 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.4'
lhsmtool_posix: 1786034930.475797 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.4' from '/tmp/arc1/sanity-hsm.test_13//0412/0x240000402:0x10:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.4'
lhsmtool_posix: 1786034930.476665 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.3'
lhsmtool_posix: 1786034930.595589 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.3' from '/tmp/arc1/sanity-hsm.test_13//0413/0x240000402:0x11:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.3'
lhsmtool_posix: 1786034930.596543 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.2'
lhsmtool_posix: 1786034930.668176 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.2' from '/tmp/arc1/sanity-hsm.test_13//0410/0x240000402:0x12:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.2'
lhsmtool_posix: 1786034930.668592 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.1'
lhsmtool_posix: 1786034930.740572 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.1' from '/tmp/arc1/sanity-hsm.test_13//0411/0x240000402:0x13:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.1'
lhsmtool_posix: 1786034930.774850 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.10'
lhsmtool_posix: 1786034930.933759 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.10' from '/tmp/arc1/sanity-hsm.test_13//0466/0x200000402:0x64:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.10'
lhsmtool_posix: 1786034930.934435 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.9'
lhsmtool_posix: 1786034931.050014 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.9' from '/tmp/arc1/sanity-hsm.test_13//0467/0x200000402:0x65:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.9'
lhsmtool_posix: 1786034931.050359 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.8'
lhsmtool_posix: 1786034931.148961 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.8' from '/tmp/arc1/sanity-hsm.test_13//0464/0x200000402:0x66:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.8'
lhsmtool_posix: 1786034931.149590 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.7'
lhsmtool_posix: 1786034931.241875 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.7' from '/tmp/arc1/sanity-hsm.test_13//0465/0x200000402:0x67:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.7'
lhsmtool_posix: 1786034931.242704 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.6'
lhsmtool_posix: 1786034931.347326 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.6' from '/tmp/arc1/sanity-hsm.test_13//046a/0x200000402:0x68:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.6'
lhsmtool_posix: 1786034931.347648 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.5'
lhsmtool_posix: 1786034931.444571 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.5' from '/tmp/arc1/sanity-hsm.test_13//046b/0x200000402:0x69:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.5'
lhsmtool_posix: 1786034931.444924 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.4'
lhsmtool_posix: 1786034931.503344 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.4' from '/tmp/arc1/sanity-hsm.test_13//0468/0x200000402:0x6a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.4'
lhsmtool_posix: 1786034931.532134 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.3'
lhsmtool_posix: 1786034931.602429 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.3' from '/tmp/arc1/sanity-hsm.test_13//0469/0x200000402:0x6b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.3'
lhsmtool_posix: 1786034931.602803 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.2'
lhsmtool_posix: 1786034931.682678 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.2' from '/tmp/arc1/sanity-hsm.test_13//046e/0x200000402:0x6c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.2'
lhsmtool_posix: 1786034931.682954 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.1'
lhsmtool_posix: 1786034931.756783 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.1' from '/tmp/arc1/sanity-hsm.test_13//046f/0x200000402:0x6d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.1'
lhsmtool_posix: 1786034931.789194 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.10'
lhsmtool_posix: 1786034931.891179 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.10' from '/tmp/arc1/sanity-hsm.test_13//0417/0x240000402:0x15:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.10'
lhsmtool_posix: 1786034931.891433 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.9'
lhsmtool_posix: 1786034932.014419 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.9' from '/tmp/arc1/sanity-hsm.test_13//0414/0x240000402:0x16:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.9'
lhsmtool_posix: 1786034932.014981 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.8'
lhsmtool_posix: 1786034932.148357 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.8' from '/tmp/arc1/sanity-hsm.test_13//0415/0x240000402:0x17:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.8'
lhsmtool_posix: 1786034932.149357 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.7'
lhsmtool_posix: 1786034932.225989 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.7' from '/tmp/arc1/sanity-hsm.test_13//041a/0x240000402:0x18:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.7'
lhsmtool_posix: 1786034932.226259 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.6'
lhsmtool_posix: 1786034932.285370 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.6' from '/tmp/arc1/sanity-hsm.test_13//041b/0x240000402:0x19:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.6'
lhsmtool_posix: 1786034932.286296 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.5'
lhsmtool_posix: 1786034932.331749 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.5' from '/tmp/arc1/sanity-hsm.test_13//0418/0x240000402:0x1a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.5'
lhsmtool_posix: 1786034932.332031 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.4'
lhsmtool_posix: 1786034932.410955 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.4' from '/tmp/arc1/sanity-hsm.test_13//0419/0x240000402:0x1b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.4'
lhsmtool_posix: 1786034932.411476 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.3'
lhsmtool_posix: 1786034932.477560 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.3' from '/tmp/arc1/sanity-hsm.test_13//041e/0x240000402:0x1c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.3'
lhsmtool_posix: 1786034932.477883 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.2'
lhsmtool_posix: 1786034932.538486 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.2' from '/tmp/arc1/sanity-hsm.test_13//041f/0x240000402:0x1d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.2'
lhsmtool_posix: 1786034932.538826 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.1'
lhsmtool_posix: 1786034932.572488 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.1' from '/tmp/arc1/sanity-hsm.test_13//041c/0x240000402:0x1e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.1'
lhsmtool_posix: 1786034932.583317 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.10'
lhsmtool_posix: 1786034932.642997 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.10' from '/tmp/arc1/sanity-hsm.test_13//046d/0x200000402:0x6f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.10'
lhsmtool_posix: 1786034932.643806 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.9'
lhsmtool_posix: 1786034932.689505 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.9' from '/tmp/arc1/sanity-hsm.test_13//0472/0x200000402:0x70:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.9'
lhsmtool_posix: 1786034932.689802 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.8'
lhsmtool_posix: 1786034932.718511 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.8' from '/tmp/arc1/sanity-hsm.test_13//0473/0x200000402:0x71:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.8'
lhsmtool_posix: 1786034932.719375 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.7'
lhsmtool_posix: 1786034932.753345 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.7' from '/tmp/arc1/sanity-hsm.test_13//0470/0x200000402:0x72:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.7'
lhsmtool_posix: 1786034932.754010 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.6'
lhsmtool_posix: 1786034932.791590 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.6' from '/tmp/arc1/sanity-hsm.test_13//0471/0x200000402:0x73:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.6'
lhsmtool_posix: 1786034932.792136 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.5'
lhsmtool_posix: 1786034932.839208 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.5' from '/tmp/arc1/sanity-hsm.test_13//0476/0x200000402:0x74:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.5'
lhsmtool_posix: 1786034932.839431 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.4'
lhsmtool_posix: 1786034932.878515 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.4' from '/tmp/arc1/sanity-hsm.test_13//0477/0x200000402:0x75:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.4'
lhsmtool_posix: 1786034932.878820 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.3'
lhsmtool_posix: 1786034932.922026 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.3' from '/tmp/arc1/sanity-hsm.test_13//0474/0x200000402:0x76:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.3'
lhsmtool_posix: 1786034932.922262 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.2'
lhsmtool_posix: 1786034932.971237 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.2' from '/tmp/arc1/sanity-hsm.test_13//0475/0x200000402:0x77:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.2'
lhsmtool_posix: 1786034932.972860 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.1'
lhsmtool_posix: 1786034933.018003 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.1' from '/tmp/arc1/sanity-hsm.test_13//047a/0x200000402:0x78:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.1'
lhsmtool_posix: 1786034933.024519 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.10'
lhsmtool_posix: 1786034933.076730 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.10' from '/tmp/arc1/sanity-hsm.test_13//0422/0x240000402:0x20:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.10'
lhsmtool_posix: 1786034933.077509 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.9'
lhsmtool_posix: 1786034933.124119 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.9' from '/tmp/arc1/sanity-hsm.test_13//0423/0x240000402:0x21:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.9'
lhsmtool_posix: 1786034933.124453 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.8'
lhsmtool_posix: 1786034933.160298 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.8' from '/tmp/arc1/sanity-hsm.test_13//0420/0x240000402:0x22:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.8'
lhsmtool_posix: 1786034933.161104 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.7'
lhsmtool_posix: 1786034933.189734 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.7' from '/tmp/arc1/sanity-hsm.test_13//0421/0x240000402:0x23:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.7'
lhsmtool_posix: 1786034933.190298 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.6'
lhsmtool_posix: 1786034933.228564 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.6' from '/tmp/arc1/sanity-hsm.test_13//0426/0x240000402:0x24:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.6'
lhsmtool_posix: 1786034933.229042 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.5'
lhsmtool_posix: 1786034933.263284 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.5' from '/tmp/arc1/sanity-hsm.test_13//0427/0x240000402:0x25:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.5'
lhsmtool_posix: 1786034933.263544 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.4'
lhsmtool_posix: 1786034933.313792 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.4' from '/tmp/arc1/sanity-hsm.test_13//0424/0x240000402:0x26:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.4'
lhsmtool_posix: 1786034933.314048 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.3'
lhsmtool_posix: 1786034933.360030 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.3' from '/tmp/arc1/sanity-hsm.test_13//0425/0x240000402:0x27:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.3'
lhsmtool_posix: 1786034933.360264 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.2'
lhsmtool_posix: 1786034933.415503 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.2' from '/tmp/arc1/sanity-hsm.test_13//042a/0x240000402:0x28:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.2'
lhsmtool_posix: 1786034933.416529 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.1'
lhsmtool_posix: 1786034933.473316 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.1' from '/tmp/arc1/sanity-hsm.test_13//042b/0x240000402:0x29:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.1'
lhsmtool_posix: 1786034933.489734 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.10'
lhsmtool_posix: 1786034933.550965 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.10' from '/tmp/arc1/sanity-hsm.test_13//0478/0x200000402:0x7a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.10'
lhsmtool_posix: 1786034933.551341 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.9'
lhsmtool_posix: 1786034933.592281 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.9' from '/tmp/arc1/sanity-hsm.test_13//0479/0x200000402:0x7b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.9'
lhsmtool_posix: 1786034933.592512 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.8'
lhsmtool_posix: 1786034933.618789 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.8' from '/tmp/arc1/sanity-hsm.test_13//047e/0x200000402:0x7c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.8'
lhsmtool_posix: 1786034933.619061 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.7'
lhsmtool_posix: 1786034933.673435 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.7' from '/tmp/arc1/sanity-hsm.test_13//047f/0x200000402:0x7d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.7'
lhsmtool_posix: 1786034933.673783 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.6'
lhsmtool_posix: 1786034933.723069 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.6' from '/tmp/arc1/sanity-hsm.test_13//047c/0x200000402:0x7e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.6'
lhsmtool_posix: 1786034933.724240 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.5'
lhsmtool_posix: 1786034933.768794 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.5' from '/tmp/arc1/sanity-hsm.test_13//047d/0x200000402:0x7f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.5'
lhsmtool_posix: 1786034933.769699 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.4'
lhsmtool_posix: 1786034933.817140 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.4' from '/tmp/arc1/sanity-hsm.test_13//0482/0x200000402:0x80:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.4'
lhsmtool_posix: 1786034933.818080 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.3'
lhsmtool_posix: 1786034933.858137 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.3' from '/tmp/arc1/sanity-hsm.test_13//0483/0x200000402:0x81:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.3'
lhsmtool_posix: 1786034933.858404 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.2'
lhsmtool_posix: 1786034933.930570 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.2' from '/tmp/arc1/sanity-hsm.test_13//0480/0x200000402:0x82:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.2'
lhsmtool_posix: 1786034933.931493 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.1'
lhsmtool_posix: 1786034933.974563 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.1' from '/tmp/arc1/sanity-hsm.test_13//0481/0x200000402:0x83:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.1'
lhsmtool_posix: 1786034933.979393 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.10'
lhsmtool_posix: 1786034934.028481 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.10' from '/tmp/arc1/sanity-hsm.test_13//0429/0x240000402:0x2b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.10'
lhsmtool_posix: 1786034934.029904 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.9'
lhsmtool_posix: 1786034934.071079 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.9' from '/tmp/arc1/sanity-hsm.test_13//042e/0x240000402:0x2c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.9'
lhsmtool_posix: 1786034934.071323 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.8'
lhsmtool_posix: 1786034934.106949 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.8' from '/tmp/arc1/sanity-hsm.test_13//042f/0x240000402:0x2d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.8'
lhsmtool_posix: 1786034934.107665 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.7'
lhsmtool_posix: 1786034934.173164 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.7' from '/tmp/arc1/sanity-hsm.test_13//042c/0x240000402:0x2e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.7'
lhsmtool_posix: 1786034934.175005 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.6'
lhsmtool_posix: 1786034934.231370 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.6' from '/tmp/arc1/sanity-hsm.test_13//042d/0x240000402:0x2f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.6'
lhsmtool_posix: 1786034934.232383 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.5'
lhsmtool_posix: 1786034934.300215 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.5' from '/tmp/arc1/sanity-hsm.test_13//0432/0x240000402:0x30:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.5'
lhsmtool_posix: 1786034934.300760 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.4'
lhsmtool_posix: 1786034934.368390 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.4' from '/tmp/arc1/sanity-hsm.test_13//0433/0x240000402:0x31:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.4'
lhsmtool_posix: 1786034934.374584 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.3'
lhsmtool_posix: 1786034934.426385 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.3' from '/tmp/arc1/sanity-hsm.test_13//0430/0x240000402:0x32:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.3'
lhsmtool_posix: 1786034934.427813 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.2'
lhsmtool_posix: 1786034934.483939 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.2' from '/tmp/arc1/sanity-hsm.test_13//0431/0x240000402:0x33:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.2'
lhsmtool_posix: 1786034934.484538 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.1'
lhsmtool_posix: 1786034934.602558 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.1' from '/tmp/arc1/sanity-hsm.test_13//0436/0x240000402:0x34:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.1'
lhsmtool_posix: 1786034934.624833 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.10'
lhsmtool_posix: 1786034934.773497 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.10' from '/tmp/arc1/sanity-hsm.test_13//0487/0x200000402:0x85:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.10'
lhsmtool_posix: 1786034934.774244 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.9'
lhsmtool_posix: 1786034934.919282 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.9' from '/tmp/arc1/sanity-hsm.test_13//0484/0x200000402:0x86:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.9'
lhsmtool_posix: 1786034934.920381 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.8'
lhsmtool_posix: 1786034935.000069 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.8' from '/tmp/arc1/sanity-hsm.test_13//0485/0x200000402:0x87:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.8'
lhsmtool_posix: 1786034935.000322 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.7'
lhsmtool_posix: 1786034935.059355 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.7' from '/tmp/arc1/sanity-hsm.test_13//048a/0x200000402:0x88:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.7'
lhsmtool_posix: 1786034935.060494 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.6'
lhsmtool_posix: 1786034935.103661 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.6' from '/tmp/arc1/sanity-hsm.test_13//048b/0x200000402:0x89:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.6'
lhsmtool_posix: 1786034935.103976 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.5'
lhsmtool_posix: 1786034935.143101 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.5' from '/tmp/arc1/sanity-hsm.test_13//0488/0x200000402:0x8a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.5'
lhsmtool_posix: 1786034935.144187 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.4'
lhsmtool_posix: 1786034935.188174 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.4' from '/tmp/arc1/sanity-hsm.test_13//0489/0x200000402:0x8b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.4'
lhsmtool_posix: 1786034935.189488 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.3'
lhsmtool_posix: 1786034935.229351 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.3' from '/tmp/arc1/sanity-hsm.test_13//048e/0x200000402:0x8c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.3'
lhsmtool_posix: 1786034935.230497 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.2'
lhsmtool_posix: 1786034935.270978 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.2' from '/tmp/arc1/sanity-hsm.test_13//048f/0x200000402:0x8d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.2'
lhsmtool_posix: 1786034935.271694 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.1'
lhsmtool_posix: 1786034935.316324 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.1' from '/tmp/arc1/sanity-hsm.test_13//048c/0x200000402:0x8e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.1'
lhsmtool_posix: 1786034935.321109 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.10'
lhsmtool_posix: 1786034935.364767 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.10' from '/tmp/arc1/sanity-hsm.test_13//0434/0x240000402:0x36:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.10'
lhsmtool_posix: 1786034935.365350 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.9'
lhsmtool_posix: 1786034935.398228 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.9' from '/tmp/arc1/sanity-hsm.test_13//0435/0x240000402:0x37:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.9'
lhsmtool_posix: 1786034935.399273 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.8'
lhsmtool_posix: 1786034935.443456 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.8' from '/tmp/arc1/sanity-hsm.test_13//043a/0x240000402:0x38:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.8'
lhsmtool_posix: 1786034935.444352 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.7'
lhsmtool_posix: 1786034935.484790 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.7' from '/tmp/arc1/sanity-hsm.test_13//043b/0x240000402:0x39:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.7'
lhsmtool_posix: 1786034935.485082 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.6'
lhsmtool_posix: 1786034935.529852 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.6' from '/tmp/arc1/sanity-hsm.test_13//0438/0x240000402:0x3a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.6'
lhsmtool_posix: 1786034935.530303 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.5'
lhsmtool_posix: 1786034935.573974 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.5' from '/tmp/arc1/sanity-hsm.test_13//0439/0x240000402:0x3b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.5'
lhsmtool_posix: 1786034935.574229 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.4'
lhsmtool_posix: 1786034935.619780 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.4' from '/tmp/arc1/sanity-hsm.test_13//043e/0x240000402:0x3c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.4'
lhsmtool_posix: 1786034935.620168 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.3'
lhsmtool_posix: 1786034935.663777 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.3' from '/tmp/arc1/sanity-hsm.test_13//043f/0x240000402:0x3d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.3'
lhsmtool_posix: 1786034935.664066 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.2'
lhsmtool_posix: 1786034935.709314 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.2' from '/tmp/arc1/sanity-hsm.test_13//043c/0x240000402:0x3e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.2'
lhsmtool_posix: 1786034935.710404 [36882]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.1'
lhsmtool_posix: 1786034935.768081 [36882]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.1' from '/tmp/arc1/sanity-hsm.test_13//043d/0x240000402:0x3f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.1'
lhsmtool_posix: 1786034935.771295 [36882]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_13/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 13 (42s)

== sanity-hsm test 14: Rebind archived file to a new fid ========================================================== 12:49:20 (1786034960)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_14/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133595 s, 7.8 MB/s
0+0 records in
0+0 records out
0 bytes copied, 0.0159528 s, 0.0 kB/s
rebind 0x200000403:0x73:0x0 to 0x200000403:0x74:0x0
lhsmtool_posix: 1786034965.266568 [37849]: action=2 src=0x200000403:0x73:0x0 dst=0x200000403:0x74:0x0 mount_point=/mnt/lustre2
lhsmtool_posix: 1786034965.268699 [37849]: rebind [0x200000403:0x73:0x0] to [0x200000403:0x74:0x0]
lhsmtool_posix: 1786034965.268876 [37849]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
PASS 14 (12s)

== sanity-hsm test 15: Rebind a list of files ============ 12:49:33 (1786034973)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_15/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.258061 s, 4.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.190268 s, 5.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116132 s, 9.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125413 s, 8.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.144981 s, 7.2 MB/s
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
0+0 records in
0+0 records out
0 bytes copied, 0.0100628 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.0154449 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.0138725 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.0118897 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00765825 s, 0.0 kB/s
rebind list of files
lhsmtool_posix: 1786034981.838695 [38637]: action=2 src=/tmp/tmp.8224 dst=(null) mount_point=/mnt/lustre2
lhsmtool_posix: 1786034981.841283 [38637]: rebind [0x200000403:0x76:0x0] to [0x200000403:0x7b:0x0]
lhsmtool_posix: 1786034981.842106 [38637]: rebind [0x200000403:0x77:0x0] to [0x200000403:0x7c:0x0]
lhsmtool_posix: 1786034981.842467 [38637]: rebind [0x200000403:0x78:0x0] to [0x200000403:0x7d:0x0]
lhsmtool_posix: 1786034981.843641 [38637]: rebind [0x200000403:0x79:0x0] to [0x200000403:0x7e:0x0]
lhsmtool_posix: 1786034981.844019 [38637]: rebind [0x200000403:0x7a:0x0] to [0x200000403:0x7f:0x0]
lhsmtool_posix: 1786034981.844119 [38637]: 5 lines read from '/tmp/tmp.8224', 5 rebind successful
lhsmtool_posix: 1786034981.844143 [38637]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
PASS 15 (25s)

== sanity-hsm test 16: Test CT bandwith control option === 12:49:57 (1786034997)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_16/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
20+0 records in
20+0 records out
20971520 bytes (21 MB, 20 MiB) copied, 0.0653065 s, 321 MB/s
Waiting 200s for 'SUCCEED'
Waiting 190s for 'SUCCEED'
Updated after 20s: want 'SUCCEED' got 'SUCCEED'
PASS 16 (30s)

== sanity-hsm test 20: Release is not permitted ========== 12:50:27 (1786035027)
0+0 records in
0+0 records out
0 bytes copied, 0.00682297 s, 0.0 kB/s
0x200000403:0x87:0x0
Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted
Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted
Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted
Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted
PASS 20 (8s)

== sanity-hsm test 21: Simple release tests ============== 12:50:36 (1786035036)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_21/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.210929 s, 5.0 MB/s
PASS 21 (14s)

== sanity-hsm test 22: Could not swap a release file ===== 12:50:49 (1786035049)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_22/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137187 s, 7.6 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0819437 s, 12.8 MB/s
0x200000403:0x8b:0x0
lfs swap_layouts: error: cannot swap layout between '/mnt/lustre/d22.sanity-hsm/test_swap' and '/mnt/lustre/d22.sanity-hsm/test_release': Operation not supported (95)
PASS 22 (14s)

== sanity-hsm test 23: Release does not change a/mtime (utime) ========================================================== 12:51:03 (1786035063)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_23/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.209612 s, 5.0 MB/s
PASS 23 (10s)

== sanity-hsm test 24a: Archive, release, and restore does not change a/mtime (i/o) ========================================================== 12:51:14 (1786035074)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.223216 s, 4.7 MB/s
Killing existing copytools on oleg205-client.virtnet with signal TERM
copytools stopped in 0s
192.168.202.105@tcp:/lustre /mnt/lustre lustre rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg205-client.virtnet /mnt/lustre (opts:)
Starting client: oleg205-client.virtnet:  -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre
PASS 24a (18s)

== sanity-hsm test 24b: root can archive, release, and restore user files ========================================================== 12:51:32 (1786035092)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.121833 s, 8.6 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm]
/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm: (0x00000009) exists archived, archive_id:1
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [md5sum] [/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm]
PASS 24b (16s)

== sanity-hsm test 24c: check that user,group,other request masks work ========================================================== 12:51:48 (1786035108)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.2032 s, 5.2 MB/s
0x200000403:0x94:0x0
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.169739 s, 6.2 MB/s
0x200000403:0x95:0x0
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.218119 s, 4.8 MB/s
0x200000403:0x96:0x0
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
PASS 24c (30s)

== sanity-hsm test 24d: check that read-only mounts are respected ========================================================== 12:52:18 (1786035138)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156797 s, 6.7 MB/s
0x200000403:0x97:0x0
/mnt/lustre/d24d.sanity-hsm/f24d.sanity-hsm
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 0
	obdidx		 objid		 objid		 group
	     0	            80	         0x50	   0x280000401

Starting client: oleg205-client.virtnet:  -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre3
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre3"'
Cannot send HSM request (use of /mnt/lustre2/d24d.sanity-hsm/f24d.sanity-hsm): Read-only file system
Waiting 200s for 'SUCCEED'
Updated after 3s: want 'SUCCEED' got 'SUCCEED'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 1.18017 s, 888 kB/s
Cannot send HSM request (use of /mnt/lustre2/d24d.sanity-hsm/f24d.sanity-hsm): Read-only file system
Stopping client oleg205-client.virtnet /mnt/lustre3 (opts:)
PASS 24d (21s)

== sanity-hsm test 24e: tar succeeds on HSM released files ========================================================== 12:52:39 (1786035159)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152799 s, 6.9 MB/s
/mnt/lustre/d24e.sanity-hsm/f24e.sanity-hsm: (0x0000000d) released exists archived, archive_id:1
tar: Removing leading `/' from member names
PASS 24e (11s)

== sanity-hsm test 24f: root can archive, release, and restore tar files ========================================================== 12:52:50 (1786035170)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
54fb6627dbaa37721048e4549db3224d /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm
f24f.sanity-hsm
f24f.sanity-hsm
Sum0 = 54fb6627dbaa37721048e4549db3224d  /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm, sum1 = 54fb6627dbaa37721048e4549db3224d  /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm
PASS 24f (11s)

== sanity-hsm test 24g: write by non-owner still sets dirty ========================================================== 12:53:01 (1786035181)
RUNAS = 'runas -u 500 -g 500'
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24g/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Please listen carefully as our options have changed.
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [tee] [/mnt/lustre/d24g.sanity-hsm/f24g.sanity-hsm]
To be electrocuted by your telephone, press #.
PASS 24g (9s)

== sanity-hsm test 25a: Restore lost file (HS_LOST flag) from import ========================================================== 12:53:11 (1786035191)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_25a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1786035194.746722 [47634]: action=1 src=d25a.sanity-hsm/f25a.sanity-hsm dst=/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786035194.764045 [47634]: importing '/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_25a//d25a.sanity-hsm/f25a.sanity-hsm'
lhsmtool_posix: 1786035194.823273 [47634]: imported '/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_25a//0406/0x240000404:0x2:0x0'=='/tmp/arc1/sanity-hsm.test_25a//d25a.sanity-hsm/f25a.sanity-hsm'
lhsmtool_posix: 1786035194.823332 [47634]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
md5sum: /mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm: No data available
PASS 25a (12s)

== sanity-hsm test 25b: Restore lost file (HS_LOST flag) after release ========================================================== 12:53:23 (1786035203)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_25b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
md5sum: /mnt/lustre/d25b.sanity-hsm/f25b.sanity-hsm: No data available
PASS 25b (13s)

== sanity-hsm test 26A: Remove the archive of a valid file ========================================================== 12:53:36 (1786035216)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.00865915 s, 0.0 kB/s
PASS 26A (13s)

== sanity-hsm test 26a: Remove Archive On Last Unlink (RAoLU) policy ========================================================== 12:53:49 (1786035229)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 4s: want 'SUCCEED' got 'SUCCEED'
PASS 26a (39s)

== sanity-hsm test 26b: RAoLU policy when CDT off ======== 12:54:28 (1786035268)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0001.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=enabled
Killing existing copytools on oleg205-client.virtnet with signal TERM
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 26b (28s)

== sanity-hsm test 26c: RAoLU effective when file closed ========================================================== 12:54:56 (1786035296)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
multiop /mnt/lustre/d26c.sanity-hsm/f26c.sanity-hsm vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.8224
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Waiting 200s for 'SUCCEED'
Updated after 8s: want 'SUCCEED' got 'SUCCEED'
PASS 26c (44s)

== sanity-hsm test 26d: RAoLU when Client eviction ======= 12:55:40 (1786035340)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.236108 s, 4.4 MB/s
multiop /mnt/lustre/d26d.sanity-hsm/f26d.sanity-hsm vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.8224
Waiting 200s for 'SUCCEED'
Updated after 8s: want 'SUCCEED' got 'SUCCEED'
PASS 26d (39s)

== sanity-hsm test 26e: RAoLU with a non-started coordinator ========================================================== 12:56:20 (1786035380)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151974 s, 6.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119835 s, 8.8 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Killing existing copytools on oleg205-client.virtnet with signal TERM
copytools stopped in 0s
Failing mds1 on oleg205-server
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
12:56:57 (1786035417) shut down
facet: mds1 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds1 to oleg205-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
12:57:30 (1786035450) targets are mounted
12:57:30 (1786035450) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
Check cookie from RAoLU request (last: 1786034553, remove: 1786034554)
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=enabled
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
PASS 26e (131s)

== sanity-hsm test 27a: Remove the archive of an imported file (Operation not permitted) ========================================================== 12:58:31 (1786035511)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_27a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
39+0 records in
39+0 records out
40894464 bytes (41 MB, 39 MiB) copied, 1.35084 s, 30.3 MB/s
lhsmtool_posix: 1786035515.766048 [54711]: action=1 src=d27a.sanity-hsm/f27a.sanity-hsm dst=/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786035515.784159 [54711]: importing '/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_27a//d27a.sanity-hsm/f27a.sanity-hsm'
lhsmtool_posix: 1786035515.955928 [54711]: imported '/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_27a//0400/0x240000404:0x4:0x0'=='/tmp/arc1/sanity-hsm.test_27a//d27a.sanity-hsm/f27a.sanity-hsm'
lhsmtool_posix: 1786035515.955989 [54711]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Cannot send HSM request (use of /mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm): Operation not permitted
PASS 27a (12s)

== sanity-hsm test 27b: Remove the archive of a relased file (Operation not permitted) ========================================================== 12:58:42 (1786035522)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_27b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.0166005 s, 0.0 kB/s
Cannot send HSM request (use of /mnt/lustre/d27b.sanity-hsm/f27b.sanity-hsm): Operation not permitted
PASS 27b (10s)

== sanity-hsm test 28: Concurrent archive/file remove ==== 12:58:52 (1786035532)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_28/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.00290793 s, 0.0 kB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0001.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=enabled
PASS 28 (22s)

== sanity-hsm test 29a: Tests --mntpath and --archive options ========================================================== 12:59:14 (1786035554)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 7  "/mnt/lustre"'
Cannot send HSM request (use of /mnt/lustre): Invalid argument
hsm: '/qwerty/uyt' is not a valid FID
PASS 29a (8s)

== sanity-hsm test 29b: Archive/delete/remove by FID from the archive. ========================================================== 12:59:23 (1786035563)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.126263 s, 8.3 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
PASS 29b (14s)

== sanity-hsm test 29c: Archive/delete/remove by FID, using a file list. ========================================================== 12:59:37 (1786035577)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12581 s, 8.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.166184 s, 6.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.183108 s, 5.7 MB/s
PASS 29c (19s)

== sanity-hsm test 29d: hsm_remove by FID with archive_id 0 for unlinked file cause ========================================================== 12:59:56 (1786035596)

 SKIP: sanity-hsm test_29d Need 3 or more clients, have 1
SKIP 29d (5s)

== sanity-hsm test 30a: Restore at exec (import case) ==== 13:00:01 (1786035601)

 SKIP: sanity-hsm test_30a Need 2 or more clients, have 1
SKIP 30a (4s)

== sanity-hsm test 30b: Restore at exec (release case) === 13:00:05 (1786035605)

 SKIP: sanity-hsm test_30b Need 2 or more clients, have 1
SKIP 30b (5s)

== sanity-hsm test 30c: Update during exec of released file must fail ========================================================== 13:00:10 (1786035610)

 SKIP: sanity-hsm test_30c Need 2 or more clients, have 1
SKIP 30c (4s)

== sanity-hsm test 31a: Import a large file and check size during restore ========================================================== 13:00:14 (1786035614)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
39+0 records in
39+0 records out
40894464 bytes (41 MB, 39 MiB) copied, 1.25533 s, 32.6 MB/s
lhsmtool_posix: 1786035618.239090 [59870]: action=1 src=d31a.sanity-hsm/f31a.sanity-hsm dst=/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786035618.251916 [59870]: importing '/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_31a//d31a.sanity-hsm/f31a.sanity-hsm'
lhsmtool_posix: 1786035618.360592 [59870]: imported '/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_31a//040c/0x200000407:0xb:0x0'=='/tmp/arc1/sanity-hsm.test_31a//d31a.sanity-hsm/f31a.sanity-hsm'
lhsmtool_posix: 1786035618.360711 [59870]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
size seen is right: 40894464 == 40894464
 done
PASS 31a (22s)

== sanity-hsm test 31b: Restore a large unaligned file and check size during restore ========================================================== 13:00:36 (1786035636)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
39+0 records in
39+0 records out
39000000 bytes (39 MB, 37 MiB) copied, 1.27916 s, 30.5 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
size seen is right: 39000000 == 39000000
 done
PASS 31b (25s)

== sanity-hsm test 31c: Restore a large aligned file and check size during restore ========================================================== 13:01:01 (1786035661)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
39+0 records in
39+0 records out
40894464 bytes (41 MB, 39 MiB) copied, 1.46342 s, 27.9 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
size seen is right: 40894464 == 40894464
 done
PASS 31c (27s)

== sanity-hsm test 33: Kill a restore waiting process ==== 13:01:28 (1786035688)
0+0 records in
0+0 records out
0 bytes copied, 0.00525114 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_33/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
/home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2893: 61916 Terminated              md5sum $f > /dev/null
PASS 33 (11s)

== sanity-hsm test 34: Remove file during restore ======== 13:01:40 (1786035700)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_34/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.0056105 s, 0.0 kB/s
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
/home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2925: kill: (62577) - No such process
PASS 34 (12s)

== sanity-hsm test 35: Overwrite file during restore ===== 13:01:51 (1786035711)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_35/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.00607257 s, 0.0 kB/s
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
/home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2962: kill: (63254) - No such process
PASS 35 (13s)

== sanity-hsm test 36: Move file during restore ========== 13:02:04 (1786035724)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_36/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.00534843 s, 0.0 kB/s
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
/home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2998: kill: (63929) - No such process
PASS 36 (13s)

== sanity-hsm test 37: re-archive a dirty file =========== 13:02:17 (1786035737)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_37/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.238476 s, 4.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111557 s, 9.4 MB/s
PASS 37 (75s)

== sanity-hsm test 40: Parallel archive requests ========= 13:03:32 (1786035812)
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=1152921504606846976: Cannot allocate memory
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='1152921504606846976': Cannot allocate memory
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 12
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/max_requests=1152921504606846976: Cannot allocate memory
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/max_requests'='1152921504606846976': Cannot allocate memory
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 12
set max_requests=1152921504606846976 failed with 12
[ 1810.452121] Lustre: lustre-MDT0000: No more memory to set HSM max_requests=1152921504606846976 (max request memory: 461MB, current total 6/975940): rc = -12
[ 1811.566394] Lustre: lustre-MDT0001: No more memory to set HSM max_requests=1152921504606846976 (max request memory: 461MB, current total 975940/975940): rc = -12
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_40/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=purge
mdt.lustre-MDT0001.hsm_control=purge
Wait for all requests being enqueued...100 archive requests submitted
100 archive requests submitted
100 archive requests submitted
100 archive requests submitted
OK
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
PASS 40 (174s)

== sanity-hsm test 50: Archive with large number of pending HSM actions ========================================================== 13:06:26 (1786035986)
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=1000000: Cannot allocate memory
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='1000000': Cannot allocate memory
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 12
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/max_requests=1000000: Cannot allocate memory
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/max_requests'='1000000': Cannot allocate memory
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 12
Filesystem                  Inodes IUsed  IFree IUse% Mounted on
192.168.202.105@tcp:/lustre 524222  1207 523015    1% /mnt/lustre
 - create 1183 (time 1786036006.32 total 10.02 last 118.04)
 - create 2409 (time 1786036016.33 total 20.03 last 122.49)
 - create 3578 (time 1786036026.33 total 30.03 last 116.87)
 - create 4934 (time 1786036036.33 total 40.04 last 135.57)
 - create 6198 (time 1786036046.33 total 50.04 last 126.37)
 - create 7663 (time 1786036056.35 total 60.05 last 146.32)
 - create 9013 (time 1786036066.35 total 70.05 last 134.96)
total: 10000 create in 77.44 seconds: 129.13 ops/second
10000
 - unlinked 0 (time 1786036165 ; total 0 ; last 0)
total: 10000 unlinks in 68 seconds: 147.058823 unlinks/second
Start Phase files_num: 10000 time: 85
 - create 872 (time 1786036249.41 total 10.00 last 87.18)
 - create 1952 (time 1786036259.41 total 20.01 last 107.96)
 - create 3410 (time 1786036269.41 total 30.01 last 145.73)
 - create 4753 (time 1786036279.42 total 40.01 last 134.28)
 - create 5874 (time 1786036289.42 total 50.01 last 112.09)
 - create 7313 (time 1786036299.42 total 60.02 last 143.84)
 - create 8359 (time 1786036309.42 total 70.02 last 104.58)
 - create 9473 (time 1786036319.43 total 80.02 last 111.37)
 - create 10000 (time 1786036324.23 total 84.82 last 109.72)
 - create 11391 (time 1786036334.23 total 94.83 last 139.08)
 - create 12716 (time 1786036344.25 total 104.85 last 132.19)
 - create 13790 (time 1786036354.26 total 114.85 last 107.36)
 - create 15155 (time 1786036364.26 total 124.86 last 136.46)
 - create 16542 (time 1786036374.27 total 134.86 last 138.62)
 - create 18043 (time 1786036384.27 total 144.86 last 150.08)
 - create 19652 (time 1786036394.27 total 154.87 last 160.86)
total: 20000 create in 157.17 seconds: 127.25 ops/second
 - unlinked 0 (time 1786036583 ; total 0 ; last 0)
 - unlinked 10000 (time 1786036657 ; total 74 ; last 74)
total: 20000 unlinks in 149 seconds: 134.228195 unlinks/second
Middle Phase files_num: 20000 time: 182
 - create 1366 (time 1786036747.55 total 10.00 last 136.56)
 - create 2696 (time 1786036757.55 total 20.00 last 132.98)
 - create 4200 (time 1786036767.55 total 30.01 last 150.37)
 - create 5722 (time 1786036777.57 total 40.02 last 151.97)
 - create 7116 (time 1786036787.58 total 50.03 last 139.25)
 - create 8110 (time 1786036797.58 total 60.04 last 99.36)
 - create 9286 (time 1786036807.59 total 70.05 last 117.46)
total: 10000 create in 75.72 seconds: 132.06 ops/second
40000
 - unlinked 0 (time 1786036914 ; total 0 ; last 0)
total: 10000 unlinks in 75 seconds: 133.333328 unlinks/second
End Phase files_num: 10000 time: 92
40000
mdt.lustre-MDT0000.hsm_control=purge
mdt.lustre-MDT0001.hsm_control=purge
PASS 50 (1022s)

== sanity-hsm test 52: Opened for write file on an evicted client should be set dirty ========================================================== 13:23:28 (1786037008)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_52/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.230283 s, 4.6 MB/s
multiop /mnt/lustre/d52.sanity-hsm/f52.sanity-hsm vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.8224
PASS 52 (15s)

== sanity-hsm test 53: Opened for read file on an evicted client should not be set dirty ========================================================== 13:23:43 (1786037023)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_53/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170615 s, 6.1 MB/s
multiop /mnt/lustre/d53.sanity-hsm/f53.sanity-hsm vo_c
TMPPIPE=/tmp/multiop_open_wait_pipe.8224
pdsh@oleg205-client: oleg205-client: ssh exited with exit code 5
PASS 53 (15s)

== sanity-hsm test 54: Write during an archive cancels it ========================================================== 13:23:59 (1786037039)
39+0 records in
39+0 records out
39000000 bytes (39 MB, 37 MiB) copied, 1.10972 s, 35.1 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_54/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm.policy=+NRA
mdt.lustre-MDT0001.hsm.policy=+NRA
Waiting 200s for 'FAILED'
Waiting 170s for 'FAILED'
Updated after 32s: want 'FAILED' got 'FAILED'
mdt.lustre-MDT0000.hsm.policy=-NRA
mdt.lustre-MDT0001.hsm.policy=-NRA
PASS 54 (50s)

== sanity-hsm test 55: Truncate during an archive cancels it ========================================================== 13:24:48 (1786037088)
39+0 records in
39+0 records out
39000000 bytes (39 MB, 37 MiB) copied, 1.08882 s, 35.8 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_55/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm.policy=+NRA
mdt.lustre-MDT0001.hsm.policy=+NRA
mdt.lustre-MDT0000.hsm.policy=-NRA
mdt.lustre-MDT0001.hsm.policy=-NRA
PASS 55 (16s)

== sanity-hsm test 56: Setattr during an archive is ok === 13:25:04 (1786037104)
39+0 records in
39+0 records out
39000000 bytes (39 MB, 37 MiB) copied, 1.23966 s, 31.5 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_56/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Waiting 190s for 'SUCCEED'
Updated after 36s: want 'SUCCEED' got 'SUCCEED'
PASS 56 (49s)

== sanity-hsm test 57: Archive a file with dirty cache on another node ========================================================== 13:25:53 (1786037153)

 SKIP: sanity-hsm test_57 Need 2 or more clients, have 1
SKIP 57 (5s)

== sanity-hsm test 58: Truncate a released file will trigger restore ========================================================== 13:25:58 (1786037158)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_58/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
truncate up from 1516 to 3032
/mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2
truncate down from 1516 to 758
/mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2
truncate to 0
/mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2
PASS 58 (22s)

== sanity-hsm test 59: Release stripeless file with non-zero size ========================================================== 13:26:20 (1786037180)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_59/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 59 (10s)

== sanity-hsm test 60: Changing progress update interval from default ========================================================== 13:26:30 (1786037190)
10+0 records in
10+0 records out
10485760 bytes (10 MB, 10 MiB) copied, 0.273066 s, 38.4 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_60/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 --update-interval 5 "/mnt/lustre2"'
Waiting 100s for 'start copy'
Expecting a progress update within 20 seconds... 5242880 bytes copied in 1 seconds.
Wait for on going archive hsm action to complete
Waiting 10s for 'copied'
Updated after 5s: want 'copied' got 'copied'
PASS 60 (20s)

== sanity-hsm test 61: Waiting archive of a removed file should fail ========================================================== 13:26:50 (1786037210)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_61/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0001.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=enabled
PASS 61 (17s)

== sanity-hsm test 70: Copytool logs JSON register/unregister events to FIFO ========================================================== 13:27:08 (1786037228)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_70/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --event-fifo /tmp/sanity-hsm.test_70.dKtj/fifo "/mnt/lustre2"'
Killing existing copytools on oleg205-client.virtnet with signal TERM
copytools stopped in 0s
Register/Unregister events look OK.
PASS 70 (11s)

== sanity-hsm test 71: Copytool logs JSON archive events to FIFO ========================================================== 13:27:19 (1786037239)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_71/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --update-interval 5 --event-fifo /tmp/sanity-hsm.test_71.Qhkm/fifo "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm.policy=-NRA
mdt.lustre-MDT0001.hsm.policy=-NRA
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.163924 s, 6.4 MB/s
Archive events look OK.
mdt.lustre-MDT0000.hsm.policy=-NRA
mdt.lustre-MDT0001.hsm.policy=-NRA
PASS 71 (24s)

== sanity-hsm test 72: Copytool logs JSON restore events to FIFO ========================================================== 13:27:43 (1786037263)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_72/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --update-interval 5 --event-fifo /tmp/sanity-hsm.test_72.TmPK/fifo "/mnt/lustre2"'
16+0 records in
16+0 records out
16000000 bytes (16 MB, 15 MiB) copied, 0.770669 s, 20.8 MB/s
lhsmtool_posix: 1786037270.806326 [82869]: action=1 src=d72.sanity-hsm/f72.sanity-hsm dst=/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786037270.827951 [82869]: importing '/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_72//d72.sanity-hsm/f72.sanity-hsm'
lhsmtool_posix: 1786037270.899462 [82869]: imported '/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_72//0bc5/0x200000bd2:0x17:0x0'=='/tmp/arc1/sanity-hsm.test_72//d72.sanity-hsm/f72.sanity-hsm'
lhsmtool_posix: 1786037270.899521 [82869]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Verifying released state: 
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Restore events look OK.
PASS 72 (26s)

== sanity-hsm test 90: Archive/restore a file list ======= 13:28:09 (1786037289)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_90/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=purge
mdt.lustre-MDT0001.hsm_control=purge
Waiting 200s for ''
Changed after 3s: from 'lrh=[type=10680000 len=136 idx=4/9606] fid=[0x200000403:0xd4:0x0] dfid=[0x200000403:0xd4:0x0] compound/cookie=0x0/0x6a7555ec action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9608] fid=[0x200000403:0xd6:0x0] dfid=[0x200000403:0xd6:0x0] compound/cookie=0x0/0x6a7555ee action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9609] fid=[0x200000403:0xd7:0x0] dfid=[0x200000403:0xd7:0x0] compound/cookie=0x0/0x6a7555ef action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9610] fid=[0x200000403:0xd8:0x0] dfid=[0x200000403:0xd8:0x0] compound/cookie=0x0/0x6a7555f0 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9611] fid=[0x200000403:0xd9:0x0] dfid=[0x200000403:0xd9:0x0] compound/cookie=0x0/0x6a7555f1 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9612] fid=[0x200000403:0xda:0x0] dfid=[0x200000403:0xda:0x0] compound/cookie=0x0/0x6a7555f2 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9613] fid=[0x200000403:0xdb:0x0] dfid=[0x200000403:0xdb:0x0] compound/cookie=0x0/0x6a7555f3 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9614] fid=[0x200000403:0xdc:0x0] dfid=[0x200000403:0xdc:0x0] compound/cookie=0x0/0x6a7555f4 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9615] fid=[0x200000403:0xdd:0x0] dfid=[0x200000403:0xdd:0x0] compound/cookie=0x0/0x6a7555f5 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9616] fid=[0x200000403:0xde:0x0] dfid=[0x200000403:0xde:0x0] compound/cookie=0x0/0x6a7555f6 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9617] fid=[0x200000403:0xdf:0x0] dfid=[0x200000403:0xdf:0x0] compound/cookie=0x0/0x6a7555f7 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9618] fid=[0x200000403:0xe0:0x0] dfid=[0x200000403:0xe0:0x0] compound/cookie=0x0/0x6a7555f8 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9619] fid=[0x200000403:0xe1:0x0] dfid=[0x200000403:0xe1:0x0] compound/cookie=0x0/0x6a7555f9 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9620] fid=[0x200000403:0xe2:0x0] dfid=[0x200000403:0xe2:0x0] compound/cookie=0x0/0x6a7555fa action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9621] fid=[0x200000403:0xe3:0x0] dfid=[0x200000403:0xe3:0x0] compound/cookie=0x0/0x6a7555fb action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9622] fid=[0x200000403:0xe4:0x0] dfid=[0x200000403:0xe4:0x0] compound/cookie=0x0/0x6a7555fc action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9623] fid=[0x200000403:0xe5:0x0] dfid=[0x200000403:0xe5:0x0] compound/cookie=0x0/0x6a7555fd action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9624] fid=[0x200000403:0xe6:0x0] dfid=[0x200000403:0xe6:0x0] compound/cookie=0x0/0x6a7555fe action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9625] fid=[0x200000403:0xe7:0x0] dfid=[0x200000403:0xe7:0x0] compound/cookie=0x0/0x6a7555ff action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9626] fid=[0x200000403:0xe8:0x0] dfid=[0x200000403:0xe8:0x0] compound/cookie=0x0/0x6a755600 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9627] fid=[0x200000403:0xe9:0x0] dfid=[0x200000403:0xe9:0x0] compound/cookie=0x0/0x6a755601 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9628] fid=[0x200000403:0xea:0x0] dfid=[0x200000403:0xea:0x0] compound/cookie=0x0/0x6a755602 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9629] fid=[0x200000403:0xeb:0x0] dfid=[0x200000403:0xeb:0x0] compound/cookie=0x0/0x6a755603 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9630] fid=[0x200000403:0xec:0x0] dfid=[0x200000403:0xec:0x0] compound/cookie=0x0/0x6a755604 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9631] fid=[0x200000403:0xed:0x0] dfid=[0x200000403:0xed:0x0] compound/cookie=0x0/0x6a755605 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9632] fid=[0x200000403:0xee:0x0] dfid=[0x200000403:0xee:0x0] compound/cookie=0x0/0x6a755606 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9633] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a755607 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9634] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a755608 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9635] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a755609 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9636] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a75560a action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9637] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a75560b action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9639] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a75560c action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9640] fid=[0x200000403:0xf5:0x0] dfid=[0x200000403:0xf5:0x0] compound/cookie=0x0/0x6a75560d action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9641] fid=[0x200000403:0xf6:0x0] dfid=[0x200000403:0xf6:0x0] compound/cookie=0x0/0x6a75560e action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9642] fid=[0x200000403:0xf7:0x0] dfid=[0x200000403:0xf7:0x0] compound/cookie=0x0/0x6a75560f action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9643] fid=[0x200000403:0xf8:0x0] dfid=[0x200000403:0xf8:0x0] compound/cookie=0x0/0x6a755610 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9644] fid=[0x200000403:0xf9:0x0] dfid=[0x200000403:0xf9:0x0] compound/cookie=0x0/0x6a755611 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9645] fid=[0x200000403:0xfa:0x0] dfid=[0x200000403:0xfa:0x0] compound/cookie=0x0/0x6a755612 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9646] fid=[0x200000403:0xfb:0x0] dfid=[0x200000403:0xfb:0x0] compound/cookie=0x0/0x6a755613 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9647] fid=[0x200000403:0xfc:0x0] dfid=[0x200000403:0xfc:0x0] compound/cookie=0x0/0x6a755614 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9648] fid=[0x200000403:0xfd:0x0] dfid=[0x200000403:0xfd:0x0] compound/cookie=0x0/0x6a755615 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9649] fid=[0x200000403:0xfe:0x0] dfid=[0x200000403:0xfe:0x0] compound/cookie=0x0/0x6a755616 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9650] fid=[0x200000403:0xff:0x0] dfid=[0x200000403:0xff:0x0] compound/cookie=0x0/0x6a755617 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9651] fid=[0x200000403:0x100:0x0] dfid=[0x200000403:0x100:0x0] compound/cookie=0x0/0x6a755618 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/9643] fid=[0x200000403:0xf8:0x0] dfid=[0x200000403:0xf8:0x0] compound/cookie=0x0/0x6a755610 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9644] fid=[0x200000403:0xf9:0x0] dfid=[0x200000403:0xf9:0x0] compound/cookie=0x0/0x6a755611 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9645] fid=[0x200000403:0xfa:0x0] dfid=[0x200000403:0xfa:0x0] compound/cookie=0x0/0x6a755612 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9646] fid=[0x200000403:0xfb:0x0] dfid=[0x200000403:0xfb:0x0] compound/cookie=0x0/0x6a755613 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9647] fid=[0x200000403:0xfc:0x0] dfid=[0x200000403:0xfc:0x0] compound/cookie=0x0/0x6a755614 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9648] fid=[0x200000403:0xfd:0x0] dfid=[0x200000403:0xfd:0x0] compound/cookie=0x0/0x6a755615 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9649] fid=[0x200000403:0xfe:0x0] dfid=[0x200000403:0xfe:0x0] compound/cookie=0x0/0x6a755616 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9650] fid=[0x200000403:0xff:0x0] dfid=[0x200000403:0xff:0x0] compound/cookie=0x0/0x6a755617 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9651] fid=[0x200000403:0x100:0x0] dfid=[0x200000403:0x100:0x0] compound/cookie=0x0/0x6a755618 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]'
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Waiting 200s for ''
Changed after 2s: from 'lrh=[type=10680000 len=136 idx=4/9655] fid=[0x200000403:0xd1:0x0] dfid=[0x200000403:0xd1:0x0] compound/cookie=0x0/0x6a75561c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9656] fid=[0x200000403:0xd2:0x0] dfid=[0x200000403:0xd2:0x0] compound/cookie=0x0/0x6a75561d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9657] fid=[0x200000403:0xd3:0x0] dfid=[0x200000403:0xd3:0x0] compound/cookie=0x0/0x6a75561e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9658] fid=[0x200000403:0xd4:0x0] dfid=[0x200000403:0xd4:0x0] compound/cookie=0x0/0x6a75561f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9659] fid=[0x200000403:0xd5:0x0] dfid=[0x200000403:0xd5:0x0] compound/cookie=0x0/0x6a755620 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9660] fid=[0x200000403:0xd6:0x0] dfid=[0x200000403:0xd6:0x0] compound/cookie=0x0/0x6a755621 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9661] fid=[0x200000403:0xd7:0x0] dfid=[0x200000403:0xd7:0x0] compound/cookie=0x0/0x6a755622 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9662] fid=[0x200000403:0xd8:0x0] dfid=[0x200000403:0xd8:0x0] compound/cookie=0x0/0x6a755623 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9663] fid=[0x200000403:0xd9:0x0] dfid=[0x200000403:0xd9:0x0] compound/cookie=0x0/0x6a755624 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9664] fid=[0x200000403:0xda:0x0] dfid=[0x200000403:0xda:0x0] compound/cookie=0x0/0x6a755625 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9665] fid=[0x200000403:0xdb:0x0] dfid=[0x200000403:0xdb:0x0] compound/cookie=0x0/0x6a755626 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9666] fid=[0x200000403:0xdc:0x0] dfid=[0x200000403:0xdc:0x0] compound/cookie=0x0/0x6a755627 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9667] fid=[0x200000403:0xdd:0x0] dfid=[0x200000403:0xdd:0x0] compound/cookie=0x0/0x6a755628 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9668] fid=[0x200000403:0xde:0x0] dfid=[0x200000403:0xde:0x0] compound/cookie=0x0/0x6a755629 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9669] fid=[0x200000403:0xdf:0x0] dfid=[0x200000403:0xdf:0x0] compound/cookie=0x0/0x6a75562a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9670] fid=[0x200000403:0xe0:0x0] dfid=[0x200000403:0xe0:0x0] compound/cookie=0x0/0x6a75562b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9671] fid=[0x200000403:0xe1:0x0] dfid=[0x200000403:0xe1:0x0] compound/cookie=0x0/0x6a75562c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9672] fid=[0x200000403:0xe2:0x0] dfid=[0x200000403:0xe2:0x0] compound/cookie=0x0/0x6a75562d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9673] fid=[0x200000403:0xe3:0x0] dfid=[0x200000403:0xe3:0x0] compound/cookie=0x0/0x6a75562e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9674] fid=[0x200000403:0xe4:0x0] dfid=[0x200000403:0xe4:0x0] compound/cookie=0x0/0x6a75562f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9675] fid=[0x200000403:0xe5:0x0] dfid=[0x200000403:0xe5:0x0] compound/cookie=0x0/0x6a755630 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9676] fid=[0x200000403:0xe6:0x0] dfid=[0x200000403:0xe6:0x0] compound/cookie=0x0/0x6a755631 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9677] fid=[0x200000403:0xe7:0x0] dfid=[0x200000403:0xe7:0x0] compound/cookie=0x0/0x6a755632 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9678] fid=[0x200000403:0xe8:0x0] dfid=[0x200000403:0xe8:0x0] compound/cookie=0x0/0x6a755633 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9679] fid=[0x200000403:0xe9:0x0] dfid=[0x200000403:0xe9:0x0] compound/cookie=0x0/0x6a755634 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9680] fid=[0x200000403:0xea:0x0] dfid=[0x200000403:0xea:0x0] compound/cookie=0x0/0x6a755635 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9681] fid=[0x200000403:0xeb:0x0] dfid=[0x200000403:0xeb:0x0] compound/cookie=0x0/0x6a755636 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9682] fid=[0x200000403:0xec:0x0] dfid=[0x200000403:0xec:0x0] compound/cookie=0x0/0x6a755637 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9683] fid=[0x200000403:0xed:0x0] dfid=[0x200000403:0xed:0x0] compound/cookie=0x0/0x6a755638 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9684] fid=[0x200000403:0xee:0x0] dfid=[0x200000403:0xee:0x0] compound/cookie=0x0/0x6a755639 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9685] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a75563a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9686] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a75563b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9687] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a75563c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9688] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a75563d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9689] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a75563e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9690] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a75563f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9691] fid=[0x200000403:0xf5:0x0] dfid=[0x200000403:0xf5:0x0] compound/cookie=0x0/0x6a755640 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9692] fid=[0x200000403:0xf6:0x0] dfid=[0x200000403:0xf6:0x0] compound/cookie=0x0/0x6a755641 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9693] fid=[0x200000403:0xf7:0x0] dfid=[0x200000403:0xf7:0x0] compound/cookie=0x0/0x6a755642 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9694] fid=[0x200000403:0xf8:0x0] dfid=[0x200000403:0xf8:0x0] compound/cookie=0x0/0x6a755643 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9695] fid=[0x200000403:0xf9:0x0] dfid=[0x200000403:0xf9:0x0] compound/cookie=0x0/0x6a755644 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9696] fid=[0x200000403:0xfa:0x0] dfid=[0x200000403:0xfa:0x0] compound/cookie=0x0/0x6a755645 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9697] fid=[0x200000403:0xfb:0x0] dfid=[0x200000403:0xfb:0x0] compound/cookie=0x0/0x6a755646 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9698] fid=[0x200000403:0xfc:0x0] dfid=[0x200000403:0xfc:0x0] compound/cookie=0x0/0x6a755647 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9700] fid=[0x200000403:0xfd:0x0] dfid=[0x200000403:0xfd:0x0] compound/cookie=0x0/0x6a755648 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9701] fid=[0x200000403:0xfe:0x0] dfid=[0x200000403:0xfe:0x0] compound/cookie=0x0/0x6a755649 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9702] fid=[0x200000403:0xff:0x0] dfid=[0x200000403:0xff:0x0] compound/cookie=0x0/0x6a75564a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9703] fid=[0x200000403:0x100:0x0] dfid=[0x200000403:0x100:0x0] compound/cookie=0x0/0x6a75564b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/9670] fid=[0x200000403:0xe0:0x0] dfid=[0x200000403:0xe0:0x0] compound/cookie=0x0/0x6a75562b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9671] fid=[0x200000403:0xe1:0x0] dfid=[0x200000403:0xe1:0x0] compound/cookie=0x0/0x6a75562c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9672] fid=[0x200000403:0xe2:0x0] dfid=[0x200000403:0xe2:0x0] compound/cookie=0x0/0x6a75562d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9673] fid=[0x200000403:0xe3:0x0] dfid=[0x200000403:0xe3:0x0] compound/cookie=0x0/0x6a75562e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9674] fid=[0x200000403:0xe4:0x0] dfid=[0x200000403:0xe4:0x0] compound/cookie=0x0/0x6a75562f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9675] fid=[0x200000403:0xe5:0x0] dfid=[0x200000403:0xe5:0x0] compound/cookie=0x0/0x6a755630 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9676] fid=[0x200000403:0xe6:0x0] dfid=[0x200000403:0xe6:0x0] compound/cookie=0x0/0x6a755631 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9677] fid=[0x200000403:0xe7:0x0] dfid=[0x200000403:0xe7:0x0] compound/cookie=0x0/0x6a755632 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9678] fid=[0x200000403:0xe8:0x0] dfid=[0x200000403:0xe8:0x0] compound/cookie=0x0/0x6a755633 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9679] fid=[0x200000403:0xe9:0x0] dfid=[0x200000403:0xe9:0x0] compound/cookie=0x0/0x6a755634 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9680] fid=[0x200000403:0xea:0x0] dfid=[0x200000403:0xea:0x0] compound/cookie=0x0/0x6a755635 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9681] fid=[0x200000403:0xeb:0x0] dfid=[0x200000403:0xeb:0x0] compound/cookie=0x0/0x6a755636 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9682] fid=[0x200000403:0xec:0x0] dfid=[0x200000403:0xec:0x0] compound/cookie=0x0/0x6a755637 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9683] fid=[0x200000403:0xed:0x0] dfid=[0x200000403:0xed:0x0] compound/cookie=0x0/0x6a755638 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9684] fid=[0x200000403:0xee:0x0] dfid=[0x200000403:0xee:0x0] compound/cookie=0x0/0x6a755639 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9685] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a75563a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9686] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a75563b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9687] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a75563c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9688] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a75563d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9689] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a75563e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9690] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a75563f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9691] fid=[0x200000403:0xf5:0x0] dfid=[0x200000403:0xf5:0x0] compound/cookie=0x0/0x6a755640 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9692] fid=[0x200000403:0xf6:0x0] dfid=[0x200000403:0xf6:0x0] compound/cookie=0x0/0x6a755641 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9693] fid=[0x200000403:0xf7:0x0] dfid=[0x200000403:0xf7:0x0] compound/cookie=0x0/0x6a755642 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9694] fid=[0x200000403:0xf8:0x0] dfid=[0x200000403:0xf8:0x0] compound/cookie=0x0/0x6a755643 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9695] fid=[0x200000403:0xf9:0x0] dfid=[0x200000403:0xf9:0x0] compound/cookie=0x0/0x6a755644 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9696] fid=[0x200000403:0xfa:0x0] dfid=[0x200000403:0xfa:0x0] compound/cookie=0x0/0x6a755645 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9697] fid=[0x200000403:0xfb:0x0] dfid=[0x200000403:0xfb:0x0] compound/cookie=0x0/0x6a755646 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9698] fid=[0x200000403:0xfc:0x0] dfid=[0x200000403:0xfc:0x0] compound/cookie=0x0/0x6a755647 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9700] fid=[0x200000403:0xfd:0x0] dfid=[0x200000403:0xfd:0x0] compound/cookie=0x0/0x6a755648 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9701] fid=[0x200000403:0xfe:0x0] dfid=[0x200000403:0xfe:0x0] compound/cookie=0x0/0x6a755649 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9702] fid=[0x200000403:0xff:0x0] dfid=[0x200000403:0xff:0x0] compound/cookie=0x0/0x6a75564a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9703] fid=[0x200000403:0x100:0x0] dfid=[0x200000403:0x100:0x0] compound/cookie=0x0/0x6a75564b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]'
Changed after 5s: from 'lrh=[type=10680000 len=136 idx=4/9670] fid=[0x200000403:0xe0:0x0] dfid=[0x200000403:0xe0:0x0] compound/cookie=0x0/0x6a75562b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9671] fid=[0x200000403:0xe1:0x0] dfid=[0x200000403:0xe1:0x0] compound/cookie=0x0/0x6a75562c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9672] fid=[0x200000403:0xe2:0x0] dfid=[0x200000403:0xe2:0x0] compound/cookie=0x0/0x6a75562d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9673] fid=[0x200000403:0xe3:0x0] dfid=[0x200000403:0xe3:0x0] compound/cookie=0x0/0x6a75562e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9674] fid=[0x200000403:0xe4:0x0] dfid=[0x200000403:0xe4:0x0] compound/cookie=0x0/0x6a75562f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9675] fid=[0x200000403:0xe5:0x0] dfid=[0x200000403:0xe5:0x0] compound/cookie=0x0/0x6a755630 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9676] fid=[0x200000403:0xe6:0x0] dfid=[0x200000403:0xe6:0x0] compound/cookie=0x0/0x6a755631 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9677] fid=[0x200000403:0xe7:0x0] dfid=[0x200000403:0xe7:0x0] compound/cookie=0x0/0x6a755632 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9678] fid=[0x200000403:0xe8:0x0] dfid=[0x200000403:0xe8:0x0] compound/cookie=0x0/0x6a755633 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9679] fid=[0x200000403:0xe9:0x0] dfid=[0x200000403:0xe9:0x0] compound/cookie=0x0/0x6a755634 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9680] fid=[0x200000403:0xea:0x0] dfid=[0x200000403:0xea:0x0] compound/cookie=0x0/0x6a755635 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9681] fid=[0x200000403:0xeb:0x0] dfid=[0x200000403:0xeb:0x0] compound/cookie=0x0/0x6a755636 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9682] fid=[0x200000403:0xec:0x0] dfid=[0x200000403:0xec:0x0] compound/cookie=0x0/0x6a755637 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9683] fid=[0x200000403:0xed:0x0] dfid=[0x200000403:0xed:0x0] compound/cookie=0x0/0x6a755638 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9684] fid=[0x200000403:0xee:0x0] dfid=[0x200000403:0xee:0x0] compound/cookie=0x0/0x6a755639 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9685] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a75563a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9686] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a75563b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9687] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a75563c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9688] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a75563d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9689] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a75563e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9690] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a75563f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9691] fid=[0x200000403:0xf5:0x0] dfid=[0x200000403:0xf5:0x0] compound/cookie=0x0/0x6a755640 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9692] fid=[0x200000403:0xf6:0x0] dfid=[0x200000403:0xf6:0x0] compound/cookie=0x0/0x6a755641 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9693] fid=[0x200000403:0xf7:0x0] dfid=[0x200000403:0xf7:0x0] compound/cookie=0x0/0x6a755642 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9694] fid=[0x200000403:0xf8:0x0] dfid=[0x200000403:0xf8:0x0] compound/cookie=0x0/0x6a755643 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9695] fid=[0x200000403:0xf9:0x0] dfid=[0x200000403:0xf9:0x0] compound/cookie=0x0/0x6a755644 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9696] fid=[0x200000403:0xfa:0x0] dfid=[0x200000403:0xfa:0x0] compound/cookie=0x0/0x6a755645 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9697] fid=[0x200000403:0xfb:0x0] dfid=[0x200000403:0xfb:0x0] compound/cookie=0x0/0x6a755646 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9698] fid=[0x200000403:0xfc:0x0] dfid=[0x200000403:0xfc:0x0] compound/cookie=0x0/0x6a755647 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9700] fid=[0x200000403:0xfd:0x0] dfid=[0x200000403:0xfd:0x0] compound/cookie=0x0/0x6a755648 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9701] fid=[0x200000403:0xfe:0x0] dfid=[0x200000403:0xfe:0x0] compound/cookie=0x0/0x6a755649 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9702] fid=[0x200000403:0xff:0x0] dfid=[0x200000403:0xff:0x0] compound/cookie=0x0/0x6a75564a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9703] fid=[0x200000403:0x100:0x0] dfid=[0x200000403:0x100:0x0] compound/cookie=0x0/0x6a75564b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/9685] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a75563a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9686] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a75563b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9687] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a75563c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9688] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a75563d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9689] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a75563e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9690] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a75563f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9691] fid=[0x200000403:0xf5:0x0] dfid=[0x200000403:0xf5:0x0] compound/cookie=0x0/0x6a755640 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9692] fid=[0x200000403:0xf6:0x0] dfid=[0x200000403:0xf6:0x0] compound/cookie=0x0/0x6a755641 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9693] fid=[0x200000403:0xf7:0x0] dfid=[0x200000403:0xf7:0x0] compound/cookie=0x0/0x6a755642 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9694] fid=[0x200000403:0xf8:0x0] dfid=[0x200000403:0xf8:0x0] compound/cookie=0x0/0x6a755643 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9695] fid=[0x200000403:0xf9:0x0] dfid=[0x200000403:0xf9:0x0] compound/cookie=0x0/0x6a755644 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9696] fid=[0x200000403:0xfa:0x0] dfid=[0x200000403:0xfa:0x0] compound/cookie=0x0/0x6a755645 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9697] fid=[0x200000403:0xfb:0x0] dfid=[0x200000403:0xfb:0x0] compound/cookie=0x0/0x6a755646 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9698] fid=[0x200000403:0xfc:0x0] dfid=[0x200000403:0xfc:0x0] compound/cookie=0x0/0x6a755647 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9700] fid=[0x200000403:0xfd:0x0] dfid=[0x200000403:0xfd:0x0] compound/cookie=0x0/0x6a755648 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9701] fid=[0x200000403:0xfe:0x0] dfid=[0x200000403:0xfe:0x0] compound/cookie=0x0/0x6a755649 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9702] fid=[0x200000403:0xff:0x0] dfid=[0x200000403:0xff:0x0] compound/cookie=0x0/0x6a75564a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9703] fid=[0x200000403:0x100:0x0] dfid=[0x200000403:0x100:0x0] compound/cookie=0x0/0x6a75564b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]'
Changed after 7s: from 'lrh=[type=10680000 len=136 idx=4/9685] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a75563a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9686] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a75563b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9687] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a75563c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/9688] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a75563d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9689] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a75563e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9690] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a75563f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9691] fid=[0x200000403:0xf5:0x0] dfid=[0x200000403:0xf5:0x0] compound/cookie=0x0/0x6a755640 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9692] fid=[0x200000403:0xf6:0x0] dfid=[0x200000403:0xf6:0x0] compound/cookie=0x0/0x6a755641 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9693] fid=[0x200000403:0xf7:0x0] dfid=[0x200000403:0xf7:0x0] compound/cookie=0x0/0x6a755642 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9694] fid=[0x200000403:0xf8:0x0] dfid=[0x200000403:0xf8:0x0] compound/cookie=0x0/0x6a755643 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9695] fid=[0x200000403:0xf9:0x0] dfid=[0x200000403:0xf9:0x0] compound/cookie=0x0/0x6a755644 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9696] fid=[0x200000403:0xfa:0x0] dfid=[0x200000403:0xfa:0x0] compound/cookie=0x0/0x6a755645 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9697] fid=[0x200000403:0xfb:0x0] dfid=[0x200000403:0xfb:0x0] compound/cookie=0x0/0x6a755646 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9698] fid=[0x200000403:0xfc:0x0] dfid=[0x200000403:0xfc:0x0] compound/cookie=0x0/0x6a755647 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9700] fid=[0x200000403:0xfd:0x0] dfid=[0x200000403:0xfd:0x0] compound/cookie=0x0/0x6a755648 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9701] fid=[0x200000403:0xfe:0x0] dfid=[0x200000403:0xfe:0x0] compound/cookie=0x0/0x6a755649 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9702] fid=[0x200000403:0xff:0x0] dfid=[0x200000403:0xff:0x0] compound/cookie=0x0/0x6a75564a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9703] fid=[0x200000403:0x100:0x0] dfid=[0x200000403:0x100:0x0] compound/cookie=0x0/0x6a75564b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/9701] fid=[0x200000403:0xfe:0x0] dfid=[0x200000403:0xfe:0x0] compound/cookie=0x0/0x6a755649 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9702] fid=[0x200000403:0xff:0x0] dfid=[0x200000403:0xff:0x0] compound/cookie=0x0/0x6a75564a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/9703] fid=[0x200000403:0x100:0x0] dfid=[0x200000403:0x100:0x0] compound/cookie=0x0/0x6a75564b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]'
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
PASS 90 (102s)

== sanity-hsm test 100: Set coordinator /proc tunables === 13:29:51 (1786037391)
Testing mdt.lustre-MDT0000.hsm.loop_period
Set loop_period to 0 must failed
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/loop_period=0: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/loop_period'='0': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/loop_period=0: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/loop_period'='0': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
Testing mdt.lustre-MDT0000.hsm.grace_delay
Set grace_delay to 0 must failed
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/grace_delay=0: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/grace_delay'='0': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/grace_delay=0: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/grace_delay'='0': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
Testing mdt.lustre-MDT0000.hsm.active_request_timeout
Set active_request_timeout to 0 must failed
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/active_request_timeout=0: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/active_request_timeout'='0': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/active_request_timeout=0: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/active_request_timeout'='0': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
Testing mdt.lustre-MDT0000.hsm.max_requests
Set max_requests to 0 must failed
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=0: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='0': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/max_requests=0: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/max_requests'='0': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
Testing mdt.lustre-MDT0000.hsm.default_archive_id
Set default_archive_id to 0 must failed
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/default_archive_id=0: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/default_archive_id'='0': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
oleg205-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/default_archive_id=0: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/default_archive_id'='0': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
PASS 100 (65s)

== sanity-hsm test 102: Verify coordinator control ======= 13:30:56 (1786037456)
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0001.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=enabled
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0001.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=enabled
PASS 102 (29s)

== sanity-hsm test 103: Purge all requests =============== 13:31:25 (1786037485)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_103/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=purge
mdt.lustre-MDT0001.hsm_control=purge
Current requests
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
PASS 103 (19s)

== sanity-hsm test 103a: Purge pending restore requests == 13:31:44 (1786037504)
mdt.lustre-MDT0000.hsm.policy=-NBR
mdt.lustre-MDT0001.hsm.policy=-NBR
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_103a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
(0x200000403:0x148:0x0|0x200000403:0x149:0x0|0x200000403:0x14a:0x0|0x200000403:0x14b:0x0|0x200000403:0x14c:0x0|0x200000403:0x14d:0x0|0x200000403:0x14e:0x0|0x200000403:0x14f:0x0).*action=ARCHIVE.*status=SUCCEED
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Killing existing copytools on oleg205-client.virtnet with signal TERM
copytools stopped in 0s
cat: '/mnt/lustre/.lustre/fid/0x200000403:0x148:0x0': No data available
cat: '/mnt/lustre/.lustre/fid/0x200000403:0x149:0x0': No data available
cat: '/mnt/lustre/.lustre/fid/0x200000403:0x14e:0x0': No data available
cat: '/mnt/lustre/.lustre/fid/0x200000403:0x14d:0x0': No data available
cat: '/mnt/lustre/.lustre/fid/0x200000403:0x14c:0x0': No data available
cat: '/mnt/lustre/.lustre/fid/0x200000403:0x14b:0x0': No data available
cat: '/mnt/lustre/.lustre/fid/0x200000403:0x14f:0x0': No data available
cat: '/mnt/lustre/.lustre/fid/0x200000403:0x14a:0x0': No data available
mdt.lustre-MDT0000.hsm_control=purge
mdt.lustre-MDT0001.hsm_control=purge
PASS 103a (25s)

== sanity-hsm test 104: Copy tool data field ============= 13:32:09 (1786037529)
0+0 records in
0+0 records out
0 bytes copied, 0.0115908 s, 0.0 kB/s
mdt.lustre-MDT0000.hsm_control=purge
mdt.lustre-MDT0001.hsm_control=purge
PASS 104 (13s)

== sanity-hsm test 105: Restart of coordinator =========== 13:32:23 (1786037543)
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0001.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0001.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=enabled
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0001.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=enabled
mdt.lustre-MDT0000.hsm_control=purge
mdt.lustre-MDT0001.hsm_control=purge
PASS 105 (47s)

== sanity-hsm test 106a: Copytool register/unregister ==== 13:33:09 (1786037589)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
oleg205-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg205-client.virtnet: executing get_client_uuid /mnt/lustre2
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2
oleg205-client.virtnet: 89670
Killing existing copytools on oleg205-client.virtnet with signal TERM
copytools stopped in 0s
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
uuid not found in agent list on mds1
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
uuid not found in agent list on mds2
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
oleg205-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg205-client.virtnet: executing get_client_uuid /mnt/lustre2
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2
PASS 106a (52s)

== sanity-hsm test 106b: Unregister agent after a copytool crash ========================================================== 13:34:01 (1786037641)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
oleg205-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg205-client.virtnet: executing get_client_uuid /mnt/lustre2
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2
oleg205-client.virtnet: 91408
Killing existing copytools on oleg205-client.virtnet with signal KILL
copytools stopped in 0s
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
uuid not found in agent list on mds1
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
uuid not found in agent list on mds2
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2
PASS 106b (30s)

== sanity-hsm test 106c: Unregister copytool on client eviction ========================================================== 13:34:32 (1786037672)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
oleg205-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg205-client.virtnet: executing get_client_uuid /mnt/lustre2
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2
oleg205-client.virtnet: 92641
oleg205-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg205-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg205-client.virtnet: executing get_client_uuid /mnt/lustre2
mdc.lustre-MDT0000-mdc-ffff989ee02a8800.active=0
mdc.lustre-MDT0001-mdc-ffff989ee02a8800.active=0
mdt.lustre-MDT0000.evict_client=1fdbb798-4fef-4fb0-9120-e2730ecad4ab
mdt.lustre-MDT0001.evict_client=1fdbb798-4fef-4fb0-9120-e2730ecad4ab
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
uuid not found in agent list on mds1
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
uuid not found in agent list on mds2
mdc.lustre-MDT0000-mdc-ffff989ee02a8800.active=1
mdc.lustre-MDT0001-mdc-ffff989ee02a8800.active=1
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2
mdc.lustre-MDT0000-mdc-ffff989ee02a8800.active=1
mdc.lustre-MDT0001-mdc-ffff989ee02a8800.active=1
PASS 106c (64s)

== sanity-hsm test 107: Copytool re-register after MDS restart ========================================================== 13:35:36 (1786037736)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_107/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Failing mds1 on oleg205-server
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
13:35:46 (1786037746) shut down
facet: mds1 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds1 to oleg205-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
13:36:19 (1786037779) targets are mounted
13:36:19 (1786037779) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
PASS 107 (64s)

== sanity-hsm test 109: Policy display/change ============ 13:36:40 (1786037800)
mdt.lustre-MDT0000.hsm.policy=+NBR
mdt.lustre-MDT0000.hsm.policy=+NRA
mdt.lustre-MDT0000.hsm.policy=-NBR
mdt.lustre-MDT0000.hsm.policy=-NRA
mdt.lustre-MDT0000.hsm.policy=NRA NBR
Next set_param must failed
oleg205-server: error: set_param: setting /sys/kernel/debug/lustre/mdt/lustre-MDT0000/hsm/policy=wrong: Invalid argument
oleg205-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/policy'='wrong': Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 22
Back to default policy
mdt.lustre-MDT0000.hsm.policy=+NRA
mdt.lustre-MDT0001.hsm.policy=+NRA
mdt.lustre-MDT0000.hsm.policy=-NBR
mdt.lustre-MDT0001.hsm.policy=-NBR
PASS 109 (31s)

== sanity-hsm test 110a: Non blocking restore policy (import case) ========================================================== 13:37:11 (1786037831)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_110a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1786037835.120530 [97242]: action=1 src=d110a.sanity-hsm/f110a.sanity-hsm dst=/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786037835.130208 [97242]: importing '/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_110a//d110a.sanity-hsm/f110a.sanity-hsm'
lhsmtool_posix: 1786037835.209532 [97242]: imported '/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_110a//0bb6/0x200000bd2:0x64:0x0'=='/tmp/arc1/sanity-hsm.test_110a//d110a.sanity-hsm/f110a.sanity-hsm'
lhsmtool_posix: 1786037835.209735 [97242]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
mdt.lustre-MDT0000.hsm.policy=+NBR
mdt.lustre-MDT0001.hsm.policy=+NBR
md5sum: /mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm: No data available
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
mdt.lustre-MDT0000.hsm.policy=-NBR
mdt.lustre-MDT0001.hsm.policy=-NBR
PASS 110a (18s)

== sanity-hsm test 110b: Non blocking restore policy (release case) ========================================================== 13:37:29 (1786037849)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_110b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm.policy=+NBR
mdt.lustre-MDT0001.hsm.policy=+NBR
md5sum: /mnt/lustre/d110b.sanity-hsm/f110b.sanity-hsm: No data available
mdt.lustre-MDT0000.hsm.policy=-NBR
mdt.lustre-MDT0001.hsm.policy=-NBR
PASS 110b (15s)

== sanity-hsm test 111a: No retry policy (import case), restore will error ========================================================== 13:37:44 (1786037864)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_111a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1786037867.506833 [98642]: action=1 src=d111a.sanity-hsm/f111a.sanity-hsm dst=/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786037867.515972 [98642]: importing '/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_111a//d111a.sanity-hsm/f111a.sanity-hsm'
lhsmtool_posix: 1786037867.559807 [98642]: imported '/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_111a//0bbb/0x200000bd2:0x69:0x0'=='/tmp/arc1/sanity-hsm.test_111a//d111a.sanity-hsm/f111a.sanity-hsm'
lhsmtool_posix: 1786037867.559853 [98642]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
mdt.lustre-MDT0000.hsm.policy=+NRA
mdt.lustre-MDT0001.hsm.policy=+NRA
Remove from backend: 0x200000bd2:0x69:0x0 = /tmp/arc1/sanity-hsm.test_111a/0bbb/0x200000bd2:0x69:0x0
mdt.lustre-MDT0000.hsm.policy=-NRA
mdt.lustre-MDT0001.hsm.policy=-NRA
PASS 111a (16s)

== sanity-hsm test 111b: No retry policy (release case), restore will error ========================================================== 13:38:00 (1786037880)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_111b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm.policy=+NRA
mdt.lustre-MDT0001.hsm.policy=+NRA
Remove from backend: 0x200000bd3:0x7:0x0 = /tmp/arc1/sanity-hsm.test_111b/0bd4/0x200000bd3:0x7:0x0
mdt.lustre-MDT0000.hsm.policy=-NRA
mdt.lustre-MDT0001.hsm.policy=-NRA
PASS 111b (16s)

== sanity-hsm test 112: State of recorded request ======== 13:38:16 (1786037896)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_112/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0001.hsm_control=disabled
/mnt/lustre/d112.sanity-hsm/f112.sanity-hsm: ARCHIVE waiting (from 0 to EOF)
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=enabled
PASS 112 (18s)

== sanity-hsm test 113: wrong stat after restore ========= 13:38:34 (1786037914)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0682213 s, 15.4 MB/s
Starting client: oleg205-client.virtnet:  -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre3
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_113/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre3"'
Verifying released state: 
multiop /mnt/lustre/d113.sanity-hsm/f113.sanity-hsm voO_WRONLY:O_APPEND:_w4c
TMPPIPE=/tmp/multiop_open_wait_pipe.8224
  File: /mnt/lustre2/d113.sanity-hsm/f113.sanity-hsm
  Size: 1048576   	Blocks: 1          IO Block: 4194304 regular file
Device: 2c54f966h/743766374d	Inode: 144115238860488714  Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2026-08-06 13:38:36.000000000 -0400
Modify: 2026-08-06 13:38:36.000000000 -0400
Change: 2026-08-06 13:38:36.000000000 -0400
 Birth: 2026-08-06 13:38:35.000000000 -0400
Stopping client oleg205-client.virtnet /mnt/lustre3 (opts:)
PASS 113 (18s)

== sanity-hsm test 114: Incompatible request does not set other requests as STARTED ========================================================== 13:38:52 (1786037932)
0+0 records in
0+0 records out
0 bytes copied, 0.004214 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00334276 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_114/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0001.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=enabled
PASS 114 (20s)

== sanity-hsm test 200: Register/Cancel archive ========== 13:39:12 (1786037952)
0+0 records in
0+0 records out
0 bytes copied, 0.0080676 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_200/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
PASS 200 (13s)

== sanity-hsm test 201: Register/Cancel restore ========== 13:39:25 (1786037965)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_201/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
39+0 records in
39+0 records out
40894464 bytes (41 MB, 39 MiB) copied, 1.52398 s, 26.8 MB/s
lhsmtool_posix: 1786037969.921207 [103022]: action=1 src=d201.sanity-hsm/f201.sanity-hsm dst=/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786037969.930531 [103022]: importing '/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_201//d201.sanity-hsm/f201.sanity-hsm'
lhsmtool_posix: 1786037970.054427 [103022]: imported '/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_201//0ba0/0x200000bd2:0x72:0x0'=='/tmp/arc1/sanity-hsm.test_201//d201.sanity-hsm/f201.sanity-hsm'
lhsmtool_posix: 1786037970.055101 [103022]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0001.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=enabled
PASS 201 (25s)

== sanity-hsm test 202: Register/Cancel remove =========== 13:39:50 (1786037990)
0+0 records in
0+0 records out
0 bytes copied, 0.0179347 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_202/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Copytool is suspended on oleg205-client.virtnet
PASS 202 (14s)

== sanity-hsm test 220A: Changelog for archive =========== 13:40:04 (1786038004)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_220A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl1 cl1'
lustre-MDT0000.3 16HSM   17:40:14.968491667 2026.08.06 0x0 t=[0x200000bd3:0x12:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0001: clear the changelog for cl1 of all records
lustre-MDT0001: Deregistered changelog user #1
lustre-MDT0000: clear the changelog for cl1 of all records
lustre-MDT0000: Deregistered changelog user #1
PASS 220A (25s)

== sanity-hsm test 220a: Changelog for failed archive ==== 13:40:30 (1786038030)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_220a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl2 cl2'
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
lustre-MDT0000.6 16HSM   17:40:41.957762325 2026.08.06 0x2 t=[0x200000bd3:0x13:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0001: clear the changelog for cl2 of all records
lustre-MDT0001: Deregistered changelog user #2
lustre-MDT0000: clear the changelog for cl2 of all records
lustre-MDT0000: Deregistered changelog user #2
PASS 220a (27s)

== sanity-hsm test 221: Changelog for archive canceled === 13:40:58 (1786038058)
0+0 records in
0+0 records out
0 bytes copied, 0.0114538 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_221/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl3 cl3'
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
lustre-MDT0000.8 16HSM   17:41:10.041202062 2026.08.06 0x7d t=[0x200000bd3:0x14:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0001: clear the changelog for cl3 of all records
lustre-MDT0001: Deregistered changelog user #3
lustre-MDT0000: clear the changelog for cl3 of all records
lustre-MDT0000: Deregistered changelog user #3
PASS 221 (27s)

== sanity-hsm test 222a: Changelog for explicit restore == 13:41:25 (1786038085)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1786038089.222795 [106866]: action=1 src=d222a.sanity-hsm/f222a.sanity-hsm dst=/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786038089.230160 [106866]: importing '/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222a//d222a.sanity-hsm/f222a.sanity-hsm'
lhsmtool_posix: 1786038089.321970 [106866]: imported '/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222a//0bab/0x200000bd2:0x79:0x0'=='/tmp/arc1/sanity-hsm.test_222a//d222a.sanity-hsm/f222a.sanity-hsm'
lhsmtool_posix: 1786038089.322037 [106866]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl4 cl4'
lustre-MDT0000.11 16HSM   17:41:37.332567760 2026.08.06 0x80 t=[0x200000bd2:0x79:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x75:0x0]
lustre-MDT0001: clear the changelog for cl4 of all records
lustre-MDT0001: Deregistered changelog user #4
lustre-MDT0000: clear the changelog for cl4 of all records
lustre-MDT0000: Deregistered changelog user #4
PASS 222a (33s)

== sanity-hsm test 222b: Changelog for implicit restore == 13:41:58 (1786038118)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl5 cl5'
4ef076ad20e5d4a2f4729d6ed41a3bf9  /mnt/lustre/d222b.sanity-hsm/f222b.sanity-hsm
lustre-MDT0000.20 16HSM   17:42:09.843791709 2026.08.06 0x80 t=[0x200000bd3:0x16:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0001: clear the changelog for cl5 of all records
lustre-MDT0001: Deregistered changelog user #5
lustre-MDT0000: clear the changelog for cl5 of all records
lustre-MDT0000: Deregistered changelog user #5
PASS 222b (24s)

== sanity-hsm test 222c: Changelog for failed explicit restore ========================================================== 13:42:23 (1786038143)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1786038146.481495 [108498]: action=1 src=d222c.sanity-hsm/f222c.sanity-hsm dst=/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786038146.490541 [108498]: importing '/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222c//d222c.sanity-hsm/f222c.sanity-hsm'
lhsmtool_posix: 1786038146.616419 [108498]: imported '/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222c//0baf/0x200000bd2:0x7d:0x0'=='/tmp/arc1/sanity-hsm.test_222c//d222c.sanity-hsm/f222c.sanity-hsm'
lhsmtool_posix: 1786038146.616491 [108498]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl6 cl6'
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
lustre-MDT0000.22 16HSM   17:42:34.580640478 2026.08.06 0x82 t=[0x200000bd2:0x7d:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0001: clear the changelog for cl6 of all records
lustre-MDT0001: Deregistered changelog user #6
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0000: Deregistered changelog user #6
PASS 222c (29s)

== sanity-hsm test 222d: Changelog for failed implicit restore ========================================================== 13:42:52 (1786038172)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl7 cl7'
Remove from backend: 0x200000bd3:0x18:0x0 = /tmp/arc1/sanity-hsm.test_222d/0bcb/0x200000bd3:0x18:0x0
md5sum: /mnt/lustre/d222d.sanity-hsm/f222d.sanity-hsm: No data available
lustre-MDT0000.29 16HSM   17:43:02.641261013 2026.08.06 0x82 t=[0x200000bd3:0x18:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0001: clear the changelog for cl7 of all records
lustre-MDT0001: Deregistered changelog user #7
lustre-MDT0000: clear the changelog for cl7 of all records
lustre-MDT0000: Deregistered changelog user #7
PASS 222d (26s)

== sanity-hsm test 223a: Changelog for restore canceled (import case) ========================================================== 13:43:18 (1786038198)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_223a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
39+0 records in
39+0 records out
40894464 bytes (41 MB, 39 MiB) copied, 1.13712 s, 36.0 MB/s
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl8 cl8'
lhsmtool_posix: 1786038209.872070 [110243]: action=1 src=d223a.sanity-hsm/f223a.sanity-hsm dst=/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1786038209.881389 [110243]: importing '/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_223a//d223a.sanity-hsm/f223a.sanity-hsm'
lhsmtool_posix: 1786038209.945567 [110243]: imported '/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_223a//0b50/0x200000bd2:0x82:0x0'=='/tmp/arc1/sanity-hsm.test_223a//d223a.sanity-hsm/f223a.sanity-hsm'
lhsmtool_posix: 1786038209.946483 [110243]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Waiting 200s for 'STARTED'
Waiting 200s for 'SUCCEED'
Waiting 180s for 'SUCCEED'
Updated after 27s: want 'SUCCEED' got 'SUCCEED'
lustre-MDT0000.36 16HSM   17:44:00.453805429 2026.08.06 0xfd t=[0x200000bd2:0x82:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x75:0x0]
lustre-MDT0001: clear the changelog for cl8 of all records
lustre-MDT0001: Deregistered changelog user #8
lustre-MDT0000: clear the changelog for cl8 of all records
lustre-MDT0000: Deregistered changelog user #8
PASS 223a (57s)

== sanity-hsm test 223b: Changelog for restore canceled (release case) ========================================================== 13:44:15 (1786038255)
0+0 records in
0+0 records out
0 bytes copied, 0.00514469 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_223b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl9 cl9'
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
lustre-MDT0000.43 16HSM   17:44:28.710170195 2026.08.06 0xfd t=[0x200000bd3:0x1c:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0001: clear the changelog for cl9 of all records
lustre-MDT0001: Deregistered changelog user #9
lustre-MDT0000: clear the changelog for cl9 of all records
lustre-MDT0000: Deregistered changelog user #9
PASS 223b (28s)

== sanity-hsm test 224A: Changelog for remove ============ 13:44:43 (1786038283)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_224A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl10 cl10'
lustre-MDT0000.48 16HSM   17:44:52.406806764 2026.08.06 0x200 t=[0x200000bd3:0x1e:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x80:0x0]
lustre-MDT0001: clear the changelog for cl10 of all records
lustre-MDT0001: Deregistered changelog user #10
lustre-MDT0000: clear the changelog for cl10 of all records
lustre-MDT0000: Deregistered changelog user #10
PASS 224A (23s)

== sanity-hsm test 224a: Changelog for failed remove ===== 13:45:06 (1786038306)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_224a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl11 cl11'
Remove from backend: 0x200000bd3:0x1f:0x0 = /tmp/arc1/sanity-hsm.test_224a/0bcc/0x200000bd3:0x1f:0x0
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
lustre-MDT0000.53 16HSM   17:45:17.942039902 2026.08.06 0x202 t=[0x200000bd3:0x1f:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x75:0x0]
lustre-MDT0001: clear the changelog for cl11 of all records
lustre-MDT0001: Deregistered changelog user #11
lustre-MDT0000: clear the changelog for cl11 of all records
lustre-MDT0000: Deregistered changelog user #11
PASS 224a (27s)

== sanity-hsm test 225: Changelog for remove canceled ==== 13:45:33 (1786038333)
Test disabled
PASS 225 (9s)

== sanity-hsm test 226: changelog for last rm/mv with exiting archive ========================================================== 13:45:42 (1786038342)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_226/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
0x200000bd3:0x22:0x0
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl12 cl12'
lustre-MDT0000.54 16HSM   17:45:53.824634027 2026.08.06 0x280 t=[0x200000bd3:0x20:0x0] ef=0x13 u=0:0 nid=0@<0:0>
lustre-MDT0000.55 16HSM   17:45:53.969804396 2026.08.06 0x280 t=[0x200000bd3:0x20:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x7c:0x0]
lustre-MDT0000.56 16HSM   17:45:53.969916706 2026.08.06 0x0 t=[0x200000bd3:0x20:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x7c:0x0]
lustre-MDT0000.57 16HSM   17:45:54.977491119 2026.08.06 0x280 t=[0x200000bd3:0x21:0x0] ef=0x13 u=0:0 nid=0@<0:0>
lustre-MDT0000.58 16HSM   17:45:55.087489123 2026.08.06 0x280 t=[0x200000bd3:0x21:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000.59 16HSM   17:45:55.087619847 2026.08.06 0x0 t=[0x200000bd3:0x21:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000.60 06UNLNK 17:45:55.400327360 2026.08.06 0x3 t=[0x200000bd3:0x20:0x0] j=rm.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x87:0x0] f226.sanity-hsm-1
lustre-MDT0000.60 06UNLNK 17:45:55.400327360 2026.08.06 0x3 t=[0x200000bd3:0x20:0x0] j=rm.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x87:0x0] f226.sanity-hsm-1
lustre-MDT0000.61 08RENME 17:45:55.889688429 2026.08.06 0x3 t=[0x200000bd3:0x21:0x0] j=mv.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x200000bd2:0x87:0x0] f226.sanity-hsm-2 s=[0x200000bd3:0x22:0x0] sp=[0x200000bd2:0x87:0x0] f226.sanity-hsm-3
lustre-MDT0001: clear the changelog for cl12 of all records
lustre-MDT0001: Deregistered changelog user #12
lustre-MDT0000: clear the changelog for cl12 of all records
lustre-MDT0000: Deregistered changelog user #12
PASS 226 (29s)

== sanity-hsm test 227: changelog when explicit setting of HSM flags ========================================================== 13:46:11 (1786038371)
0+0 records in
0+0 records out
0 bytes copied, 0.00754887 s, 0.0 kB/s
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl13 cl13'
lustre-MDT0001: clear the changelog for cl13 of all records
lustre-MDT0001: Deregistered changelog user #13
lustre-MDT0000: clear the changelog for cl13 of all records
lustre-MDT0000: Deregistered changelog user #13
PASS 227 (27s)

== sanity-hsm test 228: On released file, return extend to FIEMAP. For [cp,tar] --sparse ========================================================== 13:46:38 (1786038398)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_228/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115839 s, 9.1 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
/mnt/lustre/f228.sanity-hsm: 1 extent found
tar: Removing leading `/' from member names
mnt/lustre/f228.sanity-hsm
PASS 228 (13s)

== sanity-hsm test 250: Coordinator max request ========== 13:46:51 (1786038411)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_250/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.0119792 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00977319 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00356987 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00374839 s, 0.0 kB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
0+0 records in
0+0 records out
0 bytes copied, 0.00470458 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00496279 s, 0.0 kB/s
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
PASS 250 (32s)

== sanity-hsm test 251: Coordinator request timeout ====== 13:47:23 (1786038443)
0+0 records in
0+0 records out
0 bytes copied, 0.0166757 s, 0.0 kB/s
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0001.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=enabled
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_251/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Copytool is suspended on oleg205-client.virtnet
Waiting 200s for 'STARTED'
Updated after 2s: want 'STARTED' got 'STARTED'
Waiting 200s for 'CANCELED'
Updated after 2s: want 'CANCELED' got 'CANCELED'
PASS 251 (35s)

== sanity-hsm test 252: Timeout'ed running archive of a removed file should be canceled ========================================================== 13:47:58 (1786038478)
0+0 records in
0+0 records out
0 bytes copied, 0.00848275 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_252/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
PASS 252 (21s)

== sanity-hsm test 253: Check for wrong file size after release ========================================================== 13:48:19 (1786038499)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_253/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
10+0 records in
10+0 records out
10000000 bytes (10 MB, 9.5 MiB) copied, 0.476078 s, 21.0 MB/s
fail_loc=0x807
Cannot send HSM request (use of /mnt/lustre/d253.sanity-hsm/f253.sanity-hsm): Invalid argument
could not release file
PASS 253 (12s)

== sanity-hsm test 254a: Request counters are initialized to zero ========================================================== 13:48:31 (1786038511)
PASS 254a (12s)

== sanity-hsm test 254b: Request counters are correctly incremented and decremented ========================================================== 13:48:43 (1786038523)
Will launch 41 requests of each type
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_254b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Checking archive requests
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
Checking restore requests
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
Waiting 90s for '0'
Updated after 3s: want '0' got '0'
Checking remove requests
Copytool is suspended on oleg205-client.virtnet
Copytool is continued on oleg205-client.virtnet
PASS 254b (43s)

== sanity-hsm test 255: Copytool registration wakes the coordinator up ========================================================== 13:49:26 (1786038566)
0+0 records in
0+0 records out
0 bytes copied, 0.00499522 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_255/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Killing existing copytools on oleg205-client.virtnet with signal TERM
copytools stopped in 1s
0+0 records in
0+0 records out
0 bytes copied, 0.00612007 s, 0.0 kB/s
0x200000bd3:0x85:0x0
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0001.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=enabled
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_255/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 255 (37s)

== sanity-hsm test 256: HSM copytool register on DNE with stopped MDT must not panic ========================================================== 13:50:03 (1786038603)
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=shutdown
mdt.lustre-MDT0001.hsm_control=enabled
PASS 256 (34s)

== sanity-hsm test 260a: Restore request have priority over other requests ========================================================== 13:50:37 (1786038637)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179954 s, 5.8 MB/s
0x200000bd3:0x86:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.145611 s, 7.2 MB/s
0x200000bd3:0x87:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117928 s, 8.9 MB/s
0x200000bd3:0x88:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128531 s, 8.2 MB/s
0x200000bd3:0x89:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.187838 s, 5.6 MB/s
0x200000bd3:0x8a:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137999 s, 7.6 MB/s
0x200000bd3:0x8b:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116729 s, 9.0 MB/s
0x200000bd3:0x8c:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119081 s, 8.8 MB/s
0x200000bd3:0x8d:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122548 s, 8.6 MB/s
0x200000bd3:0x8e:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122844 s, 8.5 MB/s
0x200000bd3:0x8f:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170801 s, 6.1 MB/s
0x200000bd3:0x90:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.243421 s, 4.3 MB/s
0x200000bd3:0x91:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110129 s, 9.5 MB/s
0x200000bd3:0x92:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115564 s, 9.1 MB/s
0x200000bd3:0x93:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180083 s, 5.8 MB/s
0x200000bd3:0x94:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.236531 s, 4.4 MB/s
0x200000bd3:0x95:0x0
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Killing existing copytools on oleg205-client.virtnet with signal TERM
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
RESTORE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
PASS 260a (49s)

== sanity-hsm test 260b: Restore request have priority over other requests ========================================================== 13:51:26 (1786038686)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.193296 s, 5.4 MB/s
0x200000bd3:0x98:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.191366 s, 5.5 MB/s
0x200000bd3:0x99:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0845565 s, 12.4 MB/s
0x200000bd3:0x9a:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11061 s, 9.5 MB/s
0x200000bd3:0x9b:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12871 s, 8.1 MB/s
0x200000bd3:0x9c:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.092745 s, 11.3 MB/s
0x200000bd3:0x9d:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0925682 s, 11.3 MB/s
0x200000bd3:0x9e:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.153891 s, 6.8 MB/s
0x200000bd3:0x9f:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129302 s, 8.1 MB/s
0x200000bd3:0xa0:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129981 s, 8.1 MB/s
0x200000bd3:0xa1:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.106506 s, 9.8 MB/s
0x200000bd3:0xa2:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.183459 s, 5.7 MB/s
0x200000bd3:0xa3:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161823 s, 6.5 MB/s
0x200000bd3:0xa4:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.147101 s, 7.1 MB/s
0x200000bd3:0xa5:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.144077 s, 7.3 MB/s
0x200000bd3:0xa6:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0960452 s, 10.9 MB/s
0x200000bd3:0xa7:0x0
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre2"'
Killing existing copytools on oleg205-client.virtnet with signal TERM
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre2"'
RESTORE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
PASS 260b (47s)

== sanity-hsm test 260c: Requests are not reordered on the 'hot' path of the coordinator ========================================================== 13:52:13 (1786038733)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.176374 s, 5.9 MB/s
0x200000bd3:0xa9:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156744 s, 6.7 MB/s
0x200000bd3:0xaa:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.198775 s, 5.3 MB/s
0x200000bd3:0xab:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.263843 s, 4.0 MB/s
0x200000bd3:0xac:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.198948 s, 5.3 MB/s
0x200000bd3:0xad:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.189255 s, 5.5 MB/s
0x200000bd3:0xae:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154346 s, 6.8 MB/s
0x200000bd3:0xaf:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.241448 s, 4.3 MB/s
0x200000bd3:0xb0:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0755573 s, 13.9 MB/s
0x200000bd3:0xb1:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0991369 s, 10.6 MB/s
0x200000bd3:0xb2:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0895441 s, 11.7 MB/s
0x200000bd3:0xb3:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0898397 s, 11.7 MB/s
0x200000bd3:0xb4:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.087978 s, 11.9 MB/s
0x200000bd3:0xb5:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.175107 s, 6.0 MB/s
0x200000bd3:0xb6:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.174547 s, 6.0 MB/s
0x200000bd3:0xb7:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.176239 s, 5.9 MB/s
0x200000bd3:0xb8:0x0
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre2"'
Killing existing copytools on oleg205-client.virtnet with signal TERM
copytools stopped in 0s
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0001.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=enabled
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre2"'
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
RESTORE
PASS 260c (56s)

== sanity-hsm test 261: Report 0 bytes size after HSM release ========================================================== 13:53:09 (1786038789)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_261/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
2+0 records in
2+0 records out
8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0235665 s, 348 kB/s
/mnt/lustre/d261.sanity-hsm/f261.sanity-hsm: (0x00000009) exists archived, archive_id:2
/mnt/lustre/d261.sanity-hsm/f261.sanity-hsm: (0x0000000d) released exists archived, archive_id:2
PASS 261 (13s)

== sanity-hsm test 262: The client should return 1 block for HSM released files ========================================================== 13:53:22 (1786038802)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_262/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
2+0 records in
2+0 records out
8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0240522 s, 341 kB/s
PASS 262 (9s)

== sanity-hsm test 300: On disk coordinator state kept between MDT umount/mount ========================================================== 13:53:31 (1786038811)
Stop coordinator and remove coordinator state at mount
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0001.hsm_control=shutdown
Failing mds1 on oleg205-server
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
13:53:47 (1786038827) shut down
facet: mds1 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds1 to oleg205-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
13:54:21 (1786038861) targets are mounted
13:54:21 (1786038861) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
Set coordinator start at mount, and start coordinator
Failing mds1 on oleg205-server
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
13:55:07 (1786038907) shut down
facet: mds1 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds1 to oleg205-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
13:55:43 (1786038943) targets are mounted
13:55:43 (1786038943) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
PASS 300 (153s)

== sanity-hsm test 301: HSM tunnable are persistent ====== 13:56:04 (1786038964)
Failing mds1 on oleg205-server
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
13:56:15 (1786038975) shut down
facet: mds1 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds1 to oleg205-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
13:56:52 (1786039012) targets are mounted
13:56:52 (1786039012) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
PASS 301 (73s)

== sanity-hsm test 302: HSM tunnable are persistent when CDT is off ========================================================== 13:57:17 (1786039037)
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0001.hsm_control=shutdown
Failing mds1 on oleg205-server
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
13:57:30 (1786039050) shut down
facet: mds1 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds1 to oleg205-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
13:58:04 (1786039084) targets are mounted
13:58:04 (1786039084) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
Failing mds2 on oleg205-server
Stopping /mnt/lustre-mds2 (opts:) on oleg205-server
13:58:21 (1786039101) shut down
facet: mds2 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds2 to oleg205-server
mount facets: mds2
Start mds2: mount -t lustre -o localrecov  /dev/mapper/mds2_flakey /mnt/lustre-mds2
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0001
13:58:48 (1786039128) targets are mounted
13:58:49 (1786039129) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec
PASS 302 (116s)

== sanity-hsm test 400: Single request is sent to the right MDT ========================================================== 13:59:13 (1786039153)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_400/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.146673 s, 7.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151415 s, 6.9 MB/s
archive successful on mdt0
archive successful on mdt1
PASS 400 (10s)

== sanity-hsm test 401: Compound requests split and sent to their respective MDTs ========================================================== 13:59:23 (1786039163)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_401/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.126145 s, 8.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0815928 s, 12.9 MB/s
archive successful on mdt0
archive successful on mdt1
PASS 401 (11s)

== sanity-hsm test 402a: Copytool start fails if all MDTs are inactive ========================================================== 13:59:34 (1786039174)
deactivate lustre-MDT0000-mdc-ffff989ed04b4800 on oleg205-client.virtnet
deactivate lustre-MDT0001-mdc-ffff989ed04b4800 on oleg205-client.virtnet
deactivate lustre-MDT0000-mdc-ffff989ee02a8800 on oleg205-client.virtnet
deactivate lustre-MDT0001-mdc-ffff989ee02a8800 on oleg205-client.virtnet
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_402a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Failed to start copytool agt1 on 'oleg205-client.virtnet'
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
uuid not found in agent list on mds1
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
uuid not found in agent list on mds2
activate lustre-MDT0000-mdc-ffff989ed04b4800 on oleg205-client.virtnet
activate lustre-MDT0001-mdc-ffff989ed04b4800 on oleg205-client.virtnet
activate lustre-MDT0000-mdc-ffff989ee02a8800 on oleg205-client.virtnet
activate lustre-MDT0001-mdc-ffff989ee02a8800 on oleg205-client.virtnet
PASS 402a (11s)

== sanity-hsm test 402b: CDT must retry request upon slow start of CT ========================================================== 13:59:45 (1786039185)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_402b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
fail_loc=0x14d
fail_loc=0
Waiting 200s for 'SUCCEED'
Updated after 7s: want 'SUCCEED' got 'SUCCEED'
PASS 402b (29s)

== sanity-hsm test 403: Copytool starts with inactive MDT and register on reconnect ========================================================== 14:00:14 (1786039214)
deactivate lustre-MDT0001-mdc-ffff989ed04b4800 on oleg205-client.virtnet
deactivate lustre-MDT0001-mdc-ffff989ee02a8800 on oleg205-client.virtnet
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_403/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
oleg205-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg205-client.virtnet: executing get_client_uuid /mnt/lustre2
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
uuid not found in agent list on mds2
oleg205-client.virtnet: 136981
activate lustre-MDT0001-mdc-ffff989ed04b4800 on oleg205-client.virtnet
activate lustre-MDT0001-mdc-ffff989ee02a8800 on oleg205-client.virtnet
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1
found agent uuid=1fdbb798-4fef-4fb0-9120-e2730ecad4ab archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2
PASS 403 (25s)

== sanity-hsm test 404: Inactive MDT does not block requests for active MDTs ========================================================== 14:00:39 (1786039239)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_404/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.106583 s, 9.8 MB/s
deactivate lustre-MDT0001-mdc-ffff989ed04b4800 on oleg205-client.virtnet
deactivate lustre-MDT0001-mdc-ffff989ee02a8800 on oleg205-client.virtnet
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
archive successful on mdt0
activate lustre-MDT0001-mdc-ffff989ed04b4800 on oleg205-client.virtnet
activate lustre-MDT0001-mdc-ffff989ee02a8800 on oleg205-client.virtnet
PASS 404 (12s)

== sanity-hsm test 405: archive and release under striped directory ========================================================== 14:00:51 (1786039251)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_405/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0860559 s, 12.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.140081 s, 7.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0598078 s, 17.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0910801 s, 11.5 MB/s
archive successful on 0x240000bd2:0x1:0x0
archive successful on 0x240000bd2:0x2:0x0
archive successful on 0x240000bd2:0x3:0x0
archive successful on 0x2000032e3:0x6:0x0
PASS 405 (22s)

== sanity-hsm test 406: attempting to migrate HSM archived files is safe ========================================================== 14:01:14 (1786039274)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.177623 s, 5.9 MB/s
old fid 0x2000032e3:0x8:0x0
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_406/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lfs migrate: /mnt/lustre/d406.sanity-hsm/f406.sanity-hsm migrate failed: Operation not supported (95)
lfs migrate: cb_migrate_mdt_fini: error completing migration of /mnt/lustre/d406.sanity-hsm: Directory not empty (39)
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
new fid 0x240000bd3:0x7:0x0
debug=+trace
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
PASS 406 (20s)

== sanity-hsm test 407: Check for double RESTORE records in llog ========================================================== 14:01:33 (1786039293)
0+0 records in
0+0 records out
0 bytes copied, 0.0114536 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_407/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
fail_val=5
fail_loc=0x164
Copytool is suspended on oleg205-client.virtnet
mdt.lustre-MDT0000.hsm.actions=
lrh=[type=10680000 len=136 idx=6/4] fid=[0x2000032e3:0x3:0x0] dfid=[0x2000032e3:0x3:0x0] compound/cookie=0x0/0x6a74cb27 action=ARCHIVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/5] fid=[0x2000032e3:0x6:0x0] dfid=[0x2000032e3:0x6:0x0] compound/cookie=0x0/0x6a74cb28 action=ARCHIVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/6] fid=[0x2000032e3:0x6:0x0] dfid=[0x2000032e3:0x7:0x0] compound/cookie=0x0/0x6a74cb29 action=RESTORE archive#=3 flags=0x4 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/7] fid=[0x2000032e3:0x8:0x0] dfid=[0x2000032e3:0x8:0x0] compound/cookie=0x0/0x6a74cb2a action=ARCHIVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/8] fid=[0x2000032e3:0x8:0x0] dfid=[0x2000032e3:0x9:0x0] compound/cookie=0x0/0x6a74cb2b action=RESTORE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/9] fid=[0x2000032e3:0x8:0x0] dfid=[0x2000032e3:0x8:0x0] compound/cookie=0x0/0x6a74cb2c action=REMOVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/10] fid=[0x2000032e3:0xb:0x0] dfid=[0x2000032e3:0xb:0x0] compound/cookie=0x0/0x6a74cb2d action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
Failing mds1 on oleg205-server
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
14:01:47 (1786039307) shut down
facet: mds1 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds1 to oleg205-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
mdt.lustre-MDT0000.hsm.actions=
lrh=[type=10680000 len=136 idx=6/4] fid=[0x2000032e3:0x3:0x0] dfid=[0x2000032e3:0x3:0x0] compound/cookie=0x0/0x6a74cb27 action=ARCHIVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/5] fid=[0x2000032e3:0x6:0x0] dfid=[0x2000032e3:0x6:0x0] compound/cookie=0x0/0x6a74cb28 action=ARCHIVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/6] fid=[0x2000032e3:0x6:0x0] dfid=[0x2000032e3:0x7:0x0] compound/cookie=0x0/0x6a74cb29 action=RESTORE archive#=3 flags=0x4 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/7] fid=[0x2000032e3:0x8:0x0] dfid=[0x2000032e3:0x8:0x0] compound/cookie=0x0/0x6a74cb2a action=ARCHIVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/8] fid=[0x2000032e3:0x8:0x0] dfid=[0x2000032e3:0x9:0x0] compound/cookie=0x0/0x6a74cb2b action=RESTORE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/9] fid=[0x2000032e3:0x8:0x0] dfid=[0x2000032e3:0x8:0x0] compound/cookie=0x0/0x6a74cb2c action=REMOVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/10] fid=[0x2000032e3:0xb:0x0] dfid=[0x2000032e3:0xb:0x0] compound/cookie=0x0/0x6a74cb2d action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/11] fid=[0x2000032e3:0xb:0x0] dfid=[0x2000032e3:0xb:0x0] compound/cookie=0x0/0x6a74cb2e action=RESTORE archive#=2 flags=0x4 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
14:02:19 (1786039339) targets are mounted
14:02:19 (1786039339) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
fail_loc=0
mdt.lustre-MDT0000.hsm.actions=
lrh=[type=10680000 len=136 idx=6/10] fid=[0x2000032e3:0xb:0x0] dfid=[0x2000032e3:0xb:0x0] compound/cookie=0x0/0x6a74cb2d action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/11] fid=[0x2000032e3:0xb:0x0] dfid=[0x2000032e3:0xb:0x0] compound/cookie=0x0/0x6a74cb2e action=RESTORE archive#=2 flags=0x4 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
Copytool is continued on oleg205-client.virtnet
d41d8cd98f00b204e9800998ecf8427e  /mnt/lustre/d407.sanity-hsm/f407.sanity-hsm
d41d8cd98f00b204e9800998ecf8427e  /mnt/lustre2/d407.sanity-hsm/f407.sanity-hsm
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
PASS 407 (68s)

== sanity-hsm test 408: Verify fiemap on release file ==== 14:02:41 (1786039361)
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_408/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
65536 bytes (66 kB, 64 KiB) copied, 0.0435212 s, 1.5 MB/s
1+0 records in
1+0 records out
65536 bytes (66 kB, 64 KiB) copied, 0.0314843 s, 2.1 MB/s
  File: /mnt/lustre/f408.sanity-hsm
  Size: 262144    	Blocks: 256        IO Block: 4194304 regular file
Device: 2c54f966h/743766374d	Inode: 144115406615871500  Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2026-08-06 14:02:43.000000000 -0400
Modify: 2026-08-06 14:02:43.000000000 -0400
Change: 2026-08-06 14:02:43.000000000 -0400
 Birth: 2026-08-06 14:02:42.000000000 -0400
disk usage: 131072	/mnt/lustre/f408.sanity-hsm
file size: 262144	/mnt/lustre/f408.sanity-hsm
extent 0 in offset 0, length 262144
flags (0x3): LAST UNKNOWN
No unwritten extents, extents number 1, sum of lengths 262144, expected sum 262144
PASS 408 (12s)

== sanity-hsm test 409a: Coordinator should not stop when in use ========================================================== 14:02:53 (1786039373)
0+0 records in
0+0 records out
0 bytes copied, 0.00495351 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
fail_val=5
fail_loc=0x164
cat: /mnt/lustre/d409a.sanity-hsm/f409a.sanity-hsm: No data available
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0001.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=enabled
Killing existing copytools on oleg205-client.virtnet with signal TERM
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0001.hsm_control=enabled
PASS 409a (31s)

== sanity-hsm test 409b: getattr released file with CDT stopped after remount ========================================================== 14:03:25 (1786039405)
0+0 records in
0+0 records out
0 bytes copied, 0.00498543 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Killing existing copytools on oleg205-client.virtnet with signal TERM
copytools stopped in 0s
Failing mds1 on oleg205-server
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
14:04:00 (1786039440) shut down
facet: mds1 facet_host: oleg205-server facet_failover_host: oleg205-server
Failover mds1 to oleg205-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
14:04:33 (1786039473) targets are mounted
14:04:33 (1786039473) facet_failover done
oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
  File: /mnt/lustre/d409b.sanity-hsm/f409b.sanity-hsm
  Size: 0         	Blocks: 0          IO Block: 4194304 regular empty file
Device: 2c54f966h/743766374d	Inode: 144115406632648721  Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2026-08-06 14:03:27.000000000 -0400
Modify: 2026-08-06 14:03:27.000000000 -0400
Change: 2026-08-06 14:03:27.000000000 -0400
 Birth: 2026-08-06 14:03:27.000000000 -0400
PASS 409b (112s)

== sanity-hsm test 410: lfs data_version -s allows release of force-archived file ========================================================== 14:05:17 (1786039517)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.251507 s, 4.2 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_410/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Cannot send HSM request (use of /mnt/lustre/d410.sanity-hsm/f410.sanity-hsm): Operation not permitted
PASS 410 (11s)

== sanity-hsm test 411: hsm_ops rbac role ================ 14:05:28 (1786039528)
On MGS 192.168.202.105, active = nodemap.active=1
On MGS 192.168.202.105, test_411.trusted_nodemap = nodemap.test_411.trusted_nodemap=1
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_411/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
/mnt/lustre/d411.sanity-hsm/fileA: (0x00000000)
Killing existing copytools on oleg205-client.virtnet with signal TERM
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_411/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
On MGS 192.168.202.105, test_411.rbac = nodemap.test_411.rbac=file_perms,dne_ops,quota_ops,byfid_ops,chlg_ops,fscrypt_admin,server_upcall,ignore_root_prjquota,immutable_flags,local_admin,pool_quota_ops,lqa_quota_ops,projid_set,foreign_ops
/mnt/lustre/d411.sanity-hsm/fileB: (0x00000000)
Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied
Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Operation not permitted
Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied
Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied
lfs hsm_set: change hsm flags for '/mnt/lustre/d411.sanity-hsm/fileB' failed: Permission denied
lfs hsm_clear: change hsm flags for '/mnt/lustre/d411.sanity-hsm/fileB' failed: Permission denied
On MGS 192.168.202.105, active = nodemap.active=0
oleg205-server: error: nodemap 'test_411' does not exist
oleg205-server: nodemap_del: Invalid argument
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
On MGS 192.168.202.105, active = nodemap.active=0
PASS 411 (43s)

== sanity-hsm test 500: various LLAPI HSM tests ========== 14:06:11 (1786039571)
striped dir -i0 -c2 -H crush2  /mnt/lustre/d500.sanity-hsm
 test1 @1786039658: Register/unregister copytool 2000x to check for leaks ...... pass
 test2 @1786039658: Re/un-register copytool multiple times without error ....... pass
llapi_hsm_test: NULL archive numbers
llapi_hsm_test: NULL archive numbers
llapi_hsm_test: -1 requested when archive id >= 0 is supported
 test3 @1786039658: Pass bad parameters to llapi_hsm_copytool_register() ....... pass
 test4 @1786039658: Bad parameters to llapi_hsm_copytool_unregister() .......... pass
 test5 @1786039658: Test llapi_hsm_copytool_recv() in non-blocking mode ........ pass
 test6 @1786039658: Test llapi_hsm_copytool_recv() with bogus parameters ....... pass
 test7 @1786039658: Test event polling (without actual traffic) ................ pass
 test50 @1786039658: Test llapi_hsm_state_get()/get_fd() ....................... pass
 test51 @1786039660: Test llapi_hsm_state_set_fd() ............................. pass
 test52 @1786039660: Test llapi_hsm_current_action() ........................... pass
 test100 @1786039660: Simple archive creation with no progress reported. ....... pass
 test101 @1786039669: Simple archive creation with progress every byte. ........ pass
 test102 @1786039677: Archive creation with progress every byte, backwards ..... pass
 test103 @1786039678: Archive creation with a single progress report ........... pass
 test104 @1786039679: Archive creation with two progress reports ............... pass
 test105 @1786039680: Archive creation with one bogus progress report .......... pass
 test106 @1786039681: Archive creation with one empty progress report .......... pass
 test107 @1786039682: Archive creation with one bogus progress report .......... pass
 test108 @1786039689: Archive creation with same progress report each time ..... pass
 test109 @1786039690: Archive creation with one report, with large number ...... pass
 test110 @1786039691: Archive with 10 progress reports, checking progress ...... pass
 test111 @1786039693: Archive with 10 reports in reverse, checking progress .... pass
 test112 @1786039694: Archive with 10 reports, duplicated, check progress ...... pass
 test113 @1786039695: Archive with 9 reports, with 20% overlapping coverage .... pass
PASS 500 (131s)

== sanity-hsm test 600: Changelog fields 'u=' and 'nid=' ========================================================== 14:08:22 (1786039702)
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl1 cl1'
mdd.lustre-MDT0000.changelog_mask=ALL
mdd.lustre-MDT0001.changelog_mask=ALL
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d600.sanity-hsm/f600.sanity-hsm]
Got NID '192.168.202.5@tcp'
lustre-MDT0001: clear the changelog for cl1 of all records
lustre-MDT0001: Deregistered changelog user #1
lustre-MDT0000: clear the changelog for cl1 of all records
lustre-MDT0000: Deregistered changelog user #1
PASS 600 (22s)

== sanity-hsm test 601: OPEN Changelog entry ============= 14:08:45 (1786039725)
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl2 cl2'
mdd.lustre-MDT0000.changelog_mask=ALL
mdd.lustre-MDT0001.changelog_mask=ALL
lustre-MDT0000: clear the changelog for cl2 of all records
lustre-MDT0001: clear the changelog for cl2 of all records
lustre-MDT0001.4 10OPEN  18:08:54.294194121 2026.08.06 0x1 t=[0x240000bd3:0x1b:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.202.5@tcp m=r--
lustre-MDT0001: clear the changelog for cl2 of all records
lustre-MDT0001: Deregistered changelog user #2
lustre-MDT0000: clear the changelog for cl2 of all records
lustre-MDT0000: Deregistered changelog user #2
PASS 601 (20s)

== sanity-hsm test 602: Changelog record CLOSE only if open+write or OPEN recorded ========================================================== 14:09:06 (1786039746)
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl3 cl3'
mdd.lustre-MDT0000.changelog_mask=ALL
mdd.lustre-MDT0001.changelog_mask=ALL
lustre-MDT0000: clear the changelog for cl3 of all records
lustre-MDT0001: clear the changelog for cl3 of all records
lustre-MDT0000.9 11CLOSE 18:09:16.048870512 2026.08.06 0x1 t=[0x2000032e2:0x1d:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000: clear the changelog for cl3 of all records
lustre-MDT0001: clear the changelog for cl3 of all records
lustre-MDT0000.10 10OPEN  18:09:16.373458910 2026.08.06 0x242 t=[0x2000032e2:0x1d:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.202.5@tcp m=-w- p=[0x2000032e2:0x1a:0x0]
lustre-MDT0000.11 23GXATR 18:09:16.379541258 2026.08.06 0x0 t=[0x2000032e2:0x1d:0x0] j=bash.0 ef=0x1b u=0:0 nid=192.168.202.5@tcp x=user.job
lustre-MDT0000.12 13TRUNC 18:09:16.384746268 2026.08.06 0xe t=[0x2000032e2:0x1d:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x2000032e2:0x1c:0x0]
lustre-MDT0000.13 11CLOSE 18:09:16.409600363 2026.08.06 0x242 t=[0x2000032e2:0x1d:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000.13 11CLOSE 18:09:16.409600363 2026.08.06 0x242 t=[0x2000032e2:0x1d:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
mdd.lustre-MDT0000.changelog_mask=-OPEN
mdd.lustre-MDT0001.changelog_mask=-OPEN
lustre-MDT0000: clear the changelog for cl3 of all records
lustre-MDT0001: clear the changelog for cl3 of all records
f
lustre-MDT0000: clear the changelog for cl3 of all records
lustre-MDT0001: clear the changelog for cl3 of all records
lustre-MDT0000.14 13TRUNC 18:09:19.769226372 2026.08.06 0xe t=[0x2000032e2:0x1d:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp p=[0x2000032e2:0x1c:0x0]
lustre-MDT0000.15 11CLOSE 18:09:19.784242938 2026.08.06 0x242 t=[0x2000032e2:0x1d:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000.15 11CLOSE 18:09:19.784242938 2026.08.06 0x242 t=[0x2000032e2:0x1d:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0001: clear the changelog for cl3 of all records
lustre-MDT0001: Deregistered changelog user #3
lustre-MDT0000: clear the changelog for cl3 of all records
lustre-MDT0000: Deregistered changelog user #3
PASS 602 (28s)

== sanity-hsm test 603: GETXATTR Changelog entry ========= 14:09:33 (1786039773)
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl4 cl4'
mdd.lustre-MDT0000.changelog_mask=ALL
mdd.lustre-MDT0001.changelog_mask=ALL
lustre-MDT0000: clear the changelog for cl4 of all records
lustre-MDT0001: clear the changelog for cl4 of all records
getfattr: Removing leading '/' from absolute path names
# file: mnt/lustre/d603.sanity-hsm/f603.sanity-hsm
user.xattr1="value1"

lustre-MDT0001.11 23GXATR 18:09:43.833653834 2026.08.06 0x0 t=[0x240000bd3:0x1d:0x0] j=getfattr.0 ef=0x1b u=0:0 nid=192.168.202.5@tcp x=user.xattr1
lustre-MDT0001: clear the changelog for cl4 of all records
lustre-MDT0001: Deregistered changelog user #4
lustre-MDT0000: clear the changelog for cl4 of all records
lustre-MDT0000: Deregistered changelog user #4
PASS 603 (25s)

== sanity-hsm test 604: NOPEN Changelog entry ============ 14:09:58 (1786039798)
mdd.lustre-MDT0000.changelog_deniednext=20
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl5 cl5'
mdd.lustre-MDT0000.changelog_mask=ALL
mdd.lustre-MDT0001.changelog_mask=ALL
lustre-MDT0000: clear the changelog for cl5 of all records
lustre-MDT0001: clear the changelog for cl5 of all records
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm]
cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied
lustre-MDT0000.20 24NOPEN 18:10:10.933573869 2026.08.06 0x1 t=[0x2000032e2:0x1f:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.202.5@tcp m=r-- p=[0x2000032e2:0x1a:0x0]
Got NID '192.168.202.5@tcp'
lustre-MDT0000: clear the changelog for cl5 of all records
lustre-MDT0001: clear the changelog for cl5 of all records
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm]
cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied
lustre-MDT0000: clear the changelog for cl5 of all records
lustre-MDT0001: clear the changelog for cl5 of all records
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm]
cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied
lustre-MDT0000.21 24NOPEN 18:10:32.986534481 2026.08.06 0x1 t=[0x2000032e2:0x1f:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.202.5@tcp m=r--
Got NID '192.168.202.5@tcp'
lustre-MDT0001: clear the changelog for cl5 of all records
lustre-MDT0001: Deregistered changelog user #5
lustre-MDT0000: clear the changelog for cl5 of all records
lustre-MDT0000: Deregistered changelog user #5
mdd.lustre-MDT0000.changelog_deniednext=60
PASS 604 (51s)

== sanity-hsm test 605: Test OPEN and CLOSE rate limit in Changelogs ========================================================== 14:10:49 (1786039849)
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl6 cl6'
mdd.lustre-MDT0000.changelog_mask=ALL
mdd.lustre-MDT0001.changelog_mask=ALL
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0001: clear the changelog for cl6 of all records
lustre-MDT0000.25 10OPEN  18:10:59.124169990 2026.08.06 0x43 t=[0x2000032e2:0x21:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.202.5@tcp m=rw-
lustre-MDT0000.25 10OPEN  18:10:59.124169990 2026.08.06 0x43 t=[0x2000032e2:0x21:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.202.5@tcp m=rw-
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0001: clear the changelog for cl6 of all records
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0001: clear the changelog for cl6 of all records
lustre-MDT0000.26 10OPEN  18:11:00.897831140 2026.08.06 0x1 t=[0x2000032e2:0x21:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.202.5@tcp m=r--
lustre-MDT0000.27 11CLOSE 18:11:00.936870414 2026.08.06 0x1 t=[0x2000032e2:0x21:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000.26 10OPEN  18:11:00.897831140 2026.08.06 0x1 t=[0x2000032e2:0x21:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.202.5@tcp m=r--
lustre-MDT0000.27 11CLOSE 18:11:00.936870414 2026.08.06 0x1 t=[0x2000032e2:0x21:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0001: clear the changelog for cl6 of all records
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0001: clear the changelog for cl6 of all records
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [cat] [/mnt/lustre/d605.sanity-hsm/f605.sanity-hsm]
lustre-MDT0000.28 10OPEN  18:11:02.883420393 2026.08.06 0x1 t=[0x2000032e2:0x21:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.202.5@tcp m=r--
lustre-MDT0000.29 11CLOSE 18:11:02.892259574 2026.08.06 0x1 t=[0x2000032e2:0x21:0x0] j=cat.500 ef=0x13 u=500:500 nid=192.168.202.5@tcp
lustre-MDT0000.28 10OPEN  18:11:02.883420393 2026.08.06 0x1 t=[0x2000032e2:0x21:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.202.5@tcp m=r--
lustre-MDT0000.29 11CLOSE 18:11:02.892259574 2026.08.06 0x1 t=[0x2000032e2:0x21:0x0] j=cat.500 ef=0x13 u=500:500 nid=192.168.202.5@tcp
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0001: clear the changelog for cl6 of all records
lustre-MDT0000.30 11CLOSE 18:11:04.180509041 2026.08.06 0x43 t=[0x2000032e2:0x21:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0000.30 11CLOSE 18:11:04.180509041 2026.08.06 0x43 t=[0x2000032e2:0x21:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.5@tcp
lustre-MDT0001: clear the changelog for cl6 of all records
lustre-MDT0001: Deregistered changelog user #6
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0000: Deregistered changelog user #6
PASS 605 (28s)

== sanity-hsm test 606: llog_reader groks changelog fields ========================================================== 14:11:17 (1786039877)
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl7 cl7'
mdd.lustre-MDT0000.changelog_mask=ALL
mdd.lustre-MDT0001.changelog_mask=ALL
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d606.sanity-hsm/f606.sanity-hsm]
Stopping /mnt/lustre-mds1 (opts:) on oleg205-server
rec #2 type=1064553b len=64 offset 8256
Header size : 8192	 llh_size : 64
Time : Thu Aug  6 13:36:10 2026
Number of records: 1	cat_idx: 0	last_idx: 2
Flags: 0x2012
Target uuid : 
-----------------------
#02 (064)fid=[0x1:0x3b:0x0] path=O/1/d27/59
Got UID/GID 500:500
Got NID 192.168.202.5@tcp
Start mds1: mount -t lustre -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
oleg205-server: oleg205-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1
Started lustre-MDT0000
lustre-MDT0001: clear the changelog for cl7 of all records
lustre-MDT0001: Deregistered changelog user #7
lustre-MDT0000: clear the changelog for cl7 of all records
lustre-MDT0000: Deregistered changelog user #7
PASS 606 (74s)

== sanity-hsm test 607a: release file migrated after archive (non-blocking migrate) ========================================================== 14:12:32 (1786039952)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.234223 s, 4.5 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
PASS 607a (14s)

== sanity-hsm test 607b: Migrate should not change the HSM attribute of dirty files ========================================================== 14:12:46 (1786039966)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.334072 s, 3.1 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
llite.lustre-ffff989ed04b4800.xattr_cache=0
llite.lustre-ffff989ee02a8800.xattr_cache=0
/mnt/lustre/d607b.sanity-hsm/f607b.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:1
llite.lustre-ffff989ed04b4800.xattr_cache=1
llite.lustre-ffff989ee02a8800.xattr_cache=1
PASS 607b (11s)

== sanity-hsm test 607c: 'lfs swap_layouts' should set dirty flag on HSM file ========================================================== 14:12:57 (1786039977)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.243117 s, 4.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.319357 s, 3.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.266249 s, 3.9 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 3s: want 'SUCCEED' got 'SUCCEED'
lfs swap_layouts: error: cannot swap layout between '/mnt/lustre/d607c.sanity-hsm/f607c.sanity-hsm-1' and '/mnt/lustre/d607c.sanity-hsm/f607c.sanity-hsm-3': Operation not permitted (1)
PASS 607c (15s)

== sanity-hsm test 607d: Migrate should not set HSM dirty flag for an empty file ========================================================== 14:13:12 (1786039992)
0+0 records in
0+0 records out
0 bytes copied, 0.00587423 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 607d (11s)

== sanity-hsm test 607e: release file migrated after archive (blocking migrate) ========================================================== 14:13:23 (1786040003)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.327076 s, 3.2 MB/s
Starting copytool 'agt1' on 'oleg205-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 607e (14s)
== sanity-hsm test complete, duration 5704 sec =========== 14:13:37 (1786040017)
=== sanity-hsm: start cleanup 14:13:39 (1786040019) ===
Stopping clients: oleg205-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg205-client.virtnet /mnt/lustre2 opts:
=== sanity-hsm: finish cleanup 14:14:18 (1786040058) ===