-----============= acceptance-small: sanity-hsm ============----- Thu Aug 27 22:28:07 EDT 2026
MGS_OS_ID_LIKE=rhel centos fedora rocky
MGS_OS_VERSION_ID=8.10
MGS_OS_ID=rocky
MGS_OS_VERSION_CODE=134873088
MDS1_OS_VERSION_ID=8.10
MDS1_OS_VERSION_CODE=134873088
MDS1_OS_ID_LIKE=rhel centos fedora rocky
MDS1_OS_ID=rocky
OST1_OS_VERSION_CODE=134873088
OST1_OS_ID_LIKE=rhel centos fedora rocky
OST1_OS_VERSION_ID=8.10
OST1_OS_ID=rocky
CLIENT_OS_ID=rocky
CLIENT_OS_VERSION_CODE=134873088
CLIENT_OS_VERSION_ID=8.10
CLIENT_OS_ID_LIKE=rhel centos fedora rocky
oleg656-server: /home/green/git/lustre-release/lustre/tests/except/sanity-hsm.ex
- see MDS1_VERSION <= CLIENT_VERSION (34683220 <= 34683220) for LU-18924, go 100 105
excepting tests: 
=== sanity-hsm: start setup 22:28:26 (1787884106) ===
Starting client oleg656-client.virtnet:  -o user_xattr,flock 192.168.206.156@tcp:/lustre /mnt/lustre2
Mount client oleg656-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.206.156@tcp:/lustre /mnt/lustre2
Started clients oleg656-client.virtnet: 
192.168.206.156@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose)
oleg656-client.virtnet: executing check_config_client /mnt/lustre
oleg656-client.virtnet: Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients oleg656-client.virtnet environments
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff94445182f000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff9444529b0800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff94445182f000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff9444529b0800.idle_timeout=debug
disable quota as required
oleg656-server: oleg656-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
=== sanity-hsm: finish setup 22:29:01 (1787884141) ===
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [true]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d0_runas_test/f7624]
nobody:x:65534:
Killing existing copytools on oleg656-client.virtnet with signal TERM
pkill: pidfile not valid
Try `pkill --help' for more information.
Set HSM on and start
Set sanity-hsm HSM policy

== sanity-hsm test 1A: lfs hsm flags root/non-root access ========================================================== 22:29:29 (1787884169)
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_set] [--norelease] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_clear] [--norelease] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_set] [--exists] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
lfs hsm_set: change hsm flags for '/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm' failed: Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm]
PASS 1A (9s)

== sanity-hsm test 1a: mmap & cat a HSM released file ==== 22:29:38 (1787884178)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.455357 s, 2.3 MB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Verifying released state: PASS 1a (12s)

== sanity-hsm test 1b: Archive, Release and Restore composite file ========================================================== 22:29:51 (1787884191)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0537551 s, 19.5 MB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
archive /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm
release /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm
verify released state: 
pass
restore /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
verify restored state: 
pass
PASS 1b (13s)

== sanity-hsm test 1c: Check setting archive-id in lfs hsm_set ========================================================== 22:30:04 (1787884204)
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm]
verifying archive number is 32
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm]
verifying archive number is still 32
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm]
verifying archive number is 33
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm]
verifying archive number is 16
PASS 1c (11s)

== sanity-hsm test 1d: Archive, Release and Restore DoM file ========================================================== 22:30:15 (1787884215)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.182171 s, 5.8 MB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
archive /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm
release /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm
verify released state: 
pass
restore /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm
verify restored state: 
pass
PASS 1d (12s)

== sanity-hsm test 1e: Archive, Release and Restore SEL file ========================================================== 22:30:27 (1787884227)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0803231 s, 13.1 MB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
archive /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm
release /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm
verify released state: 
pass
restore /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm
verify restored state: 
pass
PASS 1e (12s)

== sanity-hsm test 1f: DoM file release after restore ==== 22:30:39 (1787884239)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.063313 s, 16.6 MB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
archive /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm
release /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm
verify released state: 
pass
restore /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm
verify restored state: 
pass
release again /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm
/mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm: (0x0000000d) released exists archived, archive_id:1
verify released state: 
pass
PASS 1f (11s)

== sanity-hsm test 2: Check file dirtyness when doing setattr ========================================================== 22:30:50 (1787884250)
0+0 records in
0+0 records out
0 bytes copied, 0.00639768 s, 0.0 kB/s
0x200000402:0x9:0x0
PASS 2 (8s)

== sanity-hsm test 3: Check file dirtyness when opening for write ========================================================== 22:30:58 (1787884258)
Succeed in opening file "/mnt/lustre/d3.sanity-hsm/f3.sanity-hsm"(flags=O_WRONLY)
3+0 records in
3+0 records out
3+0 records in
3+0 records out
PASS 3 (8s)

== sanity-hsm test 4: Useless cancel must not be registered ========================================================== 22:31:06 (1787884266)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.415031 s, 2.5 MB/s
PASS 4 (9s)

== sanity-hsm test 8: Test default archive number ======== 22:31:16 (1787884276)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_8/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 8 (9s)

== sanity-hsm test 9A: Use of explicit archive number, with dedicated copytool ========================================================== 22:31:25 (1787884285)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_9A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 3  "/mnt/lustre2"'
oleg656-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg656-client.virtnet: executing get_client_uuid /mnt/lustre2
found agent uuid=adb42772-e4bd-42de-b82a-3d30610a8517 archive_id=3 requests=[current:0 ok:0 errors:0] on mds1
PASS 9A (24s)

== sanity-hsm test 9a: Multiple remote agents ============ 22:31:49 (1787884309)

 SKIP: sanity-hsm test_9a Need 3 or more clients, have 1
SKIP 9a (3s)

== sanity-hsm test 10a: Archive a file =================== 22:31:53 (1787884313)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
/home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 996: warning: command substitution: ignored null byte in input
Verifying content
Verifying hsm state 
Verifying archive number is 2
PASS 10a (9s)

== sanity-hsm test 10b: Archive of non dirty file must work without doing request ========================================================== 22:32:02 (1787884322)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 10b (12s)

== sanity-hsm test 10c: Check forbidden archive ========== 22:32:14 (1787884334)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Cannot send HSM request (use of /mnt/lustre/d10c.sanity-hsm/f10c.sanity-hsm): Operation not permitted
PASS 10c (9s)

== sanity-hsm test 10d: Archive a file on the default archive id ========================================================== 22:32:23 (1787884343)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 10d (11s)

== sanity-hsm test 11a: Import a file ==================== 22:32:34 (1787884354)
lhsmtool_posix: 1787884357.369907 [21121]: action=1 src=d11a.sanity-hsm/f11a.sanity-hsm dst=/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787884357.378030 [21121]: importing '/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11a//d11a.sanity-hsm/f11a.sanity-hsm'
lhsmtool_posix: 1787884357.431968 [21121]: imported '/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11a//042b/0x200000401:0x2a:0x0'=='/tmp/arc1/sanity-hsm.test_11a//d11a.sanity-hsm/f11a.sanity-hsm'
lhsmtool_posix: 1787884357.432027 [21121]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Verifying released state: Verifying imported size 158=158
Verifying released pattern: raid0,released
Verifying new fid 0x200000401:0x2a:0x0 in archive
PASS 11a (9s)

== sanity-hsm test 11b: Import a deleted file using its FID ========================================================== 22:32:43 (1787884363)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_11b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1787884367.253034 [21804]: action=1 src=0x200000402:0x12:0x0 dst=/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787884367.271501 [21804]: Resolving [0x200000402:0x12:0x0] to /tmp/arc1/sanity-hsm.test_11b//0410/0x200000402:0x12:0x0
lhsmtool_posix: 1787884367.271611 [21804]: importing '/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11b//0410/0x200000402:0x12:0x0'
lhsmtool_posix: 1787884367.321605 [21804]: imported '/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11b//042d/0x200000401:0x2c:0x0'=='/tmp/arc1/sanity-hsm.test_11b//0410/0x200000402:0x12:0x0'
lhsmtool_posix: 1787884367.322513 [21804]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm: OK
PASS 11b (10s)

== sanity-hsm test 11c: Import a file to a directory with a pool ========================================================== 22:32:53 (1787884373)
Creating new pool test_11c
oleg656-server: Pool lustre.test_11c created
Adding targets to pool
oleg656-server: OST lustre-OST0001_UUID added to pool lustre.test_11c
lhsmtool_posix: 1787884383.889957 [22492]: action=1 src=d11c.sanity-hsm/f11c.sanity-hsm dst=/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787884383.900077 [22492]: importing '/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11c//d11c.sanity-hsm/f11c.sanity-hsm'
lhsmtool_posix: 1787884383.962070 [22492]: imported '/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11c//042e/0x200000401:0x2f:0x0'=='/tmp/arc1/sanity-hsm.test_11c//d11c.sanity-hsm/f11c.sanity-hsm'
lhsmtool_posix: 1787884383.962306 [22492]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Destroy the created pools: test_11c
lustre.test_11c
oleg656-server: OST lustre-OST0001_UUID removed from pool lustre.test_11c
oleg656-server: Pool lustre.test_11c destroyed
PASS 11c (27s)

== sanity-hsm test 12a: Restore an imported file explicitly ========================================================== 22:33:20 (1787884400)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1787884403.039343 [23214]: action=1 src=d12a.sanity-hsm/f12a.sanity-hsm dst=/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787884403.054555 [23214]: importing '/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12a//d12a.sanity-hsm/f12a.sanity-hsm'
lhsmtool_posix: 1787884403.160102 [23214]: imported '/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12a//0433/0x200000401:0x32:0x0'=='/tmp/arc1/sanity-hsm.test_12a//d12a.sanity-hsm/f12a.sanity-hsm'
lhsmtool_posix: 1787884403.160174 [23214]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Verifying released state: 
Verifying file state: 
PASS 12a (10s)

== sanity-hsm test 12b: Restore an imported file implicitly ========================================================== 22:33:30 (1787884410)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1787884413.275922 [23912]: action=1 src=d12b.sanity-hsm/f12b.sanity-hsm dst=/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787884413.287643 [23912]: importing '/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12b//d12b.sanity-hsm/f12b.sanity-hsm'
lhsmtool_posix: 1787884413.383116 [23912]: imported '/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12b//0434/0x200000401:0x35:0x0'=='/tmp/arc1/sanity-hsm.test_12b//d12b.sanity-hsm/f12b.sanity-hsm'
lhsmtool_posix: 1787884413.383173 [23912]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Verifying released state: 
Verifying file state after restore: 
PASS 12b (9s)

== sanity-hsm test 12c: Restore a file with stripe of 2 == 22:33:39 (1787884419)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
5+0 records in
5+0 records out
5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.111482 s, 47.0 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
/mnt/lustre/d12c.sanity-hsm/f12c.sanity-hsm: OK
PASS 12c (13s)

== sanity-hsm test 12d: Restore of a non archived, non released file must work ========================================================== 22:33:52 (1787884432)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 12d (11s)

== sanity-hsm test 12e: Check forbidden restore ========== 22:34:03 (1787884443)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
/mnt/lustre/d12e.sanity-hsm/f12e.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:1
Cannot send HSM request (use of /mnt/lustre/d12e.sanity-hsm/f12e.sanity-hsm): Operation not permitted
PASS 12e (9s)

== sanity-hsm test 12f: Restore a released file explicitly ========================================================== 22:34:12 (1787884452)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Verifying file state: PASS 12f (9s)

== sanity-hsm test 12g: Restore a released file implicitly ========================================================== 22:34:21 (1787884461)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12g/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 12g (12s)

== sanity-hsm test 12h: Restore a released file implicitly from a second node ========================================================== 22:34:33 (1787884473)

 SKIP: sanity-hsm test_12h Need 2 or more clients, have 1
SKIP 12h (3s)

== sanity-hsm test 12m: Archive/release/implicit restore ========================================================== 22:34:37 (1787884477)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12m/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 12m (10s)

== sanity-hsm test 12n: Import/implicit restore/release == 22:34:47 (1787884487)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12n/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1787884489.882934 [28685]: action=1 src=d12n.sanity-hsm/f12n.sanity-hsm dst=/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787884489.889874 [28685]: importing '/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12n//d12n.sanity-hsm/f12n.sanity-hsm'
lhsmtool_posix: 1787884489.994123 [28685]: imported '/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12n//0445/0x200000401:0x44:0x0'=='/tmp/arc1/sanity-hsm.test_12n//d12n.sanity-hsm/f12n.sanity-hsm'
lhsmtool_posix: 1787884489.994186 [28685]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
PASS 12n (9s)

== sanity-hsm test 12o: Layout-swap failure during Restore leaves file released ========================================================== 22:34:56 (1787884496)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12o/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
fail_loc=0x152
mdt.lustre-MDT0000.hsm.policy=+NRA
diff: /mnt/lustre/d12o.sanity-hsm/f12o.sanity-hsm: No data available
mdt.lustre-MDT0000.hsm.policy=-NRA
fail_loc=0
mdt.lustre-MDT0000.hsm_control=purge
PASS 12o (30s)

== sanity-hsm test 12p: implicit restore of a file on copytool mount point ========================================================== 22:35:27 (1787884527)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12p/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 12p (11s)

== sanity-hsm test 12q: file attributes are refreshed after restore ========================================================== 22:35:37 (1787884537)
Starting client: oleg656-client.virtnet:  -o user_xattr,flock 192.168.206.156@tcp:/lustre /mnt/lustre3
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12q/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre3"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.348298 s, 3.0 MB/s
Killing existing copytools on oleg656-client.virtnet with signal TERM
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12q/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre3"'
Stopping client oleg656-client.virtnet /mnt/lustre3 (opts:)
PASS 12q (18s)

== sanity-hsm test 12r: lseek restores released file ===== 22:35:55 (1787884555)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12r/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 12r (10s)

== sanity-hsm test 12s: race between restore requests ==== 22:36:05 (1787884565)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12s/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
fail_loc=0x8000018b
PASS 12s (17s)

== sanity-hsm test 12t: Multiple parallel reads for a HSM imported file ========================================================== 22:36:22 (1787884582)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12t/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1787884585.977491 [32739]: action=1 src=0x200000402:0x2c:0x0 dst=/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787884585.990584 [32739]: Resolving [0x200000402:0x2c:0x0] to /tmp/arc1/sanity-hsm.test_12t//042e/0x200000402:0x2c:0x0
lhsmtool_posix: 1787884585.990700 [32739]: importing '/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12t//042e/0x200000402:0x2c:0x0'
lhsmtool_posix: 1787884586.045921 [32739]: imported '/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12t//0453/0x200000401:0x52:0x0'=='/tmp/arc1/sanity-hsm.test_12t//042e/0x200000402:0x2c:0x0'
lhsmtool_posix: 1787884586.045987 [32739]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
PASS 12t (11s)

== sanity-hsm test 12u: Multiple reads on multiple HSM imported files in parallel ========================================================== 22:36:33 (1787884593)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12u/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1787884608.990766 [33606]: action=1 src=0x200000402:0x2e:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0 mount_point=/mnt/lustre2
lhsmtool_posix: 1787884609.000842 [33606]: Resolving [0x200000402:0x2e:0x0] to /tmp/arc1/sanity-hsm.test_12u//042c/0x200000402:0x2e:0x0
lhsmtool_posix: 1787884609.000955 [33606]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0' from '/tmp/arc1/sanity-hsm.test_12u//042c/0x200000402:0x2e:0x0'
lhsmtool_posix: 1787884609.057507 [33606]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0' from '/tmp/arc1/sanity-hsm.test_12u//0455/0x200000401:0x54:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042c/0x200000402:0x2e:0x0'
lhsmtool_posix: 1787884609.058597 [33606]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1787884609.339511 [33635]: action=1 src=0x200000402:0x2f:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1 mount_point=/mnt/lustre2
lhsmtool_posix: 1787884609.345814 [33635]: Resolving [0x200000402:0x2f:0x0] to /tmp/arc1/sanity-hsm.test_12u//042d/0x200000402:0x2f:0x0
lhsmtool_posix: 1787884609.346714 [33635]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1' from '/tmp/arc1/sanity-hsm.test_12u//042d/0x200000402:0x2f:0x0'
lhsmtool_posix: 1787884609.388023 [33635]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1' from '/tmp/arc1/sanity-hsm.test_12u//0454/0x200000401:0x55:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042d/0x200000402:0x2f:0x0'
lhsmtool_posix: 1787884609.388090 [33635]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1787884609.789413 [33664]: action=1 src=0x200000402:0x30:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2 mount_point=/mnt/lustre2
lhsmtool_posix: 1787884609.809764 [33664]: Resolving [0x200000402:0x30:0x0] to /tmp/arc1/sanity-hsm.test_12u//0432/0x200000402:0x30:0x0
lhsmtool_posix: 1787884609.809868 [33664]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2' from '/tmp/arc1/sanity-hsm.test_12u//0432/0x200000402:0x30:0x0'
lhsmtool_posix: 1787884609.920682 [33664]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2' from '/tmp/arc1/sanity-hsm.test_12u//0457/0x200000401:0x56:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0432/0x200000402:0x30:0x0'
lhsmtool_posix: 1787884609.920867 [33664]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1787884610.369470 [33693]: action=1 src=0x200000402:0x31:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3 mount_point=/mnt/lustre2
lhsmtool_posix: 1787884610.388385 [33693]: Resolving [0x200000402:0x31:0x0] to /tmp/arc1/sanity-hsm.test_12u//0433/0x200000402:0x31:0x0
lhsmtool_posix: 1787884610.388487 [33693]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3' from '/tmp/arc1/sanity-hsm.test_12u//0433/0x200000402:0x31:0x0'
lhsmtool_posix: 1787884610.477811 [33693]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3' from '/tmp/arc1/sanity-hsm.test_12u//0456/0x200000401:0x57:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0433/0x200000402:0x31:0x0'
lhsmtool_posix: 1787884610.477869 [33693]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1787884610.882884 [33722]: action=1 src=0x200000402:0x32:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4 mount_point=/mnt/lustre2
lhsmtool_posix: 1787884610.894607 [33722]: Resolving [0x200000402:0x32:0x0] to /tmp/arc1/sanity-hsm.test_12u//0430/0x200000402:0x32:0x0
lhsmtool_posix: 1787884610.894710 [33722]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4' from '/tmp/arc1/sanity-hsm.test_12u//0430/0x200000402:0x32:0x0'
lhsmtool_posix: 1787884610.967134 [33722]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4' from '/tmp/arc1/sanity-hsm.test_12u//0459/0x200000401:0x58:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0430/0x200000402:0x32:0x0'
lhsmtool_posix: 1787884610.967201 [33722]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1787884611.256539 [33751]: action=1 src=0x200000402:0x33:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5 mount_point=/mnt/lustre2
lhsmtool_posix: 1787884611.264474 [33751]: Resolving [0x200000402:0x33:0x0] to /tmp/arc1/sanity-hsm.test_12u//0431/0x200000402:0x33:0x0
lhsmtool_posix: 1787884611.269547 [33751]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5' from '/tmp/arc1/sanity-hsm.test_12u//0431/0x200000402:0x33:0x0'
lhsmtool_posix: 1787884611.329641 [33751]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5' from '/tmp/arc1/sanity-hsm.test_12u//0458/0x200000401:0x59:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0431/0x200000402:0x33:0x0'
lhsmtool_posix: 1787884611.329779 [33751]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1787884611.641062 [33780]: action=1 src=0x200000402:0x34:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6 mount_point=/mnt/lustre2
lhsmtool_posix: 1787884611.653645 [33780]: Resolving [0x200000402:0x34:0x0] to /tmp/arc1/sanity-hsm.test_12u//0436/0x200000402:0x34:0x0
lhsmtool_posix: 1787884611.654921 [33780]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6' from '/tmp/arc1/sanity-hsm.test_12u//0436/0x200000402:0x34:0x0'
lhsmtool_posix: 1787884611.707829 [33780]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6' from '/tmp/arc1/sanity-hsm.test_12u//045b/0x200000401:0x5a:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0436/0x200000402:0x34:0x0'
lhsmtool_posix: 1787884611.707888 [33780]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1787884612.094885 [33809]: action=1 src=0x200000402:0x35:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7 mount_point=/mnt/lustre2
lhsmtool_posix: 1787884612.114477 [33809]: Resolving [0x200000402:0x35:0x0] to /tmp/arc1/sanity-hsm.test_12u//0437/0x200000402:0x35:0x0
lhsmtool_posix: 1787884612.114576 [33809]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7' from '/tmp/arc1/sanity-hsm.test_12u//0437/0x200000402:0x35:0x0'
lhsmtool_posix: 1787884612.212088 [33809]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7' from '/tmp/arc1/sanity-hsm.test_12u//045a/0x200000401:0x5b:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0437/0x200000402:0x35:0x0'
lhsmtool_posix: 1787884612.212145 [33809]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1787884612.521843 [33838]: action=1 src=0x200000402:0x36:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8 mount_point=/mnt/lustre2
lhsmtool_posix: 1787884612.528407 [33838]: Resolving [0x200000402:0x36:0x0] to /tmp/arc1/sanity-hsm.test_12u//0434/0x200000402:0x36:0x0
lhsmtool_posix: 1787884612.528504 [33838]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8' from '/tmp/arc1/sanity-hsm.test_12u//0434/0x200000402:0x36:0x0'
lhsmtool_posix: 1787884612.609739 [33838]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8' from '/tmp/arc1/sanity-hsm.test_12u//045d/0x200000401:0x5c:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0434/0x200000402:0x36:0x0'
lhsmtool_posix: 1787884612.615376 [33838]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
lhsmtool_posix: 1787884613.034819 [33867]: action=1 src=0x200000402:0x37:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9 mount_point=/mnt/lustre2
lhsmtool_posix: 1787884613.047592 [33867]: Resolving [0x200000402:0x37:0x0] to /tmp/arc1/sanity-hsm.test_12u//0435/0x200000402:0x37:0x0
lhsmtool_posix: 1787884613.047692 [33867]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9' from '/tmp/arc1/sanity-hsm.test_12u//0435/0x200000402:0x37:0x0'
lhsmtool_posix: 1787884613.125841 [33867]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9' from '/tmp/arc1/sanity-hsm.test_12u//045c/0x200000401:0x5d:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0435/0x200000402:0x37:0x0'
lhsmtool_posix: 1787884613.150056 [33867]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
PASS 12u (32s)

== sanity-hsm test 13: Recursively import and restore a directory ========================================================== 22:37:05 (1787884625)
lhsmtool_posix: 1787884635.575008 [35644]: action=1 src=subdir dst=/mnt/lustre/d13.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787884635.720380 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.10'
lhsmtool_posix: 1787884635.806139 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.10' from '/tmp/arc1/sanity-hsm.test_13//0460/0x200000401:0x61:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.10'
lhsmtool_posix: 1787884635.806464 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.9'
lhsmtool_posix: 1787884635.885207 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.9' from '/tmp/arc1/sanity-hsm.test_13//0463/0x200000401:0x62:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.9'
lhsmtool_posix: 1787884635.885569 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.8'
lhsmtool_posix: 1787884636.029907 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.8' from '/tmp/arc1/sanity-hsm.test_13//0462/0x200000401:0x63:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.8'
lhsmtool_posix: 1787884636.030565 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.7'
lhsmtool_posix: 1787884636.138916 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.7' from '/tmp/arc1/sanity-hsm.test_13//0465/0x200000401:0x64:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.7'
lhsmtool_posix: 1787884636.139166 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.6'
lhsmtool_posix: 1787884636.234566 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.6' from '/tmp/arc1/sanity-hsm.test_13//0464/0x200000401:0x65:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.6'
lhsmtool_posix: 1787884636.234805 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.5'
lhsmtool_posix: 1787884636.328765 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.5' from '/tmp/arc1/sanity-hsm.test_13//0467/0x200000401:0x66:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.5'
lhsmtool_posix: 1787884636.329044 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.4'
lhsmtool_posix: 1787884636.393517 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.4' from '/tmp/arc1/sanity-hsm.test_13//0466/0x200000401:0x67:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.4'
lhsmtool_posix: 1787884636.393790 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.3'
lhsmtool_posix: 1787884636.466525 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.3' from '/tmp/arc1/sanity-hsm.test_13//0469/0x200000401:0x68:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.3'
lhsmtool_posix: 1787884636.466761 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.2'
lhsmtool_posix: 1787884636.520816 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.2' from '/tmp/arc1/sanity-hsm.test_13//0468/0x200000401:0x69:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.2'
lhsmtool_posix: 1787884636.521074 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.1'
lhsmtool_posix: 1787884636.578315 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.1' from '/tmp/arc1/sanity-hsm.test_13//046b/0x200000401:0x6a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.1'
lhsmtool_posix: 1787884636.587261 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.10'
lhsmtool_posix: 1787884636.685126 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.10' from '/tmp/arc1/sanity-hsm.test_13//046d/0x200000401:0x6c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.10'
lhsmtool_posix: 1787884636.695278 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.9'
lhsmtool_posix: 1787884636.781433 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.9' from '/tmp/arc1/sanity-hsm.test_13//046c/0x200000401:0x6d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.9'
lhsmtool_posix: 1787884636.781682 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.8'
lhsmtool_posix: 1787884636.932797 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.8' from '/tmp/arc1/sanity-hsm.test_13//046f/0x200000401:0x6e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.8'
lhsmtool_posix: 1787884636.933065 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.7'
lhsmtool_posix: 1787884637.030469 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.7' from '/tmp/arc1/sanity-hsm.test_13//046e/0x200000401:0x6f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.7'
lhsmtool_posix: 1787884637.030699 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.6'
lhsmtool_posix: 1787884637.137781 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.6' from '/tmp/arc1/sanity-hsm.test_13//0471/0x200000401:0x70:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.6'
lhsmtool_posix: 1787884637.138677 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.5'
lhsmtool_posix: 1787884637.227904 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.5' from '/tmp/arc1/sanity-hsm.test_13//0470/0x200000401:0x71:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.5'
lhsmtool_posix: 1787884637.228590 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.4'
lhsmtool_posix: 1787884637.336875 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.4' from '/tmp/arc1/sanity-hsm.test_13//0473/0x200000401:0x72:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.4'
lhsmtool_posix: 1787884637.337745 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.3'
lhsmtool_posix: 1787884637.445858 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.3' from '/tmp/arc1/sanity-hsm.test_13//0472/0x200000401:0x73:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.3'
lhsmtool_posix: 1787884637.446294 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.2'
lhsmtool_posix: 1787884637.493371 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.2' from '/tmp/arc1/sanity-hsm.test_13//0475/0x200000401:0x74:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.2'
lhsmtool_posix: 1787884637.494142 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.1'
lhsmtool_posix: 1787884637.531068 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.1' from '/tmp/arc1/sanity-hsm.test_13//0474/0x200000401:0x75:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.1'
lhsmtool_posix: 1787884637.537580 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.10'
lhsmtool_posix: 1787884637.582754 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.10' from '/tmp/arc1/sanity-hsm.test_13//0476/0x200000401:0x77:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.10'
lhsmtool_posix: 1787884637.583417 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.9'
lhsmtool_posix: 1787884637.618502 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.9' from '/tmp/arc1/sanity-hsm.test_13//0479/0x200000401:0x78:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.9'
lhsmtool_posix: 1787884637.619260 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.8'
lhsmtool_posix: 1787884637.667847 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.8' from '/tmp/arc1/sanity-hsm.test_13//0478/0x200000401:0x79:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.8'
lhsmtool_posix: 1787884637.669276 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.7'
lhsmtool_posix: 1787884637.724337 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.7' from '/tmp/arc1/sanity-hsm.test_13//047b/0x200000401:0x7a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.7'
lhsmtool_posix: 1787884637.724559 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.6'
lhsmtool_posix: 1787884637.763993 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.6' from '/tmp/arc1/sanity-hsm.test_13//047a/0x200000401:0x7b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.6'
lhsmtool_posix: 1787884637.764486 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.5'
lhsmtool_posix: 1787884637.834679 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.5' from '/tmp/arc1/sanity-hsm.test_13//047d/0x200000401:0x7c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.5'
lhsmtool_posix: 1787884637.835550 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.4'
lhsmtool_posix: 1787884637.890930 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.4' from '/tmp/arc1/sanity-hsm.test_13//047c/0x200000401:0x7d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.4'
lhsmtool_posix: 1787884637.891979 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.3'
lhsmtool_posix: 1787884637.953919 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.3' from '/tmp/arc1/sanity-hsm.test_13//047f/0x200000401:0x7e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.3'
lhsmtool_posix: 1787884637.954162 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.2'
lhsmtool_posix: 1787884638.034182 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.2' from '/tmp/arc1/sanity-hsm.test_13//047e/0x200000401:0x7f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.2'
lhsmtool_posix: 1787884638.035169 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.1'
lhsmtool_posix: 1787884638.139992 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.1' from '/tmp/arc1/sanity-hsm.test_13//0481/0x200000401:0x80:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.1'
lhsmtool_posix: 1787884638.147270 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.10'
lhsmtool_posix: 1787884638.253910 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.10' from '/tmp/arc1/sanity-hsm.test_13//0483/0x200000401:0x82:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.10'
lhsmtool_posix: 1787884638.254162 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.9'
lhsmtool_posix: 1787884638.369945 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.9' from '/tmp/arc1/sanity-hsm.test_13//0482/0x200000401:0x83:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.9'
lhsmtool_posix: 1787884638.370205 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.8'
lhsmtool_posix: 1787884638.498766 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.8' from '/tmp/arc1/sanity-hsm.test_13//0485/0x200000401:0x84:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.8'
lhsmtool_posix: 1787884638.499626 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.7'
lhsmtool_posix: 1787884638.574518 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.7' from '/tmp/arc1/sanity-hsm.test_13//0484/0x200000401:0x85:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.7'
lhsmtool_posix: 1787884638.574754 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.6'
lhsmtool_posix: 1787884638.653052 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.6' from '/tmp/arc1/sanity-hsm.test_13//0487/0x200000401:0x86:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.6'
lhsmtool_posix: 1787884638.653343 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.5'
lhsmtool_posix: 1787884638.733889 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.5' from '/tmp/arc1/sanity-hsm.test_13//0486/0x200000401:0x87:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.5'
lhsmtool_posix: 1787884638.734839 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.4'
lhsmtool_posix: 1787884638.801655 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.4' from '/tmp/arc1/sanity-hsm.test_13//0489/0x200000401:0x88:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.4'
lhsmtool_posix: 1787884638.802134 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.3'
lhsmtool_posix: 1787884638.862604 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.3' from '/tmp/arc1/sanity-hsm.test_13//0488/0x200000401:0x89:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.3'
lhsmtool_posix: 1787884638.862852 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.2'
lhsmtool_posix: 1787884638.958339 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.2' from '/tmp/arc1/sanity-hsm.test_13//048b/0x200000401:0x8a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.2'
lhsmtool_posix: 1787884638.958542 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.1'
lhsmtool_posix: 1787884639.024437 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.1' from '/tmp/arc1/sanity-hsm.test_13//048a/0x200000401:0x8b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.1'
lhsmtool_posix: 1787884639.039664 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.10'
lhsmtool_posix: 1787884639.107805 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.10' from '/tmp/arc1/sanity-hsm.test_13//048c/0x200000401:0x8d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.10'
lhsmtool_posix: 1787884639.108052 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.9'
lhsmtool_posix: 1787884639.179876 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.9' from '/tmp/arc1/sanity-hsm.test_13//048f/0x200000401:0x8e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.9'
lhsmtool_posix: 1787884639.180128 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.8'
lhsmtool_posix: 1787884639.248196 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.8' from '/tmp/arc1/sanity-hsm.test_13//048e/0x200000401:0x8f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.8'
lhsmtool_posix: 1787884639.248717 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.7'
lhsmtool_posix: 1787884639.302636 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.7' from '/tmp/arc1/sanity-hsm.test_13//0491/0x200000401:0x90:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.7'
lhsmtool_posix: 1787884639.303364 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.6'
lhsmtool_posix: 1787884639.348567 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.6' from '/tmp/arc1/sanity-hsm.test_13//0490/0x200000401:0x91:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.6'
lhsmtool_posix: 1787884639.348875 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.5'
lhsmtool_posix: 1787884639.397656 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.5' from '/tmp/arc1/sanity-hsm.test_13//0493/0x200000401:0x92:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.5'
lhsmtool_posix: 1787884639.399200 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.4'
lhsmtool_posix: 1787884639.460872 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.4' from '/tmp/arc1/sanity-hsm.test_13//0492/0x200000401:0x93:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.4'
lhsmtool_posix: 1787884639.461922 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.3'
lhsmtool_posix: 1787884639.502922 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.3' from '/tmp/arc1/sanity-hsm.test_13//0495/0x200000401:0x94:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.3'
lhsmtool_posix: 1787884639.503923 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.2'
lhsmtool_posix: 1787884639.563963 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.2' from '/tmp/arc1/sanity-hsm.test_13//0494/0x200000401:0x95:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.2'
lhsmtool_posix: 1787884639.565855 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.1'
lhsmtool_posix: 1787884639.615711 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.1' from '/tmp/arc1/sanity-hsm.test_13//0497/0x200000401:0x96:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.1'
lhsmtool_posix: 1787884639.621080 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.10'
lhsmtool_posix: 1787884639.682130 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.10' from '/tmp/arc1/sanity-hsm.test_13//0499/0x200000401:0x98:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.10'
lhsmtool_posix: 1787884639.682696 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.9'
lhsmtool_posix: 1787884639.721109 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.9' from '/tmp/arc1/sanity-hsm.test_13//0498/0x200000401:0x99:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.9'
lhsmtool_posix: 1787884639.721395 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.8'
lhsmtool_posix: 1787884639.754027 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.8' from '/tmp/arc1/sanity-hsm.test_13//049b/0x200000401:0x9a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.8'
lhsmtool_posix: 1787884639.754557 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.7'
lhsmtool_posix: 1787884639.800885 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.7' from '/tmp/arc1/sanity-hsm.test_13//049a/0x200000401:0x9b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.7'
lhsmtool_posix: 1787884639.801866 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.6'
lhsmtool_posix: 1787884639.854929 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.6' from '/tmp/arc1/sanity-hsm.test_13//049d/0x200000401:0x9c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.6'
lhsmtool_posix: 1787884639.855454 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.5'
lhsmtool_posix: 1787884639.897691 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.5' from '/tmp/arc1/sanity-hsm.test_13//049c/0x200000401:0x9d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.5'
lhsmtool_posix: 1787884639.898005 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.4'
lhsmtool_posix: 1787884639.956001 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.4' from '/tmp/arc1/sanity-hsm.test_13//049f/0x200000401:0x9e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.4'
lhsmtool_posix: 1787884639.956972 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.3'
lhsmtool_posix: 1787884640.005542 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.3' from '/tmp/arc1/sanity-hsm.test_13//049e/0x200000401:0x9f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.3'
lhsmtool_posix: 1787884640.005997 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.2'
lhsmtool_posix: 1787884640.051158 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.2' from '/tmp/arc1/sanity-hsm.test_13//04a1/0x200000401:0xa0:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.2'
lhsmtool_posix: 1787884640.051555 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.1'
lhsmtool_posix: 1787884640.099929 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.1' from '/tmp/arc1/sanity-hsm.test_13//04a0/0x200000401:0xa1:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.1'
lhsmtool_posix: 1787884640.107538 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.10'
lhsmtool_posix: 1787884640.148832 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.10' from '/tmp/arc1/sanity-hsm.test_13//04a2/0x200000401:0xa3:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.10'
lhsmtool_posix: 1787884640.149928 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.9'
lhsmtool_posix: 1787884640.188581 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.9' from '/tmp/arc1/sanity-hsm.test_13//04a5/0x200000401:0xa4:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.9'
lhsmtool_posix: 1787884640.189313 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.8'
lhsmtool_posix: 1787884640.296374 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.8' from '/tmp/arc1/sanity-hsm.test_13//04a4/0x200000401:0xa5:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.8'
lhsmtool_posix: 1787884640.296571 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.7'
lhsmtool_posix: 1787884640.388600 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.7' from '/tmp/arc1/sanity-hsm.test_13//04a7/0x200000401:0xa6:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.7'
lhsmtool_posix: 1787884640.397519 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.6'
lhsmtool_posix: 1787884640.498654 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.6' from '/tmp/arc1/sanity-hsm.test_13//04a6/0x200000401:0xa7:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.6'
lhsmtool_posix: 1787884640.498976 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.5'
lhsmtool_posix: 1787884640.592047 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.5' from '/tmp/arc1/sanity-hsm.test_13//04a9/0x200000401:0xa8:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.5'
lhsmtool_posix: 1787884640.594884 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.4'
lhsmtool_posix: 1787884640.735144 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.4' from '/tmp/arc1/sanity-hsm.test_13//04a8/0x200000401:0xa9:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.4'
lhsmtool_posix: 1787884640.735475 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.3'
lhsmtool_posix: 1787884640.824413 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.3' from '/tmp/arc1/sanity-hsm.test_13//04ab/0x200000401:0xaa:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.3'
lhsmtool_posix: 1787884640.824596 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.2'
lhsmtool_posix: 1787884640.880601 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.2' from '/tmp/arc1/sanity-hsm.test_13//04aa/0x200000401:0xab:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.2'
lhsmtool_posix: 1787884640.880789 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.1'
lhsmtool_posix: 1787884640.919974 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.1' from '/tmp/arc1/sanity-hsm.test_13//04ad/0x200000401:0xac:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.1'
lhsmtool_posix: 1787884640.932197 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.10'
lhsmtool_posix: 1787884640.980710 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.10' from '/tmp/arc1/sanity-hsm.test_13//04af/0x200000401:0xae:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.10'
lhsmtool_posix: 1787884640.980914 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.9'
lhsmtool_posix: 1787884641.020667 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.9' from '/tmp/arc1/sanity-hsm.test_13//04ae/0x200000401:0xaf:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.9'
lhsmtool_posix: 1787884641.020872 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.8'
lhsmtool_posix: 1787884641.069348 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.8' from '/tmp/arc1/sanity-hsm.test_13//04b1/0x200000401:0xb0:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.8'
lhsmtool_posix: 1787884641.069556 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.7'
lhsmtool_posix: 1787884641.108190 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.7' from '/tmp/arc1/sanity-hsm.test_13//04b0/0x200000401:0xb1:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.7'
lhsmtool_posix: 1787884641.109418 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.6'
lhsmtool_posix: 1787884641.153996 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.6' from '/tmp/arc1/sanity-hsm.test_13//04b3/0x200000401:0xb2:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.6'
lhsmtool_posix: 1787884641.155961 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.5'
lhsmtool_posix: 1787884641.198199 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.5' from '/tmp/arc1/sanity-hsm.test_13//04b2/0x200000401:0xb3:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.5'
lhsmtool_posix: 1787884641.198971 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.4'
lhsmtool_posix: 1787884641.248339 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.4' from '/tmp/arc1/sanity-hsm.test_13//04b5/0x200000401:0xb4:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.4'
lhsmtool_posix: 1787884641.248900 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.3'
lhsmtool_posix: 1787884641.288912 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.3' from '/tmp/arc1/sanity-hsm.test_13//04b4/0x200000401:0xb5:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.3'
lhsmtool_posix: 1787884641.290827 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.2'
lhsmtool_posix: 1787884641.335708 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.2' from '/tmp/arc1/sanity-hsm.test_13//04b7/0x200000401:0xb6:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.2'
lhsmtool_posix: 1787884641.336393 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.1'
lhsmtool_posix: 1787884641.379462 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.1' from '/tmp/arc1/sanity-hsm.test_13//04b6/0x200000401:0xb7:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.1'
lhsmtool_posix: 1787884641.385593 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.10'
lhsmtool_posix: 1787884641.436518 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.10' from '/tmp/arc1/sanity-hsm.test_13//04b8/0x200000401:0xb9:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.10'
lhsmtool_posix: 1787884641.438865 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.9'
lhsmtool_posix: 1787884641.489098 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.9' from '/tmp/arc1/sanity-hsm.test_13//04bb/0x200000401:0xba:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.9'
lhsmtool_posix: 1787884641.489343 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.8'
lhsmtool_posix: 1787884641.540057 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.8' from '/tmp/arc1/sanity-hsm.test_13//04ba/0x200000401:0xbb:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.8'
lhsmtool_posix: 1787884641.540316 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.7'
lhsmtool_posix: 1787884641.594039 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.7' from '/tmp/arc1/sanity-hsm.test_13//04bd/0x200000401:0xbc:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.7'
lhsmtool_posix: 1787884641.594293 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.6'
lhsmtool_posix: 1787884641.640005 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.6' from '/tmp/arc1/sanity-hsm.test_13//04bc/0x200000401:0xbd:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.6'
lhsmtool_posix: 1787884641.640182 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.5'
lhsmtool_posix: 1787884641.698446 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.5' from '/tmp/arc1/sanity-hsm.test_13//04bf/0x200000401:0xbe:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.5'
lhsmtool_posix: 1787884641.698633 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.4'
lhsmtool_posix: 1787884641.744788 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.4' from '/tmp/arc1/sanity-hsm.test_13//04be/0x200000401:0xbf:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.4'
lhsmtool_posix: 1787884641.745403 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.3'
lhsmtool_posix: 1787884641.792140 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.3' from '/tmp/arc1/sanity-hsm.test_13//04c1/0x200000401:0xc0:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.3'
lhsmtool_posix: 1787884641.793101 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.2'
lhsmtool_posix: 1787884641.834852 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.2' from '/tmp/arc1/sanity-hsm.test_13//04c0/0x200000401:0xc1:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.2'
lhsmtool_posix: 1787884641.835595 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.1'
lhsmtool_posix: 1787884641.880940 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.1' from '/tmp/arc1/sanity-hsm.test_13//04c3/0x200000401:0xc2:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.1'
lhsmtool_posix: 1787884641.887129 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.10'
lhsmtool_posix: 1787884641.954180 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.10' from '/tmp/arc1/sanity-hsm.test_13//04c5/0x200000401:0xc4:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.10'
lhsmtool_posix: 1787884641.954499 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.9'
lhsmtool_posix: 1787884642.050106 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.9' from '/tmp/arc1/sanity-hsm.test_13//04c4/0x200000401:0xc5:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.9'
lhsmtool_posix: 1787884642.050987 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.8'
lhsmtool_posix: 1787884642.118888 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.8' from '/tmp/arc1/sanity-hsm.test_13//04c7/0x200000401:0xc6:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.8'
lhsmtool_posix: 1787884642.119143 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.7'
lhsmtool_posix: 1787884642.185780 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.7' from '/tmp/arc1/sanity-hsm.test_13//04c6/0x200000401:0xc7:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.7'
lhsmtool_posix: 1787884642.186018 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.6'
lhsmtool_posix: 1787884642.271674 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.6' from '/tmp/arc1/sanity-hsm.test_13//04c9/0x200000401:0xc8:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.6'
lhsmtool_posix: 1787884642.271917 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.5'
lhsmtool_posix: 1787884642.320328 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.5' from '/tmp/arc1/sanity-hsm.test_13//04c8/0x200000401:0xc9:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.5'
lhsmtool_posix: 1787884642.320591 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.4'
lhsmtool_posix: 1787884642.363355 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.4' from '/tmp/arc1/sanity-hsm.test_13//04cb/0x200000401:0xca:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.4'
lhsmtool_posix: 1787884642.363608 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.3'
lhsmtool_posix: 1787884642.416008 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.3' from '/tmp/arc1/sanity-hsm.test_13//04ca/0x200000401:0xcb:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.3'
lhsmtool_posix: 1787884642.416309 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.2'
lhsmtool_posix: 1787884642.530256 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.2' from '/tmp/arc1/sanity-hsm.test_13//04cd/0x200000401:0xcc:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.2'
lhsmtool_posix: 1787884642.530508 [35644]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.1'
lhsmtool_posix: 1787884642.614138 [35644]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.1' from '/tmp/arc1/sanity-hsm.test_13//04cc/0x200000401:0xcd:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.1'
lhsmtool_posix: 1787884642.614676 [35644]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_13/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 13 (47s)

== sanity-hsm test 14: Rebind archived file to a new fid ========================================================== 22:37:52 (1787884672)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_14/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.359328 s, 2.9 MB/s
0+0 records in
0+0 records out
0 bytes copied, 0.0151609 s, 0.0 kB/s
rebind 0x200000402:0xa7:0x0 to 0x200000402:0xa8:0x0
lhsmtool_posix: 1787884677.339952 [36600]: action=2 src=0x200000402:0xa7:0x0 dst=0x200000402:0xa8:0x0 mount_point=/mnt/lustre2
lhsmtool_posix: 1787884677.341596 [36600]: rebind [0x200000402:0xa7:0x0] to [0x200000402:0xa8:0x0]
lhsmtool_posix: 1787884677.342597 [36600]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
PASS 14 (13s)

== sanity-hsm test 15: Rebind a list of files ============ 22:38:05 (1787884685)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_15/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.331542 s, 3.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.302308 s, 3.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.284795 s, 3.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.485054 s, 2.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.32476 s, 3.2 MB/s
Waiting 300s for ''
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
0+0 records in
0+0 records out
0 bytes copied, 0.0227525 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00703928 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00864329 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.010985 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00388054 s, 0.0 kB/s
rebind list of files
lhsmtool_posix: 1787884697.699722 [37387]: action=2 src=/tmp/tmp.7624 dst=(null) mount_point=/mnt/lustre2
lhsmtool_posix: 1787884697.702023 [37387]: rebind [0x200000402:0xab:0x0] to [0x200000402:0xb0:0x0]
lhsmtool_posix: 1787884697.703007 [37387]: rebind [0x200000402:0xac:0x0] to [0x200000402:0xb1:0x0]
lhsmtool_posix: 1787884697.703092 [37387]: rebind [0x200000402:0xad:0x0] to [0x200000402:0xb2:0x0]
lhsmtool_posix: 1787884697.703144 [37387]: rebind [0x200000402:0xae:0x0] to [0x200000402:0xb3:0x0]
lhsmtool_posix: 1787884697.703267 [37387]: rebind [0x200000402:0xaf:0x0] to [0x200000402:0xb4:0x0]
lhsmtool_posix: 1787884697.703337 [37387]: 5 lines read from '/tmp/tmp.7624', 5 rebind successful
lhsmtool_posix: 1787884697.703356 [37387]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
PASS 15 (26s)

== sanity-hsm test 16: Test CT bandwith control option === 22:38:31 (1787884711)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_16/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
20+0 records in
20+0 records out
20971520 bytes (21 MB, 20 MiB) copied, 0.0538226 s, 390 MB/s
Waiting 200s for 'SUCCEED'
Waiting 190s for 'SUCCEED'
Updated after 20s: want 'SUCCEED' got 'SUCCEED'
PASS 16 (30s)

== sanity-hsm test 20: Release is not permitted ========== 22:39:01 (1787884741)
0+0 records in
0+0 records out
0 bytes copied, 0.0102306 s, 0.0 kB/s
0x200000402:0xbc:0x0
Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted
Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted
Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted
Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted
PASS 20 (7s)

== sanity-hsm test 21: Simple release tests ============== 22:39:08 (1787884748)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_21/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.293178 s, 3.6 MB/s
1+0 records in
1+0 records out
512 bytes copied, 0.105148 s, 4.9 kB/s
PASS 21 (11s)

== sanity-hsm test 22: Could not swap a release file ===== 22:39:19 (1787884759)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_22/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.353 s, 3.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.176912 s, 5.9 MB/s
0x200000402:0xc1:0x0
lfs swap_layouts: error: cannot swap layout between '/mnt/lustre/d22.sanity-hsm/test_swap' and '/mnt/lustre/d22.sanity-hsm/test_release': Operation not supported (95)
PASS 22 (12s)

== sanity-hsm test 23: Release does not change a/mtime (utime) ========================================================== 22:39:31 (1787884771)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_23/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.25983 s, 4.0 MB/s
PASS 23 (10s)

== sanity-hsm test 24a: Archive, release, and restore does not change a/mtime (i/o) ========================================================== 22:39:41 (1787884781)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.2422 s, 4.3 MB/s
Killing existing copytools on oleg656-client.virtnet with signal TERM
copytools stopped in 0s
192.168.206.156@tcp:/lustre /mnt/lustre lustre rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg656-client.virtnet /mnt/lustre (opts:)
Starting client: oleg656-client.virtnet:  -o user_xattr,flock 192.168.206.156@tcp:/lustre /mnt/lustre
PASS 24a (14s)

== sanity-hsm test 24b: root can archive, release, and restore user files ========================================================== 22:39:55 (1787884795)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.257285 s, 4.1 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm]
/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm: (0x00000009) exists archived, archive_id:1
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [md5sum] [/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm]
PASS 24b (16s)

== sanity-hsm test 24c: check that user,group,other request masks work ========================================================== 22:40:11 (1787884811)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.188534 s, 5.6 MB/s
0x200000402:0xcc:0x0
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.232013 s, 4.5 MB/s
0x200000402:0xcd:0x0
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.265743 s, 3.9 MB/s
0x200000402:0xce:0x0
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm]
PASS 24c (21s)

== sanity-hsm test 24d: check that read-only mounts are respected ========================================================== 22:40:32 (1787884832)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.341151 s, 3.1 MB/s
0x200000402:0xd0:0x0
/mnt/lustre/d24d.sanity-hsm/f24d.sanity-hsm
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 0
	obdidx		 objid		 objid		 group
	     0	           105	         0x69	   0x240000400

Starting client: oleg656-client.virtnet:  -o user_xattr,flock 192.168.206.156@tcp:/lustre /mnt/lustre3
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre3"'
Cannot send HSM request (use of /mnt/lustre2/d24d.sanity-hsm/f24d.sanity-hsm): Read-only file system
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 1.5049 s, 697 kB/s
Cannot send HSM request (use of /mnt/lustre2/d24d.sanity-hsm/f24d.sanity-hsm): Read-only file system
Stopping client oleg656-client.virtnet /mnt/lustre3 (opts:)
PASS 24d (20s)

== sanity-hsm test 24e: tar succeeds on HSM released files ========================================================== 22:40:52 (1787884852)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.226911 s, 4.6 MB/s
/mnt/lustre/d24e.sanity-hsm/f24e.sanity-hsm: (0x0000000d) released exists archived, archive_id:1
tar: Removing leading `/' from member names
PASS 24e (11s)

== sanity-hsm test 24f: root can archive, release, and restore tar files ========================================================== 22:41:03 (1787884863)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
54fb6627dbaa37721048e4549db3224d /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
f24f.sanity-hsm
f24f.sanity-hsm
Sum0 = 54fb6627dbaa37721048e4549db3224d  /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm, sum1 = 54fb6627dbaa37721048e4549db3224d  /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm
PASS 24f (11s)

== sanity-hsm test 24g: write by non-owner still sets dirty ========================================================== 22:41:14 (1787884874)
RUNAS = 'runas -u 500 -g 500'
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24g/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Please listen carefully as our options have changed.
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [tee] [/mnt/lustre/d24g.sanity-hsm/f24g.sanity-hsm]
To be electrocuted by your telephone, press #.
PASS 24g (10s)

== sanity-hsm test 25a: Restore lost file (HS_LOST flag) from import ========================================================== 22:41:24 (1787884884)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_25a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1787884887.341015 [46249]: action=1 src=d25a.sanity-hsm/f25a.sanity-hsm dst=/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787884887.353516 [46249]: importing '/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_25a//d25a.sanity-hsm/f25a.sanity-hsm'
lhsmtool_posix: 1787884887.428593 [46249]: imported '/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_25a//0411/0x200000404:0x15:0x0'=='/tmp/arc1/sanity-hsm.test_25a//d25a.sanity-hsm/f25a.sanity-hsm'
lhsmtool_posix: 1787884887.428664 [46249]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
md5sum: /mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm: No data available
PASS 25a (8s)

== sanity-hsm test 25b: Restore lost file (HS_LOST flag) after release ========================================================== 22:41:33 (1787884893)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_25b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
md5sum: /mnt/lustre/d25b.sanity-hsm/f25b.sanity-hsm: No data available
PASS 25b (10s)

== sanity-hsm test 26A: Remove the archive of a valid file ========================================================== 22:41:43 (1787884903)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.0168391 s, 0.0 kB/s
PASS 26A (10s)

== sanity-hsm test 26a: Remove Archive On Last Unlink (RAoLU) policy ========================================================== 22:41:53 (1787884913)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
PASS 26a (26s)

== sanity-hsm test 26b: RAoLU policy when CDT off ======== 22:42:19 (1787884939)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
Killing existing copytools on oleg656-client.virtnet with signal TERM
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 26b (17s)

== sanity-hsm test 26c: RAoLU effective when file closed ========================================================== 22:42:36 (1787884956)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
multiop /mnt/lustre/d26c.sanity-hsm/f26c.sanity-hsm vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.7624
Waiting 200s for 'SUCCEED'
Updated after 4s: want 'SUCCEED' got 'SUCCEED'
Waiting 200s for 'SUCCEED'
Updated after 6s: want 'SUCCEED' got 'SUCCEED'
PASS 26c (34s)

== sanity-hsm test 26d: RAoLU when Client eviction ======= 22:43:10 (1787884990)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.224121 s, 4.7 MB/s
multiop /mnt/lustre/d26d.sanity-hsm/f26d.sanity-hsm vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.7624
Waiting 200s for 'SUCCEED'
Updated after 9s: want 'SUCCEED' got 'SUCCEED'
PASS 26d (31s)

== sanity-hsm test 26e: RAoLU with a non-started coordinator ========================================================== 22:43:42 (1787885022)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.44167 s, 2.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.222386 s, 4.7 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Killing existing copytools on oleg656-client.virtnet with signal TERM
copytools stopped in 0s
Failing mds1 on oleg656-server
Stopping /mnt/lustre-mds1 (opts:) on oleg656-server
22:44:17 (1787885057) shut down
facet: mds1 facet_host: oleg656-server facet_failover_host: oleg656-server
Failover mds1 to oleg656-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg656-server: oleg656-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
Started lustre-MDT0000
22:44:41 (1787885081) targets are mounted
22:44:41 (1787885081) facet_failover done
oleg656-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
Check cookie from RAoLU request (last: 1787884360, remove: 1787884361)
mdt.lustre-MDT0000.hsm_control=enabled
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
PASS 26e (105s)

== sanity-hsm test 27a: Remove the archive of an imported file (Operation not permitted) ========================================================== 22:45:28 (1787885128)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_27a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
39+0 records in
39+0 records out
40894464 bytes (41 MB, 39 MiB) copied, 0.997713 s, 41.0 MB/s
lhsmtool_posix: 1787885131.887715 [52996]: action=1 src=d27a.sanity-hsm/f27a.sanity-hsm dst=/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787885131.894803 [52996]: importing '/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_27a//d27a.sanity-hsm/f27a.sanity-hsm'
lhsmtool_posix: 1787885131.955108 [52996]: imported '/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_27a//0405/0x200000406:0x3:0x0'=='/tmp/arc1/sanity-hsm.test_27a//d27a.sanity-hsm/f27a.sanity-hsm'
lhsmtool_posix: 1787885131.955170 [52996]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Cannot send HSM request (use of /mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm): Operation not permitted
PASS 27a (9s)

== sanity-hsm test 27b: Remove the archive of a relased file (Operation not permitted) ========================================================== 22:45:37 (1787885137)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_27b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.0031704 s, 0.0 kB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Cannot send HSM request (use of /mnt/lustre/d27b.sanity-hsm/f27b.sanity-hsm): Operation not permitted
PASS 27b (10s)

== sanity-hsm test 28: Concurrent archive/file remove ==== 22:45:47 (1787885147)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_28/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.00643609 s, 0.0 kB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
PASS 28 (14s)

== sanity-hsm test 29a: Tests --mntpath and --archive options ========================================================== 22:46:02 (1787885162)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 7  "/mnt/lustre"'
Cannot send HSM request (use of /mnt/lustre): Invalid argument
hsm: '/qwerty/uyt' is not a valid FID
PASS 29a (6s)

== sanity-hsm test 29b: Archive/delete/remove by FID from the archive. ========================================================== 22:46:08 (1787885168)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.175378 s, 6.0 MB/s
PASS 29b (9s)

== sanity-hsm test 29c: Archive/delete/remove by FID, using a file list. ========================================================== 22:46:17 (1787885177)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.221095 s, 4.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.246674 s, 4.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.148234 s, 7.1 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
PASS 29c (15s)

== sanity-hsm test 29d: hsm_remove by FID with archive_id 0 for unlinked file cause ========================================================== 22:46:32 (1787885192)

 SKIP: sanity-hsm test_29d Need 3 or more clients, have 1
SKIP 29d (4s)

== sanity-hsm test 30a: Restore at exec (import case) ==== 22:46:36 (1787885196)

 SKIP: sanity-hsm test_30a Need 2 or more clients, have 1
SKIP 30a (4s)

== sanity-hsm test 30b: Restore at exec (release case) === 22:46:40 (1787885200)

 SKIP: sanity-hsm test_30b Need 2 or more clients, have 1
SKIP 30b (3s)

== sanity-hsm test 30c: Update during exec of released file must fail ========================================================== 22:46:43 (1787885203)

 SKIP: sanity-hsm test_30c Need 2 or more clients, have 1
SKIP 30c (4s)

== sanity-hsm test 31a: Import a large file and check size during restore ========================================================== 22:46:47 (1787885207)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
39+0 records in
39+0 records out
40894464 bytes (41 MB, 39 MiB) copied, 1.42802 s, 28.6 MB/s
lhsmtool_posix: 1787885212.199832 [58068]: action=1 src=d31a.sanity-hsm/f31a.sanity-hsm dst=/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787885212.207699 [58068]: importing '/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_31a//d31a.sanity-hsm/f31a.sanity-hsm'
lhsmtool_posix: 1787885212.255489 [58068]: imported '/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_31a//040b/0x200000406:0xd:0x0'=='/tmp/arc1/sanity-hsm.test_31a//d31a.sanity-hsm/f31a.sanity-hsm'
lhsmtool_posix: 1787885212.255571 [58068]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
size seen is right: 40894464 == 40894464
 done
PASS 31a (21s)

== sanity-hsm test 31b: Restore a large unaligned file and check size during restore ========================================================== 22:47:08 (1787885228)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
39+0 records in
39+0 records out
39000000 bytes (39 MB, 37 MiB) copied, 1.14869 s, 34.0 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
size seen is right: 39000000 == 39000000
 done
PASS 31b (22s)

== sanity-hsm test 31c: Restore a large aligned file and check size during restore ========================================================== 22:47:30 (1787885250)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
39+0 records in
39+0 records out
40894464 bytes (41 MB, 39 MiB) copied, 1.24657 s, 32.8 MB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
size seen is right: 40894464 == 40894464
 done
PASS 31c (22s)

== sanity-hsm test 33: Kill a restore waiting process ==== 22:47:53 (1787885273)
0+0 records in
0+0 records out
0 bytes copied, 0.00450406 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_33/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Copytool is suspended on oleg656-client.virtnet
Copytool is continued on oleg656-client.virtnet
/home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2893: 60083 Terminated              md5sum $f > /dev/null
PASS 33 (12s)

== sanity-hsm test 34: Remove file during restore ======== 22:48:04 (1787885284)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_34/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.00746747 s, 0.0 kB/s
Copytool is suspended on oleg656-client.virtnet
Copytool is continued on oleg656-client.virtnet
/home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2925: kill: (60736) - No such process
PASS 34 (10s)

== sanity-hsm test 35: Overwrite file during restore ===== 22:48:14 (1787885294)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_35/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.00703212 s, 0.0 kB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Copytool is suspended on oleg656-client.virtnet
Copytool is continued on oleg656-client.virtnet
/home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2962: kill: (61412) - No such process
PASS 35 (12s)

== sanity-hsm test 36: Move file during restore ========== 22:48:26 (1787885306)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_36/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.00525339 s, 0.0 kB/s
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Copytool is suspended on oleg656-client.virtnet
Copytool is continued on oleg656-client.virtnet
/home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2998: kill: (62087) - No such process
PASS 36 (12s)

== sanity-hsm test 37: re-archive a dirty file =========== 22:48:38 (1787885318)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_37/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.221471 s, 4.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0475196 s, 22.1 MB/s
Waiting 200s for 'SUCCEED'
Updated after 4s: want 'SUCCEED' got 'SUCCEED'
PASS 37 (77s)

== sanity-hsm test 40: Parallel archive requests ========= 22:49:55 (1787885395)
oleg656-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=1152921504606846976: Cannot allocate memory
oleg656-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='1152921504606846976': Cannot allocate memory
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 12
set max_requests=1152921504606846976 failed with 12
[ 1561.150437] Lustre: lustre-MDT0000: No more memory to set HSM max_requests=1152921504606846976 (max request memory: 461MB, current total 3/975941): rc = -12
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_40/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=purge
Wait for all requests being enqueued...100 archive requests submitted
100 archive requests submitted
100 archive requests submitted
100 archive requests submitted
OK
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
PASS 40 (152s)

== sanity-hsm test 50: Archive with large number of pending HSM actions ========================================================== 22:52:27 (1787885547)
oleg656-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=1000000: Cannot allocate memory
oleg656-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='1000000': Cannot allocate memory
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 12
Filesystem                  Inodes IUsed  IFree IUse% Mounted on
192.168.206.156@tcp:/lustre 236094   990 235104    1% /mnt/lustre
 - create 1231 (time 1787885563.33 total 10.01 last 123.02)
 - create 2458 (time 1787885573.34 total 20.01 last 122.61)
 - create 3690 (time 1787885583.35 total 30.02 last 123.15)
 - create 5003 (time 1787885593.35 total 40.02 last 131.23)
 - create 6345 (time 1787885603.35 total 50.03 last 134.17)
 - create 7511 (time 1787885613.35 total 60.03 last 116.59)
 - create 8734 (time 1787885623.36 total 70.03 last 122.25)
total: 10000 create in 79.87 seconds: 125.21 ops/second
10000
 - unlinked 0 (time 1787885722 ; total 0 ; last 0)
total: 10000 unlinks in 86 seconds: 116.279068 unlinks/second
Start Phase files_num: 10000 time: 83
 - create 1093 (time 1787885822.89 total 10.00 last 109.25)
 - create 2238 (time 1787885832.89 total 20.01 last 114.43)
 - create 3407 (time 1787885842.90 total 30.02 last 116.78)
 - create 4558 (time 1787885852.91 total 40.03 last 115.03)
 - create 5601 (time 1787885862.91 total 50.03 last 104.29)
 - create 6790 (time 1787885872.92 total 60.03 last 118.83)
 - create 8028 (time 1787885882.92 total 70.03 last 123.77)
 - create 9258 (time 1787885892.92 total 80.04 last 122.96)
 - create 10000 (time 1787885898.99 total 86.11 last 122.28)
 - create 11221 (time 1787885908.99 total 96.11 last 122.08)
 - create 12455 (time 1787885918.99 total 106.11 last 123.35)
 - create 13715 (time 1787885929.00 total 116.11 last 125.98)
 - create 14829 (time 1787885939.00 total 126.12 last 111.31)
 - create 16041 (time 1787885949.01 total 136.13 last 121.13)
 - create 17289 (time 1787885959.02 total 146.13 last 124.74)
 - create 18417 (time 1787885969.02 total 156.14 last 112.72)
 - create 19561 (time 1787885979.03 total 166.14 last 114.36)
total: 20000 create in 169.37 seconds: 118.08 ops/second
 - unlinked 0 (time 1787886168 ; total 1 ; last 1)
 - unlinked 10000 (time 1787886260 ; total 93 ; last 92)
total: 20000 unlinks in 191 seconds: 104.712044 unlinks/second
Middle Phase files_num: 20000 time: 182
 - create 1132 (time 1787886373.02 total 10.00 last 113.18)
 - create 2348 (time 1787886383.03 total 20.00 last 121.58)
 - create 3470 (time 1787886393.03 total 30.00 last 112.20)
 - create 4594 (time 1787886403.03 total 40.01 last 112.38)
 - create 5701 (time 1787886413.05 total 50.03 last 110.43)
 - create 6727 (time 1787886423.06 total 60.04 last 102.53)
 - create 7789 (time 1787886433.09 total 70.07 last 105.89)
 - create 8871 (time 1787886443.10 total 80.08 last 108.09)
 - create 9981 (time 1787886453.10 total 90.08 last 110.99)
total: 10000 create in 90.29 seconds: 110.76 ops/second
40000
 - unlinked 0 (time 1787886552 ; total 0 ; last 0)
total: 10000 unlinks in 91 seconds: 109.890106 unlinks/second
End Phase files_num: 10000 time: 91
40000
mdt.lustre-MDT0000.hsm_control=purge
PASS 50 (1113s)

== sanity-hsm test 52: Opened for write file on an evicted client should be set dirty ========================================================== 23:11:00 (1787886660)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_52/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.311735 s, 3.4 MB/s
multiop /mnt/lustre/d52.sanity-hsm/f52.sanity-hsm vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.7624
pdsh@oleg656-client: oleg656-client: ssh exited with exit code 5
PASS 52 (18s)

== sanity-hsm test 53: Opened for read file on an evicted client should not be set dirty ========================================================== 23:11:19 (1787886679)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_53/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.265843 s, 3.9 MB/s
multiop /mnt/lustre/d53.sanity-hsm/f53.sanity-hsm vo_c
TMPPIPE=/tmp/multiop_open_wait_pipe.7624
pdsh@oleg656-client: oleg656-client: ssh exited with exit code 5
PASS 53 (18s)

== sanity-hsm test 54: Write during an archive cancels it ========================================================== 23:11:37 (1787886697)
39+0 records in
39+0 records out
39000000 bytes (39 MB, 37 MiB) copied, 1.07532 s, 36.3 MB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_54/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm.policy=+NRA
Waiting 200s for 'FAILED'
Waiting 170s for 'FAILED'
Updated after 34s: want 'FAILED' got 'FAILED'
mdt.lustre-MDT0000.hsm.policy=-NRA
PASS 54 (49s)

== sanity-hsm test 55: Truncate during an archive cancels it ========================================================== 23:12:26 (1787886746)
39+0 records in
39+0 records out
39000000 bytes (39 MB, 37 MiB) copied, 0.975131 s, 40.0 MB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_55/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm.policy=+NRA
mdt.lustre-MDT0000.hsm.policy=-NRA
PASS 55 (13s)

== sanity-hsm test 56: Setattr during an archive is ok === 23:12:39 (1787886759)
39+0 records in
39+0 records out
39000000 bytes (39 MB, 37 MiB) copied, 1.25569 s, 31.1 MB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_56/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Waiting 190s for 'SUCCEED'
Updated after 36s: want 'SUCCEED' got 'SUCCEED'
PASS 56 (48s)

== sanity-hsm test 57: Archive a file with dirty cache on another node ========================================================== 23:13:27 (1787886807)

 SKIP: sanity-hsm test_57 Need 2 or more clients, have 1
SKIP 57 (3s)

== sanity-hsm test 58: Truncate a released file will trigger restore ========================================================== 23:13:31 (1787886811)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_58/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
truncate up from 1516 to 3032
/mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2
truncate down from 1516 to 758
/mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2
truncate to 0
/mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2
PASS 58 (18s)

== sanity-hsm test 59: Release stripeless file with non-zero size ========================================================== 23:13:50 (1787886830)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_59/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 59 (9s)

== sanity-hsm test 60: Changing progress update interval from default ========================================================== 23:13:58 (1787886838)
10+0 records in
10+0 records out
10485760 bytes (10 MB, 10 MiB) copied, 0.255891 s, 41.0 MB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_60/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 --update-interval 5 "/mnt/lustre2"'
Waiting 100s for 'start copy'
Expecting a progress update within 20 seconds... 5242880 bytes copied in 3 seconds.
Wait for on going archive hsm action to complete
Waiting 10s for 'copied'
Updated after 5s: want 'copied' got 'copied'
PASS 60 (20s)

== sanity-hsm test 61: Waiting archive of a removed file should fail ========================================================== 23:14:18 (1787886858)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_61/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
PASS 61 (11s)

== sanity-hsm test 70: Copytool logs JSON register/unregister events to FIFO ========================================================== 23:14:29 (1787886869)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_70/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --event-fifo /tmp/sanity-hsm.test_70.lUHD/fifo "/mnt/lustre2"'
Killing existing copytools on oleg656-client.virtnet with signal TERM
copytools stopped in 0s
Register/Unregister events look OK.
PASS 70 (12s)

== sanity-hsm test 71: Copytool logs JSON archive events to FIFO ========================================================== 23:14:41 (1787886881)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_71/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --update-interval 5 --event-fifo /tmp/sanity-hsm.test_71.rH5T/fifo "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm.policy=-NRA
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.21694 s, 4.8 MB/s
Archive events look OK.
mdt.lustre-MDT0000.hsm.policy=-NRA
PASS 71 (22s)

== sanity-hsm test 72: Copytool logs JSON restore events to FIFO ========================================================== 23:15:03 (1787886903)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_72/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --update-interval 5 --event-fifo /tmp/sanity-hsm.test_72.TiPf/fifo "/mnt/lustre2"'
16+0 records in
16+0 records out
16000000 bytes (16 MB, 15 MiB) copied, 0.696991 s, 23.0 MB/s
lhsmtool_posix: 1787886908.909027 [80807]: action=1 src=d72.sanity-hsm/f72.sanity-hsm dst=/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787886908.922513 [80807]: importing '/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_72//d72.sanity-hsm/f72.sanity-hsm'
lhsmtool_posix: 1787886909.047129 [80807]: imported '/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_72//0bc8/0x200000bd2:0x1a:0x0'=='/tmp/arc1/sanity-hsm.test_72//d72.sanity-hsm/f72.sanity-hsm'
lhsmtool_posix: 1787886909.047205 [80807]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Verifying released state: 
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Restore events look OK.
PASS 72 (20s)

== sanity-hsm test 90: Archive/restore a file list ======= 23:15:23 (1787886923)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_90/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=purge
Waiting 200s for ''
Changed after 2s: from 'lrh=[type=10680000 len=136 idx=4/10013] fid=[0x200000402:0x2a5:0x0] dfid=[0x200000402:0x2a5:0x0] compound/cookie=0x0/0x6a91914b action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10014] fid=[0x200000402:0x2a6:0x0] dfid=[0x200000402:0x2a6:0x0] compound/cookie=0x0/0x6a91914c action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10015] fid=[0x200000402:0x2a7:0x0] dfid=[0x200000402:0x2a7:0x0] compound/cookie=0x0/0x6a91914d action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10016] fid=[0x200000402:0x2a8:0x0] dfid=[0x200000402:0x2a8:0x0] compound/cookie=0x0/0x6a91914e action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10017] fid=[0x200000402:0x2a9:0x0] dfid=[0x200000402:0x2a9:0x0] compound/cookie=0x0/0x6a91914f action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10018] fid=[0x200000402:0x2aa:0x0] dfid=[0x200000402:0x2aa:0x0] compound/cookie=0x0/0x6a919150 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10019] fid=[0x200000402:0x2ab:0x0] dfid=[0x200000402:0x2ab:0x0] compound/cookie=0x0/0x6a919151 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10020] fid=[0x200000402:0x2ac:0x0] dfid=[0x200000402:0x2ac:0x0] compound/cookie=0x0/0x6a919152 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10021] fid=[0x200000402:0x2ad:0x0] dfid=[0x200000402:0x2ad:0x0] compound/cookie=0x0/0x6a919153 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10022] fid=[0x200000402:0x2ae:0x0] dfid=[0x200000402:0x2ae:0x0] compound/cookie=0x0/0x6a919154 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10023] fid=[0x200000402:0x2af:0x0] dfid=[0x200000402:0x2af:0x0] compound/cookie=0x0/0x6a919155 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10024] fid=[0x200000402:0x2b0:0x0] dfid=[0x200000402:0x2b0:0x0] compound/cookie=0x0/0x6a919156 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10025] fid=[0x200000402:0x2b1:0x0] dfid=[0x200000402:0x2b1:0x0] compound/cookie=0x0/0x6a919157 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10026] fid=[0x200000402:0x2b2:0x0] dfid=[0x200000402:0x2b2:0x0] compound/cookie=0x0/0x6a919158 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10027] fid=[0x200000402:0x2b3:0x0] dfid=[0x200000402:0x2b3:0x0] compound/cookie=0x0/0x6a919159 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10028] fid=[0x200000402:0x2b4:0x0] dfid=[0x200000402:0x2b4:0x0] compound/cookie=0x0/0x6a91915a action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10029] fid=[0x200000402:0x2b5:0x0] dfid=[0x200000402:0x2b5:0x0] compound/cookie=0x0/0x6a91915b action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10030] fid=[0x200000402:0x2b6:0x0] dfid=[0x200000402:0x2b6:0x0] compound/cookie=0x0/0x6a91915c action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10031] fid=[0x200000402:0x2b7:0x0] dfid=[0x200000402:0x2b7:0x0] compound/cookie=0x0/0x6a91915d action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10032] fid=[0x200000402:0x2b8:0x0] dfid=[0x200000402:0x2b8:0x0] compound/cookie=0x0/0x6a91915e action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10033] fid=[0x200000402:0x2b9:0x0] dfid=[0x200000402:0x2b9:0x0] compound/cookie=0x0/0x6a91915f action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10034] fid=[0x200000402:0x2ba:0x0] dfid=[0x200000402:0x2ba:0x0] compound/cookie=0x0/0x6a919160 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10035] fid=[0x200000402:0x2bb:0x0] dfid=[0x200000402:0x2bb:0x0] compound/cookie=0x0/0x6a919161 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10036] fid=[0x200000402:0x2bc:0x0] dfid=[0x200000402:0x2bc:0x0] compound/cookie=0x0/0x6a919162 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10037] fid=[0x200000402:0x2bd:0x0] dfid=[0x200000402:0x2bd:0x0] compound/cookie=0x0/0x6a919163 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10038] fid=[0x200000402:0x2be:0x0] dfid=[0x200000402:0x2be:0x0] compound/cookie=0x0/0x6a919164 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10039] fid=[0x200000402:0x2bf:0x0] dfid=[0x200000402:0x2bf:0x0] compound/cookie=0x0/0x6a919165 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10040] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x6a919166 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10041] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x6a919167 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10042] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x6a919168 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10043] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x6a919169 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10044] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x6a91916a action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10045] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x6a91916b action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10046] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x6a91916c action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10047] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x6a91916d action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10048] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x6a91916e action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10049] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x6a91916f action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10050] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x6a919170 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10051] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a919171 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10052] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a919172 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10053] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a919173 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10054] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a919174 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10055] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a919175 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10056] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a919176 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10057] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a919177 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/10049] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x6a91916f action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10050] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x6a919170 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10051] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a919171 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10052] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a919172 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10053] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a919173 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10054] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a919174 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10055] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a919175 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10056] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a919176 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10057] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a919177 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]'
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
Waiting 200s for ''
Changed after 2s: from 'lrh=[type=10680000 len=136 idx=4/10058] fid=[0x200000402:0x29f:0x0] dfid=[0x200000402:0x29f:0x0] compound/cookie=0x0/0x6a919178 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10059] fid=[0x200000402:0x2a0:0x0] dfid=[0x200000402:0x2a0:0x0] compound/cookie=0x0/0x6a919179 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10060] fid=[0x200000402:0x2a1:0x0] dfid=[0x200000402:0x2a1:0x0] compound/cookie=0x0/0x6a91917a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10061] fid=[0x200000402:0x2a2:0x0] dfid=[0x200000402:0x2a2:0x0] compound/cookie=0x0/0x6a91917b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10062] fid=[0x200000402:0x2a3:0x0] dfid=[0x200000402:0x2a3:0x0] compound/cookie=0x0/0x6a91917c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10063] fid=[0x200000402:0x2a4:0x0] dfid=[0x200000402:0x2a4:0x0] compound/cookie=0x0/0x6a91917d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10064] fid=[0x200000402:0x2a5:0x0] dfid=[0x200000402:0x2a5:0x0] compound/cookie=0x0/0x6a91917e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10066] fid=[0x200000402:0x2a6:0x0] dfid=[0x200000402:0x2a6:0x0] compound/cookie=0x0/0x6a91917f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10067] fid=[0x200000402:0x2a7:0x0] dfid=[0x200000402:0x2a7:0x0] compound/cookie=0x0/0x6a919180 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10068] fid=[0x200000402:0x2a8:0x0] dfid=[0x200000402:0x2a8:0x0] compound/cookie=0x0/0x6a919181 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10069] fid=[0x200000402:0x2a9:0x0] dfid=[0x200000402:0x2a9:0x0] compound/cookie=0x0/0x6a919182 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10070] fid=[0x200000402:0x2aa:0x0] dfid=[0x200000402:0x2aa:0x0] compound/cookie=0x0/0x6a919183 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10071] fid=[0x200000402:0x2ab:0x0] dfid=[0x200000402:0x2ab:0x0] compound/cookie=0x0/0x6a919184 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10072] fid=[0x200000402:0x2ac:0x0] dfid=[0x200000402:0x2ac:0x0] compound/cookie=0x0/0x6a919185 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10073] fid=[0x200000402:0x2ad:0x0] dfid=[0x200000402:0x2ad:0x0] compound/cookie=0x0/0x6a919186 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10074] fid=[0x200000402:0x2ae:0x0] dfid=[0x200000402:0x2ae:0x0] compound/cookie=0x0/0x6a919187 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10075] fid=[0x200000402:0x2af:0x0] dfid=[0x200000402:0x2af:0x0] compound/cookie=0x0/0x6a919188 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10076] fid=[0x200000402:0x2b0:0x0] dfid=[0x200000402:0x2b0:0x0] compound/cookie=0x0/0x6a919189 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10077] fid=[0x200000402:0x2b1:0x0] dfid=[0x200000402:0x2b1:0x0] compound/cookie=0x0/0x6a91918a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10078] fid=[0x200000402:0x2b2:0x0] dfid=[0x200000402:0x2b2:0x0] compound/cookie=0x0/0x6a91918b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10079] fid=[0x200000402:0x2b3:0x0] dfid=[0x200000402:0x2b3:0x0] compound/cookie=0x0/0x6a91918c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10080] fid=[0x200000402:0x2b4:0x0] dfid=[0x200000402:0x2b4:0x0] compound/cookie=0x0/0x6a91918d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10081] fid=[0x200000402:0x2b5:0x0] dfid=[0x200000402:0x2b5:0x0] compound/cookie=0x0/0x6a91918e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10082] fid=[0x200000402:0x2b6:0x0] dfid=[0x200000402:0x2b6:0x0] compound/cookie=0x0/0x6a91918f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10083] fid=[0x200000402:0x2b7:0x0] dfid=[0x200000402:0x2b7:0x0] compound/cookie=0x0/0x6a919190 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10084] fid=[0x200000402:0x2b8:0x0] dfid=[0x200000402:0x2b8:0x0] compound/cookie=0x0/0x6a919191 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10085] fid=[0x200000402:0x2b9:0x0] dfid=[0x200000402:0x2b9:0x0] compound/cookie=0x0/0x6a919192 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10086] fid=[0x200000402:0x2ba:0x0] dfid=[0x200000402:0x2ba:0x0] compound/cookie=0x0/0x6a919193 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10087] fid=[0x200000402:0x2bb:0x0] dfid=[0x200000402:0x2bb:0x0] compound/cookie=0x0/0x6a919194 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10088] fid=[0x200000402:0x2bc:0x0] dfid=[0x200000402:0x2bc:0x0] compound/cookie=0x0/0x6a919195 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10089] fid=[0x200000402:0x2bd:0x0] dfid=[0x200000402:0x2bd:0x0] compound/cookie=0x0/0x6a919196 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10090] fid=[0x200000402:0x2be:0x0] dfid=[0x200000402:0x2be:0x0] compound/cookie=0x0/0x6a919197 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10091] fid=[0x200000402:0x2bf:0x0] dfid=[0x200000402:0x2bf:0x0] compound/cookie=0x0/0x6a919198 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10092] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x6a919199 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10093] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x6a91919a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x6a91919b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x6a91919c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x6a91919d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x6a91919e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x6a91919f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x6a9191a0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x6a9191a1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x6a9191a2 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x6a9191a3 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a9191a4 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a9191a5 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a9191a6 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a9191a7 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a9191a8 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a9191a9 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a9191aa action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/10068] fid=[0x200000402:0x2a8:0x0] dfid=[0x200000402:0x2a8:0x0] compound/cookie=0x0/0x6a919181 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10069] fid=[0x200000402:0x2a9:0x0] dfid=[0x200000402:0x2a9:0x0] compound/cookie=0x0/0x6a919182 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10071] fid=[0x200000402:0x2ab:0x0] dfid=[0x200000402:0x2ab:0x0] compound/cookie=0x0/0x6a919184 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10072] fid=[0x200000402:0x2ac:0x0] dfid=[0x200000402:0x2ac:0x0] compound/cookie=0x0/0x6a919185 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10073] fid=[0x200000402:0x2ad:0x0] dfid=[0x200000402:0x2ad:0x0] compound/cookie=0x0/0x6a919186 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10074] fid=[0x200000402:0x2ae:0x0] dfid=[0x200000402:0x2ae:0x0] compound/cookie=0x0/0x6a919187 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10075] fid=[0x200000402:0x2af:0x0] dfid=[0x200000402:0x2af:0x0] compound/cookie=0x0/0x6a919188 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10076] fid=[0x200000402:0x2b0:0x0] dfid=[0x200000402:0x2b0:0x0] compound/cookie=0x0/0x6a919189 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10077] fid=[0x200000402:0x2b1:0x0] dfid=[0x200000402:0x2b1:0x0] compound/cookie=0x0/0x6a91918a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10078] fid=[0x200000402:0x2b2:0x0] dfid=[0x200000402:0x2b2:0x0] compound/cookie=0x0/0x6a91918b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10079] fid=[0x200000402:0x2b3:0x0] dfid=[0x200000402:0x2b3:0x0] compound/cookie=0x0/0x6a91918c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10080] fid=[0x200000402:0x2b4:0x0] dfid=[0x200000402:0x2b4:0x0] compound/cookie=0x0/0x6a91918d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10081] fid=[0x200000402:0x2b5:0x0] dfid=[0x200000402:0x2b5:0x0] compound/cookie=0x0/0x6a91918e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10082] fid=[0x200000402:0x2b6:0x0] dfid=[0x200000402:0x2b6:0x0] compound/cookie=0x0/0x6a91918f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10083] fid=[0x200000402:0x2b7:0x0] dfid=[0x200000402:0x2b7:0x0] compound/cookie=0x0/0x6a919190 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10084] fid=[0x200000402:0x2b8:0x0] dfid=[0x200000402:0x2b8:0x0] compound/cookie=0x0/0x6a919191 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10085] fid=[0x200000402:0x2b9:0x0] dfid=[0x200000402:0x2b9:0x0] compound/cookie=0x0/0x6a919192 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10086] fid=[0x200000402:0x2ba:0x0] dfid=[0x200000402:0x2ba:0x0] compound/cookie=0x0/0x6a919193 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10087] fid=[0x200000402:0x2bb:0x0] dfid=[0x200000402:0x2bb:0x0] compound/cookie=0x0/0x6a919194 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10088] fid=[0x200000402:0x2bc:0x0] dfid=[0x200000402:0x2bc:0x0] compound/cookie=0x0/0x6a919195 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10089] fid=[0x200000402:0x2bd:0x0] dfid=[0x200000402:0x2bd:0x0] compound/cookie=0x0/0x6a919196 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10090] fid=[0x200000402:0x2be:0x0] dfid=[0x200000402:0x2be:0x0] compound/cookie=0x0/0x6a919197 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10091] fid=[0x200000402:0x2bf:0x0] dfid=[0x200000402:0x2bf:0x0] compound/cookie=0x0/0x6a919198 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10092] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x6a919199 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10093] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x6a91919a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x6a91919b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x6a91919c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x6a91919d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x6a91919e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x6a91919f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x6a9191a0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x6a9191a1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x6a9191a2 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x6a9191a3 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a9191a4 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a9191a5 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a9191a6 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a9191a7 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a9191a8 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a9191a9 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a9191aa action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]'
Changed after 4s: from 'lrh=[type=10680000 len=136 idx=4/10068] fid=[0x200000402:0x2a8:0x0] dfid=[0x200000402:0x2a8:0x0] compound/cookie=0x0/0x6a919181 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10069] fid=[0x200000402:0x2a9:0x0] dfid=[0x200000402:0x2a9:0x0] compound/cookie=0x0/0x6a919182 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10071] fid=[0x200000402:0x2ab:0x0] dfid=[0x200000402:0x2ab:0x0] compound/cookie=0x0/0x6a919184 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10072] fid=[0x200000402:0x2ac:0x0] dfid=[0x200000402:0x2ac:0x0] compound/cookie=0x0/0x6a919185 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10073] fid=[0x200000402:0x2ad:0x0] dfid=[0x200000402:0x2ad:0x0] compound/cookie=0x0/0x6a919186 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10074] fid=[0x200000402:0x2ae:0x0] dfid=[0x200000402:0x2ae:0x0] compound/cookie=0x0/0x6a919187 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10075] fid=[0x200000402:0x2af:0x0] dfid=[0x200000402:0x2af:0x0] compound/cookie=0x0/0x6a919188 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10076] fid=[0x200000402:0x2b0:0x0] dfid=[0x200000402:0x2b0:0x0] compound/cookie=0x0/0x6a919189 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10077] fid=[0x200000402:0x2b1:0x0] dfid=[0x200000402:0x2b1:0x0] compound/cookie=0x0/0x6a91918a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10078] fid=[0x200000402:0x2b2:0x0] dfid=[0x200000402:0x2b2:0x0] compound/cookie=0x0/0x6a91918b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10079] fid=[0x200000402:0x2b3:0x0] dfid=[0x200000402:0x2b3:0x0] compound/cookie=0x0/0x6a91918c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10080] fid=[0x200000402:0x2b4:0x0] dfid=[0x200000402:0x2b4:0x0] compound/cookie=0x0/0x6a91918d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10081] fid=[0x200000402:0x2b5:0x0] dfid=[0x200000402:0x2b5:0x0] compound/cookie=0x0/0x6a91918e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10082] fid=[0x200000402:0x2b6:0x0] dfid=[0x200000402:0x2b6:0x0] compound/cookie=0x0/0x6a91918f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10083] fid=[0x200000402:0x2b7:0x0] dfid=[0x200000402:0x2b7:0x0] compound/cookie=0x0/0x6a919190 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10084] fid=[0x200000402:0x2b8:0x0] dfid=[0x200000402:0x2b8:0x0] compound/cookie=0x0/0x6a919191 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10085] fid=[0x200000402:0x2b9:0x0] dfid=[0x200000402:0x2b9:0x0] compound/cookie=0x0/0x6a919192 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10086] fid=[0x200000402:0x2ba:0x0] dfid=[0x200000402:0x2ba:0x0] compound/cookie=0x0/0x6a919193 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10087] fid=[0x200000402:0x2bb:0x0] dfid=[0x200000402:0x2bb:0x0] compound/cookie=0x0/0x6a919194 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10088] fid=[0x200000402:0x2bc:0x0] dfid=[0x200000402:0x2bc:0x0] compound/cookie=0x0/0x6a919195 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10089] fid=[0x200000402:0x2bd:0x0] dfid=[0x200000402:0x2bd:0x0] compound/cookie=0x0/0x6a919196 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10090] fid=[0x200000402:0x2be:0x0] dfid=[0x200000402:0x2be:0x0] compound/cookie=0x0/0x6a919197 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10091] fid=[0x200000402:0x2bf:0x0] dfid=[0x200000402:0x2bf:0x0] compound/cookie=0x0/0x6a919198 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10092] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x6a919199 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10093] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x6a91919a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x6a91919b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x6a91919c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x6a91919d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x6a91919e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x6a91919f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x6a9191a0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x6a9191a1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x6a9191a2 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x6a9191a3 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a9191a4 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a9191a5 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a9191a6 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a9191a7 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a9191a8 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a9191a9 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a9191aa action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/10080] fid=[0x200000402:0x2b4:0x0] dfid=[0x200000402:0x2b4:0x0] compound/cookie=0x0/0x6a91918d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10081] fid=[0x200000402:0x2b5:0x0] dfid=[0x200000402:0x2b5:0x0] compound/cookie=0x0/0x6a91918e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10082] fid=[0x200000402:0x2b6:0x0] dfid=[0x200000402:0x2b6:0x0] compound/cookie=0x0/0x6a91918f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10083] fid=[0x200000402:0x2b7:0x0] dfid=[0x200000402:0x2b7:0x0] compound/cookie=0x0/0x6a919190 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10084] fid=[0x200000402:0x2b8:0x0] dfid=[0x200000402:0x2b8:0x0] compound/cookie=0x0/0x6a919191 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10085] fid=[0x200000402:0x2b9:0x0] dfid=[0x200000402:0x2b9:0x0] compound/cookie=0x0/0x6a919192 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10086] fid=[0x200000402:0x2ba:0x0] dfid=[0x200000402:0x2ba:0x0] compound/cookie=0x0/0x6a919193 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10087] fid=[0x200000402:0x2bb:0x0] dfid=[0x200000402:0x2bb:0x0] compound/cookie=0x0/0x6a919194 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10088] fid=[0x200000402:0x2bc:0x0] dfid=[0x200000402:0x2bc:0x0] compound/cookie=0x0/0x6a919195 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10089] fid=[0x200000402:0x2bd:0x0] dfid=[0x200000402:0x2bd:0x0] compound/cookie=0x0/0x6a919196 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10090] fid=[0x200000402:0x2be:0x0] dfid=[0x200000402:0x2be:0x0] compound/cookie=0x0/0x6a919197 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10091] fid=[0x200000402:0x2bf:0x0] dfid=[0x200000402:0x2bf:0x0] compound/cookie=0x0/0x6a919198 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10092] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x6a919199 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10093] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x6a91919a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x6a91919b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x6a91919c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x6a91919d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x6a91919e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x6a91919f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x6a9191a0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x6a9191a1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x6a9191a2 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x6a9191a3 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a9191a4 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a9191a5 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a9191a6 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a9191a7 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a9191a8 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a9191a9 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a9191aa action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]'
Changed after 6s: from 'lrh=[type=10680000 len=136 idx=4/10080] fid=[0x200000402:0x2b4:0x0] dfid=[0x200000402:0x2b4:0x0] compound/cookie=0x0/0x6a91918d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10081] fid=[0x200000402:0x2b5:0x0] dfid=[0x200000402:0x2b5:0x0] compound/cookie=0x0/0x6a91918e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10082] fid=[0x200000402:0x2b6:0x0] dfid=[0x200000402:0x2b6:0x0] compound/cookie=0x0/0x6a91918f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10083] fid=[0x200000402:0x2b7:0x0] dfid=[0x200000402:0x2b7:0x0] compound/cookie=0x0/0x6a919190 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10084] fid=[0x200000402:0x2b8:0x0] dfid=[0x200000402:0x2b8:0x0] compound/cookie=0x0/0x6a919191 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10085] fid=[0x200000402:0x2b9:0x0] dfid=[0x200000402:0x2b9:0x0] compound/cookie=0x0/0x6a919192 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10086] fid=[0x200000402:0x2ba:0x0] dfid=[0x200000402:0x2ba:0x0] compound/cookie=0x0/0x6a919193 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10087] fid=[0x200000402:0x2bb:0x0] dfid=[0x200000402:0x2bb:0x0] compound/cookie=0x0/0x6a919194 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10088] fid=[0x200000402:0x2bc:0x0] dfid=[0x200000402:0x2bc:0x0] compound/cookie=0x0/0x6a919195 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10089] fid=[0x200000402:0x2bd:0x0] dfid=[0x200000402:0x2bd:0x0] compound/cookie=0x0/0x6a919196 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10090] fid=[0x200000402:0x2be:0x0] dfid=[0x200000402:0x2be:0x0] compound/cookie=0x0/0x6a919197 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10091] fid=[0x200000402:0x2bf:0x0] dfid=[0x200000402:0x2bf:0x0] compound/cookie=0x0/0x6a919198 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10092] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x6a919199 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10093] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x6a91919a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x6a91919b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x6a91919c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x6a91919d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x6a91919e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x6a91919f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x6a9191a0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x6a9191a1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x6a9191a2 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x6a9191a3 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a9191a4 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a9191a5 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a9191a6 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a9191a7 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a9191a8 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a9191a9 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a9191aa action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/10092] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x6a919199 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10093] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x6a91919a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x6a91919b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x6a91919c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x6a91919d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x6a91919e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x6a91919f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x6a9191a0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x6a9191a1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x6a9191a2 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x6a9191a3 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a9191a4 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a9191a5 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a9191a6 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a9191a7 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a9191a8 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a9191a9 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a9191aa action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]'
Changed after 8s: from 'lrh=[type=10680000 len=136 idx=4/10092] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x6a919199 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10093] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x6a91919a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x6a91919b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x6a91919c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x6a91919d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x6a91919e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x6a91919f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x6a9191a0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x6a9191a1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x6a9191a2 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x6a9191a3 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a9191a4 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a9191a5 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a9191a6 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a9191a7 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a9191a8 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a9191a9 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a9191aa action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a9191a5 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a9191a6 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a9191a7 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a9191a8 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a9191a9 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a9191aa action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]'
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
PASS 90 (96s)

== sanity-hsm test 100: Set coordinator /proc tunables === 23:17:00 (1787887020)
Testing mdt.lustre-MDT0000.hsm.loop_period
Set loop_period to 0 must failed
oleg656-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/loop_period=0: Invalid argument
oleg656-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/loop_period'='0': Invalid argument
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 22
Testing mdt.lustre-MDT0000.hsm.grace_delay
Set grace_delay to 0 must failed
oleg656-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/grace_delay=0: Invalid argument
oleg656-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/grace_delay'='0': Invalid argument
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 22
Testing mdt.lustre-MDT0000.hsm.active_request_timeout
Set active_request_timeout to 0 must failed
oleg656-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/active_request_timeout=0: Invalid argument
oleg656-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/active_request_timeout'='0': Invalid argument
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 22
Testing mdt.lustre-MDT0000.hsm.max_requests
Set max_requests to 0 must failed
oleg656-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=0: Invalid argument
oleg656-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='0': Invalid argument
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 22
Testing mdt.lustre-MDT0000.hsm.default_archive_id
Set default_archive_id to 0 must failed
oleg656-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/default_archive_id=0: Invalid argument
oleg656-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/default_archive_id'='0': Invalid argument
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 22
PASS 100 (35s)

== sanity-hsm test 102: Verify coordinator control ======= 23:17:35 (1787887055)
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
PASS 102 (15s)

== sanity-hsm test 103: Purge all requests =============== 23:17:50 (1787887070)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_103/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=purge
Current requests
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
PASS 103 (14s)

== sanity-hsm test 103a: Purge pending restore requests == 23:18:04 (1787887084)
mdt.lustre-MDT0000.hsm.policy=-NBR
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_103a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
(0x200000402:0x319:0x0|0x200000402:0x31a:0x0|0x200000402:0x31b:0x0|0x200000402:0x31c:0x0|0x200000402:0x31d:0x0|0x200000402:0x31e:0x0|0x200000402:0x31f:0x0|0x200000402:0x320:0x0).*action=ARCHIVE.*status=SUCCEED
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
Killing existing copytools on oleg656-client.virtnet with signal TERM
copytools stopped in 0s
cat: '/mnt/lustre/.lustre/fid/0x200000402:0x319:0x0'cat: '/mnt/lustre/.lustre/fid/0x200000402:0x320:0x0': No data available
: No data available
cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31c:0x0'cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31d:0x0': No data available
: No data available
cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31b:0x0': No data available
cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31e:0x0'cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31a:0x0': No data available
: No data available
cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31f:0x0': No data available
mdt.lustre-MDT0000.hsm_control=purge
PASS 103a (18s)

== sanity-hsm test 104: Copy tool data field ============= 23:18:22 (1787887102)
0+0 records in
0+0 records out
0 bytes copied, 0.00911391 s, 0.0 kB/s
mdt.lustre-MDT0000.hsm_control=purge
PASS 104 (10s)

== sanity-hsm test 105: Restart of coordinator =========== 23:18:32 (1787887112)
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
mdt.lustre-MDT0000.hsm_control=purge
PASS 105 (26s)

== sanity-hsm test 106a: Copytool register/unregister ==== 23:18:58 (1787887138)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
oleg656-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg656-client.virtnet: executing get_client_uuid /mnt/lustre2
found agent uuid=adb42772-e4bd-42de-b82a-3d30610a8517 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1
oleg656-client.virtnet: 87086
Killing existing copytools on oleg656-client.virtnet with signal TERM
copytools stopped in 0s
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
uuid not found in agent list on mds1
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
oleg656-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg656-client.virtnet: executing get_client_uuid /mnt/lustre2
found agent uuid=adb42772-e4bd-42de-b82a-3d30610a8517 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1
PASS 106a (31s)

== sanity-hsm test 106b: Unregister agent after a copytool crash ========================================================== 23:19:30 (1787887170)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
oleg656-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg656-client.virtnet: executing get_client_uuid /mnt/lustre2
found agent uuid=adb42772-e4bd-42de-b82a-3d30610a8517 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1
oleg656-client.virtnet: 88777
Killing existing copytools on oleg656-client.virtnet with signal KILL
copytools stopped in 0s
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
uuid not found in agent list on mds1
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
found agent uuid=adb42772-e4bd-42de-b82a-3d30610a8517 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1
PASS 106b (20s)

== sanity-hsm test 106c: Unregister copytool on client eviction ========================================================== 23:19:50 (1787887190)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
oleg656-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg656-client.virtnet: executing get_client_uuid /mnt/lustre2
found agent uuid=adb42772-e4bd-42de-b82a-3d30610a8517 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1
oleg656-client.virtnet: 89971
oleg656-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg656-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool
oleg656-client.virtnet: executing get_client_uuid /mnt/lustre2
mdc.lustre-MDT0000-mdc-ffff9444529b0800.active=0
mdt.lustre-MDT0000.evict_client=adb42772-e4bd-42de-b82a-3d30610a8517
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
uuid not found in agent list on mds1
mdc.lustre-MDT0000-mdc-ffff9444529b0800.active=1
oleg656-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
found agent uuid=adb42772-e4bd-42de-b82a-3d30610a8517 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1
mdc.lustre-MDT0000-mdc-ffff9444529b0800.active=1
PASS 106c (47s)

== sanity-hsm test 107: Copytool re-register after MDS restart ========================================================== 23:20:37 (1787887237)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_107/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Failing mds1 on oleg656-server
Stopping /mnt/lustre-mds1 (opts:) on oleg656-server
23:20:45 (1787887245) shut down
facet: mds1 facet_host: oleg656-server facet_failover_host: oleg656-server
Failover mds1 to oleg656-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg656-server: oleg656-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
Started lustre-MDT0000
23:21:06 (1787887266) targets are mounted
23:21:06 (1787887266) facet_failover done
oleg656-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
PASS 107 (45s)

== sanity-hsm test 109: Policy display/change ============ 23:21:22 (1787887282)
mdt.lustre-MDT0000.hsm.policy=+NBR
mdt.lustre-MDT0000.hsm.policy=+NRA
mdt.lustre-MDT0000.hsm.policy=-NBR
mdt.lustre-MDT0000.hsm.policy=-NRA
mdt.lustre-MDT0000.hsm.policy=NRA NBR
Next set_param must failed
oleg656-server: error: set_param: setting /sys/kernel/debug/lustre/mdt/lustre-MDT0000/hsm/policy=wrong: Invalid argument
oleg656-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/policy'='wrong': Invalid argument
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 22
Back to default policy
mdt.lustre-MDT0000.hsm.policy=+NRA
mdt.lustre-MDT0000.hsm.policy=-NBR
PASS 109 (21s)

== sanity-hsm test 110a: Non blocking restore policy (import case) ========================================================== 23:21:44 (1787887304)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_110a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1787887306.607460 [94476]: action=1 src=d110a.sanity-hsm/f110a.sanity-hsm dst=/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787887306.621462 [94476]: importing '/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_110a//d110a.sanity-hsm/f110a.sanity-hsm'
lhsmtool_posix: 1787887306.715965 [94476]: imported '/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_110a//0bba/0x200000bd2:0x68:0x0'=='/tmp/arc1/sanity-hsm.test_110a//d110a.sanity-hsm/f110a.sanity-hsm'
lhsmtool_posix: 1787887306.716024 [94476]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
mdt.lustre-MDT0000.hsm.policy=+NBR
md5sum: /mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm: No data available
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
mdt.lustre-MDT0000.hsm.policy=-NBR
PASS 110a (11s)

== sanity-hsm test 110b: Non blocking restore policy (release case) ========================================================== 23:21:56 (1787887316)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_110b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm.policy=+NBR
md5sum: /mnt/lustre/d110b.sanity-hsm/f110b.sanity-hsm: No data available
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
mdt.lustre-MDT0000.hsm.policy=-NBR
PASS 110b (12s)

== sanity-hsm test 111a: No retry policy (import case), restore will error ========================================================== 23:22:07 (1787887327)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_111a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1787887330.128807 [95833]: action=1 src=d111a.sanity-hsm/f111a.sanity-hsm dst=/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787887330.140883 [95833]: importing '/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_111a//d111a.sanity-hsm/f111a.sanity-hsm'
lhsmtool_posix: 1787887330.201126 [95833]: imported '/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_111a//0bbf/0x200000bd2:0x6d:0x0'=='/tmp/arc1/sanity-hsm.test_111a//d111a.sanity-hsm/f111a.sanity-hsm'
lhsmtool_posix: 1787887330.201196 [95833]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
mdt.lustre-MDT0000.hsm.policy=+NRA
Remove from backend: 0x200000bd2:0x6d:0x0 = /tmp/arc1/sanity-hsm.test_111a/0bbf/0x200000bd2:0x6d:0x0
mdt.lustre-MDT0000.hsm.policy=-NRA
PASS 111a (11s)

== sanity-hsm test 111b: No retry policy (release case), restore will error ========================================================== 23:22:18 (1787887338)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_111b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm.policy=+NRA
Remove from backend: 0x200000bd3:0x7:0x0 = /tmp/arc1/sanity-hsm.test_111b/0bd4/0x200000bd3:0x7:0x0
mdt.lustre-MDT0000.hsm.policy=-NRA
PASS 111b (12s)

== sanity-hsm test 112: State of recorded request ======== 23:22:30 (1787887350)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_112/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=disabled
/mnt/lustre/d112.sanity-hsm/f112.sanity-hsm: ARCHIVE waiting (from 0 to EOF)
mdt.lustre-MDT0000.hsm_control=enabled
PASS 112 (12s)

== sanity-hsm test 113: wrong stat after restore ========= 23:22:42 (1787887362)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.088732 s, 11.8 MB/s
Starting client: oleg656-client.virtnet:  -o user_xattr,flock 192.168.206.156@tcp:/lustre /mnt/lustre3
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_113/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre3"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Verifying released state: 
multiop /mnt/lustre/d113.sanity-hsm/f113.sanity-hsm voO_WRONLY:O_APPEND:_w4c
TMPPIPE=/tmp/multiop_open_wait_pipe.7624
  File: /mnt/lustre2/d113.sanity-hsm/f113.sanity-hsm
  Size: 1048576   	Blocks: 1          IO Block: 4194304 regular file
Device: 2c54f966h/743766374d	Inode: 144115238860488715  Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2026-08-27 23:22:44.000000000 -0400
Modify: 2026-08-27 23:22:44.000000000 -0400
Change: 2026-08-27 23:22:44.000000000 -0400
 Birth: 2026-08-27 23:22:44.000000000 -0400
Stopping client oleg656-client.virtnet /mnt/lustre3 (opts:)
PASS 113 (16s)

== sanity-hsm test 114: Incompatible request does not set other requests as STARTED ========================================================== 23:22:58 (1787887378)
0+0 records in
0+0 records out
0 bytes copied, 0.00601515 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00431755 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_114/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
PASS 114 (15s)

== sanity-hsm test 200: Register/Cancel archive ========== 23:23:13 (1787887393)
0+0 records in
0+0 records out
0 bytes copied, 0.0175287 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_200/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Copytool is suspended on oleg656-client.virtnet
Copytool is continued on oleg656-client.virtnet
PASS 200 (11s)

== sanity-hsm test 201: Register/Cancel restore ========== 23:23:25 (1787887405)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_201/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
39+0 records in
39+0 records out
40894464 bytes (41 MB, 39 MiB) copied, 1.22585 s, 33.4 MB/s
lhsmtool_posix: 1787887408.721717 [100069]: action=1 src=d201.sanity-hsm/f201.sanity-hsm dst=/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787887408.729542 [100069]: importing '/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_201//d201.sanity-hsm/f201.sanity-hsm'
lhsmtool_posix: 1787887408.802606 [100069]: imported '/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_201//0ba5/0x200000bd2:0x77:0x0'=='/tmp/arc1/sanity-hsm.test_201//d201.sanity-hsm/f201.sanity-hsm'
lhsmtool_posix: 1787887408.809920 [100069]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
PASS 201 (16s)

== sanity-hsm test 202: Register/Cancel remove =========== 23:23:41 (1787887421)
0+0 records in
0+0 records out
0 bytes copied, 0.00490246 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_202/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Copytool is suspended on oleg656-client.virtnet
PASS 202 (10s)

== sanity-hsm test 220A: Changelog for archive =========== 23:23:52 (1787887432)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_220A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl1'
lustre-MDT0000.3 16HSM   03:23:58.020657521 2026.08.28 0x0 t=[0x200000bd3:0x14:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000: clear the changelog for cl1 of all records
lustre-MDT0000: Deregistered changelog user #1
PASS 220A (14s)

== sanity-hsm test 220a: Changelog for failed archive ==== 23:24:07 (1787887447)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_220a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl2'
Copytool is suspended on oleg656-client.virtnet
Copytool is continued on oleg656-client.virtnet
lustre-MDT0000.6 16HSM   03:24:12.934310650 2026.08.28 0x2 t=[0x200000bd3:0x15:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000: clear the changelog for cl2 of all records
lustre-MDT0000: Deregistered changelog user #2
PASS 220a (16s)

== sanity-hsm test 221: Changelog for archive canceled === 23:24:23 (1787887463)
0+0 records in
0+0 records out
0 bytes copied, 0.00427618 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_221/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl3'
Copytool is suspended on oleg656-client.virtnet
Waiting 200s for 'CANCELED'
Updated after 2s: want 'CANCELED' got 'CANCELED'
Copytool is continued on oleg656-client.virtnet
lustre-MDT0000.8 16HSM   03:24:33.727813375 2026.08.28 0x7d t=[0x200000bd3:0x17:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000: clear the changelog for cl3 of all records
lustre-MDT0000: Deregistered changelog user #3
PASS 221 (20s)

== sanity-hsm test 222a: Changelog for explicit restore == 23:24:43 (1787887483)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1787887486.978468 [103633]: action=1 src=d222a.sanity-hsm/f222a.sanity-hsm dst=/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787887486.995154 [103633]: importing '/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222a//d222a.sanity-hsm/f222a.sanity-hsm'
lhsmtool_posix: 1787887487.053989 [103633]: imported '/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222a//0bac/0x200000bd2:0x7e:0x0'=='/tmp/arc1/sanity-hsm.test_222a//d222a.sanity-hsm/f222a.sanity-hsm'
lhsmtool_posix: 1787887487.062632 [103633]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl4'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
lustre-MDT0000.11 16HSM   03:24:51.466930073 2026.08.28 0x80 t=[0x200000bd2:0x7e:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000: clear the changelog for cl4 of all records
lustre-MDT0000: Deregistered changelog user #4
PASS 222a (19s)

== sanity-hsm test 222b: Changelog for implicit restore == 23:25:02 (1787887502)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl5'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
4ef076ad20e5d4a2f4729d6ed41a3bf9  /mnt/lustre/d222b.sanity-hsm/f222b.sanity-hsm
lustre-MDT0000.20 16HSM   03:25:10.391296917 2026.08.28 0x80 t=[0x200000bd3:0x19:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000: clear the changelog for cl5 of all records
lustre-MDT0000: Deregistered changelog user #5
PASS 222b (18s)

== sanity-hsm test 222c: Changelog for failed explicit restore ========================================================== 23:25:20 (1787887520)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lhsmtool_posix: 1787887522.693755 [105123]: action=1 src=d222c.sanity-hsm/f222c.sanity-hsm dst=/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787887522.717648 [105123]: importing '/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222c//d222c.sanity-hsm/f222c.sanity-hsm'
lhsmtool_posix: 1787887522.790569 [105123]: imported '/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222c//0b51/0x200000bd2:0x83:0x0'=='/tmp/arc1/sanity-hsm.test_222c//d222c.sanity-hsm/f222c.sanity-hsm'
lhsmtool_posix: 1787887522.790621 [105123]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl6'
Copytool is suspended on oleg656-client.virtnet
Waiting 200s for 'STARTED'
Copytool is continued on oleg656-client.virtnet
lustre-MDT0000.22 16HSM   03:25:28.767221943 2026.08.28 0x82 t=[0x200000bd2:0x83:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0000: Deregistered changelog user #6
PASS 222c (18s)

== sanity-hsm test 222d: Changelog for failed implicit restore ========================================================== 23:25:38 (1787887538)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl7'
Remove from backend: 0x200000bd3:0x1b:0x0 = /tmp/arc1/sanity-hsm.test_222d/0bc8/0x200000bd3:0x1b:0x0
md5sum: /mnt/lustre/d222d.sanity-hsm/f222d.sanity-hsm: No data available
lustre-MDT0000.29 16HSM   03:25:46.543074006 2026.08.28 0x82 t=[0x200000bd3:0x1b:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000: clear the changelog for cl7 of all records
lustre-MDT0000: Deregistered changelog user #7
PASS 222d (20s)

== sanity-hsm test 223a: Changelog for restore canceled (import case) ========================================================== 23:25:58 (1787887558)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_223a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
39+0 records in
39+0 records out
40894464 bytes (41 MB, 39 MiB) copied, 1.14473 s, 35.7 MB/s
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl8'
lhsmtool_posix: 1787887565.524623 [106688]: action=1 src=d223a.sanity-hsm/f223a.sanity-hsm dst=/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm mount_point=/mnt/lustre2
lhsmtool_posix: 1787887565.554282 [106688]: importing '/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_223a//d223a.sanity-hsm/f223a.sanity-hsm'
lhsmtool_posix: 1787887565.615479 [106688]: imported '/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_223a//0b5a/0x200000bd2:0x88:0x0'=='/tmp/arc1/sanity-hsm.test_223a//d223a.sanity-hsm/f223a.sanity-hsm'
lhsmtool_posix: 1787887565.615885 [106688]: process finished, errs: 0 major, 0 minor, rc=0 (Success)
Waiting 200s for 'SUCCEED'
Waiting 190s for 'SUCCEED'
Waiting 180s for 'SUCCEED'
Updated after 29s: want 'SUCCEED' got 'SUCCEED'
lustre-MDT0000.36 16HSM   03:26:36.319308997 2026.08.28 0xfd t=[0x200000bd2:0x88:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000: clear the changelog for cl8 of all records
lustre-MDT0000: Deregistered changelog user #8
PASS 223a (47s)

== sanity-hsm test 223b: Changelog for restore canceled (release case) ========================================================== 23:26:45 (1787887605)
0+0 records in
0+0 records out
0 bytes copied, 0.00879359 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_223b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl9'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Copytool is suspended on oleg656-client.virtnet
Copytool is continued on oleg656-client.virtnet
lustre-MDT0000.43 16HSM   03:26:55.859488754 2026.08.28 0xfd t=[0x200000bd3:0x1f:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp p=[0x200000bd2:0x86:0x0]
lustre-MDT0000: clear the changelog for cl9 of all records
lustre-MDT0000: Deregistered changelog user #9
PASS 223b (19s)

== sanity-hsm test 224A: Changelog for remove ============ 23:27:04 (1787887624)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_224A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl10'
lustre-MDT0000.48 16HSM   03:27:11.488726031 2026.08.28 0x200 t=[0x200000bd3:0x21:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp p=[0x200000bd2:0x81:0x0]
lustre-MDT0000: clear the changelog for cl10 of all records
lustre-MDT0000: Deregistered changelog user #10
PASS 224A (16s)

== sanity-hsm test 224a: Changelog for failed remove ===== 23:27:20 (1787887640)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_224a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl11'
Waiting 200s for 'SUCCEED'
Remove from backend: 0x200000bd3:0x22:0x0 = /tmp/arc1/sanity-hsm.test_224a/0bf1/0x200000bd3:0x22:0x0
Copytool is suspended on oleg656-client.virtnet
Waiting 200s for 'STARTED'
Updated after 2s: want 'STARTED' got 'STARTED'
Copytool is continued on oleg656-client.virtnet
lustre-MDT0000.53 16HSM   03:27:31.145127467 2026.08.28 0x202 t=[0x200000bd3:0x22:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp p=[0x200000bd2:0x8c:0x0]
lustre-MDT0000: clear the changelog for cl11 of all records
lustre-MDT0000: Deregistered changelog user #11
PASS 224a (20s)

== sanity-hsm test 225: Changelog for remove canceled ==== 23:27:40 (1787887660)
Test disabled
PASS 225 (6s)

== sanity-hsm test 226: changelog for last rm/mv with exiting archive ========================================================== 23:27:46 (1787887666)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_226/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
0x200000bd3:0x25:0x0
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl12'
Waiting 200s for 'SUCCEED'
lustre-MDT0000.54 16HSM   03:27:51.641552169 2026.08.28 0x280 t=[0x200000bd3:0x23:0x0] ef=0x13 u=0:0 nid=0@<0:0>
lustre-MDT0000.55 16HSM   03:27:51.789192113 2026.08.28 0x280 t=[0x200000bd3:0x23:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000.56 16HSM   03:27:51.790401701 2026.08.28 0x0 t=[0x200000bd3:0x23:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000.57 16HSM   03:27:53.820055646 2026.08.28 0x280 t=[0x200000bd3:0x24:0x0] ef=0x13 u=0:0 nid=0@<0:0>
lustre-MDT0000.58 16HSM   03:27:53.973711307 2026.08.28 0x280 t=[0x200000bd3:0x24:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000.59 16HSM   03:27:53.974050095 2026.08.28 0x0 t=[0x200000bd3:0x24:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000.60 06UNLNK 03:27:54.363745412 2026.08.28 0x3 t=[0x200000bd3:0x23:0x0] j=rm.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp p=[0x200000bd2:0x8d:0x0] f226.sanity-hsm-1
lustre-MDT0000.60 06UNLNK 03:27:54.363745412 2026.08.28 0x3 t=[0x200000bd3:0x23:0x0] j=rm.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp p=[0x200000bd2:0x8d:0x0] f226.sanity-hsm-1
lustre-MDT0000.61 08RENME 03:27:54.960931434 2026.08.28 0x3 t=[0x200000bd3:0x24:0x0] j=mv.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp p=[0x200000bd2:0x8d:0x0] f226.sanity-hsm-2 s=[0x200000bd3:0x25:0x0] sp=[0x200000bd2:0x8d:0x0] f226.sanity-hsm-3
lustre-MDT0000: clear the changelog for cl12 of all records
lustre-MDT0000: Deregistered changelog user #12
PASS 226 (16s)

== sanity-hsm test 227: changelog when explicit setting of HSM flags ========================================================== 23:28:03 (1787887683)
0+0 records in
0+0 records out
0 bytes copied, 0.00850218 s, 0.0 kB/s
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl13'
lustre-MDT0000: clear the changelog for cl13 of all records
lustre-MDT0000: Deregistered changelog user #13
PASS 227 (14s)

== sanity-hsm test 228: On released file, return extend to FIEMAP. For [cp,tar] --sparse ========================================================== 23:28:17 (1787887697)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_228/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0596574 s, 17.6 MB/s
/mnt/lustre/f228.sanity-hsm: 1 extent found
tar: Removing leading `/' from member names
mnt/lustre/f228.sanity-hsm
PASS 228 (12s)

== sanity-hsm test 250: Coordinator max request ========== 23:28:29 (1787887709)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_250/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
0+0 records in
0+0 records out
0 bytes copied, 0.00690153 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.0072361 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00614476 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00507403 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00888165 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.00581843 s, 0.0 kB/s
Copytool is suspended on oleg656-client.virtnet
Copytool is continued on oleg656-client.virtnet
PASS 250 (24s)

== sanity-hsm test 251: Coordinator request timeout ====== 23:28:54 (1787887734)
0+0 records in
0+0 records out
0 bytes copied, 0.00443683 s, 0.0 kB/s
mdt.lustre-MDT0000.hsm_control=disabled
mdt.lustre-MDT0000.hsm_control=enabled
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_251/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Copytool is suspended on oleg656-client.virtnet
Waiting 200s for 'STARTED'
Updated after 4s: want 'STARTED' got 'STARTED'
PASS 251 (21s)

== sanity-hsm test 252: Timeout'ed running archive of a removed file should be canceled ========================================================== 23:29:16 (1787887756)
0+0 records in
0+0 records out
0 bytes copied, 0.00675145 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_252/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Copytool is suspended on oleg656-client.virtnet
Copytool is continued on oleg656-client.virtnet
PASS 252 (17s)

== sanity-hsm test 253: Check for wrong file size after release ========================================================== 23:29:33 (1787887773)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_253/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
10+0 records in
10+0 records out
10000000 bytes (10 MB, 9.5 MiB) copied, 0.346876 s, 28.8 MB/s
fail_loc=0x807
Cannot send HSM request (use of /mnt/lustre/d253.sanity-hsm/f253.sanity-hsm): Invalid argument
could not release file
PASS 253 (10s)

== sanity-hsm test 254a: Request counters are initialized to zero ========================================================== 23:29:43 (1787887783)
PASS 254a (11s)

== sanity-hsm test 254b: Request counters are correctly incremented and decremented ========================================================== 23:29:54 (1787887794)
Will launch 41 requests of each type
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_254b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Checking archive requests
Copytool is suspended on oleg656-client.virtnet
Waiting 90s for '41'
Updated after 2s: want '41' got '41'
Copytool is continued on oleg656-client.virtnet
Checking restore requests
Copytool is suspended on oleg656-client.virtnet
Copytool is continued on oleg656-client.virtnet
Waiting 90s for '0'
Updated after 2s: want '0' got '0'
Checking remove requests
Copytool is suspended on oleg656-client.virtnet
Copytool is continued on oleg656-client.virtnet
PASS 254b (33s)

== sanity-hsm test 255: Copytool registration wakes the coordinator up ========================================================== 23:30:27 (1787887827)
0+0 records in
0+0 records out
0 bytes copied, 0.0120378 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_255/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Killing existing copytools on oleg656-client.virtnet with signal TERM
copytools stopped in 1s
0+0 records in
0+0 records out
0 bytes copied, 0.00369951 s, 0.0 kB/s
0x200000bd3:0x8d:0x0
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_255/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 255 (21s)

== sanity-hsm test 256: HSM copytool register on DNE with stopped MDT must not panic ========================================================== 23:30:48 (1787887848)

 SKIP: sanity-hsm test_256 needs DNE (>= 2 MDTs)
SKIP 256 (3s)

== sanity-hsm test 260a: Restore request have priority over other requests ========================================================== 23:30:52 (1787887852)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.215834 s, 4.9 MB/s
0x200000bd3:0x8f:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.227328 s, 4.6 MB/s
0x200000bd3:0x90:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.220503 s, 4.8 MB/s
0x200000bd3:0x91:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.200882 s, 5.2 MB/s
0x200000bd3:0x92:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.245324 s, 4.3 MB/s
0x200000bd3:0x93:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.221701 s, 4.7 MB/s
0x200000bd3:0x94:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.196943 s, 5.3 MB/s
0x200000bd3:0x95:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.188514 s, 5.6 MB/s
0x200000bd3:0x96:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.274356 s, 3.8 MB/s
0x200000bd3:0x97:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.231609 s, 4.5 MB/s
0x200000bd3:0x98:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.217214 s, 4.8 MB/s
0x200000bd3:0x99:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.276012 s, 3.8 MB/s
0x200000bd3:0x9a:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.196141 s, 5.3 MB/s
0x200000bd3:0x9b:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.181827 s, 5.8 MB/s
0x200000bd3:0x9c:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.225968 s, 4.6 MB/s
0x200000bd3:0x9d:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.242959 s, 4.3 MB/s
0x200000bd3:0x9e:0x0
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Killing existing copytools on oleg656-client.virtnet with signal TERM
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
ARCHIVE
ARCHIVE
RESTORE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
PASS 260a (35s)

== sanity-hsm test 260b: Restore request have priority over other requests ========================================================== 23:31:28 (1787887888)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.219185 s, 4.8 MB/s
0x200000bd3:0xa1:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.199265 s, 5.3 MB/s
0x200000bd3:0xa2:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.26708 s, 3.9 MB/s
0x200000bd3:0xa3:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.215491 s, 4.9 MB/s
0x200000bd3:0xa4:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.252826 s, 4.1 MB/s
0x200000bd3:0xa5:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120499 s, 8.7 MB/s
0x200000bd3:0xa6:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.204277 s, 5.1 MB/s
0x200000bd3:0xa7:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.187179 s, 5.6 MB/s
0x200000bd3:0xa8:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.159116 s, 6.6 MB/s
0x200000bd3:0xa9:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.190217 s, 5.5 MB/s
0x200000bd3:0xaa:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.226013 s, 4.6 MB/s
0x200000bd3:0xab:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.16514 s, 6.3 MB/s
0x200000bd3:0xac:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.214746 s, 4.9 MB/s
0x200000bd3:0xad:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.297032 s, 3.5 MB/s
0x200000bd3:0xae:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.221591 s, 4.7 MB/s
0x200000bd3:0xaf:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.23378 s, 4.5 MB/s
0x200000bd3:0xb0:0x0
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Killing existing copytools on oleg656-client.virtnet with signal TERM
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
RESTORE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
PASS 260b (38s)

== sanity-hsm test 260c: Requests are not reordered on the 'hot' path of the coordinator ========================================================== 23:32:06 (1787887926)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.198006 s, 5.3 MB/s
0x200000bd3:0xb3:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.245121 s, 4.3 MB/s
0x200000bd3:0xb4:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.196182 s, 5.3 MB/s
0x200000bd3:0xb5:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.264893 s, 4.0 MB/s
0x200000bd3:0xb6:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151339 s, 6.9 MB/s
0x200000bd3:0xb7:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.228022 s, 4.6 MB/s
0x200000bd3:0xb8:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.28881 s, 3.6 MB/s
0x200000bd3:0xb9:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.255911 s, 4.1 MB/s
0x200000bd3:0xba:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.145282 s, 7.2 MB/s
0x200000bd3:0xbb:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.181061 s, 5.8 MB/s
0x200000bd3:0xbc:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.153371 s, 6.8 MB/s
0x200000bd3:0xbd:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.165293 s, 6.3 MB/s
0x200000bd3:0xbe:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.194671 s, 5.4 MB/s
0x200000bd3:0xbf:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.182163 s, 5.8 MB/s
0x200000bd3:0xc0:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.165296 s, 6.3 MB/s
0x200000bd3:0xc1:0x0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.231699 s, 4.5 MB/s
0x200000bd3:0xc2:0x0
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre2"'
Killing existing copytools on oleg656-client.virtnet with signal TERM
copytools stopped in 0s
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
ARCHIVE
RESTORE
PASS 260c (41s)

== sanity-hsm test 261: Report 0 bytes size after HSM release ========================================================== 23:32:47 (1787887967)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_261/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
2+0 records in
2+0 records out
8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0147078 s, 557 kB/s
/mnt/lustre/d261.sanity-hsm/f261.sanity-hsm: (0x00000009) exists archived, archive_id:2
/mnt/lustre/d261.sanity-hsm/f261.sanity-hsm: (0x0000000d) released exists archived, archive_id:2
PASS 261 (10s)

== sanity-hsm test 262: The client should return 1 block for HSM released files ========================================================== 23:32:57 (1787887977)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_262/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
2+0 records in
2+0 records out
8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0120337 s, 681 kB/s
PASS 262 (9s)

== sanity-hsm test 300: On disk coordinator state kept between MDT umount/mount ========================================================== 23:33:06 (1787887986)
Stop coordinator and remove coordinator state at mount
mdt.lustre-MDT0000.hsm_control=shutdown
Failing mds1 on oleg656-server
Stopping /mnt/lustre-mds1 (opts:) on oleg656-server
23:33:17 (1787887997) shut down
facet: mds1 facet_host: oleg656-server facet_failover_host: oleg656-server
Failover mds1 to oleg656-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg656-server: oleg656-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
Started lustre-MDT0000
23:33:51 (1787888031) targets are mounted
23:33:52 (1787888032) facet_failover done
oleg656-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
Set coordinator start at mount, and start coordinator
Failing mds1 on oleg656-server
Stopping /mnt/lustre-mds1 (opts:) on oleg656-server
23:34:32 (1787888072) shut down
facet: mds1 facet_host: oleg656-server facet_failover_host: oleg656-server
Failover mds1 to oleg656-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg656-server: oleg656-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
Started lustre-MDT0000
23:34:54 (1787888094) targets are mounted
23:34:54 (1787888094) facet_failover done
oleg656-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
PASS 300 (124s)

== sanity-hsm test 301: HSM tunnable are persistent ====== 23:35:10 (1787888110)
Failing mds1 on oleg656-server
Stopping /mnt/lustre-mds1 (opts:) on oleg656-server
23:35:19 (1787888119) shut down
facet: mds1 facet_host: oleg656-server facet_failover_host: oleg656-server
Failover mds1 to oleg656-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg656-server: oleg656-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
Started lustre-MDT0000
23:35:51 (1787888151) targets are mounted
23:35:51 (1787888151) facet_failover done
oleg656-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
PASS 301 (60s)

== sanity-hsm test 302: HSM tunnable are persistent when CDT is off ========================================================== 23:36:11 (1787888171)
mdt.lustre-MDT0000.hsm_control=shutdown
Failing mds1 on oleg656-server
Stopping /mnt/lustre-mds1 (opts:) on oleg656-server
23:36:20 (1787888180) shut down
facet: mds1 facet_host: oleg656-server facet_failover_host: oleg656-server
Failover mds1 to oleg656-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg656-server: oleg656-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
Started lustre-MDT0000
23:36:44 (1787888204) targets are mounted
23:36:44 (1787888204) facet_failover done
oleg656-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
PASS 302 (54s)

== sanity-hsm test 400: Single request is sent to the right MDT ========================================================== 23:37:04 (1787888224)

 SKIP: sanity-hsm test_400 needs >= 2 MDTs
SKIP 400 (2s)

== sanity-hsm test 401: Compound requests split and sent to their respective MDTs ========================================================== 23:37:06 (1787888226)

 SKIP: sanity-hsm test_401 needs >= 2 MDTs
SKIP 401 (4s)

== sanity-hsm test 402a: Copytool start fails if all MDTs are inactive ========================================================== 23:37:10 (1787888230)
deactivate lustre-MDT0000-mdc-ffff94444414f000 on oleg656-client.virtnet
deactivate lustre-MDT0000-mdc-ffff9444529b0800 on oleg656-client.virtnet
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_402a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Failed to start copytool agt1 on 'oleg656-client.virtnet'
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
uuid not found in agent list on mds1
activate lustre-MDT0000-mdc-ffff94444414f000 on oleg656-client.virtnet
activate lustre-MDT0000-mdc-ffff9444529b0800 on oleg656-client.virtnet
PASS 402a (9s)

== sanity-hsm test 402b: CDT must retry request upon slow start of CT ========================================================== 23:37:19 (1787888239)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_402b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
fail_loc=0x14d
fail_loc=0
Waiting 200s for 'SUCCEED'
Updated after 6s: want 'SUCCEED' got 'SUCCEED'
PASS 402b (27s)

== sanity-hsm test 403: Copytool starts with inactive MDT and register on reconnect ========================================================== 23:37:46 (1787888266)

 SKIP: sanity-hsm test_403 needs >= 2 MDTs
SKIP 403 (3s)

== sanity-hsm test 404: Inactive MDT does not block requests for active MDTs ========================================================== 23:37:49 (1787888269)

 SKIP: sanity-hsm test_404 needs >= 2 MDTs
SKIP 404 (3s)

== sanity-hsm test 405: archive and release under striped directory ========================================================== 23:37:52 (1787888272)

 SKIP: sanity-hsm test_405 needs >= 2 MDTs
SKIP 405 (4s)

== sanity-hsm test 406: attempting to migrate HSM archived files is safe ========================================================== 23:37:56 (1787888276)

 SKIP: sanity-hsm test_406 needs >= 2 MDTs
SKIP 406 (3s)

== sanity-hsm test 407: Check for double RESTORE records in llog ========================================================== 23:37:59 (1787888279)
0+0 records in
0+0 records out
0 bytes copied, 0.010364 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_407/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
fail_val=5
fail_loc=0x164
Copytool is suspended on oleg656-client.virtnet
mdt.lustre-MDT0000.hsm.actions=
lrh=[type=10680000 len=136 idx=6/1] fid=[0x2000032e1:0x2:0x0] dfid=[0x2000032e1:0x2:0x0] compound/cookie=0x0/0x6a910247 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/2] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x6a910248 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
Failing mds1 on oleg656-server
Stopping /mnt/lustre-mds1 (opts:) on oleg656-server
23:38:11 (1787888291) shut down
facet: mds1 facet_host: oleg656-server facet_failover_host: oleg656-server
Failover mds1 to oleg656-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
mdt.lustre-MDT0000.hsm.actions=
lrh=[type=10680000 len=136 idx=6/1] fid=[0x2000032e1:0x2:0x0] dfid=[0x2000032e1:0x2:0x0] compound/cookie=0x0/0x6a910247 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/2] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x6a910248 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/3] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x6a910249 action=RESTORE archive#=2 flags=0x4 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]
oleg656-server: oleg656-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
Started lustre-MDT0000
23:38:42 (1787888322) targets are mounted
23:38:42 (1787888322) facet_failover done
oleg656-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
fail_loc=0
mdt.lustre-MDT0000.hsm.actions=
lrh=[type=10680000 len=136 idx=6/2] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x6a910248 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[]
lrh=[type=10680000 len=136 idx=6/3] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x6a910249 action=RESTORE archive#=2 flags=0x4 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]
Copytool is continued on oleg656-client.virtnet
d41d8cd98f00b204e9800998ecf8427e  /mnt/lustre/d407.sanity-hsm/f407.sanity-hsm
d41d8cd98f00b204e9800998ecf8427e  /mnt/lustre2/d407.sanity-hsm/f407.sanity-hsm
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
PASS 407 (65s)

== sanity-hsm test 408: Verify fiemap on release file ==== 23:39:04 (1787888344)
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_408/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
1+0 records in
1+0 records out
65536 bytes (66 kB, 64 KiB) copied, 0.178663 s, 367 kB/s

 SKIP: sanity-hsm test_408 ORI-366/LU-1941: FIEMAP unimplemented on ZFS
SKIP 408 (4s)

== sanity-hsm test 409a: Coordinator should not stop when in use ========================================================== 23:39:08 (1787888348)
0+0 records in
0+0 records out
0 bytes copied, 0.00478783 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
fail_val=5
fail_loc=0x164
cat: /mnt/lustre/d409a.sanity-hsm/f409a.sanity-hsm: No data available
mdt.lustre-MDT0000.hsm_control=shutdown
mdt.lustre-MDT0000.hsm_control=enabled
Killing existing copytools on oleg656-client.virtnet with signal TERM
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
mdt.lustre-MDT0000.hsm_control=enabled
PASS 409a (23s)

== sanity-hsm test 409b: getattr released file with CDT stopped after remount ========================================================== 23:39:32 (1787888372)
0+0 records in
0+0 records out
0 bytes copied, 0.00647582 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Killing existing copytools on oleg656-client.virtnet with signal TERM
copytools stopped in 0s
Failing mds1 on oleg656-server
Stopping /mnt/lustre-mds1 (opts:) on oleg656-server
23:40:04 (1787888404) shut down
facet: mds1 facet_host: oleg656-server facet_failover_host: oleg656-server
Failover mds1 to oleg656-server
mount facets: mds1
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg656-server: oleg656-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
Started lustre-MDT0000
23:40:27 (1787888427) targets are mounted
23:40:27 (1787888427) facet_failover done
oleg656-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
  File: /mnt/lustre/d409b.sanity-hsm/f409b.sanity-hsm
  Size: 0         	Blocks: 0          IO Block: 4194304 regular empty file
Device: 2c54f966h/743766374d	Inode: 144115406615871496  Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2026-08-27 23:39:33.000000000 -0400
Modify: 2026-08-27 23:39:33.000000000 -0400
Change: 2026-08-27 23:39:33.000000000 -0400
 Birth: 2026-08-27 23:39:33.000000000 -0400
PASS 409b (97s)

== sanity-hsm test 410: lfs data_version -s allows release of force-archived file ========================================================== 23:41:09 (1787888469)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.305938 s, 3.4 MB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_410/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Cannot send HSM request (use of /mnt/lustre/d410.sanity-hsm/f410.sanity-hsm): Operation not permitted
PASS 410 (8s)

== sanity-hsm test 411: hsm_ops rbac role ================ 23:41:17 (1787888477)
On MGS 192.168.206.156, active = nodemap.active=1
On MGS 192.168.206.156, test_411.trusted_nodemap = nodemap.test_411.trusted_nodemap=1
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_411/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
/mnt/lustre/d411.sanity-hsm/fileA: (0x00000000)
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Killing existing copytools on oleg656-client.virtnet with signal TERM
copytools stopped in 0s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_411/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
On MGS 192.168.206.156, test_411.rbac = nodemap.test_411.rbac=file_perms,dne_ops,quota_ops,byfid_ops,chlg_ops,fscrypt_admin,server_upcall,ignore_root_prjquota,immutable_flags,local_admin,pool_quota_ops,lqa_quota_ops,projid_set,foreign_ops
/mnt/lustre/d411.sanity-hsm/fileB: (0x00000000)
Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied
Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Operation not permitted
Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied
Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied
lfs hsm_set: change hsm flags for '/mnt/lustre/d411.sanity-hsm/fileB' failed: Permission denied
lfs hsm_clear: change hsm flags for '/mnt/lustre/d411.sanity-hsm/fileB' failed: Permission denied
On MGS 192.168.206.156, active = nodemap.active=0
oleg656-server: error: nodemap 'test_411' does not exist
oleg656-server: nodemap_del: Invalid argument
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
On MGS 192.168.206.156, active = nodemap.active=0
PASS 411 (41s)

== sanity-hsm test 500: various LLAPI HSM tests ========== 23:41:59 (1787888519)
 test1 @1787888577: Register/unregister copytool 2000x to check for leaks ...... pass
 test2 @1787888577: Re/un-register copytool multiple times without error ....... pass
llapi_hsm_test: NULL archive numbers
llapi_hsm_test: NULL archive numbers
llapi_hsm_test: -1 requested when archive id >= 0 is supported
 test3 @1787888577: Pass bad parameters to llapi_hsm_copytool_register() ....... pass
 test4 @1787888577: Bad parameters to llapi_hsm_copytool_unregister() .......... pass
 test5 @1787888577: Test llapi_hsm_copytool_recv() in non-blocking mode ........ pass
 test6 @1787888577: Test llapi_hsm_copytool_recv() with bogus parameters ....... pass
 test7 @1787888577: Test event polling (without actual traffic) ................ pass
 test50 @1787888577: Test llapi_hsm_state_get()/get_fd() ....................... pass
 test51 @1787888578: Test llapi_hsm_state_set_fd() ............................. pass
 test52 @1787888578: Test llapi_hsm_current_action() ........................... pass
 test100 @1787888579: Simple archive creation with no progress reported. ....... pass
 test101 @1787888584: Simple archive creation with progress every byte. ........ pass
 test102 @1787888589: Archive creation with progress every byte, backwards ..... pass
 test103 @1787888590: Archive creation with a single progress report ........... pass
 test104 @1787888591: Archive creation with two progress reports ............... pass
 test105 @1787888592: Archive creation with one bogus progress report .......... pass
 test106 @1787888593: Archive creation with one empty progress report .......... pass
 test107 @1787888594: Archive creation with one bogus progress report .......... pass
 test108 @1787888600: Archive creation with same progress report each time ..... pass
 test109 @1787888601: Archive creation with one report, with large number ...... pass
 test110 @1787888602: Archive with 10 progress reports, checking progress ...... pass
 test111 @1787888604: Archive with 10 reports in reverse, checking progress .... pass
 test112 @1787888605: Archive with 10 reports, duplicated, check progress ...... pass
 test113 @1787888606: Archive with 9 reports, with 20% overlapping coverage .... pass
PASS 500 (94s)

== sanity-hsm test 600: Changelog fields 'u=' and 'nid=' ========================================================== 23:43:32 (1787888612)
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl1'
mdd.lustre-MDT0000.changelog_mask=ALL
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d600.sanity-hsm/f600.sanity-hsm]
Got NID '192.168.206.56@tcp'
lustre-MDT0000: clear the changelog for cl1 of all records
lustre-MDT0000: Deregistered changelog user #1
PASS 600 (14s)

== sanity-hsm test 601: OPEN Changelog entry ============= 23:43:46 (1787888626)
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl2'
mdd.lustre-MDT0000.changelog_mask=ALL
lustre-MDT0000: clear the changelog for cl2 of all records
lustre-MDT0000.8 10OPEN  03:43:52.532308632 2026.08.28 0x1 t=[0x2000032e1:0x26:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.206.56@tcp m=r-- p=[0x2000032e1:0x23:0x0]
lustre-MDT0000: clear the changelog for cl2 of all records
lustre-MDT0000: Deregistered changelog user #2
PASS 601 (13s)

== sanity-hsm test 602: Changelog record CLOSE only if open+write or OPEN recorded ========================================================== 23:44:00 (1787888640)
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl3'
mdd.lustre-MDT0000.changelog_mask=ALL
lustre-MDT0000: clear the changelog for cl3 of all records
lustre-MDT0000.14 11CLOSE 03:44:05.472486006 2026.08.28 0x1 t=[0x2000032e1:0x28:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000: clear the changelog for cl3 of all records
lustre-MDT0000.15 10OPEN  03:44:05.749398245 2026.08.28 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.206.56@tcp m=-w- p=[0x2000032e1:0x25:0x0]
lustre-MDT0000.16 13TRUNC 03:44:05.756404913 2026.08.28 0xe t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp p=[0x2000032e1:0x27:0x0]
lustre-MDT0000.17 11CLOSE 03:44:05.788329923 2026.08.28 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000.17 11CLOSE 03:44:05.788329923 2026.08.28 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
mdd.lustre-MDT0000.changelog_mask=-OPEN
lustre-MDT0000: clear the changelog for cl3 of all records
f
lustre-MDT0000: clear the changelog for cl3 of all records
lustre-MDT0000.18 13TRUNC 03:44:07.793764581 2026.08.28 0xe t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp p=[0x2000032e1:0x27:0x0]
lustre-MDT0000.19 11CLOSE 03:44:07.808219035 2026.08.28 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000.19 11CLOSE 03:44:07.808219035 2026.08.28 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000: clear the changelog for cl3 of all records
lustre-MDT0000: Deregistered changelog user #3
PASS 602 (16s)

== sanity-hsm test 603: GETXATTR Changelog entry ========= 23:44:15 (1787888655)
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl4'
mdd.lustre-MDT0000.changelog_mask=ALL
lustre-MDT0000: clear the changelog for cl4 of all records
getfattr: Removing leading '/' from absolute path names
# file: mnt/lustre/d603.sanity-hsm/f603.sanity-hsm
user.xattr1="value1"

lustre-MDT0000.25 23GXATR 03:44:21.114617847 2026.08.28 0x0 t=[0x2000032e1:0x2a:0x0] j=getfattr.0 ef=0x1b u=0:0 nid=192.168.206.56@tcp x=user.xattr1
lustre-MDT0000: clear the changelog for cl4 of all records
lustre-MDT0000: Deregistered changelog user #4
PASS 603 (14s)

== sanity-hsm test 604: NOPEN Changelog entry ============ 23:44:30 (1787888670)
mdd.lustre-MDT0000.changelog_deniednext=20
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl5'
mdd.lustre-MDT0000.changelog_mask=ALL
lustre-MDT0000: clear the changelog for cl5 of all records
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm]
cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied
lustre-MDT0000.30 24NOPEN 03:44:37.640554776 2026.08.28 0x1 t=[0x2000032e1:0x2c:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.206.56@tcp m=r--
Got NID '192.168.206.56@tcp'
lustre-MDT0000: clear the changelog for cl5 of all records
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm]
cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied
lustre-MDT0000: clear the changelog for cl5 of all records
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm]
cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied
lustre-MDT0000.31 24NOPEN 03:44:58.642719913 2026.08.28 0x1 t=[0x2000032e1:0x2c:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.206.56@tcp m=r--
Got NID '192.168.206.56@tcp'
lustre-MDT0000: clear the changelog for cl5 of all records
lustre-MDT0000: Deregistered changelog user #5
mdd.lustre-MDT0000.changelog_deniednext=60
PASS 604 (39s)

== sanity-hsm test 605: Test OPEN and CLOSE rate limit in Changelogs ========================================================== 23:45:08 (1787888708)
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl6'
mdd.lustre-MDT0000.changelog_mask=ALL
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0000.35 10OPEN  03:45:14.581737470 2026.08.28 0x43 t=[0x2000032e1:0x2e:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.206.56@tcp m=rw-
lustre-MDT0000.35 10OPEN  03:45:14.581737470 2026.08.28 0x43 t=[0x2000032e1:0x2e:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.206.56@tcp m=rw-
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0000.36 10OPEN  03:45:15.470039622 2026.08.28 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.206.56@tcp m=r-- p=[0x2000032e1:0x2b:0x0]
lustre-MDT0000.37 11CLOSE 03:45:15.510260482 2026.08.28 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000.36 10OPEN  03:45:15.470039622 2026.08.28 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.206.56@tcp m=r-- p=[0x2000032e1:0x2b:0x0]
lustre-MDT0000.37 11CLOSE 03:45:15.510260482 2026.08.28 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0000: clear the changelog for cl6 of all records
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [cat] [/mnt/lustre/d605.sanity-hsm/f605.sanity-hsm]
lustre-MDT0000.38 10OPEN  03:45:16.950646227 2026.08.28 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.206.56@tcp m=r-- p=[0x2000032e1:0x2d:0x0]
lustre-MDT0000.39 11CLOSE 03:45:16.962487112 2026.08.28 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.500 ef=0x13 u=500:500 nid=192.168.206.56@tcp
lustre-MDT0000.38 10OPEN  03:45:16.950646227 2026.08.28 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.206.56@tcp m=r-- p=[0x2000032e1:0x2d:0x0]
lustre-MDT0000.39 11CLOSE 03:45:16.962487112 2026.08.28 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.500 ef=0x13 u=500:500 nid=192.168.206.56@tcp
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0000.40 11CLOSE 03:45:17.505563849 2026.08.28 0x43 t=[0x2000032e1:0x2e:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000.40 11CLOSE 03:45:17.505563849 2026.08.28 0x43 t=[0x2000032e1:0x2e:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.206.56@tcp
lustre-MDT0000: clear the changelog for cl6 of all records
lustre-MDT0000: Deregistered changelog user #6
PASS 605 (17s)

== sanity-hsm test 606: llog_reader groks changelog fields ========================================================== 23:45:25 (1787888725)
mdd.lustre-MDT0000.changelog_mask=+hsm
Registered 1 changelog users: 'cl7'
mdd.lustre-MDT0000.changelog_mask=ALL
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d606.sanity-hsm/f606.sanity-hsm]
Stopping /mnt/lustre-mds1 (opts:) on oleg656-server
rec #2 type=1064553b len=64 offset 8256
Header size : 8192	 llh_size : 64
Time : Thu Aug 27 23:21:00 2026
Number of records: 1	cat_idx: 0	last_idx: 2
Flags: 0x2012
Target uuid : 
-----------------------
#02 (064)fid=[0x1:0x3b:0x0] path=oi.1/0x1:0x3b:0x0
oleg656-server: llog_reader: The llog is corrupted, 1 errors found
Got UID/GID 500:500
Got NID 192.168.206.56@tcp
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg656-server: oleg656-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg656-client: oleg656-server: ssh exited with exit code 1
Started lustre-MDT0000
lustre-MDT0000: clear the changelog for cl7 of all records
lustre-MDT0000: Deregistered changelog user #7
PASS 606 (59s)

== sanity-hsm test 607a: release file migrated after archive (non-blocking migrate) ========================================================== 23:46:25 (1787888785)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.230477 s, 4.5 MB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
PASS 607a (11s)

== sanity-hsm test 607b: Migrate should not change the HSM attribute of dirty files ========================================================== 23:46:35 (1787888795)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.234741 s, 4.5 MB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
llite.lustre-ffff94444414f000.xattr_cache=0
llite.lustre-ffff9444529b0800.xattr_cache=0
/mnt/lustre/d607b.sanity-hsm/f607b.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:1
llite.lustre-ffff94444414f000.xattr_cache=1
llite.lustre-ffff9444529b0800.xattr_cache=1
PASS 607b (10s)

== sanity-hsm test 607c: 'lfs swap_layouts' should set dirty flag on HSM file ========================================================== 23:46:45 (1787888805)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.239456 s, 4.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.211116 s, 5.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.223294 s, 4.7 MB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
lfs swap_layouts: error: cannot swap layout between '/mnt/lustre/d607c.sanity-hsm/f607c.sanity-hsm-1' and '/mnt/lustre/d607c.sanity-hsm/f607c.sanity-hsm-3': Operation not permitted (1)
PASS 607c (11s)

== sanity-hsm test 607d: Migrate should not set HSM dirty flag for an empty file ========================================================== 23:46:56 (1787888816)
0+0 records in
0+0 records out
0 bytes copied, 0.00699883 s, 0.0 kB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
PASS 607d (13s)

== sanity-hsm test 607e: release file migrated after archive (blocking migrate) ========================================================== 23:47:10 (1787888830)
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.402517 s, 2.6 MB/s
Starting copytool 'agt1' on 'oleg656-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre2"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
PASS 607e (14s)
== sanity-hsm test complete, duration 4756 sec =========== 23:47:25 (1787888845)
=== sanity-hsm: start cleanup 23:47:27 (1787888847) ===
Stopping clients: oleg656-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg656-client.virtnet /mnt/lustre2 opts:
=== sanity-hsm: finish cleanup 23:48:02 (1787888882) ===