-----============= acceptance-small: sanity-hsm ============----- Fri Aug 7 07:23:12 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg427-server: /home/green/git/lustre-release/lustre/tests/except/sanity-hsm.ex - see MDS1_VERSION <= CLIENT_VERSION (34682930 <= 34682930) for LU-18924, go 100 105 excepting tests: === sanity-hsm: start setup 07:23:37 (1786101817) === Starting client oleg427-client.virtnet: -o user_xattr,flock 192.168.204.127@tcp:/lustre /mnt/lustre2 Mount client oleg427-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.204.127@tcp:/lustre /mnt/lustre2 Started clients oleg427-client.virtnet: 192.168.204.127@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) oleg427-client.virtnet: executing check_config_client /mnt/lustre oleg427-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg427-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8a8ec288d000.idle_timeout=debug osc.lustre-OST0000-osc-ffff8a8ece3a7000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8a8ec288d000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8a8ece3a7000.idle_timeout=debug disable quota as required oleg427-server: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-hsm: finish setup 07:24:20 (1786101860) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7626] nobody:x:65534: Killing existing copytools on oleg427-client.virtnet with signal TERM pkill: pidfile not valid Try `pkill --help' for more information. Set HSM on and start Set sanity-hsm HSM policy == sanity-hsm test 1A: lfs hsm flags root/non-root access ========================================================== 07:24:47 (1786101887) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_set] [--norelease] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_clear] [--norelease] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_set] [--exists] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] lfs hsm_set: change hsm flags for '/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm' failed: Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] PASS 1A (10s) == sanity-hsm test 1a: mmap & cat a HSM released file ==== 07:24:57 (1786101897) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.196901 s, 5.3 MB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Verifying released state: PASS 1a (14s) == sanity-hsm test 1b: Archive, Release and Restore composite file ========================================================== 07:25:11 (1786101911) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0698248 s, 15.0 MB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' archive /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' release /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm verify released state: pass restore /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' verify restored state: pass PASS 1b (14s) == sanity-hsm test 1c: Check setting archive-id in lfs hsm_set ========================================================== 07:25:25 (1786101925) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] verifying archive number is 32 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] verifying archive number is still 32 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] verifying archive number is 33 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] verifying archive number is 16 PASS 1c (10s) == sanity-hsm test 1d: Archive, Release and Restore DoM file ========================================================== 07:25:35 (1786101935) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117034 s, 9.0 MB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' archive /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm release /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm verify released state: pass restore /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm verify restored state: pass PASS 1d (12s) == sanity-hsm test 1e: Archive, Release and Restore SEL file ========================================================== 07:25:47 (1786101947) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118839 s, 8.8 MB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' archive /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' release /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm verify released state: pass restore /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' verify restored state: pass PASS 1e (20s) == sanity-hsm test 1f: DoM file release after restore ==== 07:26:07 (1786101967) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0931922 s, 11.3 MB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' archive /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm release /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm verify released state: pass restore /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 3s: want 'SUCCEED' got 'SUCCEED' verify restored state: pass release again /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm: (0x0000000d) released exists archived, archive_id:1 verify released state: pass PASS 1f (16s) == sanity-hsm test 2: Check file dirtyness when doing setattr ========================================================== 07:26:23 (1786101983) 0+0 records in 0+0 records out 0 bytes copied, 0.0149383 s, 0.0 kB/s 0x200000402:0x9:0x0 PASS 2 (11s) == sanity-hsm test 3: Check file dirtyness when opening for write ========================================================== 07:26:34 (1786101994) Succeed in opening file "/mnt/lustre/d3.sanity-hsm/f3.sanity-hsm"(flags=O_WRONLY) 3+0 records in 3+0 records out 3+0 records in 3+0 records out PASS 3 (10s) == sanity-hsm test 4: Useless cancel must not be registered ========================================================== 07:26:44 (1786102004) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.252098 s, 4.2 MB/s PASS 4 (9s) == sanity-hsm test 8: Test default archive number ======== 07:26:54 (1786102014) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_8/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 8 (11s) == sanity-hsm test 9A: Use of explicit archive number, with dedicated copytool ========================================================== 07:27:04 (1786102024) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_9A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 3 "/mnt/lustre2"' oleg427-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg427-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=f099b708-b058-4989-aed9-5104ddfef353 archive_id=3 requests=[current:0 ok:0 errors:0] on mds1 PASS 9A (27s) == sanity-hsm test 9a: Multiple remote agents ============ 07:27:31 (1786102051) SKIP: sanity-hsm test_9a Need 3 or more clients, have 1 SKIP 9a (4s) == sanity-hsm test 10a: Archive a file =================== 07:27:35 (1786102055) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 996: warning: command substitution: ignored null byte in input Verifying content Verifying hsm state Verifying archive number is 2 PASS 10a (10s) == sanity-hsm test 10b: Archive of non dirty file must work without doing request ========================================================== 07:27:45 (1786102065) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 10b (11s) == sanity-hsm test 10c: Check forbidden archive ========== 07:27:56 (1786102076) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Cannot send HSM request (use of /mnt/lustre/d10c.sanity-hsm/f10c.sanity-hsm): Operation not permitted PASS 10c (8s) == sanity-hsm test 10d: Archive a file on the default archive id ========================================================== 07:28:04 (1786102084) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 10d (10s) == sanity-hsm test 11a: Import a file ==================== 07:28:15 (1786102095) lhsmtool_posix: 1786102097.475601 [21168]: action=1 src=d11a.sanity-hsm/f11a.sanity-hsm dst=/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786102097.481996 [21168]: importing '/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11a//d11a.sanity-hsm/f11a.sanity-hsm' lhsmtool_posix: 1786102097.523433 [21168]: imported '/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11a//042b/0x200000401:0x2a:0x0'=='/tmp/arc1/sanity-hsm.test_11a//d11a.sanity-hsm/f11a.sanity-hsm' lhsmtool_posix: 1786102097.524034 [21168]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Verifying released state: Verifying imported size 158=158 Verifying released pattern: raid0,released Verifying new fid 0x200000401:0x2a:0x0 in archive PASS 11a (8s) == sanity-hsm test 11b: Import a deleted file using its FID ========================================================== 07:28:23 (1786102103) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_11b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1786102107.195519 [21852]: action=1 src=0x200000402:0x12:0x0 dst=/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786102107.216909 [21852]: Resolving [0x200000402:0x12:0x0] to /tmp/arc1/sanity-hsm.test_11b//0410/0x200000402:0x12:0x0 lhsmtool_posix: 1786102107.216989 [21852]: importing '/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11b//0410/0x200000402:0x12:0x0' lhsmtool_posix: 1786102107.284680 [21852]: imported '/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11b//042d/0x200000401:0x2c:0x0'=='/tmp/arc1/sanity-hsm.test_11b//0410/0x200000402:0x12:0x0' lhsmtool_posix: 1786102107.284814 [21852]: process finished, errs: 0 major, 0 minor, rc=0 (Success) /mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm: OK PASS 11b (11s) == sanity-hsm test 11c: Import a file to a directory with a pool ========================================================== 07:28:34 (1786102114) Creating new pool test_11c oleg427-server: Pool lustre.test_11c created Adding targets to pool oleg427-server: OST lustre-OST0001_UUID added to pool lustre.test_11c lhsmtool_posix: 1786102124.306483 [22541]: action=1 src=d11c.sanity-hsm/f11c.sanity-hsm dst=/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786102124.328047 [22541]: importing '/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11c//d11c.sanity-hsm/f11c.sanity-hsm' lhsmtool_posix: 1786102124.402950 [22541]: imported '/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11c//042e/0x200000401:0x2f:0x0'=='/tmp/arc1/sanity-hsm.test_11c//d11c.sanity-hsm/f11c.sanity-hsm' lhsmtool_posix: 1786102124.403006 [22541]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Destroy the created pools: test_11c lustre.test_11c oleg427-server: OST lustre-OST0001_UUID removed from pool lustre.test_11c oleg427-server: Pool lustre.test_11c destroyed PASS 11c (27s) == sanity-hsm test 12a: Restore an imported file explicitly ========================================================== 07:29:01 (1786102141) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1786102144.826064 [23261]: action=1 src=d12a.sanity-hsm/f12a.sanity-hsm dst=/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786102144.845134 [23261]: importing '/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12a//d12a.sanity-hsm/f12a.sanity-hsm' lhsmtool_posix: 1786102144.964468 [23261]: imported '/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12a//0433/0x200000401:0x32:0x0'=='/tmp/arc1/sanity-hsm.test_12a//d12a.sanity-hsm/f12a.sanity-hsm' lhsmtool_posix: 1786102144.967393 [23261]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Verifying released state: Verifying file state: PASS 12a (12s) == sanity-hsm test 12b: Restore an imported file implicitly ========================================================== 07:29:13 (1786102153) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1786102156.620047 [23960]: action=1 src=d12b.sanity-hsm/f12b.sanity-hsm dst=/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786102156.628277 [23960]: importing '/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12b//d12b.sanity-hsm/f12b.sanity-hsm' lhsmtool_posix: 1786102156.673401 [23960]: imported '/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12b//0434/0x200000401:0x35:0x0'=='/tmp/arc1/sanity-hsm.test_12b//d12b.sanity-hsm/f12b.sanity-hsm' lhsmtool_posix: 1786102156.673950 [23960]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Verifying released state: Verifying file state after restore: PASS 12b (11s) == sanity-hsm test 12c: Restore a file with stripe of 2 == 07:29:24 (1786102164) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 5+0 records in 5+0 records out 5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.234771 s, 22.3 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' /mnt/lustre/d12c.sanity-hsm/f12c.sanity-hsm: OK PASS 12c (14s) == sanity-hsm test 12d: Restore of a non archived, non released file must work ========================================================== 07:29:38 (1786102178) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 12d (13s) == sanity-hsm test 12e: Check forbidden restore ========== 07:29:51 (1786102191) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' /mnt/lustre/d12e.sanity-hsm/f12e.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:1 Cannot send HSM request (use of /mnt/lustre/d12e.sanity-hsm/f12e.sanity-hsm): Operation not permitted PASS 12e (10s) == sanity-hsm test 12f: Restore a released file explicitly ========================================================== 07:30:01 (1786102201) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Verifying file state: PASS 12f (12s) == sanity-hsm test 12g: Restore a released file implicitly ========================================================== 07:30:13 (1786102213) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12g/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 12g (14s) == sanity-hsm test 12h: Restore a released file implicitly from a second node ========================================================== 07:30:27 (1786102227) SKIP: sanity-hsm test_12h Need 2 or more clients, have 1 SKIP 12h (4s) == sanity-hsm test 12m: Archive/release/implicit restore ========================================================== 07:30:31 (1786102231) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12m/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 12m (10s) == sanity-hsm test 12n: Import/implicit restore/release == 07:30:41 (1786102241) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12n/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1786102244.421751 [28739]: action=1 src=d12n.sanity-hsm/f12n.sanity-hsm dst=/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786102244.429068 [28739]: importing '/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12n//d12n.sanity-hsm/f12n.sanity-hsm' lhsmtool_posix: 1786102244.482677 [28739]: imported '/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12n//0445/0x200000401:0x44:0x0'=='/tmp/arc1/sanity-hsm.test_12n//d12n.sanity-hsm/f12n.sanity-hsm' lhsmtool_posix: 1786102244.483045 [28739]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 12n (10s) == sanity-hsm test 12o: Layout-swap failure during Restore leaves file released ========================================================== 07:30:51 (1786102251) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12o/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' fail_loc=0x152 mdt.lustre-MDT0000.hsm.policy=+NRA diff: /mnt/lustre/d12o.sanity-hsm/f12o.sanity-hsm: No data available mdt.lustre-MDT0000.hsm.policy=-NRA fail_loc=0 mdt.lustre-MDT0000.hsm_control=purge PASS 12o (35s) == sanity-hsm test 12p: implicit restore of a file on copytool mount point ========================================================== 07:31:26 (1786102286) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12p/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 12p (13s) == sanity-hsm test 12q: file attributes are refreshed after restore ========================================================== 07:31:39 (1786102299) Starting client: oleg427-client.virtnet: -o user_xattr,flock 192.168.204.127@tcp:/lustre /mnt/lustre3 Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12q/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre3"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154155 s, 6.8 MB/s Killing existing copytools on oleg427-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12q/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre3"' Stopping client oleg427-client.virtnet /mnt/lustre3 (opts:) PASS 12q (19s) == sanity-hsm test 12r: lseek restores released file ===== 07:31:59 (1786102319) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12r/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 12r (16s) == sanity-hsm test 12s: race between restore requests ==== 07:32:14 (1786102334) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12s/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' fail_loc=0x8000018b PASS 12s (18s) == sanity-hsm test 12t: Multiple parallel reads for a HSM imported file ========================================================== 07:32:32 (1786102352) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12t/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1786102356.654528 [32798]: action=1 src=0x200000402:0x2c:0x0 dst=/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786102356.665186 [32798]: Resolving [0x200000402:0x2c:0x0] to /tmp/arc1/sanity-hsm.test_12t//042e/0x200000402:0x2c:0x0 lhsmtool_posix: 1786102356.666427 [32798]: importing '/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12t//042e/0x200000402:0x2c:0x0' lhsmtool_posix: 1786102356.739679 [32798]: imported '/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12t//0453/0x200000401:0x52:0x0'=='/tmp/arc1/sanity-hsm.test_12t//042e/0x200000402:0x2c:0x0' lhsmtool_posix: 1786102356.741735 [32798]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 12t (11s) == sanity-hsm test 12u: Multiple reads on multiple HSM imported files in parallel ========================================================== 07:32:44 (1786102364) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12u/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1786102380.072119 [33664]: action=1 src=0x200000402:0x2e:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0 mount_point=/mnt/lustre2 lhsmtool_posix: 1786102380.078580 [33664]: Resolving [0x200000402:0x2e:0x0] to /tmp/arc1/sanity-hsm.test_12u//042c/0x200000402:0x2e:0x0 lhsmtool_posix: 1786102380.078668 [33664]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0' from '/tmp/arc1/sanity-hsm.test_12u//042c/0x200000402:0x2e:0x0' lhsmtool_posix: 1786102380.115742 [33664]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0' from '/tmp/arc1/sanity-hsm.test_12u//0455/0x200000401:0x54:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042c/0x200000402:0x2e:0x0' lhsmtool_posix: 1786102380.116395 [33664]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1786102380.406916 [33694]: action=1 src=0x200000402:0x2f:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1 mount_point=/mnt/lustre2 lhsmtool_posix: 1786102380.413613 [33694]: Resolving [0x200000402:0x2f:0x0] to /tmp/arc1/sanity-hsm.test_12u//042d/0x200000402:0x2f:0x0 lhsmtool_posix: 1786102380.414191 [33694]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1' from '/tmp/arc1/sanity-hsm.test_12u//042d/0x200000402:0x2f:0x0' lhsmtool_posix: 1786102380.460398 [33694]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1' from '/tmp/arc1/sanity-hsm.test_12u//0454/0x200000401:0x55:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042d/0x200000402:0x2f:0x0' lhsmtool_posix: 1786102380.460939 [33694]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1786102380.837610 [33723]: action=1 src=0x200000402:0x30:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2 mount_point=/mnt/lustre2 lhsmtool_posix: 1786102380.848654 [33723]: Resolving [0x200000402:0x30:0x0] to /tmp/arc1/sanity-hsm.test_12u//0432/0x200000402:0x30:0x0 lhsmtool_posix: 1786102380.851547 [33723]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2' from '/tmp/arc1/sanity-hsm.test_12u//0432/0x200000402:0x30:0x0' lhsmtool_posix: 1786102380.899435 [33723]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2' from '/tmp/arc1/sanity-hsm.test_12u//0457/0x200000401:0x56:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0432/0x200000402:0x30:0x0' lhsmtool_posix: 1786102380.900440 [33723]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1786102381.151939 [33752]: action=1 src=0x200000402:0x31:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3 mount_point=/mnt/lustre2 lhsmtool_posix: 1786102381.164202 [33752]: Resolving [0x200000402:0x31:0x0] to /tmp/arc1/sanity-hsm.test_12u//0433/0x200000402:0x31:0x0 lhsmtool_posix: 1786102381.164319 [33752]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3' from '/tmp/arc1/sanity-hsm.test_12u//0433/0x200000402:0x31:0x0' lhsmtool_posix: 1786102381.237947 [33752]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3' from '/tmp/arc1/sanity-hsm.test_12u//0456/0x200000401:0x57:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0433/0x200000402:0x31:0x0' lhsmtool_posix: 1786102381.240122 [33752]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1786102381.653223 [33781]: action=1 src=0x200000402:0x32:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4 mount_point=/mnt/lustre2 lhsmtool_posix: 1786102381.663289 [33781]: Resolving [0x200000402:0x32:0x0] to /tmp/arc1/sanity-hsm.test_12u//0430/0x200000402:0x32:0x0 lhsmtool_posix: 1786102381.666116 [33781]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4' from '/tmp/arc1/sanity-hsm.test_12u//0430/0x200000402:0x32:0x0' lhsmtool_posix: 1786102381.730677 [33781]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4' from '/tmp/arc1/sanity-hsm.test_12u//0459/0x200000401:0x58:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0430/0x200000402:0x32:0x0' lhsmtool_posix: 1786102381.731652 [33781]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1786102382.039462 [33810]: action=1 src=0x200000402:0x33:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5 mount_point=/mnt/lustre2 lhsmtool_posix: 1786102382.046479 [33810]: Resolving [0x200000402:0x33:0x0] to /tmp/arc1/sanity-hsm.test_12u//0431/0x200000402:0x33:0x0 lhsmtool_posix: 1786102382.049186 [33810]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5' from '/tmp/arc1/sanity-hsm.test_12u//0431/0x200000402:0x33:0x0' lhsmtool_posix: 1786102382.102066 [33810]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5' from '/tmp/arc1/sanity-hsm.test_12u//0458/0x200000401:0x59:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0431/0x200000402:0x33:0x0' lhsmtool_posix: 1786102382.102136 [33810]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1786102382.465124 [33839]: action=1 src=0x200000402:0x34:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6 mount_point=/mnt/lustre2 lhsmtool_posix: 1786102382.478259 [33839]: Resolving [0x200000402:0x34:0x0] to /tmp/arc1/sanity-hsm.test_12u//0436/0x200000402:0x34:0x0 lhsmtool_posix: 1786102382.478351 [33839]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6' from '/tmp/arc1/sanity-hsm.test_12u//0436/0x200000402:0x34:0x0' lhsmtool_posix: 1786102382.558977 [33839]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6' from '/tmp/arc1/sanity-hsm.test_12u//045b/0x200000401:0x5a:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0436/0x200000402:0x34:0x0' lhsmtool_posix: 1786102382.559038 [33839]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1786102383.145966 [33868]: action=1 src=0x200000402:0x35:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7 mount_point=/mnt/lustre2 lhsmtool_posix: 1786102383.159549 [33868]: Resolving [0x200000402:0x35:0x0] to /tmp/arc1/sanity-hsm.test_12u//0437/0x200000402:0x35:0x0 lhsmtool_posix: 1786102383.161147 [33868]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7' from '/tmp/arc1/sanity-hsm.test_12u//0437/0x200000402:0x35:0x0' lhsmtool_posix: 1786102383.215878 [33868]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7' from '/tmp/arc1/sanity-hsm.test_12u//045a/0x200000401:0x5b:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0437/0x200000402:0x35:0x0' lhsmtool_posix: 1786102383.215942 [33868]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1786102383.601517 [33897]: action=1 src=0x200000402:0x36:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8 mount_point=/mnt/lustre2 lhsmtool_posix: 1786102383.613430 [33897]: Resolving [0x200000402:0x36:0x0] to /tmp/arc1/sanity-hsm.test_12u//0434/0x200000402:0x36:0x0 lhsmtool_posix: 1786102383.615003 [33897]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8' from '/tmp/arc1/sanity-hsm.test_12u//0434/0x200000402:0x36:0x0' lhsmtool_posix: 1786102383.671442 [33897]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8' from '/tmp/arc1/sanity-hsm.test_12u//045d/0x200000401:0x5c:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0434/0x200000402:0x36:0x0' lhsmtool_posix: 1786102383.671501 [33897]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1786102384.156575 [33926]: action=1 src=0x200000402:0x37:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9 mount_point=/mnt/lustre2 lhsmtool_posix: 1786102384.166533 [33926]: Resolving [0x200000402:0x37:0x0] to /tmp/arc1/sanity-hsm.test_12u//0435/0x200000402:0x37:0x0 lhsmtool_posix: 1786102384.168526 [33926]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9' from '/tmp/arc1/sanity-hsm.test_12u//0435/0x200000402:0x37:0x0' lhsmtool_posix: 1786102384.225562 [33926]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9' from '/tmp/arc1/sanity-hsm.test_12u//045c/0x200000401:0x5d:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0435/0x200000402:0x37:0x0' lhsmtool_posix: 1786102384.225926 [33926]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 12u (32s) == sanity-hsm test 13: Recursively import and restore a directory ========================================================== 07:33:16 (1786102396) lhsmtool_posix: 1786102409.833476 [35673]: action=1 src=subdir dst=/mnt/lustre/d13.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786102409.925344 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.10' lhsmtool_posix: 1786102410.019212 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.10' from '/tmp/arc1/sanity-hsm.test_13//0460/0x200000401:0x61:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.10' lhsmtool_posix: 1786102410.019681 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.9' lhsmtool_posix: 1786102410.090134 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.9' from '/tmp/arc1/sanity-hsm.test_13//0463/0x200000401:0x62:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.9' lhsmtool_posix: 1786102410.091389 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.8' lhsmtool_posix: 1786102410.157958 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.8' from '/tmp/arc1/sanity-hsm.test_13//0462/0x200000401:0x63:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.8' lhsmtool_posix: 1786102410.158493 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.7' lhsmtool_posix: 1786102410.220819 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.7' from '/tmp/arc1/sanity-hsm.test_13//0465/0x200000401:0x64:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.7' lhsmtool_posix: 1786102410.221895 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.6' lhsmtool_posix: 1786102410.272023 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.6' from '/tmp/arc1/sanity-hsm.test_13//0464/0x200000401:0x65:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.6' lhsmtool_posix: 1786102410.272823 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.5' lhsmtool_posix: 1786102410.320849 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.5' from '/tmp/arc1/sanity-hsm.test_13//0467/0x200000401:0x66:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.5' lhsmtool_posix: 1786102410.321079 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.4' lhsmtool_posix: 1786102410.366647 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.4' from '/tmp/arc1/sanity-hsm.test_13//0466/0x200000401:0x67:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.4' lhsmtool_posix: 1786102410.367444 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.3' lhsmtool_posix: 1786102410.413868 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.3' from '/tmp/arc1/sanity-hsm.test_13//0469/0x200000401:0x68:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.3' lhsmtool_posix: 1786102410.414056 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.2' lhsmtool_posix: 1786102410.462444 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.2' from '/tmp/arc1/sanity-hsm.test_13//0468/0x200000401:0x69:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.2' lhsmtool_posix: 1786102410.462663 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.1' lhsmtool_posix: 1786102410.509329 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.1' from '/tmp/arc1/sanity-hsm.test_13//046b/0x200000401:0x6a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.1' lhsmtool_posix: 1786102410.517815 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.10' lhsmtool_posix: 1786102410.585401 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.10' from '/tmp/arc1/sanity-hsm.test_13//046d/0x200000401:0x6c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.10' lhsmtool_posix: 1786102410.586043 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.9' lhsmtool_posix: 1786102410.629857 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.9' from '/tmp/arc1/sanity-hsm.test_13//046c/0x200000401:0x6d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.9' lhsmtool_posix: 1786102410.630647 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.8' lhsmtool_posix: 1786102410.673947 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.8' from '/tmp/arc1/sanity-hsm.test_13//046f/0x200000401:0x6e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.8' lhsmtool_posix: 1786102410.674136 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.7' lhsmtool_posix: 1786102410.711150 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.7' from '/tmp/arc1/sanity-hsm.test_13//046e/0x200000401:0x6f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.7' lhsmtool_posix: 1786102410.711850 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.6' lhsmtool_posix: 1786102410.747557 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.6' from '/tmp/arc1/sanity-hsm.test_13//0471/0x200000401:0x70:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.6' lhsmtool_posix: 1786102410.748454 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.5' lhsmtool_posix: 1786102410.788996 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.5' from '/tmp/arc1/sanity-hsm.test_13//0470/0x200000401:0x71:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.5' lhsmtool_posix: 1786102410.789223 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.4' lhsmtool_posix: 1786102410.825556 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.4' from '/tmp/arc1/sanity-hsm.test_13//0473/0x200000401:0x72:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.4' lhsmtool_posix: 1786102410.826372 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.3' lhsmtool_posix: 1786102410.868451 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.3' from '/tmp/arc1/sanity-hsm.test_13//0472/0x200000401:0x73:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.3' lhsmtool_posix: 1786102410.869382 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.2' lhsmtool_posix: 1786102410.907130 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.2' from '/tmp/arc1/sanity-hsm.test_13//0475/0x200000401:0x74:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.2' lhsmtool_posix: 1786102410.907880 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.1' lhsmtool_posix: 1786102410.951294 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.1' from '/tmp/arc1/sanity-hsm.test_13//0474/0x200000401:0x75:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.1' lhsmtool_posix: 1786102410.956394 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.10' lhsmtool_posix: 1786102410.999083 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.10' from '/tmp/arc1/sanity-hsm.test_13//0476/0x200000401:0x77:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.10' lhsmtool_posix: 1786102411.000270 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.9' lhsmtool_posix: 1786102411.036264 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.9' from '/tmp/arc1/sanity-hsm.test_13//0479/0x200000401:0x78:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.9' lhsmtool_posix: 1786102411.036970 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.8' lhsmtool_posix: 1786102411.081670 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.8' from '/tmp/arc1/sanity-hsm.test_13//0478/0x200000401:0x79:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.8' lhsmtool_posix: 1786102411.084626 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.7' lhsmtool_posix: 1786102411.129590 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.7' from '/tmp/arc1/sanity-hsm.test_13//047b/0x200000401:0x7a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.7' lhsmtool_posix: 1786102411.130584 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.6' lhsmtool_posix: 1786102411.169071 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.6' from '/tmp/arc1/sanity-hsm.test_13//047a/0x200000401:0x7b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.6' lhsmtool_posix: 1786102411.169593 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.5' lhsmtool_posix: 1786102411.211987 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.5' from '/tmp/arc1/sanity-hsm.test_13//047d/0x200000401:0x7c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.5' lhsmtool_posix: 1786102411.212783 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.4' lhsmtool_posix: 1786102411.252920 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.4' from '/tmp/arc1/sanity-hsm.test_13//047c/0x200000401:0x7d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.4' lhsmtool_posix: 1786102411.253128 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.3' lhsmtool_posix: 1786102411.296330 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.3' from '/tmp/arc1/sanity-hsm.test_13//047f/0x200000401:0x7e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.3' lhsmtool_posix: 1786102411.297125 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.2' lhsmtool_posix: 1786102411.338080 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.2' from '/tmp/arc1/sanity-hsm.test_13//047e/0x200000401:0x7f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.2' lhsmtool_posix: 1786102411.339564 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.1' lhsmtool_posix: 1786102411.374671 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.1' from '/tmp/arc1/sanity-hsm.test_13//0481/0x200000401:0x80:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.1' lhsmtool_posix: 1786102411.381420 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.10' lhsmtool_posix: 1786102411.453304 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.10' from '/tmp/arc1/sanity-hsm.test_13//0483/0x200000401:0x82:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.10' lhsmtool_posix: 1786102411.453789 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.9' lhsmtool_posix: 1786102411.491948 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.9' from '/tmp/arc1/sanity-hsm.test_13//0482/0x200000401:0x83:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.9' lhsmtool_posix: 1786102411.492322 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.8' lhsmtool_posix: 1786102411.535059 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.8' from '/tmp/arc1/sanity-hsm.test_13//0485/0x200000401:0x84:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.8' lhsmtool_posix: 1786102411.536013 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.7' lhsmtool_posix: 1786102411.584055 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.7' from '/tmp/arc1/sanity-hsm.test_13//0484/0x200000401:0x85:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.7' lhsmtool_posix: 1786102411.584306 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.6' lhsmtool_posix: 1786102411.626109 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.6' from '/tmp/arc1/sanity-hsm.test_13//0487/0x200000401:0x86:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.6' lhsmtool_posix: 1786102411.627033 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.5' lhsmtool_posix: 1786102411.670956 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.5' from '/tmp/arc1/sanity-hsm.test_13//0486/0x200000401:0x87:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.5' lhsmtool_posix: 1786102411.673749 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.4' lhsmtool_posix: 1786102411.718533 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.4' from '/tmp/arc1/sanity-hsm.test_13//0489/0x200000401:0x88:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.4' lhsmtool_posix: 1786102411.719877 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.3' lhsmtool_posix: 1786102411.762321 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.3' from '/tmp/arc1/sanity-hsm.test_13//0488/0x200000401:0x89:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.3' lhsmtool_posix: 1786102411.763136 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.2' lhsmtool_posix: 1786102411.816014 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.2' from '/tmp/arc1/sanity-hsm.test_13//048b/0x200000401:0x8a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.2' lhsmtool_posix: 1786102411.817127 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.1' lhsmtool_posix: 1786102411.864850 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.1' from '/tmp/arc1/sanity-hsm.test_13//048a/0x200000401:0x8b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.1' lhsmtool_posix: 1786102411.873101 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.10' lhsmtool_posix: 1786102411.939062 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.10' from '/tmp/arc1/sanity-hsm.test_13//048c/0x200000401:0x8d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.10' lhsmtool_posix: 1786102411.940205 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.9' lhsmtool_posix: 1786102412.002269 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.9' from '/tmp/arc1/sanity-hsm.test_13//048f/0x200000401:0x8e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.9' lhsmtool_posix: 1786102412.004640 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.8' lhsmtool_posix: 1786102412.055582 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.8' from '/tmp/arc1/sanity-hsm.test_13//048e/0x200000401:0x8f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.8' lhsmtool_posix: 1786102412.055829 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.7' lhsmtool_posix: 1786102412.108319 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.7' from '/tmp/arc1/sanity-hsm.test_13//0491/0x200000401:0x90:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.7' lhsmtool_posix: 1786102412.108829 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.6' lhsmtool_posix: 1786102412.185591 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.6' from '/tmp/arc1/sanity-hsm.test_13//0490/0x200000401:0x91:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.6' lhsmtool_posix: 1786102412.187632 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.5' lhsmtool_posix: 1786102412.261018 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.5' from '/tmp/arc1/sanity-hsm.test_13//0493/0x200000401:0x92:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.5' lhsmtool_posix: 1786102412.261527 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.4' lhsmtool_posix: 1786102412.308953 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.4' from '/tmp/arc1/sanity-hsm.test_13//0492/0x200000401:0x93:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.4' lhsmtool_posix: 1786102412.309593 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.3' lhsmtool_posix: 1786102412.347303 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.3' from '/tmp/arc1/sanity-hsm.test_13//0495/0x200000401:0x94:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.3' lhsmtool_posix: 1786102412.347989 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.2' lhsmtool_posix: 1786102412.411914 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.2' from '/tmp/arc1/sanity-hsm.test_13//0494/0x200000401:0x95:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.2' lhsmtool_posix: 1786102412.412134 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.1' lhsmtool_posix: 1786102412.465920 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.1' from '/tmp/arc1/sanity-hsm.test_13//0497/0x200000401:0x96:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.1' lhsmtool_posix: 1786102412.472896 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.10' lhsmtool_posix: 1786102412.535958 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.10' from '/tmp/arc1/sanity-hsm.test_13//0499/0x200000401:0x98:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.10' lhsmtool_posix: 1786102412.536971 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.9' lhsmtool_posix: 1786102412.582915 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.9' from '/tmp/arc1/sanity-hsm.test_13//0498/0x200000401:0x99:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.9' lhsmtool_posix: 1786102412.583858 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.8' lhsmtool_posix: 1786102412.627648 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.8' from '/tmp/arc1/sanity-hsm.test_13//049b/0x200000401:0x9a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.8' lhsmtool_posix: 1786102412.628557 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.7' lhsmtool_posix: 1786102412.672138 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.7' from '/tmp/arc1/sanity-hsm.test_13//049a/0x200000401:0x9b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.7' lhsmtool_posix: 1786102412.673001 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.6' lhsmtool_posix: 1786102412.720614 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.6' from '/tmp/arc1/sanity-hsm.test_13//049d/0x200000401:0x9c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.6' lhsmtool_posix: 1786102412.721678 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.5' lhsmtool_posix: 1786102412.810112 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.5' from '/tmp/arc1/sanity-hsm.test_13//049c/0x200000401:0x9d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.5' lhsmtool_posix: 1786102412.811862 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.4' lhsmtool_posix: 1786102412.879355 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.4' from '/tmp/arc1/sanity-hsm.test_13//049f/0x200000401:0x9e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.4' lhsmtool_posix: 1786102412.879619 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.3' lhsmtool_posix: 1786102412.932611 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.3' from '/tmp/arc1/sanity-hsm.test_13//049e/0x200000401:0x9f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.3' lhsmtool_posix: 1786102412.933751 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.2' lhsmtool_posix: 1786102412.986380 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.2' from '/tmp/arc1/sanity-hsm.test_13//04a1/0x200000401:0xa0:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.2' lhsmtool_posix: 1786102412.987566 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.1' lhsmtool_posix: 1786102413.038925 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.1' from '/tmp/arc1/sanity-hsm.test_13//04a0/0x200000401:0xa1:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.1' lhsmtool_posix: 1786102413.049671 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.10' lhsmtool_posix: 1786102413.116598 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.10' from '/tmp/arc1/sanity-hsm.test_13//04a2/0x200000401:0xa3:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.10' lhsmtool_posix: 1786102413.119111 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.9' lhsmtool_posix: 1786102413.170753 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.9' from '/tmp/arc1/sanity-hsm.test_13//04a5/0x200000401:0xa4:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.9' lhsmtool_posix: 1786102413.170967 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.8' lhsmtool_posix: 1786102413.216953 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.8' from '/tmp/arc1/sanity-hsm.test_13//04a4/0x200000401:0xa5:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.8' lhsmtool_posix: 1786102413.217480 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.7' lhsmtool_posix: 1786102413.260657 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.7' from '/tmp/arc1/sanity-hsm.test_13//04a7/0x200000401:0xa6:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.7' lhsmtool_posix: 1786102413.261343 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.6' lhsmtool_posix: 1786102413.301864 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.6' from '/tmp/arc1/sanity-hsm.test_13//04a6/0x200000401:0xa7:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.6' lhsmtool_posix: 1786102413.302072 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.5' lhsmtool_posix: 1786102413.341582 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.5' from '/tmp/arc1/sanity-hsm.test_13//04a9/0x200000401:0xa8:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.5' lhsmtool_posix: 1786102413.341828 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.4' lhsmtool_posix: 1786102413.383681 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.4' from '/tmp/arc1/sanity-hsm.test_13//04a8/0x200000401:0xa9:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.4' lhsmtool_posix: 1786102413.384328 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.3' lhsmtool_posix: 1786102413.437347 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.3' from '/tmp/arc1/sanity-hsm.test_13//04ab/0x200000401:0xaa:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.3' lhsmtool_posix: 1786102413.438165 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.2' lhsmtool_posix: 1786102413.503823 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.2' from '/tmp/arc1/sanity-hsm.test_13//04aa/0x200000401:0xab:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.2' lhsmtool_posix: 1786102413.504760 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.1' lhsmtool_posix: 1786102413.560946 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.1' from '/tmp/arc1/sanity-hsm.test_13//04ad/0x200000401:0xac:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.1' lhsmtool_posix: 1786102413.573845 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.10' lhsmtool_posix: 1786102413.634379 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.10' from '/tmp/arc1/sanity-hsm.test_13//04af/0x200000401:0xae:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.10' lhsmtool_posix: 1786102413.636079 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.9' lhsmtool_posix: 1786102413.698578 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.9' from '/tmp/arc1/sanity-hsm.test_13//04ae/0x200000401:0xaf:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.9' lhsmtool_posix: 1786102413.699738 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.8' lhsmtool_posix: 1786102413.750411 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.8' from '/tmp/arc1/sanity-hsm.test_13//04b1/0x200000401:0xb0:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.8' lhsmtool_posix: 1786102413.753026 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.7' lhsmtool_posix: 1786102413.814662 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.7' from '/tmp/arc1/sanity-hsm.test_13//04b0/0x200000401:0xb1:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.7' lhsmtool_posix: 1786102413.815356 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.6' lhsmtool_posix: 1786102413.858992 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.6' from '/tmp/arc1/sanity-hsm.test_13//04b3/0x200000401:0xb2:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.6' lhsmtool_posix: 1786102413.859296 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.5' lhsmtool_posix: 1786102413.903351 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.5' from '/tmp/arc1/sanity-hsm.test_13//04b2/0x200000401:0xb3:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.5' lhsmtool_posix: 1786102413.904628 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.4' lhsmtool_posix: 1786102413.951090 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.4' from '/tmp/arc1/sanity-hsm.test_13//04b5/0x200000401:0xb4:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.4' lhsmtool_posix: 1786102413.951905 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.3' lhsmtool_posix: 1786102413.995413 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.3' from '/tmp/arc1/sanity-hsm.test_13//04b4/0x200000401:0xb5:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.3' lhsmtool_posix: 1786102413.996345 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.2' lhsmtool_posix: 1786102414.042595 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.2' from '/tmp/arc1/sanity-hsm.test_13//04b7/0x200000401:0xb6:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.2' lhsmtool_posix: 1786102414.043814 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.1' lhsmtool_posix: 1786102414.090778 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.1' from '/tmp/arc1/sanity-hsm.test_13//04b6/0x200000401:0xb7:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.1' lhsmtool_posix: 1786102414.100786 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.10' lhsmtool_posix: 1786102414.159634 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.10' from '/tmp/arc1/sanity-hsm.test_13//04b8/0x200000401:0xb9:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.10' lhsmtool_posix: 1786102414.159895 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.9' lhsmtool_posix: 1786102414.217173 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.9' from '/tmp/arc1/sanity-hsm.test_13//04bb/0x200000401:0xba:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.9' lhsmtool_posix: 1786102414.217971 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.8' lhsmtool_posix: 1786102414.285624 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.8' from '/tmp/arc1/sanity-hsm.test_13//04ba/0x200000401:0xbb:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.8' lhsmtool_posix: 1786102414.285906 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.7' lhsmtool_posix: 1786102414.340318 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.7' from '/tmp/arc1/sanity-hsm.test_13//04bd/0x200000401:0xbc:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.7' lhsmtool_posix: 1786102414.341349 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.6' lhsmtool_posix: 1786102414.384226 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.6' from '/tmp/arc1/sanity-hsm.test_13//04bc/0x200000401:0xbd:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.6' lhsmtool_posix: 1786102414.385973 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.5' lhsmtool_posix: 1786102414.433626 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.5' from '/tmp/arc1/sanity-hsm.test_13//04bf/0x200000401:0xbe:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.5' lhsmtool_posix: 1786102414.435371 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.4' lhsmtool_posix: 1786102414.496662 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.4' from '/tmp/arc1/sanity-hsm.test_13//04be/0x200000401:0xbf:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.4' lhsmtool_posix: 1786102414.498085 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.3' lhsmtool_posix: 1786102414.559262 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.3' from '/tmp/arc1/sanity-hsm.test_13//04c1/0x200000401:0xc0:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.3' lhsmtool_posix: 1786102414.560760 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.2' lhsmtool_posix: 1786102414.613349 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.2' from '/tmp/arc1/sanity-hsm.test_13//04c0/0x200000401:0xc1:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.2' lhsmtool_posix: 1786102414.613749 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.1' lhsmtool_posix: 1786102414.673052 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.1' from '/tmp/arc1/sanity-hsm.test_13//04c3/0x200000401:0xc2:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.1' lhsmtool_posix: 1786102414.683302 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.10' lhsmtool_posix: 1786102414.769935 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.10' from '/tmp/arc1/sanity-hsm.test_13//04c5/0x200000401:0xc4:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.10' lhsmtool_posix: 1786102414.770166 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.9' lhsmtool_posix: 1786102414.834660 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.9' from '/tmp/arc1/sanity-hsm.test_13//04c4/0x200000401:0xc5:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.9' lhsmtool_posix: 1786102414.835636 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.8' lhsmtool_posix: 1786102414.884556 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.8' from '/tmp/arc1/sanity-hsm.test_13//04c7/0x200000401:0xc6:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.8' lhsmtool_posix: 1786102414.885935 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.7' lhsmtool_posix: 1786102414.946682 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.7' from '/tmp/arc1/sanity-hsm.test_13//04c6/0x200000401:0xc7:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.7' lhsmtool_posix: 1786102414.947752 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.6' lhsmtool_posix: 1786102415.007305 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.6' from '/tmp/arc1/sanity-hsm.test_13//04c9/0x200000401:0xc8:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.6' lhsmtool_posix: 1786102415.008002 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.5' lhsmtool_posix: 1786102415.050548 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.5' from '/tmp/arc1/sanity-hsm.test_13//04c8/0x200000401:0xc9:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.5' lhsmtool_posix: 1786102415.051100 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.4' lhsmtool_posix: 1786102415.157652 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.4' from '/tmp/arc1/sanity-hsm.test_13//04cb/0x200000401:0xca:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.4' lhsmtool_posix: 1786102415.159784 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.3' lhsmtool_posix: 1786102415.244560 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.3' from '/tmp/arc1/sanity-hsm.test_13//04ca/0x200000401:0xcb:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.3' lhsmtool_posix: 1786102415.246764 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.2' lhsmtool_posix: 1786102415.318666 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.2' from '/tmp/arc1/sanity-hsm.test_13//04cd/0x200000401:0xcc:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.2' lhsmtool_posix: 1786102415.319743 [35673]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.1' lhsmtool_posix: 1786102415.375187 [35673]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.1' from '/tmp/arc1/sanity-hsm.test_13//04cc/0x200000401:0xcd:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.1' lhsmtool_posix: 1786102415.378617 [35673]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_13/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 13 (54s) == sanity-hsm test 14: Rebind archived file to a new fid ========================================================== 07:34:11 (1786102451) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_14/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.211866 s, 4.9 MB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00640601 s, 0.0 kB/s rebind 0x200000402:0xa7:0x0 to 0x200000402:0xa8:0x0 lhsmtool_posix: 1786102456.076002 [36628]: action=2 src=0x200000402:0xa7:0x0 dst=0x200000402:0xa8:0x0 mount_point=/mnt/lustre2 lhsmtool_posix: 1786102456.081769 [36628]: rebind [0x200000402:0xa7:0x0] to [0x200000402:0xa8:0x0] lhsmtool_posix: 1786102456.081961 [36628]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 14 (13s) == sanity-hsm test 15: Rebind a list of files ============ 07:34:24 (1786102464) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_15/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.300823 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.17222 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.259835 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.173221 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.315841 s, 3.3 MB/s Waiting 300s for '' pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 0+0 records in 0+0 records out 0 bytes copied, 0.00818447 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.0184271 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.0272605 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00964894 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00777065 s, 0.0 kB/s rebind list of files lhsmtool_posix: 1786102475.011759 [37416]: action=2 src=/tmp/tmp.7626 dst=(null) mount_point=/mnt/lustre2 lhsmtool_posix: 1786102475.013679 [37416]: rebind [0x200000402:0xab:0x0] to [0x200000402:0xb0:0x0] lhsmtool_posix: 1786102475.014393 [37416]: rebind [0x200000402:0xac:0x0] to [0x200000402:0xb1:0x0] lhsmtool_posix: 1786102475.014442 [37416]: rebind [0x200000402:0xad:0x0] to [0x200000402:0xb2:0x0] lhsmtool_posix: 1786102475.014492 [37416]: rebind [0x200000402:0xae:0x0] to [0x200000402:0xb3:0x0] lhsmtool_posix: 1786102475.014542 [37416]: rebind [0x200000402:0xaf:0x0] to [0x200000402:0xb4:0x0] lhsmtool_posix: 1786102475.014602 [37416]: 5 lines read from '/tmp/tmp.7626', 5 rebind successful lhsmtool_posix: 1786102475.014619 [37416]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 15 (27s) == sanity-hsm test 16: Test CT bandwith control option === 07:34:51 (1786102491) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_16/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 20+0 records in 20+0 records out 20971520 bytes (21 MB, 20 MiB) copied, 0.0790449 s, 265 MB/s Waiting 200s for 'SUCCEED' Waiting 180s for 'SUCCEED' Updated after 22s: want 'SUCCEED' got 'SUCCEED' PASS 16 (33s) == sanity-hsm test 20: Release is not permitted ========== 07:35:24 (1786102524) 0+0 records in 0+0 records out 0 bytes copied, 0.015953 s, 0.0 kB/s 0x200000402:0xbc:0x0 Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted PASS 20 (9s) == sanity-hsm test 21: Simple release tests ============== 07:35:33 (1786102533) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_21/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.270412 s, 3.9 MB/s 1+0 records in 1+0 records out 512 bytes copied, 0.129613 s, 4.0 kB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 21 (16s) == sanity-hsm test 22: Could not swap a release file ===== 07:35:49 (1786102549) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_22/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.19732 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.190732 s, 5.5 MB/s 0x200000402:0xc1:0x0 lfs swap_layouts: error: cannot swap layout between '/mnt/lustre/d22.sanity-hsm/test_swap' and '/mnt/lustre/d22.sanity-hsm/test_release': Operation not supported (95) PASS 22 (12s) == sanity-hsm test 23: Release does not change a/mtime (utime) ========================================================== 07:36:01 (1786102561) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_23/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.355879 s, 2.9 MB/s PASS 23 (11s) == sanity-hsm test 24a: Archive, release, and restore does not change a/mtime (i/o) ========================================================== 07:36:12 (1786102572) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.309404 s, 3.4 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Killing existing copytools on oleg427-client.virtnet with signal TERM copytools stopped in 0s 192.168.204.127@tcp:/lustre /mnt/lustre lustre rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg427-client.virtnet /mnt/lustre (opts:) Starting client: oleg427-client.virtnet: -o user_xattr,flock 192.168.204.127@tcp:/lustre /mnt/lustre PASS 24a (18s) == sanity-hsm test 24b: root can archive, release, and restore user files ========================================================== 07:36:31 (1786102591) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14383 s, 7.3 MB/s Waiting 200s for 'SUCCEED' running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm] /mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm: (0x00000009) exists archived, archive_id:1 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [md5sum] [/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm] PASS 24b (14s) == sanity-hsm test 24c: check that user,group,other request masks work ========================================================== 07:36:44 (1786102604) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.284295 s, 3.7 MB/s 0x200000402:0xcc:0x0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.232987 s, 4.5 MB/s 0x200000402:0xcd:0x0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.155934 s, 6.7 MB/s 0x200000402:0xce:0x0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] PASS 24c (18s) == sanity-hsm test 24d: check that read-only mounts are respected ========================================================== 07:37:02 (1786102622) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.261288 s, 4.0 MB/s 0x200000402:0xd0:0x0 /mnt/lustre/d24d.sanity-hsm/f24d.sanity-hsm lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 106 0x6a 0x280000400 Starting client: oleg427-client.virtnet: -o user_xattr,flock 192.168.204.127@tcp:/lustre /mnt/lustre3 Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre3"' Cannot send HSM request (use of /mnt/lustre2/d24d.sanity-hsm/f24d.sanity-hsm): Read-only file system 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 1.06929 s, 981 kB/s Cannot send HSM request (use of /mnt/lustre2/d24d.sanity-hsm/f24d.sanity-hsm): Read-only file system Stopping client oleg427-client.virtnet /mnt/lustre3 (opts:) PASS 24d (18s) == sanity-hsm test 24e: tar succeeds on HSM released files ========================================================== 07:37:20 (1786102640) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.215679 s, 4.9 MB/s /mnt/lustre/d24e.sanity-hsm/f24e.sanity-hsm: (0x0000000d) released exists archived, archive_id:1 tar: Removing leading `/' from member names PASS 24e (12s) == sanity-hsm test 24f: root can archive, release, and restore tar files ========================================================== 07:37:32 (1786102652) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 54fb6627dbaa37721048e4549db3224d /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm f24f.sanity-hsm f24f.sanity-hsm Sum0 = 54fb6627dbaa37721048e4549db3224d /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm, sum1 = 54fb6627dbaa37721048e4549db3224d /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm PASS 24f (12s) == sanity-hsm test 24g: write by non-owner still sets dirty ========================================================== 07:37:44 (1786102664) RUNAS = 'runas -u 500 -g 500' Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24g/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Please listen carefully as our options have changed. running as uid/gid/euid/egid 500/500/500/500, groups: 500 [tee] [/mnt/lustre/d24g.sanity-hsm/f24g.sanity-hsm] To be electrocuted by your telephone, press #. PASS 24g (11s) == sanity-hsm test 25a: Restore lost file (HS_LOST flag) from import ========================================================== 07:37:55 (1786102675) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_25a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1786102678.146456 [46262]: action=1 src=d25a.sanity-hsm/f25a.sanity-hsm dst=/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786102678.157009 [46262]: importing '/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_25a//d25a.sanity-hsm/f25a.sanity-hsm' lhsmtool_posix: 1786102678.207029 [46262]: imported '/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_25a//0411/0x200000404:0x15:0x0'=='/tmp/arc1/sanity-hsm.test_25a//d25a.sanity-hsm/f25a.sanity-hsm' lhsmtool_posix: 1786102678.208300 [46262]: process finished, errs: 0 major, 0 minor, rc=0 (Success) md5sum: /mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm: No data available PASS 25a (8s) == sanity-hsm test 25b: Restore lost file (HS_LOST flag) after release ========================================================== 07:38:03 (1786102683) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_25b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' md5sum: /mnt/lustre/d25b.sanity-hsm/f25b.sanity-hsm: No data available PASS 25b (13s) == sanity-hsm test 26A: Remove the archive of a valid file ========================================================== 07:38:16 (1786102696) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.010099 s, 0.0 kB/s PASS 26A (11s) == sanity-hsm test 26a: Remove Archive On Last Unlink (RAoLU) policy ========================================================== 07:38:27 (1786102707) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 4s: want 'SUCCEED' got 'SUCCEED' PASS 26a (35s) == sanity-hsm test 26b: RAoLU policy when CDT off ======== 07:39:02 (1786102742) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled Killing existing copytools on oleg427-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 26b (24s) == sanity-hsm test 26c: RAoLU effective when file closed ========================================================== 07:39:26 (1786102766) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' multiop /mnt/lustre/d26c.sanity-hsm/f26c.sanity-hsm vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7626 Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 7s: want 'SUCCEED' got 'SUCCEED' PASS 26c (31s) == sanity-hsm test 26d: RAoLU when Client eviction ======= 07:39:57 (1786102797) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.313144 s, 3.3 MB/s multiop /mnt/lustre/d26d.sanity-hsm/f26d.sanity-hsm vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7626 Waiting 200s for 'SUCCEED' Updated after 8s: want 'SUCCEED' got 'SUCCEED' PASS 26d (31s) == sanity-hsm test 26e: RAoLU with a non-started coordinator ========================================================== 07:40:28 (1786102828) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.150535 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.144405 s, 7.3 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Killing existing copytools on oleg427-client.virtnet with signal TERM copytools stopped in 1s Failing mds1 on oleg427-server Stopping /mnt/lustre-mds1 (opts:) on oleg427-server 07:41:05 (1786102865) shut down facet: mds1 facet_host: oleg427-server facet_failover_host: oleg427-server Failover mds1 to oleg427-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg427-server: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 Started lustre-MDT0000 07:41:39 (1786102899) targets are mounted 07:41:39 (1786102899) facet_failover done oleg427-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Check cookie from RAoLU request (last: 1786102079, remove: 1786102080) mdt.lustre-MDT0000.hsm_control=enabled Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 26e (120s) == sanity-hsm test 27a: Remove the archive of an imported file (Operation not permitted) ========================================================== 07:42:29 (1786102949) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_27a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB, 39 MiB) copied, 1.0357 s, 39.5 MB/s lhsmtool_posix: 1786102953.870481 [53013]: action=1 src=d27a.sanity-hsm/f27a.sanity-hsm dst=/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786102953.883821 [53013]: importing '/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_27a//d27a.sanity-hsm/f27a.sanity-hsm' lhsmtool_posix: 1786102953.962620 [53013]: imported '/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_27a//0405/0x200000406:0x3:0x0'=='/tmp/arc1/sanity-hsm.test_27a//d27a.sanity-hsm/f27a.sanity-hsm' lhsmtool_posix: 1786102953.968182 [53013]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Cannot send HSM request (use of /mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm): Operation not permitted PASS 27a (12s) == sanity-hsm test 27b: Remove the archive of a relased file (Operation not permitted) ========================================================== 07:42:40 (1786102960) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_27b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.00555853 s, 0.0 kB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Cannot send HSM request (use of /mnt/lustre/d27b.sanity-hsm/f27b.sanity-hsm): Operation not permitted PASS 27b (12s) == sanity-hsm test 28: Concurrent archive/file remove ==== 07:42:53 (1786102973) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_28/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.010498 s, 0.0 kB/s mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled PASS 28 (17s) == sanity-hsm test 29a: Tests --mntpath and --archive options ========================================================== 07:43:11 (1786102991) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 7 "/mnt/lustre"' Cannot send HSM request (use of /mnt/lustre): Invalid argument hsm: '/qwerty/uyt' is not a valid FID PASS 29a (9s) == sanity-hsm test 29b: Archive/delete/remove by FID from the archive. ========================================================== 07:43:20 (1786103000) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.205709 s, 5.1 MB/s PASS 29b (13s) == sanity-hsm test 29c: Archive/delete/remove by FID, using a file list. ========================================================== 07:43:34 (1786103014) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137264 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.164455 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157672 s, 6.7 MB/s PASS 29c (18s) == sanity-hsm test 29d: hsm_remove by FID with archive_id 0 for unlinked file cause ========================================================== 07:43:51 (1786103031) SKIP: sanity-hsm test_29d Need 3 or more clients, have 1 SKIP 29d (5s) == sanity-hsm test 30a: Restore at exec (import case) ==== 07:43:56 (1786103036) SKIP: sanity-hsm test_30a Need 2 or more clients, have 1 SKIP 30a (5s) == sanity-hsm test 30b: Restore at exec (release case) === 07:44:02 (1786103042) SKIP: sanity-hsm test_30b Need 2 or more clients, have 1 SKIP 30b (3s) == sanity-hsm test 30c: Update during exec of released file must fail ========================================================== 07:44:05 (1786103045) SKIP: sanity-hsm test_30c Need 2 or more clients, have 1 SKIP 30c (4s) == sanity-hsm test 31a: Import a large file and check size during restore ========================================================== 07:44:09 (1786103049) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB, 39 MiB) copied, 0.750492 s, 54.5 MB/s lhsmtool_posix: 1786103052.898125 [58072]: action=1 src=d31a.sanity-hsm/f31a.sanity-hsm dst=/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786103052.909467 [58072]: importing '/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_31a//d31a.sanity-hsm/f31a.sanity-hsm' lhsmtool_posix: 1786103052.965742 [58072]: imported '/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_31a//040b/0x200000406:0xd:0x0'=='/tmp/arc1/sanity-hsm.test_31a//d31a.sanity-hsm/f31a.sanity-hsm' lhsmtool_posix: 1786103052.966513 [58072]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' size seen is right: 40894464 == 40894464 done PASS 31a (21s) == sanity-hsm test 31b: Restore a large unaligned file and check size during restore ========================================================== 07:44:31 (1786103071) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 39000000 bytes (39 MB, 37 MiB) copied, 1.27911 s, 30.5 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' size seen is right: 39000000 == 39000000 done PASS 31b (26s) == sanity-hsm test 31c: Restore a large aligned file and check size during restore ========================================================== 07:44:57 (1786103097) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB, 39 MiB) copied, 1.12554 s, 36.3 MB/s Waiting 200s for 'SUCCEED' Updated after 3s: want 'SUCCEED' got 'SUCCEED' size seen is right: 40894464 == 40894464 done PASS 31c (25s) == sanity-hsm test 33: Kill a restore waiting process ==== 07:45:22 (1786103122) 0+0 records in 0+0 records out 0 bytes copied, 0.00584195 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_33/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Copytool is suspended on oleg427-client.virtnet Copytool is continued on oleg427-client.virtnet /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2893: 60090 Terminated md5sum $f > /dev/null PASS 33 (14s) == sanity-hsm test 34: Remove file during restore ======== 07:45:37 (1786103137) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_34/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.00805718 s, 0.0 kB/s Copytool is suspended on oleg427-client.virtnet Waiting 200s for 'STARTED' Updated after 2s: want 'STARTED' got 'STARTED' Copytool is continued on oleg427-client.virtnet /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2925: kill: (60743) - No such process PASS 34 (13s) == sanity-hsm test 35: Overwrite file during restore ===== 07:45:51 (1786103151) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_35/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.0115631 s, 0.0 kB/s Copytool is suspended on oleg427-client.virtnet Copytool is continued on oleg427-client.virtnet /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2962: kill: (61421) - No such process PASS 35 (13s) == sanity-hsm test 36: Move file during restore ========== 07:46:04 (1786103164) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_36/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.00555057 s, 0.0 kB/s Copytool is suspended on oleg427-client.virtnet Copytool is continued on oleg427-client.virtnet /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2998: kill: (62088) - No such process PASS 36 (12s) == sanity-hsm test 37: re-archive a dirty file =========== 07:46:16 (1786103176) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_37/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.217208 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0660529 s, 15.9 MB/s Waiting 200s for 'SUCCEED' Updated after 5s: want 'SUCCEED' got 'SUCCEED' PASS 37 (79s) == sanity-hsm test 40: Parallel archive requests ========= 07:47:35 (1786103255) oleg427-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=1152921504606846976: Cannot allocate memory oleg427-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='1152921504606846976': Cannot allocate memory pdsh@oleg427-client: oleg427-server: ssh exited with exit code 12 set max_requests=1152921504606846976 failed with 12 [ 1779.112218] Lustre: lustre-MDT0000: No more memory to set HSM max_requests=1152921504606846976 (max request memory: 461MB, current total 3/975941): rc = -12 Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_40/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=purge Wait for all requests being enqueued...100 archive requests submitted 100 archive requests submitted 100 archive requests submitted 100 archive requests submitted OK pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 PASS 40 (166s) == sanity-hsm test 50: Archive with large number of pending HSM actions ========================================================== 07:50:21 (1786103421) oleg427-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=1000000: Cannot allocate memory oleg427-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='1000000': Cannot allocate memory pdsh@oleg427-client: oleg427-server: ssh exited with exit code 12 Filesystem Inodes IUsed IFree IUse% Mounted on 192.168.204.127@tcp:/lustre 236062 990 235072 1% /mnt/lustre - create 813 (time 1786103439.08 total 10.01 last 81.18) - create 1955 (time 1786103449.08 total 20.02 last 114.16) - create 3200 (time 1786103459.08 total 30.02 last 124.48) - create 4446 (time 1786103469.09 total 40.02 last 124.58) - create 5622 (time 1786103479.09 total 50.02 last 117.60) - create 6853 (time 1786103489.09 total 60.03 last 123.04) - create 8080 (time 1786103499.10 total 70.03 last 122.64) - create 9302 (time 1786103509.10 total 80.04 last 122.14) total: 10000 create in 85.77 seconds: 116.60 ops/second 10000 - unlinked 0 (time 1786103607 ; total 0 ; last 0) total: 10000 unlinks in 85 seconds: 117.647057 unlinks/second Start Phase files_num: 10000 time: 86 - create 1258 (time 1786103707.40 total 10.00 last 125.77) - create 2558 (time 1786103717.40 total 20.00 last 129.97) - create 3837 (time 1786103727.40 total 30.01 last 127.86) - create 5066 (time 1786103737.41 total 40.01 last 122.85) - create 6310 (time 1786103747.41 total 50.01 last 124.39) - create 7648 (time 1786103757.41 total 60.02 last 133.74) - create 8943 (time 1786103767.42 total 70.02 last 129.48) - create 10000 (time 1786103775.35 total 77.95 last 133.24) - create 11289 (time 1786103785.35 total 87.95 last 128.87) - create 12559 (time 1786103795.35 total 97.96 last 126.95) - create 13918 (time 1786103805.36 total 107.96 last 135.83) - create 15314 (time 1786103815.36 total 117.96 last 139.60) - create 16669 (time 1786103825.36 total 127.97 last 135.43) - create 18037 (time 1786103835.37 total 137.98 last 136.71) - create 19440 (time 1786103845.38 total 147.98 last 140.23) total: 20000 create in 151.99 seconds: 131.59 ops/second - unlinked 0 (time 1786104044 ; total 0 ; last 0) - unlinked 10000 (time 1786104148 ; total 104 ; last 104) total: 20000 unlinks in 198 seconds: 101.010101 unlinks/second Middle Phase files_num: 20000 time: 187 - create 1179 (time 1786104257.01 total 10.00 last 117.89) - create 2309 (time 1786104267.02 total 20.01 last 112.89) - create 3394 (time 1786104277.03 total 30.02 last 108.38) - create 4565 (time 1786104287.04 total 40.03 last 116.97) - create 5639 (time 1786104297.05 total 50.04 last 107.33) - create 6802 (time 1786104307.05 total 60.04 last 116.26) - create 7893 (time 1786104317.05 total 70.05 last 109.07) - create 9014 (time 1786104327.06 total 80.05 last 112.03) total: 10000 create in 88.93 seconds: 112.45 ops/second 40000 - unlinked 0 (time 1786104456 ; total 0 ; last 0) total: 10000 unlinks in 107 seconds: 93.457947 unlinks/second End Phase files_num: 10000 time: 109 40000 mdt.lustre-MDT0000.hsm_control=purge PASS 50 (1166s) == sanity-hsm test 52: Opened for write file on an evicted client should be set dirty ========================================================== 08:09:47 (1786104587) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_52/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.297834 s, 3.5 MB/s multiop /mnt/lustre/d52.sanity-hsm/f52.sanity-hsm vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7626 PASS 52 (19s) == sanity-hsm test 53: Opened for read file on an evicted client should not be set dirty ========================================================== 08:10:07 (1786104607) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_53/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.232831 s, 4.5 MB/s multiop /mnt/lustre/d53.sanity-hsm/f53.sanity-hsm vo_c TMPPIPE=/tmp/multiop_open_wait_pipe.7626 oleg427-client: error: invalid path '/mnt/lustre': Cannot send after transport endpoint shutdown pdsh@oleg427-client: oleg427-client: ssh exited with exit code 108 PASS 53 (22s) == sanity-hsm test 54: Write during an archive cancels it ========================================================== 08:10:28 (1786104628) 39+0 records in 39+0 records out 39000000 bytes (39 MB, 37 MiB) copied, 1.30363 s, 29.9 MB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_54/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=+NRA Waiting 200s for 'FAILED' Waiting 190s for 'FAILED' Updated after 33s: want 'FAILED' got 'FAILED' mdt.lustre-MDT0000.hsm.policy=-NRA PASS 54 (50s) == sanity-hsm test 55: Truncate during an archive cancels it ========================================================== 08:11:18 (1786104678) 39+0 records in 39+0 records out 39000000 bytes (39 MB, 37 MiB) copied, 1.21025 s, 32.2 MB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_55/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' Waiting 200s for 'STARTED' Updated after 2s: want 'STARTED' got 'STARTED' mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0000.hsm.policy=-NRA PASS 55 (17s) == sanity-hsm test 56: Setattr during an archive is ok === 08:11:35 (1786104695) 39+0 records in 39+0 records out 39000000 bytes (39 MB, 37 MiB) copied, 1.36219 s, 28.6 MB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_56/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 36s: want 'SUCCEED' got 'SUCCEED' PASS 56 (49s) == sanity-hsm test 57: Archive a file with dirty cache on another node ========================================================== 08:12:24 (1786104744) SKIP: sanity-hsm test_57 Need 2 or more clients, have 1 SKIP 57 (4s) == sanity-hsm test 58: Truncate a released file will trigger restore ========================================================== 08:12:29 (1786104749) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_58/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' truncate up from 1516 to 3032 /mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2 truncate down from 1516 to 758 /mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2 truncate to 0 /mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2 PASS 58 (22s) == sanity-hsm test 59: Release stripeless file with non-zero size ========================================================== 08:12:51 (1786104771) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_59/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 59 (11s) == sanity-hsm test 60: Changing progress update interval from default ========================================================== 08:13:02 (1786104782) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.276679 s, 37.9 MB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_60/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 --update-interval 5 "/mnt/lustre2"' Waiting 100s for 'start copy' Expecting a progress update within 20 seconds... 5242880 bytes copied in 2 seconds. Wait for on going archive hsm action to complete Waiting 10s for 'copied' Updated after 4s: want 'copied' got 'copied' PASS 60 (21s) == sanity-hsm test 61: Waiting archive of a removed file should fail ========================================================== 08:13:23 (1786104803) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_61/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled PASS 61 (14s) == sanity-hsm test 70: Copytool logs JSON register/unregister events to FIFO ========================================================== 08:13:38 (1786104818) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_70/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --event-fifo /tmp/sanity-hsm.test_70.kHjU/fifo "/mnt/lustre2"' Killing existing copytools on oleg427-client.virtnet with signal TERM copytools stopped in 0s Register/Unregister events look OK. PASS 70 (16s) == sanity-hsm test 71: Copytool logs JSON archive events to FIFO ========================================================== 08:13:53 (1786104833) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_71/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --update-interval 5 --event-fifo /tmp/sanity-hsm.test_71.w9HC/fifo "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=-NRA 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.373446 s, 2.8 MB/s Archive events look OK. mdt.lustre-MDT0000.hsm.policy=-NRA PASS 71 (28s) == sanity-hsm test 72: Copytool logs JSON restore events to FIFO ========================================================== 08:14:22 (1786104862) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_72/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --update-interval 5 --event-fifo /tmp/sanity-hsm.test_72.DE64/fifo "/mnt/lustre2"' 16+0 records in 16+0 records out 16000000 bytes (16 MB, 15 MiB) copied, 0.272519 s, 58.7 MB/s lhsmtool_posix: 1786104867.426452 [80766]: action=1 src=d72.sanity-hsm/f72.sanity-hsm dst=/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786104867.434971 [80766]: importing '/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_72//d72.sanity-hsm/f72.sanity-hsm' lhsmtool_posix: 1786104867.481420 [80766]: imported '/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_72//0bc8/0x200000bd2:0x1a:0x0'=='/tmp/arc1/sanity-hsm.test_72//d72.sanity-hsm/f72.sanity-hsm' lhsmtool_posix: 1786104867.483088 [80766]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Verifying released state: Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Restore events look OK. PASS 72 (24s) == sanity-hsm test 90: Archive/restore a file list ======= 08:14:45 (1786104885) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_90/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=purge Waiting 200s for '' pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 Waiting 200s for '' Changed after 3s: from 'lrh=[type=10680000 len=136 idx=4/10061] fid=[0x200000402:0x2a2:0x0] dfid=[0x200000402:0x2a2:0x0] compound/cookie=0x0/0x6a765f72 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10063] fid=[0x200000402:0x2a4:0x0] dfid=[0x200000402:0x2a4:0x0] compound/cookie=0x0/0x6a765f74 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10064] fid=[0x200000402:0x2a5:0x0] dfid=[0x200000402:0x2a5:0x0] compound/cookie=0x0/0x6a765f75 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10066] fid=[0x200000402:0x2a6:0x0] dfid=[0x200000402:0x2a6:0x0] compound/cookie=0x0/0x6a765f76 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10067] fid=[0x200000402:0x2a7:0x0] dfid=[0x200000402:0x2a7:0x0] compound/cookie=0x0/0x6a765f77 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10068] fid=[0x200000402:0x2a8:0x0] dfid=[0x200000402:0x2a8:0x0] compound/cookie=0x0/0x6a765f78 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10069] fid=[0x200000402:0x2a9:0x0] dfid=[0x200000402:0x2a9:0x0] compound/cookie=0x0/0x6a765f79 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10070] fid=[0x200000402:0x2aa:0x0] dfid=[0x200000402:0x2aa:0x0] compound/cookie=0x0/0x6a765f7a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10071] fid=[0x200000402:0x2ab:0x0] dfid=[0x200000402:0x2ab:0x0] compound/cookie=0x0/0x6a765f7b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10072] fid=[0x200000402:0x2ac:0x0] dfid=[0x200000402:0x2ac:0x0] compound/cookie=0x0/0x6a765f7c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10073] fid=[0x200000402:0x2ad:0x0] dfid=[0x200000402:0x2ad:0x0] compound/cookie=0x0/0x6a765f7d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10074] fid=[0x200000402:0x2ae:0x0] dfid=[0x200000402:0x2ae:0x0] compound/cookie=0x0/0x6a765f7e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10075] fid=[0x200000402:0x2af:0x0] dfid=[0x200000402:0x2af:0x0] compound/cookie=0x0/0x6a765f7f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10076] fid=[0x200000402:0x2b0:0x0] dfid=[0x200000402:0x2b0:0x0] compound/cookie=0x0/0x6a765f80 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10077] fid=[0x200000402:0x2b1:0x0] dfid=[0x200000402:0x2b1:0x0] compound/cookie=0x0/0x6a765f81 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10078] fid=[0x200000402:0x2b2:0x0] dfid=[0x200000402:0x2b2:0x0] compound/cookie=0x0/0x6a765f82 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10079] fid=[0x200000402:0x2b3:0x0] dfid=[0x200000402:0x2b3:0x0] compound/cookie=0x0/0x6a765f83 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10080] fid=[0x200000402:0x2b4:0x0] dfid=[0x200000402:0x2b4:0x0] compound/cookie=0x0/0x6a765f84 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10081] fid=[0x200000402:0x2b5:0x0] dfid=[0x200000402:0x2b5:0x0] compound/cookie=0x0/0x6a765f85 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10082] fid=[0x200000402:0x2b6:0x0] dfid=[0x200000402:0x2b6:0x0] compound/cookie=0x0/0x6a765f86 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10083] fid=[0x200000402:0x2b7:0x0] dfid=[0x200000402:0x2b7:0x0] compound/cookie=0x0/0x6a765f87 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10084] fid=[0x200000402:0x2b8:0x0] dfid=[0x200000402:0x2b8:0x0] compound/cookie=0x0/0x6a765f88 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10085] fid=[0x200000402:0x2b9:0x0] dfid=[0x200000402:0x2b9:0x0] compound/cookie=0x0/0x6a765f89 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10086] fid=[0x200000402:0x2ba:0x0] dfid=[0x200000402:0x2ba:0x0] compound/cookie=0x0/0x6a765f8a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10087] fid=[0x200000402:0x2bb:0x0] dfid=[0x200000402:0x2bb:0x0] compound/cookie=0x0/0x6a765f8b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10088] fid=[0x200000402:0x2bc:0x0] dfid=[0x200000402:0x2bc:0x0] compound/cookie=0x0/0x6a765f8c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10089] fid=[0x200000402:0x2bd:0x0] dfid=[0x200000402:0x2bd:0x0] compound/cookie=0x0/0x6a765f8d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10090] fid=[0x200000402:0x2be:0x0] dfid=[0x200000402:0x2be:0x0] compound/cookie=0x0/0x6a765f8e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10091] fid=[0x200000402:0x2bf:0x0] dfid=[0x200000402:0x2bf:0x0] compound/cookie=0x0/0x6a765f8f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10092] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x6a765f90 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10093] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x6a765f91 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x6a765f92 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x6a765f93 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x6a765f94 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x6a765f95 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x6a765f96 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x6a765f97 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x6a765f98 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x6a765f99 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x6a765f9a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a765f9b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a765f9c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a765f9d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a765f9e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a765f9f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a765fa0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a765fa1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/10073] fid=[0x200000402:0x2ad:0x0] dfid=[0x200000402:0x2ad:0x0] compound/cookie=0x0/0x6a765f7d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10074] fid=[0x200000402:0x2ae:0x0] dfid=[0x200000402:0x2ae:0x0] compound/cookie=0x0/0x6a765f7e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10075] fid=[0x200000402:0x2af:0x0] dfid=[0x200000402:0x2af:0x0] compound/cookie=0x0/0x6a765f7f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10076] fid=[0x200000402:0x2b0:0x0] dfid=[0x200000402:0x2b0:0x0] compound/cookie=0x0/0x6a765f80 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10077] fid=[0x200000402:0x2b1:0x0] dfid=[0x200000402:0x2b1:0x0] compound/cookie=0x0/0x6a765f81 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10078] fid=[0x200000402:0x2b2:0x0] dfid=[0x200000402:0x2b2:0x0] compound/cookie=0x0/0x6a765f82 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10079] fid=[0x200000402:0x2b3:0x0] dfid=[0x200000402:0x2b3:0x0] compound/cookie=0x0/0x6a765f83 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10080] fid=[0x200000402:0x2b4:0x0] dfid=[0x200000402:0x2b4:0x0] compound/cookie=0x0/0x6a765f84 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10081] fid=[0x200000402:0x2b5:0x0] dfid=[0x200000402:0x2b5:0x0] compound/cookie=0x0/0x6a765f85 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10082] fid=[0x200000402:0x2b6:0x0] dfid=[0x200000402:0x2b6:0x0] compound/cookie=0x0/0x6a765f86 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10083] fid=[0x200000402:0x2b7:0x0] dfid=[0x200000402:0x2b7:0x0] compound/cookie=0x0/0x6a765f87 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10084] fid=[0x200000402:0x2b8:0x0] dfid=[0x200000402:0x2b8:0x0] compound/cookie=0x0/0x6a765f88 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10085] fid=[0x200000402:0x2b9:0x0] dfid=[0x200000402:0x2b9:0x0] compound/cookie=0x0/0x6a765f89 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10086] fid=[0x200000402:0x2ba:0x0] dfid=[0x200000402:0x2ba:0x0] compound/cookie=0x0/0x6a765f8a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10087] fid=[0x200000402:0x2bb:0x0] dfid=[0x200000402:0x2bb:0x0] compound/cookie=0x0/0x6a765f8b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10088] fid=[0x200000402:0x2bc:0x0] dfid=[0x200000402:0x2bc:0x0] compound/cookie=0x0/0x6a765f8c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10089] fid=[0x200000402:0x2bd:0x0] dfid=[0x200000402:0x2bd:0x0] compound/cookie=0x0/0x6a765f8d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10090] fid=[0x200000402:0x2be:0x0] dfid=[0x200000402:0x2be:0x0] compound/cookie=0x0/0x6a765f8e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10091] fid=[0x200000402:0x2bf:0x0] dfid=[0x200000402:0x2bf:0x0] compound/cookie=0x0/0x6a765f8f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10092] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x6a765f90 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10093] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x6a765f91 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x6a765f92 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x6a765f93 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x6a765f94 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x6a765f95 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x6a765f96 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x6a765f97 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x6a765f98 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x6a765f99 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x6a765f9a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a765f9b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a765f9c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a765f9d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a765f9e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a765f9f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a765fa0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a765fa1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' Changed after 6s: from 'lrh=[type=10680000 len=136 idx=4/10073] fid=[0x200000402:0x2ad:0x0] dfid=[0x200000402:0x2ad:0x0] compound/cookie=0x0/0x6a765f7d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10074] fid=[0x200000402:0x2ae:0x0] dfid=[0x200000402:0x2ae:0x0] compound/cookie=0x0/0x6a765f7e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10075] fid=[0x200000402:0x2af:0x0] dfid=[0x200000402:0x2af:0x0] compound/cookie=0x0/0x6a765f7f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10076] fid=[0x200000402:0x2b0:0x0] dfid=[0x200000402:0x2b0:0x0] compound/cookie=0x0/0x6a765f80 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10077] fid=[0x200000402:0x2b1:0x0] dfid=[0x200000402:0x2b1:0x0] compound/cookie=0x0/0x6a765f81 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10078] fid=[0x200000402:0x2b2:0x0] dfid=[0x200000402:0x2b2:0x0] compound/cookie=0x0/0x6a765f82 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10079] fid=[0x200000402:0x2b3:0x0] dfid=[0x200000402:0x2b3:0x0] compound/cookie=0x0/0x6a765f83 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10080] fid=[0x200000402:0x2b4:0x0] dfid=[0x200000402:0x2b4:0x0] compound/cookie=0x0/0x6a765f84 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10081] fid=[0x200000402:0x2b5:0x0] dfid=[0x200000402:0x2b5:0x0] compound/cookie=0x0/0x6a765f85 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10082] fid=[0x200000402:0x2b6:0x0] dfid=[0x200000402:0x2b6:0x0] compound/cookie=0x0/0x6a765f86 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10083] fid=[0x200000402:0x2b7:0x0] dfid=[0x200000402:0x2b7:0x0] compound/cookie=0x0/0x6a765f87 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10084] fid=[0x200000402:0x2b8:0x0] dfid=[0x200000402:0x2b8:0x0] compound/cookie=0x0/0x6a765f88 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10085] fid=[0x200000402:0x2b9:0x0] dfid=[0x200000402:0x2b9:0x0] compound/cookie=0x0/0x6a765f89 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10086] fid=[0x200000402:0x2ba:0x0] dfid=[0x200000402:0x2ba:0x0] compound/cookie=0x0/0x6a765f8a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10087] fid=[0x200000402:0x2bb:0x0] dfid=[0x200000402:0x2bb:0x0] compound/cookie=0x0/0x6a765f8b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10088] fid=[0x200000402:0x2bc:0x0] dfid=[0x200000402:0x2bc:0x0] compound/cookie=0x0/0x6a765f8c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10089] fid=[0x200000402:0x2bd:0x0] dfid=[0x200000402:0x2bd:0x0] compound/cookie=0x0/0x6a765f8d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10090] fid=[0x200000402:0x2be:0x0] dfid=[0x200000402:0x2be:0x0] compound/cookie=0x0/0x6a765f8e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10091] fid=[0x200000402:0x2bf:0x0] dfid=[0x200000402:0x2bf:0x0] compound/cookie=0x0/0x6a765f8f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10092] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x6a765f90 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10093] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x6a765f91 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x6a765f92 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x6a765f93 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x6a765f94 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x6a765f95 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x6a765f96 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x6a765f97 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x6a765f98 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x6a765f99 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x6a765f9a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a765f9b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a765f9c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a765f9d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a765f9e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a765f9f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a765fa0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a765fa1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/10082] fid=[0x200000402:0x2b6:0x0] dfid=[0x200000402:0x2b6:0x0] compound/cookie=0x0/0x6a765f86 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10083] fid=[0x200000402:0x2b7:0x0] dfid=[0x200000402:0x2b7:0x0] compound/cookie=0x0/0x6a765f87 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10084] fid=[0x200000402:0x2b8:0x0] dfid=[0x200000402:0x2b8:0x0] compound/cookie=0x0/0x6a765f88 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10085] fid=[0x200000402:0x2b9:0x0] dfid=[0x200000402:0x2b9:0x0] compound/cookie=0x0/0x6a765f89 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10086] fid=[0x200000402:0x2ba:0x0] dfid=[0x200000402:0x2ba:0x0] compound/cookie=0x0/0x6a765f8a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10087] fid=[0x200000402:0x2bb:0x0] dfid=[0x200000402:0x2bb:0x0] compound/cookie=0x0/0x6a765f8b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10088] fid=[0x200000402:0x2bc:0x0] dfid=[0x200000402:0x2bc:0x0] compound/cookie=0x0/0x6a765f8c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10089] fid=[0x200000402:0x2bd:0x0] dfid=[0x200000402:0x2bd:0x0] compound/cookie=0x0/0x6a765f8d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10090] fid=[0x200000402:0x2be:0x0] dfid=[0x200000402:0x2be:0x0] compound/cookie=0x0/0x6a765f8e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10091] fid=[0x200000402:0x2bf:0x0] dfid=[0x200000402:0x2bf:0x0] compound/cookie=0x0/0x6a765f8f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10092] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x6a765f90 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10093] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x6a765f91 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x6a765f92 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x6a765f93 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x6a765f94 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x6a765f95 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x6a765f96 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x6a765f97 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x6a765f98 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x6a765f99 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x6a765f9a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a765f9b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a765f9c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a765f9d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a765f9e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a765f9f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a765fa0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a765fa1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' Changed after 9s: from 'lrh=[type=10680000 len=136 idx=4/10082] fid=[0x200000402:0x2b6:0x0] dfid=[0x200000402:0x2b6:0x0] compound/cookie=0x0/0x6a765f86 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10083] fid=[0x200000402:0x2b7:0x0] dfid=[0x200000402:0x2b7:0x0] compound/cookie=0x0/0x6a765f87 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10084] fid=[0x200000402:0x2b8:0x0] dfid=[0x200000402:0x2b8:0x0] compound/cookie=0x0/0x6a765f88 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10085] fid=[0x200000402:0x2b9:0x0] dfid=[0x200000402:0x2b9:0x0] compound/cookie=0x0/0x6a765f89 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10086] fid=[0x200000402:0x2ba:0x0] dfid=[0x200000402:0x2ba:0x0] compound/cookie=0x0/0x6a765f8a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10087] fid=[0x200000402:0x2bb:0x0] dfid=[0x200000402:0x2bb:0x0] compound/cookie=0x0/0x6a765f8b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10088] fid=[0x200000402:0x2bc:0x0] dfid=[0x200000402:0x2bc:0x0] compound/cookie=0x0/0x6a765f8c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10089] fid=[0x200000402:0x2bd:0x0] dfid=[0x200000402:0x2bd:0x0] compound/cookie=0x0/0x6a765f8d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10090] fid=[0x200000402:0x2be:0x0] dfid=[0x200000402:0x2be:0x0] compound/cookie=0x0/0x6a765f8e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10091] fid=[0x200000402:0x2bf:0x0] dfid=[0x200000402:0x2bf:0x0] compound/cookie=0x0/0x6a765f8f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10092] fid=[0x200000402:0x2c0:0x0] dfid=[0x200000402:0x2c0:0x0] compound/cookie=0x0/0x6a765f90 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10093] fid=[0x200000402:0x2c1:0x0] dfid=[0x200000402:0x2c1:0x0] compound/cookie=0x0/0x6a765f91 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x6a765f92 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x6a765f93 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x6a765f94 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x6a765f95 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x6a765f96 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x6a765f97 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x6a765f98 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x6a765f99 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x6a765f9a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a765f9b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a765f9c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a765f9d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a765f9e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a765f9f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a765fa0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a765fa1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x6a765f92 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x6a765f93 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x6a765f94 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x6a765f95 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x6a765f96 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x6a765f97 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x6a765f98 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x6a765f99 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x6a765f9a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a765f9b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a765f9c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a765f9d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a765f9e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a765f9f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a765fa0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a765fa1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' Changed after 11s: from 'lrh=[type=10680000 len=136 idx=4/10094] fid=[0x200000402:0x2c2:0x0] dfid=[0x200000402:0x2c2:0x0] compound/cookie=0x0/0x6a765f92 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10095] fid=[0x200000402:0x2c3:0x0] dfid=[0x200000402:0x2c3:0x0] compound/cookie=0x0/0x6a765f93 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10096] fid=[0x200000402:0x2c4:0x0] dfid=[0x200000402:0x2c4:0x0] compound/cookie=0x0/0x6a765f94 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10097] fid=[0x200000402:0x2c5:0x0] dfid=[0x200000402:0x2c5:0x0] compound/cookie=0x0/0x6a765f95 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10098] fid=[0x200000402:0x2c6:0x0] dfid=[0x200000402:0x2c6:0x0] compound/cookie=0x0/0x6a765f96 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10099] fid=[0x200000402:0x2c7:0x0] dfid=[0x200000402:0x2c7:0x0] compound/cookie=0x0/0x6a765f97 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10100] fid=[0x200000402:0x2c8:0x0] dfid=[0x200000402:0x2c8:0x0] compound/cookie=0x0/0x6a765f98 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10101] fid=[0x200000402:0x2c9:0x0] dfid=[0x200000402:0x2c9:0x0] compound/cookie=0x0/0x6a765f99 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10102] fid=[0x200000402:0x2ca:0x0] dfid=[0x200000402:0x2ca:0x0] compound/cookie=0x0/0x6a765f9a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a765f9b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a765f9c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a765f9d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a765f9e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a765f9f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a765fa0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a765fa1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/10103] fid=[0x200000402:0x2cb:0x0] dfid=[0x200000402:0x2cb:0x0] compound/cookie=0x0/0x6a765f9b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10104] fid=[0x200000402:0x2cc:0x0] dfid=[0x200000402:0x2cc:0x0] compound/cookie=0x0/0x6a765f9c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10105] fid=[0x200000402:0x2cd:0x0] dfid=[0x200000402:0x2cd:0x0] compound/cookie=0x0/0x6a765f9d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/10106] fid=[0x200000402:0x2ce:0x0] dfid=[0x200000402:0x2ce:0x0] compound/cookie=0x0/0x6a765f9e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10107] fid=[0x200000402:0x2cf:0x0] dfid=[0x200000402:0x2cf:0x0] compound/cookie=0x0/0x6a765f9f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10108] fid=[0x200000402:0x2d0:0x0] dfid=[0x200000402:0x2d0:0x0] compound/cookie=0x0/0x6a765fa0 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/10109] fid=[0x200000402:0x2d1:0x0] dfid=[0x200000402:0x2d1:0x0] compound/cookie=0x0/0x6a765fa1 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 PASS 90 (106s) == sanity-hsm test 100: Set coordinator /proc tunables === 08:16:31 (1786104991) Testing mdt.lustre-MDT0000.hsm.loop_period Set loop_period to 0 must failed oleg427-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/loop_period=0: Invalid argument oleg427-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/loop_period'='0': Invalid argument pdsh@oleg427-client: oleg427-server: ssh exited with exit code 22 Testing mdt.lustre-MDT0000.hsm.grace_delay Set grace_delay to 0 must failed oleg427-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/grace_delay=0: Invalid argument oleg427-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/grace_delay'='0': Invalid argument pdsh@oleg427-client: oleg427-server: ssh exited with exit code 22 Testing mdt.lustre-MDT0000.hsm.active_request_timeout Set active_request_timeout to 0 must failed oleg427-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/active_request_timeout=0: Invalid argument oleg427-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/active_request_timeout'='0': Invalid argument pdsh@oleg427-client: oleg427-server: ssh exited with exit code 22 Testing mdt.lustre-MDT0000.hsm.max_requests Set max_requests to 0 must failed oleg427-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=0: Invalid argument oleg427-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='0': Invalid argument pdsh@oleg427-client: oleg427-server: ssh exited with exit code 22 Testing mdt.lustre-MDT0000.hsm.default_archive_id Set default_archive_id to 0 must failed oleg427-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/default_archive_id=0: Invalid argument oleg427-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/default_archive_id'='0': Invalid argument pdsh@oleg427-client: oleg427-server: ssh exited with exit code 22 PASS 100 (41s) == sanity-hsm test 102: Verify coordinator control ======= 08:17:12 (1786105032) mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled PASS 102 (18s) == sanity-hsm test 103: Purge all requests =============== 08:17:30 (1786105050) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_103/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=purge Current requests pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 PASS 103 (19s) == sanity-hsm test 103a: Purge pending restore requests == 08:17:49 (1786105069) mdt.lustre-MDT0000.hsm.policy=-NBR Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_103a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' (0x200000402:0x319:0x0|0x200000402:0x31a:0x0|0x200000402:0x31b:0x0|0x200000402:0x31c:0x0|0x200000402:0x31d:0x0|0x200000402:0x31e:0x0|0x200000402:0x31f:0x0|0x200000402:0x320:0x0).*action=ARCHIVE.*status=SUCCEED Killing existing copytools on oleg427-client.virtnet with signal TERM copytools stopped in 0s cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31d:0x0': No data available cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31f:0x0': No data available cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31b:0x0': No data available cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31c:0x0': No data available cat: '/mnt/lustre/.lustre/fid/0x200000402:0x320:0x0': No data available cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31a:0x0': No data available cat: '/mnt/lustre/.lustre/fid/0x200000402:0x319:0x0': No data available cat: '/mnt/lustre/.lustre/fid/0x200000402:0x31e:0x0': No data available mdt.lustre-MDT0000.hsm_control=purge PASS 103a (21s) == sanity-hsm test 104: Copy tool data field ============= 08:18:10 (1786105090) 0+0 records in 0+0 records out 0 bytes copied, 0.00916054 s, 0.0 kB/s mdt.lustre-MDT0000.hsm_control=purge PASS 104 (14s) == sanity-hsm test 105: Restart of coordinator =========== 08:18:24 (1786105104) mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0000.hsm_control=purge PASS 105 (30s) == sanity-hsm test 106a: Copytool register/unregister ==== 08:18:54 (1786105134) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' oleg427-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg427-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=f099b708-b058-4989-aed9-5104ddfef353 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 oleg427-client.virtnet: 87071 Killing existing copytools on oleg427-client.virtnet with signal TERM copytools stopped in 0s pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 uuid not found in agent list on mds1 Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' oleg427-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg427-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=f099b708-b058-4989-aed9-5104ddfef353 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 PASS 106a (43s) == sanity-hsm test 106b: Unregister agent after a copytool crash ========================================================== 08:19:37 (1786105177) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' oleg427-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg427-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=f099b708-b058-4989-aed9-5104ddfef353 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 oleg427-client.virtnet: 88766 Killing existing copytools on oleg427-client.virtnet with signal KILL copytools stopped in 0s pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 uuid not found in agent list on mds1 Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' found agent uuid=f099b708-b058-4989-aed9-5104ddfef353 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 PASS 106b (30s) == sanity-hsm test 106c: Unregister copytool on client eviction ========================================================== 08:20:07 (1786105207) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' oleg427-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg427-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=f099b708-b058-4989-aed9-5104ddfef353 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 oleg427-client.virtnet: 89961 oleg427-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg427-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg427-client.virtnet: executing get_client_uuid /mnt/lustre2 mdc.lustre-MDT0000-mdc-ffff8a8ece3a7000.active=0 mdt.lustre-MDT0000.evict_client=f099b708-b058-4989-aed9-5104ddfef353 pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 uuid not found in agent list on mds1 mdc.lustre-MDT0000-mdc-ffff8a8ece3a7000.active=1 oleg427-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec found agent uuid=f099b708-b058-4989-aed9-5104ddfef353 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 mdc.lustre-MDT0000-mdc-ffff8a8ece3a7000.active=1 PASS 106c (61s) == sanity-hsm test 107: Copytool re-register after MDS restart ========================================================== 08:21:08 (1786105268) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_107/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Failing mds1 on oleg427-server Stopping /mnt/lustre-mds1 (opts:) on oleg427-server 08:21:17 (1786105277) shut down facet: mds1 facet_host: oleg427-server facet_failover_host: oleg427-server Failover mds1 to oleg427-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg427-server: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 Started lustre-MDT0000 08:21:54 (1786105314) targets are mounted 08:21:54 (1786105314) facet_failover done oleg427-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 107 (68s) == sanity-hsm test 109: Policy display/change ============ 08:22:17 (1786105337) mdt.lustre-MDT0000.hsm.policy=+NBR mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0000.hsm.policy=-NBR mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0000.hsm.policy=NRA NBR Next set_param must failed oleg427-server: error: set_param: setting /sys/kernel/debug/lustre/mdt/lustre-MDT0000/hsm/policy=wrong: Invalid argument oleg427-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/policy'='wrong': Invalid argument pdsh@oleg427-client: oleg427-server: ssh exited with exit code 22 Back to default policy mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0000.hsm.policy=-NBR PASS 109 (25s) == sanity-hsm test 110a: Non blocking restore policy (import case) ========================================================== 08:22:42 (1786105362) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_110a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1786105365.784238 [94479]: action=1 src=d110a.sanity-hsm/f110a.sanity-hsm dst=/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786105365.790567 [94479]: importing '/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_110a//d110a.sanity-hsm/f110a.sanity-hsm' lhsmtool_posix: 1786105365.849611 [94479]: imported '/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_110a//0bba/0x200000bd2:0x68:0x0'=='/tmp/arc1/sanity-hsm.test_110a//d110a.sanity-hsm/f110a.sanity-hsm' lhsmtool_posix: 1786105365.850244 [94479]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdt.lustre-MDT0000.hsm.policy=+NBR md5sum: /mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm: No data available Waiting 200s for 'SUCCEED' Updated after 3s: want 'SUCCEED' got 'SUCCEED' mdt.lustre-MDT0000.hsm.policy=-NBR PASS 110a (16s) == sanity-hsm test 110b: Non blocking restore policy (release case) ========================================================== 08:22:58 (1786105378) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_110b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=+NBR md5sum: /mnt/lustre/d110b.sanity-hsm/f110b.sanity-hsm: No data available mdt.lustre-MDT0000.hsm.policy=-NBR PASS 110b (14s) == sanity-hsm test 111a: No retry policy (import case), restore will error ========================================================== 08:23:13 (1786105393) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_111a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1786105396.699805 [95831]: action=1 src=d111a.sanity-hsm/f111a.sanity-hsm dst=/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786105396.714146 [95831]: importing '/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_111a//d111a.sanity-hsm/f111a.sanity-hsm' lhsmtool_posix: 1786105396.807763 [95831]: imported '/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_111a//0bbf/0x200000bd2:0x6d:0x0'=='/tmp/arc1/sanity-hsm.test_111a//d111a.sanity-hsm/f111a.sanity-hsm' lhsmtool_posix: 1786105396.808388 [95831]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdt.lustre-MDT0000.hsm.policy=+NRA Remove from backend: 0x200000bd2:0x6d:0x0 = /tmp/arc1/sanity-hsm.test_111a/0bbf/0x200000bd2:0x6d:0x0 Waiting 200s for 'FAILED' Updated after 2s: want 'FAILED' got 'FAILED' mdt.lustre-MDT0000.hsm.policy=-NRA PASS 111a (17s) == sanity-hsm test 111b: No retry policy (release case), restore will error ========================================================== 08:23:29 (1786105409) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_111b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=+NRA Remove from backend: 0x200000bd3:0x7:0x0 = /tmp/arc1/sanity-hsm.test_111b/0bd4/0x200000bd3:0x7:0x0 Waiting 200s for 'FAILED' Updated after 2s: want 'FAILED' got 'FAILED' mdt.lustre-MDT0000.hsm.policy=-NRA PASS 111b (16s) == sanity-hsm test 112: State of recorded request ======== 08:23:45 (1786105425) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_112/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=disabled /mnt/lustre/d112.sanity-hsm/f112.sanity-hsm: ARCHIVE waiting (from 0 to EOF) mdt.lustre-MDT0000.hsm_control=enabled PASS 112 (15s) == sanity-hsm test 113: wrong stat after restore ========= 08:24:01 (1786105441) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0515323 s, 20.3 MB/s Starting client: oleg427-client.virtnet: -o user_xattr,flock 192.168.204.127@tcp:/lustre /mnt/lustre3 Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_113/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre3"' Verifying released state: multiop /mnt/lustre/d113.sanity-hsm/f113.sanity-hsm voO_WRONLY:O_APPEND:_w4c TMPPIPE=/tmp/multiop_open_wait_pipe.7626 File: /mnt/lustre2/d113.sanity-hsm/f113.sanity-hsm Size: 1048576 Blocks: 1 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115238860488715 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-08-07 08:24:02.000000000 -0400 Modify: 2026-08-07 08:24:02.000000000 -0400 Change: 2026-08-07 08:24:02.000000000 -0400 Birth: 2026-08-07 08:24:02.000000000 -0400 Stopping client oleg427-client.virtnet /mnt/lustre3 (opts:) PASS 113 (15s) == sanity-hsm test 114: Incompatible request does not set other requests as STARTED ========================================================== 08:24:16 (1786105456) 0+0 records in 0+0 records out 0 bytes copied, 0.0148703 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00772391 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_114/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled PASS 114 (18s) == sanity-hsm test 200: Register/Cancel archive ========== 08:24:33 (1786105473) 0+0 records in 0+0 records out 0 bytes copied, 0.00813112 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_200/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Copytool is suspended on oleg427-client.virtnet Copytool is continued on oleg427-client.virtnet PASS 200 (12s) == sanity-hsm test 201: Register/Cancel restore ========== 08:24:45 (1786105485) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_201/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB, 39 MiB) copied, 0.923296 s, 44.3 MB/s lhsmtool_posix: 1786105489.641106 [100075]: action=1 src=d201.sanity-hsm/f201.sanity-hsm dst=/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786105489.652630 [100075]: importing '/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_201//d201.sanity-hsm/f201.sanity-hsm' lhsmtool_posix: 1786105489.714357 [100075]: imported '/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_201//0ba5/0x200000bd2:0x77:0x0'=='/tmp/arc1/sanity-hsm.test_201//d201.sanity-hsm/f201.sanity-hsm' lhsmtool_posix: 1786105489.714813 [100075]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled PASS 201 (18s) == sanity-hsm test 202: Register/Cancel remove =========== 08:25:03 (1786105503) 0+0 records in 0+0 records out 0 bytes copied, 0.0109086 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_202/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Copytool is suspended on oleg427-client.virtnet PASS 202 (11s) == sanity-hsm test 220A: Changelog for archive =========== 08:25:14 (1786105514) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_220A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl1' lustre-MDT0000.3 16HSM 12:25:20.564237876 2026.08.07 0x0 t=[0x200000bd3:0x14:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 PASS 220A (17s) == sanity-hsm test 220a: Changelog for failed archive ==== 08:25:31 (1786105531) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_220a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl2' Copytool is suspended on oleg427-client.virtnet Copytool is continued on oleg427-client.virtnet lustre-MDT0000.6 16HSM 12:25:39.101316810 2026.08.07 0x2 t=[0x200000bd3:0x15:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0000: Deregistered changelog user #2 PASS 220a (18s) == sanity-hsm test 221: Changelog for archive canceled === 08:25:49 (1786105549) 0+0 records in 0+0 records out 0 bytes copied, 0.00505134 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_221/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl3' Copytool is suspended on oleg427-client.virtnet Copytool is continued on oleg427-client.virtnet lustre-MDT0000.8 16HSM 12:25:56.612366417 2026.08.07 0x7d t=[0x200000bd3:0x17:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000: Deregistered changelog user #3 PASS 221 (18s) == sanity-hsm test 222a: Changelog for explicit restore == 08:26:07 (1786105567) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1786105570.161466 [103639]: action=1 src=d222a.sanity-hsm/f222a.sanity-hsm dst=/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786105570.172111 [103639]: importing '/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222a//d222a.sanity-hsm/f222a.sanity-hsm' lhsmtool_posix: 1786105570.230516 [103639]: imported '/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222a//0bac/0x200000bd2:0x7e:0x0'=='/tmp/arc1/sanity-hsm.test_222a//d222a.sanity-hsm/f222a.sanity-hsm' lhsmtool_posix: 1786105570.230580 [103639]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl4' lustre-MDT0000.11 16HSM 12:26:13.481019186 2026.08.07 0x80 t=[0x200000bd2:0x7e:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp p=[0x200000bd2:0x7a:0x0] lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 PASS 222a (15s) == sanity-hsm test 222b: Changelog for implicit restore == 08:26:22 (1786105582) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl5' 4ef076ad20e5d4a2f4729d6ed41a3bf9 /mnt/lustre/d222b.sanity-hsm/f222b.sanity-hsm lustre-MDT0000.20 16HSM 12:26:30.417957429 2026.08.07 0x80 t=[0x200000bd3:0x19:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0000: Deregistered changelog user #5 PASS 222b (19s) == sanity-hsm test 222c: Changelog for failed explicit restore ========================================================== 08:26:41 (1786105601) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1786105604.372786 [105113]: action=1 src=d222c.sanity-hsm/f222c.sanity-hsm dst=/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786105604.379021 [105113]: importing '/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222c//d222c.sanity-hsm/f222c.sanity-hsm' lhsmtool_posix: 1786105604.428596 [105113]: imported '/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222c//0b51/0x200000bd2:0x83:0x0'=='/tmp/arc1/sanity-hsm.test_222c//d222c.sanity-hsm/f222c.sanity-hsm' lhsmtool_posix: 1786105604.428657 [105113]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl6' Copytool is suspended on oleg427-client.virtnet Copytool is continued on oleg427-client.virtnet lustre-MDT0000.22 16HSM 12:26:48.887246607 2026.08.07 0x82 t=[0x200000bd2:0x83:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp p=[0x200000bd2:0x81:0x0] lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000: Deregistered changelog user #6 PASS 222c (18s) == sanity-hsm test 222d: Changelog for failed implicit restore ========================================================== 08:26:59 (1786105619) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl7' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Remove from backend: 0x200000bd3:0x1b:0x0 = /tmp/arc1/sanity-hsm.test_222d/0bc8/0x200000bd3:0x1b:0x0 md5sum: /mnt/lustre/d222d.sanity-hsm/f222d.sanity-hsm: No data available lustre-MDT0000.29 16HSM 12:27:09.614538243 2026.08.07 0x82 t=[0x200000bd3:0x1b:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp p=[0x200000bd2:0x81:0x0] lustre-MDT0000: clear the changelog for cl7 of all records lustre-MDT0000: Deregistered changelog user #7 PASS 222d (21s) == sanity-hsm test 223a: Changelog for restore canceled (import case) ========================================================== 08:27:20 (1786105640) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_223a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB, 39 MiB) copied, 0.968923 s, 42.2 MB/s mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl8' lhsmtool_posix: 1786105647.693933 [106678]: action=1 src=d223a.sanity-hsm/f223a.sanity-hsm dst=/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1786105647.723284 [106678]: importing '/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_223a//d223a.sanity-hsm/f223a.sanity-hsm' lhsmtool_posix: 1786105647.798889 [106678]: imported '/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_223a//0b5a/0x200000bd2:0x88:0x0'=='/tmp/arc1/sanity-hsm.test_223a//d223a.sanity-hsm/f223a.sanity-hsm' lhsmtool_posix: 1786105647.798954 [106678]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Waiting 200s for 'SUCCEED' Waiting 190s for 'SUCCEED' Waiting 180s for 'SUCCEED' Updated after 28s: want 'SUCCEED' got 'SUCCEED' lustre-MDT0000.36 16HSM 12:27:58.416180057 2026.08.07 0xfd t=[0x200000bd2:0x88:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp p=[0x200000bd2:0x86:0x0] lustre-MDT0000: clear the changelog for cl8 of all records lustre-MDT0000: Deregistered changelog user #8 PASS 223a (50s) == sanity-hsm test 223b: Changelog for restore canceled (release case) ========================================================== 08:28:10 (1786105690) 0+0 records in 0+0 records out 0 bytes copied, 0.00443932 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_223b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl9' Copytool is suspended on oleg427-client.virtnet Copytool is continued on oleg427-client.virtnet lustre-MDT0000.43 16HSM 12:28:20.239895396 2026.08.07 0xfd t=[0x200000bd3:0x1f:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp p=[0x200000bd2:0x7a:0x0] lustre-MDT0000: clear the changelog for cl9 of all records lustre-MDT0000: Deregistered changelog user #9 PASS 223b (20s) == sanity-hsm test 224A: Changelog for remove ============ 08:28:30 (1786105710) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_224A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl10' lustre-MDT0000.48 16HSM 12:28:36.873671185 2026.08.07 0x200 t=[0x200000bd3:0x21:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp lustre-MDT0000: clear the changelog for cl10 of all records lustre-MDT0000: Deregistered changelog user #10 PASS 224A (17s) == sanity-hsm test 224a: Changelog for failed remove ===== 08:28:47 (1786105727) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_224a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl11' Remove from backend: 0x200000bd3:0x22:0x0 = /tmp/arc1/sanity-hsm.test_224a/0bf1/0x200000bd3:0x22:0x0 Copytool is suspended on oleg427-client.virtnet Copytool is continued on oleg427-client.virtnet lustre-MDT0000.53 16HSM 12:28:55.439377635 2026.08.07 0x202 t=[0x200000bd3:0x22:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp p=[0x200000bd2:0x8c:0x0] lustre-MDT0000: clear the changelog for cl11 of all records lustre-MDT0000: Deregistered changelog user #11 PASS 224a (18s) == sanity-hsm test 225: Changelog for remove canceled ==== 08:29:05 (1786105745) Test disabled PASS 225 (8s) == sanity-hsm test 226: changelog for last rm/mv with exiting archive ========================================================== 08:29:13 (1786105753) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_226/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0x200000bd3:0x25:0x0 mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl12' lustre-MDT0000.54 16HSM 12:29:19.006081489 2026.08.07 0x280 t=[0x200000bd3:0x23:0x0] ef=0x13 u=0:0 nid=0@<0:0> lustre-MDT0000.55 16HSM 12:29:19.200886781 2026.08.07 0x280 t=[0x200000bd3:0x23:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp p=[0x200000bd2:0x8c:0x0] lustre-MDT0000.56 16HSM 12:29:19.201093732 2026.08.07 0x0 t=[0x200000bd3:0x23:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp p=[0x200000bd2:0x8c:0x0] lustre-MDT0000.57 16HSM 12:29:20.219819463 2026.08.07 0x280 t=[0x200000bd3:0x24:0x0] ef=0x13 u=0:0 nid=0@<0:0> lustre-MDT0000.58 16HSM 12:29:20.377989713 2026.08.07 0x280 t=[0x200000bd3:0x24:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp lustre-MDT0000.59 16HSM 12:29:20.378448642 2026.08.07 0x0 t=[0x200000bd3:0x24:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp lustre-MDT0000.60 06UNLNK 12:29:20.737207341 2026.08.07 0x3 t=[0x200000bd3:0x23:0x0] j=rm.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp p=[0x200000bd2:0x8d:0x0] f226.sanity-hsm-1 lustre-MDT0000.60 06UNLNK 12:29:20.737207341 2026.08.07 0x3 t=[0x200000bd3:0x23:0x0] j=rm.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp p=[0x200000bd2:0x8d:0x0] f226.sanity-hsm-1 lustre-MDT0000.61 08RENME 12:29:21.201317738 2026.08.07 0x3 t=[0x200000bd3:0x24:0x0] j=mv.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp p=[0x200000bd2:0x8d:0x0] f226.sanity-hsm-2 s=[0x200000bd3:0x25:0x0] sp=[0x200000bd2:0x8d:0x0] f226.sanity-hsm-3 lustre-MDT0000: clear the changelog for cl12 of all records lustre-MDT0000: Deregistered changelog user #12 PASS 226 (17s) == sanity-hsm test 227: changelog when explicit setting of HSM flags ========================================================== 08:29:30 (1786105770) 0+0 records in 0+0 records out 0 bytes copied, 0.00649733 s, 0.0 kB/s mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl13' lustre-MDT0000: clear the changelog for cl13 of all records lustre-MDT0000: Deregistered changelog user #13 PASS 227 (18s) == sanity-hsm test 228: On released file, return extend to FIEMAP. For [cp,tar] --sparse ========================================================== 08:29:49 (1786105789) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_228/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0768852 s, 13.6 MB/s /mnt/lustre/f228.sanity-hsm: 1 extent found tar: Removing leading `/' from member names mnt/lustre/f228.sanity-hsm PASS 228 (13s) == sanity-hsm test 250: Coordinator max request ========== 08:30:02 (1786105802) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_250/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.00695799 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00735928 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00440928 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00480746 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.0103188 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.0065509 s, 0.0 kB/s Copytool is suspended on oleg427-client.virtnet Copytool is continued on oleg427-client.virtnet PASS 250 (29s) == sanity-hsm test 251: Coordinator request timeout ====== 08:30:31 (1786105831) 0+0 records in 0+0 records out 0 bytes copied, 0.00628535 s, 0.0 kB/s mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_251/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Copytool is suspended on oleg427-client.virtnet Waiting 200s for 'STARTED' Updated after 2s: want 'STARTED' got 'STARTED' Waiting 200s for 'CANCELED' Updated after 2s: want 'CANCELED' got 'CANCELED' PASS 251 (25s) == sanity-hsm test 252: Timeout'ed running archive of a removed file should be canceled ========================================================== 08:30:56 (1786105856) 0+0 records in 0+0 records out 0 bytes copied, 0.00994794 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_252/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Copytool is suspended on oleg427-client.virtnet Copytool is continued on oleg427-client.virtnet PASS 252 (19s) == sanity-hsm test 253: Check for wrong file size after release ========================================================== 08:31:15 (1786105875) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_253/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 10+0 records in 10+0 records out 10000000 bytes (10 MB, 9.5 MiB) copied, 0.256212 s, 39.0 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' fail_loc=0x807 Cannot send HSM request (use of /mnt/lustre/d253.sanity-hsm/f253.sanity-hsm): Invalid argument could not release file PASS 253 (13s) == sanity-hsm test 254a: Request counters are initialized to zero ========================================================== 08:31:28 (1786105888) PASS 254a (12s) == sanity-hsm test 254b: Request counters are correctly incremented and decremented ========================================================== 08:31:40 (1786105900) Will launch 63 requests of each type Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_254b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Checking archive requests Copytool is suspended on oleg427-client.virtnet Copytool is continued on oleg427-client.virtnet Checking restore requests Copytool is suspended on oleg427-client.virtnet Copytool is continued on oleg427-client.virtnet Waiting 90s for '0' Updated after 6s: want '0' got '0' Checking remove requests Copytool is suspended on oleg427-client.virtnet Copytool is continued on oleg427-client.virtnet PASS 254b (49s) == sanity-hsm test 255: Copytool registration wakes the coordinator up ========================================================== 08:32:29 (1786105949) 0+0 records in 0+0 records out 0 bytes copied, 0.00660777 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_255/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Killing existing copytools on oleg427-client.virtnet with signal TERM copytools stopped in 0s 0+0 records in 0+0 records out 0 bytes copied, 0.00642085 s, 0.0 kB/s 0x200000bd3:0xb9:0x0 mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_255/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 255 (26s) == sanity-hsm test 256: HSM copytool register on DNE with stopped MDT must not panic ========================================================== 08:32:55 (1786105975) SKIP: sanity-hsm test_256 needs DNE (>= 2 MDTs) SKIP 256 (4s) == sanity-hsm test 260a: Restore request have priority over other requests ========================================================== 08:32:59 (1786105979) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.163234 s, 6.4 MB/s 0x200000bd3:0xbb:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.147771 s, 7.1 MB/s 0x200000bd3:0xbc:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.162275 s, 6.5 MB/s 0x200000bd3:0xbd:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.167341 s, 6.3 MB/s 0x200000bd3:0xbe:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128077 s, 8.2 MB/s 0x200000bd3:0xbf:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154565 s, 6.8 MB/s 0x200000bd3:0xc0:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.222071 s, 4.7 MB/s 0x200000bd3:0xc1:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.148011 s, 7.1 MB/s 0x200000bd3:0xc2:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.138375 s, 7.6 MB/s 0x200000bd3:0xc3:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.175255 s, 6.0 MB/s 0x200000bd3:0xc4:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.1914 s, 5.5 MB/s 0x200000bd3:0xc5:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156379 s, 6.7 MB/s 0x200000bd3:0xc6:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128104 s, 8.2 MB/s 0x200000bd3:0xc7:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141931 s, 7.4 MB/s 0x200000bd3:0xc8:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133701 s, 7.8 MB/s 0x200000bd3:0xc9:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157081 s, 6.7 MB/s 0x200000bd3:0xca:0x0 Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Killing existing copytools on oleg427-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' ARCHIVE ARCHIVE RESTORE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE PASS 260a (42s) == sanity-hsm test 260b: Restore request have priority over other requests ========================================================== 08:33:41 (1786106021) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151557 s, 6.9 MB/s 0x200000bd3:0xcd:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137483 s, 7.6 MB/s 0x200000bd3:0xce:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.198904 s, 5.3 MB/s 0x200000bd3:0xcf:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.221957 s, 4.7 MB/s 0x200000bd3:0xd0:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.198314 s, 5.3 MB/s 0x200000bd3:0xd1:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.242915 s, 4.3 MB/s 0x200000bd3:0xd2:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.203789 s, 5.1 MB/s 0x200000bd3:0xd3:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.150381 s, 7.0 MB/s 0x200000bd3:0xd4:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.166826 s, 6.3 MB/s 0x200000bd3:0xd5:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.148636 s, 7.1 MB/s 0x200000bd3:0xd6:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.186572 s, 5.6 MB/s 0x200000bd3:0xd7:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.165687 s, 6.3 MB/s 0x200000bd3:0xd8:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.197615 s, 5.3 MB/s 0x200000bd3:0xd9:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.221979 s, 4.7 MB/s 0x200000bd3:0xda:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.16954 s, 6.2 MB/s 0x200000bd3:0xdb:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.172479 s, 6.1 MB/s 0x200000bd3:0xdc:0x0 Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2 "/mnt/lustre2"' Killing existing copytools on oleg427-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2 "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' RESTORE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE PASS 260b (40s) == sanity-hsm test 260c: Requests are not reordered on the 'hot' path of the coordinator ========================================================== 08:34:21 (1786106061) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.181886 s, 5.8 MB/s 0x200000bd3:0xdf:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.130916 s, 8.0 MB/s 0x200000bd3:0xe0:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.235335 s, 4.5 MB/s 0x200000bd3:0xe1:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.18287 s, 5.7 MB/s 0x200000bd3:0xe2:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.172863 s, 6.1 MB/s 0x200000bd3:0xe3:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.147108 s, 7.1 MB/s 0x200000bd3:0xe4:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.155497 s, 6.7 MB/s 0x200000bd3:0xe5:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135663 s, 7.7 MB/s 0x200000bd3:0xe6:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.236582 s, 4.4 MB/s 0x200000bd3:0xe7:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.146131 s, 7.2 MB/s 0x200000bd3:0xe8:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.173737 s, 6.0 MB/s 0x200000bd3:0xe9:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.308048 s, 3.4 MB/s 0x200000bd3:0xea:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.178258 s, 5.9 MB/s 0x200000bd3:0xeb:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.268021 s, 3.9 MB/s 0x200000bd3:0xec:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.258237 s, 4.1 MB/s 0x200000bd3:0xed:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.169932 s, 6.2 MB/s 0x200000bd3:0xee:0x0 Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2 "/mnt/lustre2"' Killing existing copytools on oleg427-client.virtnet with signal TERM copytools stopped in 0s mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2 "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE RESTORE PASS 260c (44s) == sanity-hsm test 261: Report 0 bytes size after HSM release ========================================================== 08:35:05 (1786106105) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_261/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 2+0 records in 2+0 records out 8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0239361 s, 342 kB/s /mnt/lustre/d261.sanity-hsm/f261.sanity-hsm: (0x00000009) exists archived, archive_id:2 Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' /mnt/lustre/d261.sanity-hsm/f261.sanity-hsm: (0x0000000d) released exists archived, archive_id:2 PASS 261 (14s) == sanity-hsm test 262: The client should return 1 block for HSM released files ========================================================== 08:35:19 (1786106119) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_262/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 2+0 records in 2+0 records out 8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0217519 s, 377 kB/s PASS 262 (12s) == sanity-hsm test 300: On disk coordinator state kept between MDT umount/mount ========================================================== 08:35:32 (1786106132) Stop coordinator and remove coordinator state at mount mdt.lustre-MDT0000.hsm_control=shutdown Failing mds1 on oleg427-server Stopping /mnt/lustre-mds1 (opts:) on oleg427-server 08:35:46 (1786106146) shut down facet: mds1 facet_host: oleg427-server facet_failover_host: oleg427-server Failover mds1 to oleg427-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg427-server: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 Started lustre-MDT0000 08:36:21 (1786106181) targets are mounted 08:36:21 (1786106181) facet_failover done oleg427-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Set coordinator start at mount, and start coordinator Failing mds1 on oleg427-server Stopping /mnt/lustre-mds1 (opts:) on oleg427-server 08:37:04 (1786106224) shut down facet: mds1 facet_host: oleg427-server facet_failover_host: oleg427-server Failover mds1 to oleg427-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg427-server: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 Started lustre-MDT0000 08:37:30 (1786106250) targets are mounted 08:37:30 (1786106250) facet_failover done oleg427-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 300 (141s) == sanity-hsm test 301: HSM tunnable are persistent ====== 08:37:52 (1786106272) Failing mds1 on oleg427-server Stopping /mnt/lustre-mds1 (opts:) on oleg427-server 08:38:01 (1786106281) shut down facet: mds1 facet_host: oleg427-server facet_failover_host: oleg427-server Failover mds1 to oleg427-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg427-server: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 Started lustre-MDT0000 08:38:26 (1786106306) targets are mounted 08:38:26 (1786106306) facet_failover done oleg427-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 301 (54s) == sanity-hsm test 302: HSM tunnable are persistent when CDT is off ========================================================== 08:38:47 (1786106327) mdt.lustre-MDT0000.hsm_control=shutdown Failing mds1 on oleg427-server Stopping /mnt/lustre-mds1 (opts:) on oleg427-server 08:38:59 (1786106339) shut down facet: mds1 facet_host: oleg427-server facet_failover_host: oleg427-server Failover mds1 to oleg427-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg427-server: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 Started lustre-MDT0000 08:39:25 (1786106365) targets are mounted 08:39:25 (1786106365) facet_failover done oleg427-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 302 (61s) == sanity-hsm test 400: Single request is sent to the right MDT ========================================================== 08:39:47 (1786106387) SKIP: sanity-hsm test_400 needs >= 2 MDTs SKIP 400 (3s) == sanity-hsm test 401: Compound requests split and sent to their respective MDTs ========================================================== 08:39:51 (1786106391) SKIP: sanity-hsm test_401 needs >= 2 MDTs SKIP 401 (4s) == sanity-hsm test 402a: Copytool start fails if all MDTs are inactive ========================================================== 08:39:55 (1786106395) deactivate lustre-MDT0000-mdc-ffff8a8ec47b9800 on oleg427-client.virtnet deactivate lustre-MDT0000-mdc-ffff8a8ece3a7000 on oleg427-client.virtnet Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_402a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Failed to start copytool agt1 on 'oleg427-client.virtnet' pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 uuid not found in agent list on mds1 activate lustre-MDT0000-mdc-ffff8a8ec47b9800 on oleg427-client.virtnet activate lustre-MDT0000-mdc-ffff8a8ece3a7000 on oleg427-client.virtnet PASS 402a (12s) == sanity-hsm test 402b: CDT must retry request upon slow start of CT ========================================================== 08:40:07 (1786106407) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_402b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' fail_loc=0x14d fail_loc=0 Waiting 200s for 'SUCCEED' Updated after 4s: want 'SUCCEED' got 'SUCCEED' PASS 402b (29s) == sanity-hsm test 403: Copytool starts with inactive MDT and register on reconnect ========================================================== 08:40:36 (1786106436) SKIP: sanity-hsm test_403 needs >= 2 MDTs SKIP 403 (4s) == sanity-hsm test 404: Inactive MDT does not block requests for active MDTs ========================================================== 08:40:40 (1786106440) SKIP: sanity-hsm test_404 needs >= 2 MDTs SKIP 404 (4s) == sanity-hsm test 405: archive and release under striped directory ========================================================== 08:40:44 (1786106444) SKIP: sanity-hsm test_405 needs >= 2 MDTs SKIP 405 (4s) == sanity-hsm test 406: attempting to migrate HSM archived files is safe ========================================================== 08:40:48 (1786106448) SKIP: sanity-hsm test_406 needs >= 2 MDTs SKIP 406 (4s) == sanity-hsm test 407: Check for double RESTORE records in llog ========================================================== 08:40:52 (1786106452) 0+0 records in 0+0 records out 0 bytes copied, 0.00451887 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_407/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' fail_val=5 fail_loc=0x164 Copytool is suspended on oleg427-client.virtnet mdt.lustre-MDT0000.hsm.actions= lrh=[type=10680000 len=136 idx=6/1] fid=[0x2000032e1:0x2:0x0] dfid=[0x2000032e1:0x2:0x0] compound/cookie=0x0/0x6a75d1f6 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/2] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x6a75d1f7 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] Failing mds1 on oleg427-server Stopping /mnt/lustre-mds1 (opts:) on oleg427-server 08:41:07 (1786106467) shut down facet: mds1 facet_host: oleg427-server facet_failover_host: oleg427-server Failover mds1 to oleg427-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg427-server: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 mdt.lustre-MDT0000.hsm.actions= lrh=[type=10680000 len=136 idx=6/1] fid=[0x2000032e1:0x2:0x0] dfid=[0x2000032e1:0x2:0x0] compound/cookie=0x0/0x6a75d1f6 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/2] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x6a75d1f7 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/3] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x6a75d1f8 action=RESTORE archive#=2 flags=0x4 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] Started lustre-MDT0000 08:41:33 (1786106493) targets are mounted 08:41:33 (1786106493) facet_failover done oleg427-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec fail_loc=0 mdt.lustre-MDT0000.hsm.actions= lrh=[type=10680000 len=136 idx=6/2] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x6a75d1f7 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/3] fid=[0x2000032e2:0x2:0x0] dfid=[0x2000032e2:0x2:0x0] compound/cookie=0x0/0x6a75d1f8 action=RESTORE archive#=2 flags=0x4 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] Copytool is continued on oleg427-client.virtnet d41d8cd98f00b204e9800998ecf8427e /mnt/lustre/d407.sanity-hsm/f407.sanity-hsm d41d8cd98f00b204e9800998ecf8427e /mnt/lustre2/d407.sanity-hsm/f407.sanity-hsm pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 PASS 407 (64s) == sanity-hsm test 408: Verify fiemap on release file ==== 08:41:57 (1786106517) Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_408/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.154801 s, 423 kB/s SKIP: sanity-hsm test_408 ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 408 (5s) == sanity-hsm test 409a: Coordinator should not stop when in use ========================================================== 08:42:02 (1786106522) 0+0 records in 0+0 records out 0 bytes copied, 0.0196888 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' fail_val=5 fail_loc=0x164 cat: /mnt/lustre/d409a.sanity-hsm/f409a.sanity-hsm: No data available mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled Killing existing copytools on oleg427-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=enabled PASS 409a (28s) == sanity-hsm test 409b: getattr released file with CDT stopped after remount ========================================================== 08:42:30 (1786106550) 0+0 records in 0+0 records out 0 bytes copied, 0.0107917 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Killing existing copytools on oleg427-client.virtnet with signal TERM copytools stopped in 0s Failing mds1 on oleg427-server Stopping /mnt/lustre-mds1 (opts:) on oleg427-server 08:43:04 (1786106584) shut down facet: mds1 facet_host: oleg427-server facet_failover_host: oleg427-server Failover mds1 to oleg427-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg427-server: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 Started lustre-MDT0000 08:43:36 (1786106616) targets are mounted 08:43:36 (1786106616) facet_failover done oleg427-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec File: /mnt/lustre/d409b.sanity-hsm/f409b.sanity-hsm Size: 0 Blocks: 0 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115406615871497 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-08-07 08:42:33.000000000 -0400 Modify: 2026-08-07 08:42:33.000000000 -0400 Change: 2026-08-07 08:42:33.000000000 -0400 Birth: 2026-08-07 08:42:32.000000000 -0400 PASS 409b (108s) == sanity-hsm test 410: lfs data_version -s allows release of force-archived file ========================================================== 08:44:18 (1786106658) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.280954 s, 3.7 MB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_410/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Cannot send HSM request (use of /mnt/lustre/d410.sanity-hsm/f410.sanity-hsm): Operation not permitted PASS 410 (10s) == sanity-hsm test 411: hsm_ops rbac role ================ 08:44:28 (1786106668) On MGS 192.168.204.127, active = nodemap.active=1 On MGS 192.168.204.127, test_411.trusted_nodemap = nodemap.test_411.trusted_nodemap=1 Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_411/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' /mnt/lustre/d411.sanity-hsm/fileA: (0x00000000) Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Killing existing copytools on oleg427-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_411/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' On MGS 192.168.204.127, test_411.rbac = nodemap.test_411.rbac=file_perms,dne_ops,quota_ops,byfid_ops,chlg_ops,fscrypt_admin,server_upcall,ignore_root_prjquota,immutable_flags,local_admin,pool_quota_ops,lqa_quota_ops,projid_set,foreign_ops /mnt/lustre/d411.sanity-hsm/fileB: (0x00000000) Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Operation not permitted Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied lfs hsm_set: change hsm flags for '/mnt/lustre/d411.sanity-hsm/fileB' failed: Permission denied lfs hsm_clear: change hsm flags for '/mnt/lustre/d411.sanity-hsm/fileB' failed: Permission denied On MGS 192.168.204.127, active = nodemap.active=0 oleg427-server: error: nodemap 'test_411' does not exist oleg427-server: nodemap_del: Invalid argument pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 On MGS 192.168.204.127, active = nodemap.active=0 PASS 411 (50s) == sanity-hsm test 500: various LLAPI HSM tests ========== 08:45:19 (1786106719) test1 @1786106783: Register/unregister copytool 2000x to check for leaks ...... pass test2 @1786106783: Re/un-register copytool multiple times without error ....... pass llapi_hsm_test: NULL archive numbers llapi_hsm_test: NULL archive numbers llapi_hsm_test: -1 requested when archive id >= 0 is supported test3 @1786106783: Pass bad parameters to llapi_hsm_copytool_register() ....... pass test4 @1786106783: Bad parameters to llapi_hsm_copytool_unregister() .......... pass test5 @1786106783: Test llapi_hsm_copytool_recv() in non-blocking mode ........ pass test6 @1786106783: Test llapi_hsm_copytool_recv() with bogus parameters ....... pass test7 @1786106784: Test event polling (without actual traffic) ................ pass test50 @1786106784: Test llapi_hsm_state_get()/get_fd() ....................... pass test51 @1786106784: Test llapi_hsm_state_set_fd() ............................. pass test52 @1786106784: Test llapi_hsm_current_action() ........................... pass test100 @1786106785: Simple archive creation with no progress reported. ....... pass test101 @1786106789: Simple archive creation with progress every byte. ........ pass test102 @1786106794: Archive creation with progress every byte, backwards ..... pass test103 @1786106795: Archive creation with a single progress report ........... pass test104 @1786106796: Archive creation with two progress reports ............... pass test105 @1786106797: Archive creation with one bogus progress report .......... pass test106 @1786106799: Archive creation with one empty progress report .......... pass test107 @1786106800: Archive creation with one bogus progress report .......... pass test108 @1786106804: Archive creation with same progress report each time ..... pass test109 @1786106805: Archive creation with one report, with large number ...... pass test110 @1786106806: Archive with 10 progress reports, checking progress ...... pass test111 @1786106808: Archive with 10 reports in reverse, checking progress .... pass test112 @1786106809: Archive with 10 reports, duplicated, check progress ...... pass test113 @1786106810: Archive with 9 reports, with 20% overlapping coverage .... pass PASS 500 (99s) == sanity-hsm test 600: Changelog fields 'u=' and 'nid=' ========================================================== 08:46:58 (1786106818) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl1' mdd.lustre-MDT0000.changelog_mask=ALL running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d600.sanity-hsm/f600.sanity-hsm] Got NID '192.168.204.27@tcp' lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 PASS 600 (20s) == sanity-hsm test 601: OPEN Changelog entry ============= 08:47:18 (1786106838) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl2' mdd.lustre-MDT0000.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0000.8 10OPEN 12:47:27.066011337 2026.08.07 0x1 t=[0x2000032e1:0x26:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.204.27@tcp m=r-- p=[0x2000032e1:0x23:0x0] lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0000: Deregistered changelog user #2 PASS 601 (22s) == sanity-hsm test 602: Changelog record CLOSE only if open+write or OPEN recorded ========================================================== 08:47:40 (1786106860) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl3' mdd.lustre-MDT0000.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000.14 11CLOSE 12:47:48.916533577 2026.08.07 0x1 t=[0x2000032e1:0x28:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000.15 10OPEN 12:47:49.242443667 2026.08.07 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.204.27@tcp m=-w- lustre-MDT0000.16 13TRUNC 12:47:49.251545656 2026.08.07 0xe t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp p=[0x2000032e1:0x27:0x0] lustre-MDT0000.17 11CLOSE 12:47:49.288417376 2026.08.07 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp lustre-MDT0000.17 11CLOSE 12:47:49.288417376 2026.08.07 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp mdd.lustre-MDT0000.changelog_mask=-OPEN lustre-MDT0000: clear the changelog for cl3 of all records f lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000.18 13TRUNC 12:47:51.703974641 2026.08.07 0xe t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp p=[0x2000032e1:0x27:0x0] lustre-MDT0000.19 11CLOSE 12:47:51.718870141 2026.08.07 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp lustre-MDT0000.19 11CLOSE 12:47:51.718870141 2026.08.07 0x242 t=[0x2000032e1:0x28:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000: Deregistered changelog user #3 PASS 602 (22s) == sanity-hsm test 603: GETXATTR Changelog entry ========= 08:48:03 (1786106883) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl4' mdd.lustre-MDT0000.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl4 of all records getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/d603.sanity-hsm/f603.sanity-hsm user.xattr1="value1" lustre-MDT0000.25 23GXATR 12:48:11.292084189 2026.08.07 0x0 t=[0x2000032e1:0x2a:0x0] j=getfattr.0 ef=0x1b u=0:0 nid=192.168.204.27@tcp x=user.xattr1 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 PASS 603 (22s) == sanity-hsm test 604: NOPEN Changelog entry ============ 08:48:24 (1786106904) mdd.lustre-MDT0000.changelog_deniednext=20 mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl5' mdd.lustre-MDT0000.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl5 of all records running as uid/gid/euid/egid 500/500/500/500, groups: 500 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm] cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied lustre-MDT0000.30 24NOPEN 12:48:36.342236023 2026.08.07 0x1 t=[0x2000032e1:0x2c:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.204.27@tcp m=r-- Got NID '192.168.204.27@tcp' lustre-MDT0000: clear the changelog for cl5 of all records running as uid/gid/euid/egid 500/500/500/500, groups: 500 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm] cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied lustre-MDT0000: clear the changelog for cl5 of all records running as uid/gid/euid/egid 500/500/500/500, groups: 500 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm] cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied lustre-MDT0000.31 24NOPEN 12:48:57.642890287 2026.08.07 0x1 t=[0x2000032e1:0x2c:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.204.27@tcp m=r-- Got NID '192.168.204.27@tcp' lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0000: Deregistered changelog user #5 mdd.lustre-MDT0000.changelog_deniednext=60 PASS 604 (46s) == sanity-hsm test 605: Test OPEN and CLOSE rate limit in Changelogs ========================================================== 08:49:10 (1786106950) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl6' mdd.lustre-MDT0000.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000.35 10OPEN 12:49:17.978582617 2026.08.07 0x43 t=[0x2000032e1:0x2e:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.204.27@tcp m=rw- lustre-MDT0000.35 10OPEN 12:49:17.978582617 2026.08.07 0x43 t=[0x2000032e1:0x2e:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.204.27@tcp m=rw- lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000.36 10OPEN 12:49:18.840818377 2026.08.07 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.204.27@tcp m=r-- lustre-MDT0000.37 11CLOSE 12:49:18.864844099 2026.08.07 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp lustre-MDT0000.36 10OPEN 12:49:18.840818377 2026.08.07 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.204.27@tcp m=r-- lustre-MDT0000.37 11CLOSE 12:49:18.864844099 2026.08.07 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000: clear the changelog for cl6 of all records running as uid/gid/euid/egid 500/500/500/500, groups: 500 [cat] [/mnt/lustre/d605.sanity-hsm/f605.sanity-hsm] lustre-MDT0000.38 10OPEN 12:49:19.807523662 2026.08.07 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.204.27@tcp m=r-- lustre-MDT0000.39 11CLOSE 12:49:19.836894390 2026.08.07 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.500 ef=0x13 u=500:500 nid=192.168.204.27@tcp lustre-MDT0000.38 10OPEN 12:49:19.807523662 2026.08.07 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.204.27@tcp m=r-- lustre-MDT0000.39 11CLOSE 12:49:19.836894390 2026.08.07 0x1 t=[0x2000032e1:0x2e:0x0] j=cat.500 ef=0x13 u=500:500 nid=192.168.204.27@tcp lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000.40 11CLOSE 12:49:20.278231509 2026.08.07 0x43 t=[0x2000032e1:0x2e:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp lustre-MDT0000.40 11CLOSE 12:49:20.278231509 2026.08.07 0x43 t=[0x2000032e1:0x2e:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.204.27@tcp lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000: Deregistered changelog user #6 PASS 605 (20s) == sanity-hsm test 606: llog_reader groks changelog fields ========================================================== 08:49:31 (1786106971) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl7' mdd.lustre-MDT0000.changelog_mask=ALL running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d606.sanity-hsm/f606.sanity-hsm] Stopping /mnt/lustre-mds1 (opts:) on oleg427-server rec #2 type=1064553b len=64 offset 8256 Header size : 8192 llh_size : 64 Time : Fri Aug 7 08:21:43 2026 Number of records: 1 cat_idx: 0 last_idx: 2 Flags: 0x2012 Target uuid : ----------------------- #02 (064)fid=[0x1:0x3b:0x0] path=oi.1/0x1:0x3b:0x0 oleg427-server: llog_reader: The llog is corrupted, 1 errors found Got UID/GID 500:500 Got NID 192.168.204.27@tcp Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg427-server: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg427-client: oleg427-server: ssh exited with exit code 1 Started lustre-MDT0000 lustre-MDT0000: clear the changelog for cl7 of all records lustre-MDT0000: Deregistered changelog user #7 PASS 606 (67s) == sanity-hsm test 607a: release file migrated after archive (non-blocking migrate) ========================================================== 08:50:39 (1786107039) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.178317 s, 5.9 MB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 607a (12s) == sanity-hsm test 607b: Migrate should not change the HSM attribute of dirty files ========================================================== 08:50:50 (1786107050) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.220338 s, 4.8 MB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' llite.lustre-ffff8a8ec47b9800.xattr_cache=0 llite.lustre-ffff8a8ece3a7000.xattr_cache=0 /mnt/lustre/d607b.sanity-hsm/f607b.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:1 llite.lustre-ffff8a8ec47b9800.xattr_cache=1 llite.lustre-ffff8a8ece3a7000.xattr_cache=1 PASS 607b (13s) == sanity-hsm test 607c: 'lfs swap_layouts' should set dirty flag on HSM file ========================================================== 08:51:03 (1786107063) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.181048 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.222295 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.136013 s, 7.7 MB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lfs swap_layouts: error: cannot swap layout between '/mnt/lustre/d607c.sanity-hsm/f607c.sanity-hsm-1' and '/mnt/lustre/d607c.sanity-hsm/f607c.sanity-hsm-3': Operation not permitted (1) PASS 607c (15s) == sanity-hsm test 607d: Migrate should not set HSM dirty flag for an empty file ========================================================== 08:51:18 (1786107078) 0+0 records in 0+0 records out 0 bytes copied, 0.0137964 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 607d (14s) == sanity-hsm test 607e: release file migrated after archive (blocking migrate) ========================================================== 08:51:33 (1786107093) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152617 s, 6.9 MB/s Starting copytool 'agt1' on 'oleg427-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 607e (17s) == sanity-hsm test complete, duration 5316 sec =========== 08:51:50 (1786107110) === sanity-hsm: start cleanup 08:51:52 (1786107112) === Stopping clients: oleg427-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg427-client.virtnet /mnt/lustre2 opts: === sanity-hsm: finish cleanup 08:52:28 (1786107148) ===