-----============= acceptance-small: sanity-hsm ============----- Wed Aug 19 01:56:53 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg248-server: /home/green/git/lustre-release/lustre/tests/except/sanity-hsm.ex - see MDS1_VERSION <= CLIENT_VERSION (34683139 <= 34683139) for LU-18924, go 100 105 excepting tests: === sanity-hsm: start setup 01:57:12 (1787119032) === Starting client oleg248-client.virtnet: -o user_xattr,flock 192.168.202.148@tcp:/lustre /mnt/lustre2 Mount client oleg248-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.202.148@tcp:/lustre /mnt/lustre2 Started clients oleg248-client.virtnet: 192.168.202.148@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) oleg248-client.virtnet: executing check_config_client /mnt/lustre oleg248-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg248-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8da00a27f800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8da01854b800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8da00a27f800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8da01854b800.idle_timeout=debug disable quota as required oleg248-server: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-hsm: finish setup 01:57:48 (1787119068) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f8221] nobody:x:65534: Killing existing copytools on oleg248-client.virtnet with signal TERM pkill: pidfile not valid Try `pkill --help' for more information. Set HSM on and start Set sanity-hsm HSM policy == sanity-hsm test 1A: lfs hsm flags root/non-root access ========================================================== 01:58:17 (1787119097) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_set] [--norelease] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_clear] [--norelease] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_set] [--exists] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] lfs hsm_set: change hsm flags for '/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm' failed: Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1A.sanity-hsm/f1A.sanity-hsm] PASS 1A (6s) == sanity-hsm test 1a: mmap & cat a HSM released file ==== 01:58:23 (1787119103) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.153422 s, 6.8 MB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Verifying released state: PASS 1a (11s) == sanity-hsm test 1b: Archive, Release and Restore composite file ========================================================== 01:58:34 (1787119114) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0927607 s, 11.3 MB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' archive /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm release /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm verify released state: pass restore /mnt/lustre/d1b.sanity-hsm/f1b.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' verify restored state: pass PASS 1b (14s) == sanity-hsm test 1c: Check setting archive-id in lfs hsm_set ========================================================== 01:58:48 (1787119128) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] verifying archive number is 32 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] verifying archive number is still 32 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] verifying archive number is 33 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d1c.sanity-hsm/f1c.sanity-hsm] verifying archive number is 16 PASS 1c (8s) == sanity-hsm test 1d: Archive, Release and Restore DoM file ========================================================== 01:58:56 (1787119136) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0728976 s, 14.4 MB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' archive /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' release /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm verify released state: pass restore /mnt/lustre/d1d.sanity-hsm/f1d.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' verify restored state: pass PASS 1d (13s) == sanity-hsm test 1e: Archive, Release and Restore SEL file ========================================================== 01:59:09 (1787119149) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0453791 s, 23.1 MB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' archive /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm release /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm verify released state: pass restore /mnt/lustre/d1e.sanity-hsm/f1e.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' verify restored state: pass PASS 1e (12s) == sanity-hsm test 1f: DoM file release after restore ==== 01:59:21 (1787119161) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0599445 s, 17.5 MB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_1f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' archive /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm release /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm verify released state: pass restore /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' verify restored state: pass release again /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm /mnt/lustre/d1f.sanity-hsm/f1f.sanity-hsm: (0x0000000d) released exists archived, archive_id:1 verify released state: pass PASS 1f (12s) == sanity-hsm test 2: Check file dirtyness when doing setattr ========================================================== 01:59:33 (1787119173) 0+0 records in 0+0 records out 0 bytes copied, 0.00953926 s, 0.0 kB/s 0x200000403:0x8:0x0 PASS 2 (8s) == sanity-hsm test 3: Check file dirtyness when opening for write ========================================================== 01:59:41 (1787119181) Succeed in opening file "/mnt/lustre/d3.sanity-hsm/f3.sanity-hsm"(flags=O_WRONLY) 3+0 records in 3+0 records out 3+0 records in 3+0 records out PASS 3 (8s) == sanity-hsm test 4: Useless cancel must not be registered ========================================================== 01:59:50 (1787119190) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.177406 s, 5.9 MB/s PASS 4 (7s) == sanity-hsm test 8: Test default archive number ======== 01:59:58 (1787119198) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_8/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 8 (10s) == sanity-hsm test 9A: Use of explicit archive number, with dedicated copytool ========================================================== 02:00:09 (1787119209) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_9A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 3 "/mnt/lustre2"' oleg248-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg248-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=3 requests=[current:0 ok:0 errors:0] on mds1 found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=3 requests=[current:0 ok:0 errors:0] on mds2 PASS 9A (31s) == sanity-hsm test 9a: Multiple remote agents ============ 02:00:39 (1787119239) SKIP: sanity-hsm test_9a Need 3 or more clients, have 1 SKIP 9a (4s) == sanity-hsm test 10a: Archive a file =================== 02:00:44 (1787119244) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 996: warning: command substitution: ignored null byte in input Verifying content Verifying hsm state Verifying archive number is 2 PASS 10a (10s) == sanity-hsm test 10b: Archive of non dirty file must work without doing request ========================================================== 02:00:53 (1787119253) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 10b (10s) == sanity-hsm test 10c: Check forbidden archive ========== 02:01:03 (1787119263) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Cannot send HSM request (use of /mnt/lustre/d10c.sanity-hsm/f10c.sanity-hsm): Operation not permitted PASS 10c (7s) == sanity-hsm test 10d: Archive a file on the default archive id ========================================================== 02:01:10 (1787119270) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_10d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 10d (9s) == sanity-hsm test 11a: Import a file ==================== 02:01:19 (1787119279) lhsmtool_posix: 1787119281.861826 [22168]: action=1 src=d11a.sanity-hsm/f11a.sanity-hsm dst=/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787119281.872547 [22168]: importing '/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11a//d11a.sanity-hsm/f11a.sanity-hsm' lhsmtool_posix: 1787119281.925837 [22168]: imported '/mnt/lustre/d11a.sanity-hsm/f11a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11a//0424/0x200000402:0x26:0x0'=='/tmp/arc1/sanity-hsm.test_11a//d11a.sanity-hsm/f11a.sanity-hsm' lhsmtool_posix: 1787119281.925911 [22168]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Verifying released state: Verifying imported size 158=158 Verifying released pattern: raid0,released Verifying new fid 0x200000402:0x26:0x0 in archive PASS 11a (9s) == sanity-hsm test 11b: Import a deleted file using its FID ========================================================== 02:01:28 (1787119288) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_11b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1787119292.118921 [22860]: action=1 src=0x200000403:0x11:0x0 dst=/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787119292.136017 [22860]: Resolving [0x200000403:0x11:0x0] to /tmp/arc1/sanity-hsm.test_11b//0412/0x200000403:0x11:0x0 lhsmtool_posix: 1787119292.136109 [22860]: importing '/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11b//0412/0x200000403:0x11:0x0' lhsmtool_posix: 1787119292.193014 [22860]: imported '/mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11b//042a/0x200000402:0x28:0x0'=='/tmp/arc1/sanity-hsm.test_11b//0412/0x200000403:0x11:0x0' lhsmtool_posix: 1787119292.193290 [22860]: process finished, errs: 0 major, 0 minor, rc=0 (Success) /mnt/lustre/d11b.sanity-hsm/f11b.sanity-hsm: OK PASS 11b (10s) == sanity-hsm test 11c: Import a file to a directory with a pool ========================================================== 02:01:39 (1787119299) Creating new pool test_11c oleg248-server: Pool lustre.test_11c created Adding targets to pool oleg248-server: OST lustre-OST0001_UUID added to pool lustre.test_11c lhsmtool_posix: 1787119310.051875 [23577]: action=1 src=d11c.sanity-hsm/f11c.sanity-hsm dst=/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787119310.058887 [23577]: importing '/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11c//d11c.sanity-hsm/f11c.sanity-hsm' lhsmtool_posix: 1787119310.133282 [23577]: imported '/mnt/lustre/d11c.sanity-hsm/f11c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_11c//0428/0x200000402:0x2a:0x0'=='/tmp/arc1/sanity-hsm.test_11c//d11c.sanity-hsm/f11c.sanity-hsm' lhsmtool_posix: 1787119310.133385 [23577]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Destroy the created pools: test_11c lustre.test_11c oleg248-server: OST lustre-OST0001_UUID removed from pool lustre.test_11c oleg248-server: Pool lustre.test_11c destroyed PASS 11c (28s) == sanity-hsm test 12a: Restore an imported file explicitly ========================================================== 02:02:06 (1787119326) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1787119328.344590 [24315]: action=1 src=d12a.sanity-hsm/f12a.sanity-hsm dst=/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787119328.351736 [24315]: importing '/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12a//d12a.sanity-hsm/f12a.sanity-hsm' lhsmtool_posix: 1787119328.405008 [24315]: imported '/mnt/lustre/d12a.sanity-hsm/f12a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12a//042f/0x200000402:0x2d:0x0'=='/tmp/arc1/sanity-hsm.test_12a//d12a.sanity-hsm/f12a.sanity-hsm' lhsmtool_posix: 1787119328.405699 [24315]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Verifying released state: Verifying file state: PASS 12a (9s) == sanity-hsm test 12b: Restore an imported file implicitly ========================================================== 02:02:15 (1787119335) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1787119338.312399 [25022]: action=1 src=d12b.sanity-hsm/f12b.sanity-hsm dst=/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787119338.332669 [25022]: importing '/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12b//d12b.sanity-hsm/f12b.sanity-hsm' lhsmtool_posix: 1787119338.409247 [25022]: imported '/mnt/lustre/d12b.sanity-hsm/f12b.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12b//042d/0x200000402:0x2f:0x0'=='/tmp/arc1/sanity-hsm.test_12b//d12b.sanity-hsm/f12b.sanity-hsm' lhsmtool_posix: 1787119338.413517 [25022]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Verifying released state: Verifying file state after restore: PASS 12b (10s) == sanity-hsm test 12c: Restore a file with stripe of 2 == 02:02:25 (1787119345) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 5+0 records in 5+0 records out 5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.143574 s, 36.5 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' /mnt/lustre/d12c.sanity-hsm/f12c.sanity-hsm: OK PASS 12c (11s) == sanity-hsm test 12d: Restore of a non archived, non released file must work ========================================================== 02:02:36 (1787119356) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 12d (13s) == sanity-hsm test 12e: Check forbidden restore ========== 02:02:50 (1787119370) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' /mnt/lustre/d12e.sanity-hsm/f12e.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:1 Cannot send HSM request (use of /mnt/lustre/d12e.sanity-hsm/f12e.sanity-hsm): Operation not permitted PASS 12e (10s) == sanity-hsm test 12f: Restore a released file explicitly ========================================================== 02:02:59 (1787119379) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Verifying file state: PASS 12f (14s) == sanity-hsm test 12g: Restore a released file implicitly ========================================================== 02:03:14 (1787119394) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12g/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 12g (14s) == sanity-hsm test 12h: Restore a released file implicitly from a second node ========================================================== 02:03:27 (1787119407) SKIP: sanity-hsm test_12h Need 2 or more clients, have 1 SKIP 12h (5s) == sanity-hsm test 12m: Archive/release/implicit restore ========================================================== 02:03:32 (1787119412) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12m/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 12m (8s) == sanity-hsm test 12n: Import/implicit restore/release == 02:03:40 (1787119420) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12n/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1787119422.826900 [29901]: action=1 src=d12n.sanity-hsm/f12n.sanity-hsm dst=/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787119422.835125 [29901]: importing '/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12n//d12n.sanity-hsm/f12n.sanity-hsm' lhsmtool_posix: 1787119422.894211 [29901]: imported '/mnt/lustre/d12n.sanity-hsm/f12n.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12n//043f/0x200000402:0x3d:0x0'=='/tmp/arc1/sanity-hsm.test_12n//d12n.sanity-hsm/f12n.sanity-hsm' lhsmtool_posix: 1787119422.894261 [29901]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 12n (8s) == sanity-hsm test 12o: Layout-swap failure during Restore leaves file released ========================================================== 02:03:48 (1787119428) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12o/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' fail_loc=0x152 mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0001.hsm.policy=+NRA diff: /mnt/lustre/d12o.sanity-hsm/f12o.sanity-hsm: No data available mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0001.hsm.policy=-NRA fail_loc=0 mdt.lustre-MDT0000.hsm_control=purge mdt.lustre-MDT0001.hsm_control=purge PASS 12o (32s) == sanity-hsm test 12p: implicit restore of a file on copytool mount point ========================================================== 02:04:20 (1787119460) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12p/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 12p (10s) == sanity-hsm test 12q: file attributes are refreshed after restore ========================================================== 02:04:30 (1787119470) Starting client: oleg248-client.virtnet: -o user_xattr,flock 192.168.202.148@tcp:/lustre /mnt/lustre3 Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12q/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre3"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.145281 s, 7.2 MB/s Killing existing copytools on oleg248-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12q/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre3"' Stopping client oleg248-client.virtnet /mnt/lustre3 (opts:) PASS 12q (19s) == sanity-hsm test 12r: lseek restores released file ===== 02:04:49 (1787119489) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12r/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 12r (9s) == sanity-hsm test 12s: race between restore requests ==== 02:04:59 (1787119499) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12s/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' fail_loc=0x8000018b PASS 12s (16s) == sanity-hsm test 12t: Multiple parallel reads for a HSM imported file ========================================================== 02:05:14 (1787119514) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12t/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1787119517.562105 [34036]: action=1 src=0x200000403:0x2a:0x0 dst=/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787119517.569688 [34036]: Resolving [0x200000403:0x2a:0x0] to /tmp/arc1/sanity-hsm.test_12t//0429/0x200000403:0x2a:0x0 lhsmtool_posix: 1787119517.569802 [34036]: importing '/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12t//0429/0x200000403:0x2a:0x0' lhsmtool_posix: 1787119517.651092 [34036]: imported '/mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_12t//0449/0x200000402:0x4b:0x0'=='/tmp/arc1/sanity-hsm.test_12t//0429/0x200000403:0x2a:0x0' lhsmtool_posix: 1787119517.651160 [34036]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 12t (11s) == sanity-hsm test 12u: Multiple reads on multiple HSM imported files in parallel ========================================================== 02:05:25 (1787119525) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_12u/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1787119540.032298 [34909]: action=1 src=0x200000403:0x2c:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0 mount_point=/mnt/lustre2 lhsmtool_posix: 1787119540.038897 [34909]: Resolving [0x200000403:0x2c:0x0] to /tmp/arc1/sanity-hsm.test_12u//042f/0x200000403:0x2c:0x0 lhsmtool_posix: 1787119540.038982 [34909]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0' from '/tmp/arc1/sanity-hsm.test_12u//042f/0x200000403:0x2c:0x0' lhsmtool_posix: 1787119540.103376 [34909]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.0' from '/tmp/arc1/sanity-hsm.test_12u//044f/0x200000402:0x4d:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042f/0x200000403:0x2c:0x0' lhsmtool_posix: 1787119540.103429 [34909]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1787119540.363422 [34938]: action=1 src=0x200000403:0x2d:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1 mount_point=/mnt/lustre2 lhsmtool_posix: 1787119540.369503 [34938]: Resolving [0x200000403:0x2d:0x0] to /tmp/arc1/sanity-hsm.test_12u//042e/0x200000403:0x2d:0x0 lhsmtool_posix: 1787119540.369767 [34938]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1' from '/tmp/arc1/sanity-hsm.test_12u//042e/0x200000403:0x2d:0x0' lhsmtool_posix: 1787119540.409738 [34938]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.1' from '/tmp/arc1/sanity-hsm.test_12u//044c/0x200000402:0x4e:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042e/0x200000403:0x2d:0x0' lhsmtool_posix: 1787119540.409809 [34938]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1787119540.625631 [34967]: action=1 src=0x200000403:0x2e:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2 mount_point=/mnt/lustre2 lhsmtool_posix: 1787119540.631735 [34967]: Resolving [0x200000403:0x2e:0x0] to /tmp/arc1/sanity-hsm.test_12u//042d/0x200000403:0x2e:0x0 lhsmtool_posix: 1787119540.632065 [34967]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2' from '/tmp/arc1/sanity-hsm.test_12u//042d/0x200000403:0x2e:0x0' lhsmtool_posix: 1787119540.663524 [34967]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.2' from '/tmp/arc1/sanity-hsm.test_12u//044d/0x200000402:0x4f:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042d/0x200000403:0x2e:0x0' lhsmtool_posix: 1787119540.663883 [34967]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1787119540.922015 [34996]: action=1 src=0x200000403:0x2f:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3 mount_point=/mnt/lustre2 lhsmtool_posix: 1787119540.932134 [34996]: Resolving [0x200000403:0x2f:0x0] to /tmp/arc1/sanity-hsm.test_12u//042c/0x200000403:0x2f:0x0 lhsmtool_posix: 1787119540.936536 [34996]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3' from '/tmp/arc1/sanity-hsm.test_12u//042c/0x200000403:0x2f:0x0' lhsmtool_posix: 1787119541.014408 [34996]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.3' from '/tmp/arc1/sanity-hsm.test_12u//0452/0x200000402:0x50:0x0'=='/tmp/arc1/sanity-hsm.test_12u//042c/0x200000403:0x2f:0x0' lhsmtool_posix: 1787119541.014452 [34996]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1787119541.301884 [35025]: action=1 src=0x200000403:0x30:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4 mount_point=/mnt/lustre2 lhsmtool_posix: 1787119541.306729 [35025]: Resolving [0x200000403:0x30:0x0] to /tmp/arc1/sanity-hsm.test_12u//0433/0x200000403:0x30:0x0 lhsmtool_posix: 1787119541.306813 [35025]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4' from '/tmp/arc1/sanity-hsm.test_12u//0433/0x200000403:0x30:0x0' lhsmtool_posix: 1787119541.371082 [35025]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.4' from '/tmp/arc1/sanity-hsm.test_12u//0453/0x200000402:0x51:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0433/0x200000403:0x30:0x0' lhsmtool_posix: 1787119541.371136 [35025]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1787119541.597200 [35054]: action=1 src=0x200000403:0x31:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5 mount_point=/mnt/lustre2 lhsmtool_posix: 1787119541.602729 [35054]: Resolving [0x200000403:0x31:0x0] to /tmp/arc1/sanity-hsm.test_12u//0432/0x200000403:0x31:0x0 lhsmtool_posix: 1787119541.602807 [35054]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5' from '/tmp/arc1/sanity-hsm.test_12u//0432/0x200000403:0x31:0x0' lhsmtool_posix: 1787119541.641731 [35054]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.5' from '/tmp/arc1/sanity-hsm.test_12u//0450/0x200000402:0x52:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0432/0x200000403:0x31:0x0' lhsmtool_posix: 1787119541.641779 [35054]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1787119541.947793 [35083]: action=1 src=0x200000403:0x32:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6 mount_point=/mnt/lustre2 lhsmtool_posix: 1787119541.960930 [35083]: Resolving [0x200000403:0x32:0x0] to /tmp/arc1/sanity-hsm.test_12u//0431/0x200000403:0x32:0x0 lhsmtool_posix: 1787119541.961028 [35083]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6' from '/tmp/arc1/sanity-hsm.test_12u//0431/0x200000403:0x32:0x0' lhsmtool_posix: 1787119542.022877 [35083]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.6' from '/tmp/arc1/sanity-hsm.test_12u//0451/0x200000402:0x53:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0431/0x200000403:0x32:0x0' lhsmtool_posix: 1787119542.023641 [35083]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1787119542.328768 [35112]: action=1 src=0x200000403:0x33:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7 mount_point=/mnt/lustre2 lhsmtool_posix: 1787119542.333486 [35112]: Resolving [0x200000403:0x33:0x0] to /tmp/arc1/sanity-hsm.test_12u//0430/0x200000403:0x33:0x0 lhsmtool_posix: 1787119542.333581 [35112]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7' from '/tmp/arc1/sanity-hsm.test_12u//0430/0x200000403:0x33:0x0' lhsmtool_posix: 1787119542.372227 [35112]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.7' from '/tmp/arc1/sanity-hsm.test_12u//0456/0x200000402:0x54:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0430/0x200000403:0x33:0x0' lhsmtool_posix: 1787119542.372585 [35112]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1787119542.638370 [35141]: action=1 src=0x200000403:0x34:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8 mount_point=/mnt/lustre2 lhsmtool_posix: 1787119542.646615 [35141]: Resolving [0x200000403:0x34:0x0] to /tmp/arc1/sanity-hsm.test_12u//0437/0x200000403:0x34:0x0 lhsmtool_posix: 1787119542.646725 [35141]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8' from '/tmp/arc1/sanity-hsm.test_12u//0437/0x200000403:0x34:0x0' lhsmtool_posix: 1787119542.739280 [35141]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.8' from '/tmp/arc1/sanity-hsm.test_12u//0457/0x200000402:0x55:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0437/0x200000403:0x34:0x0' lhsmtool_posix: 1787119542.739398 [35141]: process finished, errs: 0 major, 0 minor, rc=0 (Success) lhsmtool_posix: 1787119543.025824 [35170]: action=1 src=0x200000403:0x35:0x0 dst=/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9 mount_point=/mnt/lustre2 lhsmtool_posix: 1787119543.032345 [35170]: Resolving [0x200000403:0x35:0x0] to /tmp/arc1/sanity-hsm.test_12u//0436/0x200000403:0x35:0x0 lhsmtool_posix: 1787119543.032428 [35170]: importing '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9' from '/tmp/arc1/sanity-hsm.test_12u//0436/0x200000403:0x35:0x0' lhsmtool_posix: 1787119543.053204 [35170]: imported '/mnt/lustre/d12u.sanity-hsm/f12u.sanity-hsm.9' from '/tmp/arc1/sanity-hsm.test_12u//0454/0x200000402:0x56:0x0'=='/tmp/arc1/sanity-hsm.test_12u//0436/0x200000403:0x35:0x0' lhsmtool_posix: 1787119543.053262 [35170]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 12u (25s) == sanity-hsm test 13: Recursively import and restore a directory ========================================================== 02:05:51 (1787119551) lhsmtool_posix: 1787119558.353091 [36927]: action=1 src=subdir dst=/mnt/lustre/d13.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787119558.525858 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.10' lhsmtool_posix: 1787119558.611019 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.10' from '/tmp/arc1/sanity-hsm.test_13//045b/0x200000402:0x59:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.10' lhsmtool_posix: 1787119558.611994 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.9' lhsmtool_posix: 1787119558.681644 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.9' from '/tmp/arc1/sanity-hsm.test_13//0458/0x200000402:0x5a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.9' lhsmtool_posix: 1787119558.681846 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.8' lhsmtool_posix: 1787119558.752684 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.8' from '/tmp/arc1/sanity-hsm.test_13//0459/0x200000402:0x5b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.8' lhsmtool_posix: 1787119558.753595 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.7' lhsmtool_posix: 1787119558.817862 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.7' from '/tmp/arc1/sanity-hsm.test_13//045e/0x200000402:0x5c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.7' lhsmtool_posix: 1787119558.818994 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.6' lhsmtool_posix: 1787119558.870903 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.6' from '/tmp/arc1/sanity-hsm.test_13//045f/0x200000402:0x5d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.6' lhsmtool_posix: 1787119558.872065 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.5' lhsmtool_posix: 1787119558.923725 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.5' from '/tmp/arc1/sanity-hsm.test_13//045c/0x200000402:0x5e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.5' lhsmtool_posix: 1787119558.923933 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.4' lhsmtool_posix: 1787119558.967515 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.4' from '/tmp/arc1/sanity-hsm.test_13//045d/0x200000402:0x5f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.4' lhsmtool_posix: 1787119558.967726 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.3' lhsmtool_posix: 1787119559.002776 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.3' from '/tmp/arc1/sanity-hsm.test_13//0462/0x200000402:0x60:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.3' lhsmtool_posix: 1787119559.003697 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.2' lhsmtool_posix: 1787119559.039550 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.2' from '/tmp/arc1/sanity-hsm.test_13//0463/0x200000402:0x61:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.2' lhsmtool_posix: 1787119559.040049 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.1' lhsmtool_posix: 1787119559.082859 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.10/file.1' from '/tmp/arc1/sanity-hsm.test_13//0460/0x200000402:0x62:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.10/file.1' lhsmtool_posix: 1787119559.087282 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.10' lhsmtool_posix: 1787119559.165446 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.10' from '/tmp/arc1/sanity-hsm.test_13//0408/0x240000402:0xa:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.10' lhsmtool_posix: 1787119559.165652 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.9' lhsmtool_posix: 1787119559.244910 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.9' from '/tmp/arc1/sanity-hsm.test_13//0409/0x240000402:0xb:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.9' lhsmtool_posix: 1787119559.245272 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.8' lhsmtool_posix: 1787119559.280134 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.8' from '/tmp/arc1/sanity-hsm.test_13//040e/0x240000402:0xc:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.8' lhsmtool_posix: 1787119559.280898 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.7' lhsmtool_posix: 1787119559.311787 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.7' from '/tmp/arc1/sanity-hsm.test_13//040f/0x240000402:0xd:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.7' lhsmtool_posix: 1787119559.312512 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.6' lhsmtool_posix: 1787119559.343193 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.6' from '/tmp/arc1/sanity-hsm.test_13//040c/0x240000402:0xe:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.6' lhsmtool_posix: 1787119559.344087 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.5' lhsmtool_posix: 1787119559.376900 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.5' from '/tmp/arc1/sanity-hsm.test_13//040d/0x240000402:0xf:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.5' lhsmtool_posix: 1787119559.377778 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.4' lhsmtool_posix: 1787119559.405584 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.4' from '/tmp/arc1/sanity-hsm.test_13//0412/0x240000402:0x10:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.4' lhsmtool_posix: 1787119559.405747 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.3' lhsmtool_posix: 1787119559.425952 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.3' from '/tmp/arc1/sanity-hsm.test_13//0413/0x240000402:0x11:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.3' lhsmtool_posix: 1787119559.427627 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.2' lhsmtool_posix: 1787119559.454609 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.2' from '/tmp/arc1/sanity-hsm.test_13//0410/0x240000402:0x12:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.2' lhsmtool_posix: 1787119559.454823 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.1' lhsmtool_posix: 1787119559.491625 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.9/file.1' from '/tmp/arc1/sanity-hsm.test_13//0411/0x240000402:0x13:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.9/file.1' lhsmtool_posix: 1787119559.505039 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.10' lhsmtool_posix: 1787119559.557923 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.10' from '/tmp/arc1/sanity-hsm.test_13//0466/0x200000402:0x64:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.10' lhsmtool_posix: 1787119559.558129 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.9' lhsmtool_posix: 1787119559.592851 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.9' from '/tmp/arc1/sanity-hsm.test_13//0467/0x200000402:0x65:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.9' lhsmtool_posix: 1787119559.593244 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.8' lhsmtool_posix: 1787119559.622844 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.8' from '/tmp/arc1/sanity-hsm.test_13//0464/0x200000402:0x66:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.8' lhsmtool_posix: 1787119559.623014 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.7' lhsmtool_posix: 1787119559.690976 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.7' from '/tmp/arc1/sanity-hsm.test_13//0465/0x200000402:0x67:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.7' lhsmtool_posix: 1787119559.691166 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.6' lhsmtool_posix: 1787119559.736614 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.6' from '/tmp/arc1/sanity-hsm.test_13//046a/0x200000402:0x68:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.6' lhsmtool_posix: 1787119559.737241 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.5' lhsmtool_posix: 1787119559.774750 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.5' from '/tmp/arc1/sanity-hsm.test_13//046b/0x200000402:0x69:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.5' lhsmtool_posix: 1787119559.774966 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.4' lhsmtool_posix: 1787119559.828461 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.4' from '/tmp/arc1/sanity-hsm.test_13//0468/0x200000402:0x6a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.4' lhsmtool_posix: 1787119559.828660 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.3' lhsmtool_posix: 1787119559.879687 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.3' from '/tmp/arc1/sanity-hsm.test_13//0469/0x200000402:0x6b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.3' lhsmtool_posix: 1787119559.879886 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.2' lhsmtool_posix: 1787119559.916502 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.2' from '/tmp/arc1/sanity-hsm.test_13//046e/0x200000402:0x6c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.2' lhsmtool_posix: 1787119559.916703 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.1' lhsmtool_posix: 1787119559.952098 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.8/file.1' from '/tmp/arc1/sanity-hsm.test_13//046f/0x200000402:0x6d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.8/file.1' lhsmtool_posix: 1787119559.956656 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.10' lhsmtool_posix: 1787119559.992926 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.10' from '/tmp/arc1/sanity-hsm.test_13//0417/0x240000402:0x15:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.10' lhsmtool_posix: 1787119559.993636 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.9' lhsmtool_posix: 1787119560.017820 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.9' from '/tmp/arc1/sanity-hsm.test_13//0414/0x240000402:0x16:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.9' lhsmtool_posix: 1787119560.018617 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.8' lhsmtool_posix: 1787119560.070796 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.8' from '/tmp/arc1/sanity-hsm.test_13//0415/0x240000402:0x17:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.8' lhsmtool_posix: 1787119560.071132 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.7' lhsmtool_posix: 1787119560.110207 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.7' from '/tmp/arc1/sanity-hsm.test_13//041a/0x240000402:0x18:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.7' lhsmtool_posix: 1787119560.110959 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.6' lhsmtool_posix: 1787119560.152748 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.6' from '/tmp/arc1/sanity-hsm.test_13//041b/0x240000402:0x19:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.6' lhsmtool_posix: 1787119560.153534 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.5' lhsmtool_posix: 1787119560.189095 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.5' from '/tmp/arc1/sanity-hsm.test_13//0418/0x240000402:0x1a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.5' lhsmtool_posix: 1787119560.189618 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.4' lhsmtool_posix: 1787119560.224016 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.4' from '/tmp/arc1/sanity-hsm.test_13//0419/0x240000402:0x1b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.4' lhsmtool_posix: 1787119560.224447 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.3' lhsmtool_posix: 1787119560.254790 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.3' from '/tmp/arc1/sanity-hsm.test_13//041e/0x240000402:0x1c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.3' lhsmtool_posix: 1787119560.255416 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.2' lhsmtool_posix: 1787119560.319850 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.2' from '/tmp/arc1/sanity-hsm.test_13//041f/0x240000402:0x1d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.2' lhsmtool_posix: 1787119560.320453 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.1' lhsmtool_posix: 1787119560.353266 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.7/file.1' from '/tmp/arc1/sanity-hsm.test_13//041c/0x240000402:0x1e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.7/file.1' lhsmtool_posix: 1787119560.364493 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.10' lhsmtool_posix: 1787119560.417091 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.10' from '/tmp/arc1/sanity-hsm.test_13//046d/0x200000402:0x6f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.10' lhsmtool_posix: 1787119560.418217 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.9' lhsmtool_posix: 1787119560.477723 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.9' from '/tmp/arc1/sanity-hsm.test_13//0472/0x200000402:0x70:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.9' lhsmtool_posix: 1787119560.477921 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.8' lhsmtool_posix: 1787119560.520671 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.8' from '/tmp/arc1/sanity-hsm.test_13//0473/0x200000402:0x71:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.8' lhsmtool_posix: 1787119560.520872 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.7' lhsmtool_posix: 1787119560.552105 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.7' from '/tmp/arc1/sanity-hsm.test_13//0470/0x200000402:0x72:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.7' lhsmtool_posix: 1787119560.552363 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.6' lhsmtool_posix: 1787119560.577587 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.6' from '/tmp/arc1/sanity-hsm.test_13//0471/0x200000402:0x73:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.6' lhsmtool_posix: 1787119560.577996 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.5' lhsmtool_posix: 1787119560.601707 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.5' from '/tmp/arc1/sanity-hsm.test_13//0476/0x200000402:0x74:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.5' lhsmtool_posix: 1787119560.602133 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.4' lhsmtool_posix: 1787119560.629718 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.4' from '/tmp/arc1/sanity-hsm.test_13//0477/0x200000402:0x75:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.4' lhsmtool_posix: 1787119560.629912 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.3' lhsmtool_posix: 1787119560.665670 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.3' from '/tmp/arc1/sanity-hsm.test_13//0474/0x200000402:0x76:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.3' lhsmtool_posix: 1787119560.665860 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.2' lhsmtool_posix: 1787119560.712524 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.2' from '/tmp/arc1/sanity-hsm.test_13//0475/0x200000402:0x77:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.2' lhsmtool_posix: 1787119560.712713 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.1' lhsmtool_posix: 1787119560.772123 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.6/file.1' from '/tmp/arc1/sanity-hsm.test_13//047a/0x200000402:0x78:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.6/file.1' lhsmtool_posix: 1787119560.778707 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.10' lhsmtool_posix: 1787119560.860697 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.10' from '/tmp/arc1/sanity-hsm.test_13//0422/0x240000402:0x20:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.10' lhsmtool_posix: 1787119560.860903 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.9' lhsmtool_posix: 1787119560.928227 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.9' from '/tmp/arc1/sanity-hsm.test_13//0423/0x240000402:0x21:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.9' lhsmtool_posix: 1787119560.928488 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.8' lhsmtool_posix: 1787119561.000067 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.8' from '/tmp/arc1/sanity-hsm.test_13//0420/0x240000402:0x22:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.8' lhsmtool_posix: 1787119561.000268 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.7' lhsmtool_posix: 1787119561.047525 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.7' from '/tmp/arc1/sanity-hsm.test_13//0421/0x240000402:0x23:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.7' lhsmtool_posix: 1787119561.048423 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.6' lhsmtool_posix: 1787119561.088560 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.6' from '/tmp/arc1/sanity-hsm.test_13//0426/0x240000402:0x24:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.6' lhsmtool_posix: 1787119561.090172 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.5' lhsmtool_posix: 1787119561.122249 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.5' from '/tmp/arc1/sanity-hsm.test_13//0427/0x240000402:0x25:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.5' lhsmtool_posix: 1787119561.123347 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.4' lhsmtool_posix: 1787119561.169075 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.4' from '/tmp/arc1/sanity-hsm.test_13//0424/0x240000402:0x26:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.4' lhsmtool_posix: 1787119561.169280 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.3' lhsmtool_posix: 1787119561.207127 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.3' from '/tmp/arc1/sanity-hsm.test_13//0425/0x240000402:0x27:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.3' lhsmtool_posix: 1787119561.207754 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.2' lhsmtool_posix: 1787119561.235557 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.2' from '/tmp/arc1/sanity-hsm.test_13//042a/0x240000402:0x28:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.2' lhsmtool_posix: 1787119561.236159 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.1' lhsmtool_posix: 1787119561.281945 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.5/file.1' from '/tmp/arc1/sanity-hsm.test_13//042b/0x240000402:0x29:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.5/file.1' lhsmtool_posix: 1787119561.293108 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.10' lhsmtool_posix: 1787119561.352474 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.10' from '/tmp/arc1/sanity-hsm.test_13//0478/0x200000402:0x7a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.10' lhsmtool_posix: 1787119561.352675 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.9' lhsmtool_posix: 1787119561.383467 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.9' from '/tmp/arc1/sanity-hsm.test_13//0479/0x200000402:0x7b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.9' lhsmtool_posix: 1787119561.383671 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.8' lhsmtool_posix: 1787119561.409123 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.8' from '/tmp/arc1/sanity-hsm.test_13//047e/0x200000402:0x7c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.8' lhsmtool_posix: 1787119561.409395 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.7' lhsmtool_posix: 1787119561.454970 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.7' from '/tmp/arc1/sanity-hsm.test_13//047f/0x200000402:0x7d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.7' lhsmtool_posix: 1787119561.455168 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.6' lhsmtool_posix: 1787119561.514620 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.6' from '/tmp/arc1/sanity-hsm.test_13//047c/0x200000402:0x7e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.6' lhsmtool_posix: 1787119561.515269 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.5' lhsmtool_posix: 1787119561.574290 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.5' from '/tmp/arc1/sanity-hsm.test_13//047d/0x200000402:0x7f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.5' lhsmtool_posix: 1787119561.574828 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.4' lhsmtool_posix: 1787119561.624113 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.4' from '/tmp/arc1/sanity-hsm.test_13//0482/0x200000402:0x80:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.4' lhsmtool_posix: 1787119561.624876 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.3' lhsmtool_posix: 1787119561.669622 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.3' from '/tmp/arc1/sanity-hsm.test_13//0483/0x200000402:0x81:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.3' lhsmtool_posix: 1787119561.670084 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.2' lhsmtool_posix: 1787119561.705591 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.2' from '/tmp/arc1/sanity-hsm.test_13//0480/0x200000402:0x82:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.2' lhsmtool_posix: 1787119561.705793 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.1' lhsmtool_posix: 1787119561.765427 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.4/file.1' from '/tmp/arc1/sanity-hsm.test_13//0481/0x200000402:0x83:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.4/file.1' lhsmtool_posix: 1787119561.777899 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.10' lhsmtool_posix: 1787119561.870453 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.10' from '/tmp/arc1/sanity-hsm.test_13//0429/0x240000402:0x2b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.10' lhsmtool_posix: 1787119561.870719 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.9' lhsmtool_posix: 1787119561.906589 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.9' from '/tmp/arc1/sanity-hsm.test_13//042e/0x240000402:0x2c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.9' lhsmtool_posix: 1787119561.906769 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.8' lhsmtool_posix: 1787119561.965186 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.8' from '/tmp/arc1/sanity-hsm.test_13//042f/0x240000402:0x2d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.8' lhsmtool_posix: 1787119561.972741 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.7' lhsmtool_posix: 1787119562.027032 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.7' from '/tmp/arc1/sanity-hsm.test_13//042c/0x240000402:0x2e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.7' lhsmtool_posix: 1787119562.027749 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.6' lhsmtool_posix: 1787119562.060819 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.6' from '/tmp/arc1/sanity-hsm.test_13//042d/0x240000402:0x2f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.6' lhsmtool_posix: 1787119562.061039 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.5' lhsmtool_posix: 1787119562.089507 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.5' from '/tmp/arc1/sanity-hsm.test_13//0432/0x240000402:0x30:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.5' lhsmtool_posix: 1787119562.089720 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.4' lhsmtool_posix: 1787119562.117738 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.4' from '/tmp/arc1/sanity-hsm.test_13//0433/0x240000402:0x31:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.4' lhsmtool_posix: 1787119562.118695 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.3' lhsmtool_posix: 1787119562.149863 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.3' from '/tmp/arc1/sanity-hsm.test_13//0430/0x240000402:0x32:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.3' lhsmtool_posix: 1787119562.150079 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.2' lhsmtool_posix: 1787119562.185402 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.2' from '/tmp/arc1/sanity-hsm.test_13//0431/0x240000402:0x33:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.2' lhsmtool_posix: 1787119562.185613 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.1' lhsmtool_posix: 1787119562.218146 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.3/file.1' from '/tmp/arc1/sanity-hsm.test_13//0436/0x240000402:0x34:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.3/file.1' lhsmtool_posix: 1787119562.230847 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.10' lhsmtool_posix: 1787119562.274400 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.10' from '/tmp/arc1/sanity-hsm.test_13//0487/0x200000402:0x85:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.10' lhsmtool_posix: 1787119562.274567 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.9' lhsmtool_posix: 1787119562.297688 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.9' from '/tmp/arc1/sanity-hsm.test_13//0484/0x200000402:0x86:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.9' lhsmtool_posix: 1787119562.298246 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.8' lhsmtool_posix: 1787119562.335359 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.8' from '/tmp/arc1/sanity-hsm.test_13//0485/0x200000402:0x87:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.8' lhsmtool_posix: 1787119562.335556 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.7' lhsmtool_posix: 1787119562.386015 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.7' from '/tmp/arc1/sanity-hsm.test_13//048a/0x200000402:0x88:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.7' lhsmtool_posix: 1787119562.386187 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.6' lhsmtool_posix: 1787119562.422030 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.6' from '/tmp/arc1/sanity-hsm.test_13//048b/0x200000402:0x89:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.6' lhsmtool_posix: 1787119562.422249 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.5' lhsmtool_posix: 1787119562.465240 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.5' from '/tmp/arc1/sanity-hsm.test_13//0488/0x200000402:0x8a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.5' lhsmtool_posix: 1787119562.465453 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.4' lhsmtool_posix: 1787119562.513107 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.4' from '/tmp/arc1/sanity-hsm.test_13//0489/0x200000402:0x8b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.4' lhsmtool_posix: 1787119562.513377 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.3' lhsmtool_posix: 1787119562.556558 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.3' from '/tmp/arc1/sanity-hsm.test_13//048e/0x200000402:0x8c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.3' lhsmtool_posix: 1787119562.558046 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.2' lhsmtool_posix: 1787119562.591605 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.2' from '/tmp/arc1/sanity-hsm.test_13//048f/0x200000402:0x8d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.2' lhsmtool_posix: 1787119562.591797 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.1' lhsmtool_posix: 1787119562.651655 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.2/file.1' from '/tmp/arc1/sanity-hsm.test_13//048c/0x200000402:0x8e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.2/file.1' lhsmtool_posix: 1787119562.659672 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.10' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.10' lhsmtool_posix: 1787119562.718956 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.10' from '/tmp/arc1/sanity-hsm.test_13//0434/0x240000402:0x36:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.10' lhsmtool_posix: 1787119562.719153 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.9' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.9' lhsmtool_posix: 1787119562.761166 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.9' from '/tmp/arc1/sanity-hsm.test_13//0435/0x240000402:0x37:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.9' lhsmtool_posix: 1787119562.761404 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.8' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.8' lhsmtool_posix: 1787119562.863111 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.8' from '/tmp/arc1/sanity-hsm.test_13//043a/0x240000402:0x38:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.8' lhsmtool_posix: 1787119562.863852 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.7' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.7' lhsmtool_posix: 1787119562.939473 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.7' from '/tmp/arc1/sanity-hsm.test_13//043b/0x240000402:0x39:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.7' lhsmtool_posix: 1787119562.939914 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.6' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.6' lhsmtool_posix: 1787119563.007170 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.6' from '/tmp/arc1/sanity-hsm.test_13//0438/0x240000402:0x3a:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.6' lhsmtool_posix: 1787119563.009674 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.5' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.5' lhsmtool_posix: 1787119563.072640 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.5' from '/tmp/arc1/sanity-hsm.test_13//0439/0x240000402:0x3b:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.5' lhsmtool_posix: 1787119563.072847 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.4' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.4' lhsmtool_posix: 1787119563.105467 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.4' from '/tmp/arc1/sanity-hsm.test_13//043e/0x240000402:0x3c:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.4' lhsmtool_posix: 1787119563.105677 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.3' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.3' lhsmtool_posix: 1787119563.132686 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.3' from '/tmp/arc1/sanity-hsm.test_13//043f/0x240000402:0x3d:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.3' lhsmtool_posix: 1787119563.133517 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.2' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.2' lhsmtool_posix: 1787119563.179027 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.2' from '/tmp/arc1/sanity-hsm.test_13//043c/0x240000402:0x3e:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.2' lhsmtool_posix: 1787119563.179377 [36927]: importing '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.1' from '/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.1' lhsmtool_posix: 1787119563.209487 [36927]: imported '/mnt/lustre/d13.sanity-hsm/subdir/dir.1/file.1' from '/tmp/arc1/sanity-hsm.test_13//043d/0x240000402:0x3f:0x0'=='/tmp/arc1/sanity-hsm.test_13//subdir/dir.1/file.1' lhsmtool_posix: 1787119563.209898 [36927]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_13/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 13 (26s) == sanity-hsm test 14: Rebind archived file to a new fid ========================================================== 02:06:17 (1787119577) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_14/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.108012 s, 9.7 MB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00762993 s, 0.0 kB/s rebind 0x200000403:0x73:0x0 to 0x200000403:0x74:0x0 lhsmtool_posix: 1787119581.433594 [37878]: action=2 src=0x200000403:0x73:0x0 dst=0x200000403:0x74:0x0 mount_point=/mnt/lustre2 lhsmtool_posix: 1787119581.434603 [37878]: rebind [0x200000403:0x73:0x0] to [0x200000403:0x74:0x0] lhsmtool_posix: 1787119581.434729 [37878]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 14 (9s) == sanity-hsm test 15: Rebind a list of files ============ 02:06:26 (1787119586) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_15/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112584 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0740477 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.193779 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104142 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.183716 s, 5.7 MB/s Waiting 300s for '' pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 0+0 records in 0+0 records out 0 bytes copied, 0.00339689 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00434072 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00241389 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.005684 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00432859 s, 0.0 kB/s rebind list of files lhsmtool_posix: 1787119593.607957 [38673]: action=2 src=/tmp/tmp.8221 dst=(null) mount_point=/mnt/lustre2 lhsmtool_posix: 1787119593.609571 [38673]: rebind [0x200000403:0x76:0x0] to [0x200000403:0x7b:0x0] lhsmtool_posix: 1787119593.610274 [38673]: rebind [0x200000403:0x77:0x0] to [0x200000403:0x7c:0x0] lhsmtool_posix: 1787119593.610357 [38673]: rebind [0x200000403:0x78:0x0] to [0x200000403:0x7d:0x0] lhsmtool_posix: 1787119593.610405 [38673]: rebind [0x200000403:0x79:0x0] to [0x200000403:0x7e:0x0] lhsmtool_posix: 1787119593.610457 [38673]: rebind [0x200000403:0x7a:0x0] to [0x200000403:0x7f:0x0] lhsmtool_posix: 1787119593.610515 [38673]: 5 lines read from '/tmp/tmp.8221', 5 rebind successful lhsmtool_posix: 1787119593.610531 [38673]: process finished, errs: 0 major, 0 minor, rc=0 (Success) PASS 15 (19s) == sanity-hsm test 16: Test CT bandwith control option === 02:06:45 (1787119605) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_16/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 20+0 records in 20+0 records out 20971520 bytes (21 MB, 20 MiB) copied, 0.0915028 s, 229 MB/s Waiting 200s for 'SUCCEED' Updated after 20s: want 'SUCCEED' got 'SUCCEED' PASS 16 (29s) == sanity-hsm test 20: Release is not permitted ========== 02:07:14 (1787119634) 0+0 records in 0+0 records out 0 bytes copied, 0.0134802 s, 0.0 kB/s 0x200000403:0x87:0x0 Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted Cannot send HSM request (use of /mnt/lustre/d20.sanity-hsm/f20.sanity-hsm): Operation not permitted PASS 20 (7s) == sanity-hsm test 21: Simple release tests ============== 02:07:22 (1787119642) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_21/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0782287 s, 13.4 MB/s PASS 21 (10s) == sanity-hsm test 22: Could not swap a release file ===== 02:07:33 (1787119653) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_22/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0932966 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156543 s, 6.7 MB/s 0x200000403:0x8b:0x0 lfs swap_layouts: error: cannot swap layout between '/mnt/lustre/d22.sanity-hsm/test_swap' and '/mnt/lustre/d22.sanity-hsm/test_release': Operation not supported (95) PASS 22 (9s) == sanity-hsm test 23: Release does not change a/mtime (utime) ========================================================== 02:07:41 (1787119661) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_23/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.166392 s, 6.3 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 23 (10s) == sanity-hsm test 24a: Archive, release, and restore does not change a/mtime (i/o) ========================================================== 02:07:51 (1787119671) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131165 s, 8.0 MB/s Killing existing copytools on oleg248-client.virtnet with signal TERM copytools stopped in 0s 192.168.202.148@tcp:/lustre /mnt/lustre lustre rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg248-client.virtnet /mnt/lustre (opts:) Starting client: oleg248-client.virtnet: -o user_xattr,flock 192.168.202.148@tcp:/lustre /mnt/lustre PASS 24a (14s) == sanity-hsm test 24b: root can archive, release, and restore user files ========================================================== 02:08:05 (1787119685) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0662925 s, 15.8 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_state] [/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm] /mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm: (0x00000009) exists archived, archive_id:1 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [md5sum] [/mnt/lustre/d24b.sanity-hsm/f24b.sanity-hsm] PASS 24b (17s) == sanity-hsm test 24c: check that user,group,other request masks work ========================================================== 02:08:22 (1787119702) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120354 s, 8.7 MB/s 0x200000403:0x94:0x0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.127813 s, 8.2 MB/s 0x200000403:0x95:0x0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180351 s, 5.8 MB/s 0x200000403:0x96:0x0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] Cannot send HSM request (use of /mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm): Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [hsm_archive] [/mnt/lustre/d24c.sanity-hsm/f24c.sanity-hsm] PASS 24c (21s) == sanity-hsm test 24d: check that read-only mounts are respected ========================================================== 02:08:43 (1787119723) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0978591 s, 10.7 MB/s 0x200000403:0x97:0x0 /mnt/lustre/d24d.sanity-hsm/f24d.sanity-hsm lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 80 0x50 0x280000401 Starting client: oleg248-client.virtnet: -o user_xattr,flock 192.168.202.148@tcp:/lustre /mnt/lustre3 Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre3"' Cannot send HSM request (use of /mnt/lustre2/d24d.sanity-hsm/f24d.sanity-hsm): Read-only file system Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.831857 s, 1.3 MB/s Cannot send HSM request (use of /mnt/lustre2/d24d.sanity-hsm/f24d.sanity-hsm): Read-only file system Stopping client oleg248-client.virtnet /mnt/lustre3 (opts:) PASS 24d (16s) == sanity-hsm test 24e: tar succeeds on HSM released files ========================================================== 02:08:59 (1787119739) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0855322 s, 12.3 MB/s /mnt/lustre/d24e.sanity-hsm/f24e.sanity-hsm: (0x0000000d) released exists archived, archive_id:1 tar: Removing leading `/' from member names PASS 24e (8s) == sanity-hsm test 24f: root can archive, release, and restore tar files ========================================================== 02:09:07 (1787119747) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24f/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 54fb6627dbaa37721048e4549db3224d /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm f24f.sanity-hsm f24f.sanity-hsm Sum0 = 54fb6627dbaa37721048e4549db3224d /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm, sum1 = 54fb6627dbaa37721048e4549db3224d /mnt/lustre/d24f.sanity-hsm/f24f.sanity-hsm PASS 24f (9s) == sanity-hsm test 24g: write by non-owner still sets dirty ========================================================== 02:09:16 (1787119756) RUNAS = 'runas -u 500 -g 500' Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_24g/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Please listen carefully as our options have changed. Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' running as uid/gid/euid/egid 500/500/500/500, groups: 500 [tee] [/mnt/lustre/d24g.sanity-hsm/f24g.sanity-hsm] To be electrocuted by your telephone, press #. PASS 24g (11s) == sanity-hsm test 25a: Restore lost file (HS_LOST flag) from import ========================================================== 02:09:27 (1787119767) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_25a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1787119769.535426 [47690]: action=1 src=d25a.sanity-hsm/f25a.sanity-hsm dst=/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787119769.553637 [47690]: importing '/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_25a//d25a.sanity-hsm/f25a.sanity-hsm' lhsmtool_posix: 1787119769.666365 [47690]: imported '/mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_25a//0406/0x240000404:0x2:0x0'=='/tmp/arc1/sanity-hsm.test_25a//d25a.sanity-hsm/f25a.sanity-hsm' lhsmtool_posix: 1787119769.666435 [47690]: process finished, errs: 0 major, 0 minor, rc=0 (Success) md5sum: /mnt/lustre/d25a.sanity-hsm/f25a.sanity-hsm: No data available PASS 25a (8s) == sanity-hsm test 25b: Restore lost file (HS_LOST flag) after release ========================================================== 02:09:35 (1787119775) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_25b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' md5sum: /mnt/lustre/d25b.sanity-hsm/f25b.sanity-hsm: No data available PASS 25b (8s) == sanity-hsm test 26A: Remove the archive of a valid file ========================================================== 02:09:43 (1787119783) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.00486813 s, 0.0 kB/s PASS 26A (10s) == sanity-hsm test 26a: Remove Archive On Last Unlink (RAoLU) policy ========================================================== 02:09:53 (1787119793) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 7s: want 'SUCCEED' got 'SUCCEED' PASS 26a (35s) == sanity-hsm test 26b: RAoLU policy when CDT off ======== 02:10:29 (1787119829) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled Killing existing copytools on oleg248-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 26b (27s) == sanity-hsm test 26c: RAoLU effective when file closed ========================================================== 02:10:55 (1787119855) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' multiop /mnt/lustre/d26c.sanity-hsm/f26c.sanity-hsm vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.8221 Waiting 200s for 'SUCCEED' Updated after 7s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 8s: want 'SUCCEED' got 'SUCCEED' PASS 26c (40s) == sanity-hsm test 26d: RAoLU when Client eviction ======= 02:11:35 (1787119895) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.210165 s, 5.0 MB/s multiop /mnt/lustre/d26d.sanity-hsm/f26d.sanity-hsm vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.8221 Waiting 200s for 'SUCCEED' Updated after 6s: want 'SUCCEED' got 'SUCCEED' PASS 26d (32s) == sanity-hsm test 26e: RAoLU with a non-started coordinator ========================================================== 02:12:07 (1787119927) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102943 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0981488 s, 10.7 MB/s Killing existing copytools on oleg248-client.virtnet with signal TERM copytools stopped in 1s Failing mds1 on oleg248-server Stopping /mnt/lustre-mds1 (opts:) on oleg248-server 02:12:40 (1787119960) shut down facet: mds1 facet_host: oleg248-server facet_failover_host: oleg248-server Failover mds1 to oleg248-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg248-server: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 Started lustre-MDT0000 02:13:13 (1787119993) targets are mounted 02:13:13 (1787119993) facet_failover done oleg248-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Check cookie from RAoLU request (last: 1787119236, remove: 1787119237) mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_26e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 26e (120s) == sanity-hsm test 27a: Remove the archive of an imported file (Operation not permitted) ========================================================== 02:14:07 (1787120047) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_27a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB, 39 MiB) copied, 0.93356 s, 43.8 MB/s lhsmtool_posix: 1787120051.039562 [54782]: action=1 src=d27a.sanity-hsm/f27a.sanity-hsm dst=/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787120051.053772 [54782]: importing '/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_27a//d27a.sanity-hsm/f27a.sanity-hsm' lhsmtool_posix: 1787120051.113538 [54782]: imported '/mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_27a//0400/0x240000404:0x4:0x0'=='/tmp/arc1/sanity-hsm.test_27a//d27a.sanity-hsm/f27a.sanity-hsm' lhsmtool_posix: 1787120051.113703 [54782]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Cannot send HSM request (use of /mnt/lustre/d27a.sanity-hsm/f27a.sanity-hsm): Operation not permitted PASS 27a (8s) == sanity-hsm test 27b: Remove the archive of a relased file (Operation not permitted) ========================================================== 02:14:15 (1787120055) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_27b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.00455887 s, 0.0 kB/s Cannot send HSM request (use of /mnt/lustre/d27b.sanity-hsm/f27b.sanity-hsm): Operation not permitted PASS 27b (10s) == sanity-hsm test 28: Concurrent archive/file remove ==== 02:14:25 (1787120065) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_28/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.0249086 s, 0.0 kB/s mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled PASS 28 (19s) == sanity-hsm test 29a: Tests --mntpath and --archive options ========================================================== 02:14:45 (1787120085) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 7 "/mnt/lustre"' Cannot send HSM request (use of /mnt/lustre): Invalid argument hsm: '/qwerty/uyt' is not a valid FID PASS 29a (8s) == sanity-hsm test 29b: Archive/delete/remove by FID from the archive. ========================================================== 02:14:52 (1787120092) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116975 s, 9.0 MB/s PASS 29b (8s) == sanity-hsm test 29c: Archive/delete/remove by FID, using a file list. ========================================================== 02:15:01 (1787120101) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_29c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.169638 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0817882 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0822933 s, 12.7 MB/s Waiting 200s for 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 29c (20s) == sanity-hsm test 29d: hsm_remove by FID with archive_id 0 for unlinked file cause ========================================================== 02:15:20 (1787120120) SKIP: sanity-hsm test_29d Need 3 or more clients, have 1 SKIP 29d (3s) == sanity-hsm test 30a: Restore at exec (import case) ==== 02:15:23 (1787120123) SKIP: sanity-hsm test_30a Need 2 or more clients, have 1 SKIP 30a (3s) == sanity-hsm test 30b: Restore at exec (release case) === 02:15:27 (1787120127) SKIP: sanity-hsm test_30b Need 2 or more clients, have 1 SKIP 30b (3s) == sanity-hsm test 30c: Update during exec of released file must fail ========================================================== 02:15:30 (1787120130) SKIP: sanity-hsm test_30c Need 2 or more clients, have 1 SKIP 30c (3s) == sanity-hsm test 31a: Import a large file and check size during restore ========================================================== 02:15:34 (1787120134) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB, 39 MiB) copied, 0.76251 s, 53.6 MB/s lhsmtool_posix: 1787120137.342556 [59942]: action=1 src=d31a.sanity-hsm/f31a.sanity-hsm dst=/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787120137.354638 [59942]: importing '/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_31a//d31a.sanity-hsm/f31a.sanity-hsm' lhsmtool_posix: 1787120137.407542 [59942]: imported '/mnt/lustre/d31a.sanity-hsm/f31a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_31a//040c/0x200000407:0xb:0x0'=='/tmp/arc1/sanity-hsm.test_31a//d31a.sanity-hsm/f31a.sanity-hsm' lhsmtool_posix: 1787120137.407601 [59942]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' size seen is right: 40894464 == 40894464 done PASS 31a (20s) == sanity-hsm test 31b: Restore a large unaligned file and check size during restore ========================================================== 02:15:54 (1787120154) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 39000000 bytes (39 MB, 37 MiB) copied, 1.36634 s, 28.5 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' size seen is right: 39000000 == 39000000 done PASS 31b (23s) == sanity-hsm test 31c: Restore a large aligned file and check size during restore ========================================================== 02:16:18 (1787120178) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_31c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB, 39 MiB) copied, 1.33206 s, 30.7 MB/s Waiting 200s for 'SUCCEED' size seen is right: 40894464 == 40894464 done PASS 31c (22s) == sanity-hsm test 33: Kill a restore waiting process ==== 02:16:40 (1787120200) 0+0 records in 0+0 records out 0 bytes copied, 0.0104772 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_33/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Copytool is suspended on oleg248-client.virtnet Copytool is continued on oleg248-client.virtnet /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2893: 61981 Terminated md5sum $f > /dev/null PASS 33 (11s) == sanity-hsm test 34: Remove file during restore ======== 02:16:51 (1787120211) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_34/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.00264455 s, 0.0 kB/s Copytool is suspended on oleg248-client.virtnet Copytool is continued on oleg248-client.virtnet /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2925: kill: (62641) - No such process PASS 34 (9s) == sanity-hsm test 35: Overwrite file during restore ===== 02:17:01 (1787120221) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_35/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.00486019 s, 0.0 kB/s Copytool is suspended on oleg248-client.virtnet Copytool is continued on oleg248-client.virtnet /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2962: kill: (63318) - No such process PASS 35 (11s) == sanity-hsm test 36: Move file during restore ========== 02:17:11 (1787120231) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_36/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.00600908 s, 0.0 kB/s Copytool is suspended on oleg248-client.virtnet Copytool is continued on oleg248-client.virtnet /home/green/git/lustre-release/lustre/tests/sanity-hsm.sh: line 2998: kill: (63993) - No such process PASS 36 (12s) == sanity-hsm test 37: re-archive a dirty file =========== 02:17:23 (1787120243) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_37/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.195206 s, 5.4 MB/s Waiting 200s for 'SUCCEED' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.045483 s, 23.1 MB/s Waiting 200s for 'SUCCEED' Updated after 7s: want 'SUCCEED' got 'SUCCEED' PASS 37 (81s) == sanity-hsm test 40: Parallel archive requests ========= 02:18:44 (1787120324) oleg248-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=1152921504606846976: Cannot allocate memory oleg248-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='1152921504606846976': Cannot allocate memory pdsh@oleg248-client: oleg248-server: ssh exited with exit code 12 oleg248-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/max_requests=1152921504606846976: Cannot allocate memory oleg248-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/max_requests'='1152921504606846976': Cannot allocate memory pdsh@oleg248-client: oleg248-server: ssh exited with exit code 12 set max_requests=1152921504606846976 failed with 12 [ 1632.059172] Lustre: lustre-MDT0000: No more memory to set HSM max_requests=1152921504606846976 (max request memory: 461MB, current total 6/975941): rc = -12 [ 1633.023882] Lustre: lustre-MDT0001: No more memory to set HSM max_requests=1152921504606846976 (max request memory: 461MB, current total 975941/975941): rc = -12 Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_40/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=purge mdt.lustre-MDT0001.hsm_control=purge Wait for all requests being enqueued...100 archive requests submitted 100 archive requests submitted 100 archive requests submitted 100 archive requests submitted OK pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 PASS 40 (141s) == sanity-hsm test 50: Archive with large number of pending HSM actions ========================================================== 02:21:06 (1787120466) oleg248-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=1000000: Cannot allocate memory oleg248-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='1000000': Cannot allocate memory pdsh@oleg248-client: oleg248-server: ssh exited with exit code 12 oleg248-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/max_requests=1000000: Cannot allocate memory oleg248-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/max_requests'='1000000': Cannot allocate memory pdsh@oleg248-client: oleg248-server: ssh exited with exit code 12 Filesystem Inodes IUsed IFree IUse% Mounted on 192.168.202.148@tcp:/lustre 524222 1207 523015 1% /mnt/lustre - create 1869 (time 1787120482.01 total 10.00 last 186.84) - create 3648 (time 1787120492.01 total 20.00 last 177.89) - create 5410 (time 1787120502.01 total 30.01 last 176.15) - create 7335 (time 1787120512.01 total 40.01 last 192.46) - create 9112 (time 1787120522.02 total 50.02 last 177.55) total: 10000 create in 55.15 seconds: 181.33 ops/second 10000 - unlinked 0 (time 1787120605 ; total 0 ; last 0) total: 10000 unlinks in 56 seconds: 178.571426 unlinks/second Start Phase files_num: 10000 time: 72 - create 1793 (time 1787120676.65 total 10.01 last 179.21) - create 3455 (time 1787120686.65 total 20.01 last 166.17) - create 5167 (time 1787120696.65 total 30.01 last 171.17) - create 6934 (time 1787120706.65 total 40.01 last 176.64) - create 8744 (time 1787120716.65 total 50.01 last 181.00) - create 10000 (time 1787120723.33 total 56.69 last 188.08) - create 11648 (time 1787120733.33 total 66.69 last 164.77) - create 13387 (time 1787120743.33 total 76.69 last 173.88) - create 15069 (time 1787120753.34 total 86.69 last 168.17) - create 16746 (time 1787120763.34 total 96.70 last 167.68) - create 18695 (time 1787120773.34 total 106.70 last 194.90) total: 20000 create in 113.87 seconds: 175.65 ops/second - unlinked 0 (time 1787120935 ; total 0 ; last 0) - unlinked 10000 (time 1787120994 ; total 59 ; last 59) total: 20000 unlinks in 122 seconds: 163.934433 unlinks/second Middle Phase files_num: 20000 time: 150 - create 1758 (time 1787121072.91 total 10.00 last 175.74) - create 3462 (time 1787121082.92 total 20.01 last 170.37) - create 5135 (time 1787121092.92 total 30.01 last 167.23) - create 6848 (time 1787121102.92 total 40.01 last 171.30) - create 8278 (time 1787121112.92 total 50.01 last 142.95) - create 9448 (time 1787121122.92 total 60.01 last 116.99) total: 10000 create in 63.35 seconds: 157.85 ops/second 40000 - unlinked 0 (time 1787121223 ; total 0 ; last 0) total: 10000 unlinks in 65 seconds: 153.846161 unlinks/second End Phase files_num: 10000 time: 87 40000 mdt.lustre-MDT0000.hsm_control=purge mdt.lustre-MDT0001.hsm_control=purge PASS 50 (841s) == sanity-hsm test 52: Opened for write file on an evicted client should be set dirty ========================================================== 02:35:07 (1787121307) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_52/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.094362 s, 11.1 MB/s multiop /mnt/lustre/d52.sanity-hsm/f52.sanity-hsm vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.8221 pdsh@oleg248-client: oleg248-client: ssh exited with exit code 5 PASS 52 (18s) == sanity-hsm test 53: Opened for read file on an evicted client should not be set dirty ========================================================== 02:35:25 (1787121325) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_53/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.136837 s, 7.7 MB/s multiop /mnt/lustre/d53.sanity-hsm/f53.sanity-hsm vo_c TMPPIPE=/tmp/multiop_open_wait_pipe.8221 PASS 53 (14s) == sanity-hsm test 54: Write during an archive cancels it ========================================================== 02:35:39 (1787121339) 39+0 records in 39+0 records out 39000000 bytes (39 MB, 37 MiB) copied, 1.2237 s, 31.9 MB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_54/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0001.hsm.policy=+NRA Waiting 200s for 'FAILED' Updated after 31s: want 'FAILED' got 'FAILED' mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0001.hsm.policy=-NRA PASS 54 (49s) == sanity-hsm test 55: Truncate during an archive cancels it ========================================================== 02:36:28 (1787121388) 39+0 records in 39+0 records out 39000000 bytes (39 MB, 37 MiB) copied, 1.25232 s, 31.1 MB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_55/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0001.hsm.policy=+NRA mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0001.hsm.policy=-NRA PASS 55 (16s) == sanity-hsm test 56: Setattr during an archive is ok === 02:36:44 (1787121404) 39+0 records in 39+0 records out 39000000 bytes (39 MB, 37 MiB) copied, 0.946587 s, 41.2 MB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_56/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Waiting 190s for 'SUCCEED' Waiting 180s for 'SUCCEED' Waiting 170s for 'SUCCEED' Updated after 36s: want 'SUCCEED' got 'SUCCEED' PASS 56 (48s) == sanity-hsm test 57: Archive a file with dirty cache on another node ========================================================== 02:37:32 (1787121452) SKIP: sanity-hsm test_57 Need 2 or more clients, have 1 SKIP 57 (4s) == sanity-hsm test 58: Truncate a released file will trigger restore ========================================================== 02:37:36 (1787121456) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_58/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' truncate up from 1516 to 3032 /mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2 truncate down from 1516 to 758 /mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2 truncate to 0 /mnt/lustre/d58.sanity-hsm/f58.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:2 PASS 58 (20s) == sanity-hsm test 59: Release stripeless file with non-zero size ========================================================== 02:37:56 (1787121476) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_59/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 59 (7s) == sanity-hsm test 60: Changing progress update interval from default ========================================================== 02:38:04 (1787121484) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.426839 s, 24.6 MB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_60/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 --update-interval 5 "/mnt/lustre2"' Waiting 100s for 'start copy' Expecting a progress update within 20 seconds... 5242880 bytes copied in 2 seconds. Wait for on going archive hsm action to complete Waiting 10s for 'copied' Updated after 4s: want 'copied' got 'copied' PASS 60 (20s) == sanity-hsm test 61: Waiting archive of a removed file should fail ========================================================== 02:38:24 (1787121504) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_61/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled PASS 61 (20s) == sanity-hsm test 70: Copytool logs JSON register/unregister events to FIFO ========================================================== 02:38:44 (1787121524) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_70/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --event-fifo /tmp/sanity-hsm.test_70.MZn1/fifo "/mnt/lustre2"' Killing existing copytools on oleg248-client.virtnet with signal TERM copytools stopped in 0s Register/Unregister events look OK. PASS 70 (15s) == sanity-hsm test 71: Copytool logs JSON archive events to FIFO ========================================================== 02:38:59 (1787121539) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_71/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --update-interval 5 --event-fifo /tmp/sanity-hsm.test_71.xy27/fifo "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0001.hsm.policy=-NRA 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.155021 s, 6.8 MB/s Archive events look OK. mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0001.hsm.policy=-NRA PASS 71 (23s) == sanity-hsm test 72: Copytool logs JSON restore events to FIFO ========================================================== 02:39:22 (1787121562) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_72/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --update-interval 5 --event-fifo /tmp/sanity-hsm.test_72.msDY/fifo "/mnt/lustre2"' 16+0 records in 16+0 records out 16000000 bytes (16 MB, 15 MiB) copied, 0.57383 s, 27.9 MB/s lhsmtool_posix: 1787121567.221464 [82822]: action=1 src=d72.sanity-hsm/f72.sanity-hsm dst=/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787121567.228147 [82822]: importing '/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_72//d72.sanity-hsm/f72.sanity-hsm' lhsmtool_posix: 1787121567.266289 [82822]: imported '/mnt/lustre/d72.sanity-hsm/f72.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_72//0bc5/0x200000bd2:0x17:0x0'=='/tmp/arc1/sanity-hsm.test_72//d72.sanity-hsm/f72.sanity-hsm' lhsmtool_posix: 1787121567.267808 [82822]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Verifying released state: Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Restore events look OK. PASS 72 (22s) == sanity-hsm test 90: Archive/restore a file list ======= 02:39:44 (1787121584) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_90/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=purge mdt.lustre-MDT0001.hsm_control=purge Waiting 200s for '' Changed after 3s: from 'lrh=[type=10680000 len=136 idx=4/9609] fid=[0x200000403:0xd7:0x0] dfid=[0x200000403:0xd7:0x0] compound/cookie=0x0/0x6a85e2fa action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9610] fid=[0x200000403:0xd8:0x0] dfid=[0x200000403:0xd8:0x0] compound/cookie=0x0/0x6a85e2fb action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9611] fid=[0x200000403:0xd9:0x0] dfid=[0x200000403:0xd9:0x0] compound/cookie=0x0/0x6a85e2fc action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9612] fid=[0x200000403:0xda:0x0] dfid=[0x200000403:0xda:0x0] compound/cookie=0x0/0x6a85e2fd action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9613] fid=[0x200000403:0xdb:0x0] dfid=[0x200000403:0xdb:0x0] compound/cookie=0x0/0x6a85e2fe action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9614] fid=[0x200000403:0xdc:0x0] dfid=[0x200000403:0xdc:0x0] compound/cookie=0x0/0x6a85e2ff action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9615] fid=[0x200000403:0xdd:0x0] dfid=[0x200000403:0xdd:0x0] compound/cookie=0x0/0x6a85e300 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9616] fid=[0x200000403:0xde:0x0] dfid=[0x200000403:0xde:0x0] compound/cookie=0x0/0x6a85e301 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9617] fid=[0x200000403:0xdf:0x0] dfid=[0x200000403:0xdf:0x0] compound/cookie=0x0/0x6a85e302 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9618] fid=[0x200000403:0xe0:0x0] dfid=[0x200000403:0xe0:0x0] compound/cookie=0x0/0x6a85e303 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9619] fid=[0x200000403:0xe1:0x0] dfid=[0x200000403:0xe1:0x0] compound/cookie=0x0/0x6a85e304 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9620] fid=[0x200000403:0xe2:0x0] dfid=[0x200000403:0xe2:0x0] compound/cookie=0x0/0x6a85e305 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9621] fid=[0x200000403:0xe3:0x0] dfid=[0x200000403:0xe3:0x0] compound/cookie=0x0/0x6a85e306 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9622] fid=[0x200000403:0xe4:0x0] dfid=[0x200000403:0xe4:0x0] compound/cookie=0x0/0x6a85e307 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9623] fid=[0x200000403:0xe5:0x0] dfid=[0x200000403:0xe5:0x0] compound/cookie=0x0/0x6a85e308 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9624] fid=[0x200000403:0xe6:0x0] dfid=[0x200000403:0xe6:0x0] compound/cookie=0x0/0x6a85e309 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9625] fid=[0x200000403:0xe7:0x0] dfid=[0x200000403:0xe7:0x0] compound/cookie=0x0/0x6a85e30a action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9626] fid=[0x200000403:0xe8:0x0] dfid=[0x200000403:0xe8:0x0] compound/cookie=0x0/0x6a85e30b action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9627] fid=[0x200000403:0xe9:0x0] dfid=[0x200000403:0xe9:0x0] compound/cookie=0x0/0x6a85e30c action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9628] fid=[0x200000403:0xea:0x0] dfid=[0x200000403:0xea:0x0] compound/cookie=0x0/0x6a85e30d action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9629] fid=[0x200000403:0xeb:0x0] dfid=[0x200000403:0xeb:0x0] compound/cookie=0x0/0x6a85e30e action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9630] fid=[0x200000403:0xec:0x0] dfid=[0x200000403:0xec:0x0] compound/cookie=0x0/0x6a85e30f action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9631] fid=[0x200000403:0xed:0x0] dfid=[0x200000403:0xed:0x0] compound/cookie=0x0/0x6a85e310 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9632] fid=[0x200000403:0xee:0x0] dfid=[0x200000403:0xee:0x0] compound/cookie=0x0/0x6a85e311 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9633] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a85e312 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9634] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a85e313 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9635] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a85e314 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9636] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a85e315 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9637] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a85e316 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9639] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a85e317 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9640] fid=[0x200000403:0xf5:0x0] dfid=[0x200000403:0xf5:0x0] compound/cookie=0x0/0x6a85e318 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9641] fid=[0x200000403:0xf6:0x0] dfid=[0x200000403:0xf6:0x0] compound/cookie=0x0/0x6a85e319 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9642] fid=[0x200000403:0xf7:0x0] dfid=[0x200000403:0xf7:0x0] compound/cookie=0x0/0x6a85e31a action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9643] fid=[0x200000403:0xf8:0x0] dfid=[0x200000403:0xf8:0x0] compound/cookie=0x0/0x6a85e31b action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9644] fid=[0x200000403:0xf9:0x0] dfid=[0x200000403:0xf9:0x0] compound/cookie=0x0/0x6a85e31c action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9645] fid=[0x200000403:0xfa:0x0] dfid=[0x200000403:0xfa:0x0] compound/cookie=0x0/0x6a85e31d action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9646] fid=[0x200000403:0xfb:0x0] dfid=[0x200000403:0xfb:0x0] compound/cookie=0x0/0x6a85e31e action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9647] fid=[0x200000403:0xfc:0x0] dfid=[0x200000403:0xfc:0x0] compound/cookie=0x0/0x6a85e31f action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9648] fid=[0x200000403:0xfd:0x0] dfid=[0x200000403:0xfd:0x0] compound/cookie=0x0/0x6a85e320 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9649] fid=[0x200000403:0xfe:0x0] dfid=[0x200000403:0xfe:0x0] compound/cookie=0x0/0x6a85e321 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9650] fid=[0x200000403:0xff:0x0] dfid=[0x200000403:0xff:0x0] compound/cookie=0x0/0x6a85e322 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9651] fid=[0x200000403:0x100:0x0] dfid=[0x200000403:0x100:0x0] compound/cookie=0x0/0x6a85e323 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/9649] fid=[0x200000403:0xfe:0x0] dfid=[0x200000403:0xfe:0x0] compound/cookie=0x0/0x6a85e321 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9650] fid=[0x200000403:0xff:0x0] dfid=[0x200000403:0xff:0x0] compound/cookie=0x0/0x6a85e322 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9651] fid=[0x200000403:0x100:0x0] dfid=[0x200000403:0x100:0x0] compound/cookie=0x0/0x6a85e323 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]' pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 Waiting 200s for '' Changed after 2s: from 'lrh=[type=10680000 len=136 idx=4/9655] fid=[0x200000403:0xd1:0x0] dfid=[0x200000403:0xd1:0x0] compound/cookie=0x0/0x6a85e327 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9656] fid=[0x200000403:0xd2:0x0] dfid=[0x200000403:0xd2:0x0] compound/cookie=0x0/0x6a85e328 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9657] fid=[0x200000403:0xd3:0x0] dfid=[0x200000403:0xd3:0x0] compound/cookie=0x0/0x6a85e329 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9658] fid=[0x200000403:0xd4:0x0] dfid=[0x200000403:0xd4:0x0] compound/cookie=0x0/0x6a85e32a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9659] fid=[0x200000403:0xd5:0x0] dfid=[0x200000403:0xd5:0x0] compound/cookie=0x0/0x6a85e32b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9660] fid=[0x200000403:0xd6:0x0] dfid=[0x200000403:0xd6:0x0] compound/cookie=0x0/0x6a85e32c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9661] fid=[0x200000403:0xd7:0x0] dfid=[0x200000403:0xd7:0x0] compound/cookie=0x0/0x6a85e32d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9662] fid=[0x200000403:0xd8:0x0] dfid=[0x200000403:0xd8:0x0] compound/cookie=0x0/0x6a85e32e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9663] fid=[0x200000403:0xd9:0x0] dfid=[0x200000403:0xd9:0x0] compound/cookie=0x0/0x6a85e32f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9664] fid=[0x200000403:0xda:0x0] dfid=[0x200000403:0xda:0x0] compound/cookie=0x0/0x6a85e330 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9665] fid=[0x200000403:0xdb:0x0] dfid=[0x200000403:0xdb:0x0] compound/cookie=0x0/0x6a85e331 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9666] fid=[0x200000403:0xdc:0x0] dfid=[0x200000403:0xdc:0x0] compound/cookie=0x0/0x6a85e332 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9667] fid=[0x200000403:0xdd:0x0] dfid=[0x200000403:0xdd:0x0] compound/cookie=0x0/0x6a85e333 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9668] fid=[0x200000403:0xde:0x0] dfid=[0x200000403:0xde:0x0] compound/cookie=0x0/0x6a85e334 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9669] fid=[0x200000403:0xdf:0x0] dfid=[0x200000403:0xdf:0x0] compound/cookie=0x0/0x6a85e335 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9670] fid=[0x200000403:0xe0:0x0] dfid=[0x200000403:0xe0:0x0] compound/cookie=0x0/0x6a85e336 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9671] fid=[0x200000403:0xe1:0x0] dfid=[0x200000403:0xe1:0x0] compound/cookie=0x0/0x6a85e337 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9672] fid=[0x200000403:0xe2:0x0] dfid=[0x200000403:0xe2:0x0] compound/cookie=0x0/0x6a85e338 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9673] fid=[0x200000403:0xe3:0x0] dfid=[0x200000403:0xe3:0x0] compound/cookie=0x0/0x6a85e339 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9674] fid=[0x200000403:0xe4:0x0] dfid=[0x200000403:0xe4:0x0] compound/cookie=0x0/0x6a85e33a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9675] fid=[0x200000403:0xe5:0x0] dfid=[0x200000403:0xe5:0x0] compound/cookie=0x0/0x6a85e33b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9676] fid=[0x200000403:0xe6:0x0] dfid=[0x200000403:0xe6:0x0] compound/cookie=0x0/0x6a85e33c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9677] fid=[0x200000403:0xe7:0x0] dfid=[0x200000403:0xe7:0x0] compound/cookie=0x0/0x6a85e33d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9678] fid=[0x200000403:0xe8:0x0] dfid=[0x200000403:0xe8:0x0] compound/cookie=0x0/0x6a85e33e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9679] fid=[0x200000403:0xe9:0x0] dfid=[0x200000403:0xe9:0x0] compound/cookie=0x0/0x6a85e33f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9680] fid=[0x200000403:0xea:0x0] dfid=[0x200000403:0xea:0x0] compound/cookie=0x0/0x6a85e340 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9681] fid=[0x200000403:0xeb:0x0] dfid=[0x200000403:0xeb:0x0] compound/cookie=0x0/0x6a85e341 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9682] fid=[0x200000403:0xec:0x0] dfid=[0x200000403:0xec:0x0] compound/cookie=0x0/0x6a85e342 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9683] fid=[0x200000403:0xed:0x0] dfid=[0x200000403:0xed:0x0] compound/cookie=0x0/0x6a85e343 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9684] fid=[0x200000403:0xee:0x0] dfid=[0x200000403:0xee:0x0] compound/cookie=0x0/0x6a85e344 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9685] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a85e345 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9686] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a85e346 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9687] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a85e347 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9688] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a85e348 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9689] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a85e349 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9690] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a85e34a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9691] fid=[0x200000403:0xf5:0x0] dfid=[0x200000403:0xf5:0x0] compound/cookie=0x0/0x6a85e34b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9692] fid=[0x200000403:0xf6:0x0] dfid=[0x200000403:0xf6:0x0] compound/cookie=0x0/0x6a85e34c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9693] fid=[0x200000403:0xf7:0x0] dfid=[0x200000403:0xf7:0x0] compound/cookie=0x0/0x6a85e34d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9694] fid=[0x200000403:0xf8:0x0] dfid=[0x200000403:0xf8:0x0] compound/cookie=0x0/0x6a85e34e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9695] fid=[0x200000403:0xf9:0x0] dfid=[0x200000403:0xf9:0x0] compound/cookie=0x0/0x6a85e34f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9696] fid=[0x200000403:0xfa:0x0] dfid=[0x200000403:0xfa:0x0] compound/cookie=0x0/0x6a85e350 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9697] fid=[0x200000403:0xfb:0x0] dfid=[0x200000403:0xfb:0x0] compound/cookie=0x0/0x6a85e351 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9698] fid=[0x200000403:0xfc:0x0] dfid=[0x200000403:0xfc:0x0] compound/cookie=0x0/0x6a85e352 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9700] fid=[0x200000403:0xfd:0x0] dfid=[0x200000403:0xfd:0x0] compound/cookie=0x0/0x6a85e353 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9701] fid=[0x200000403:0xfe:0x0] dfid=[0x200000403:0xfe:0x0] compound/cookie=0x0/0x6a85e354 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9702] fid=[0x200000403:0xff:0x0] dfid=[0x200000403:0xff:0x0] compound/cookie=0x0/0x6a85e355 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9703] fid=[0x200000403:0x100:0x0] dfid=[0x200000403:0x100:0x0] compound/cookie=0x0/0x6a85e356 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/9667] fid=[0x200000403:0xdd:0x0] dfid=[0x200000403:0xdd:0x0] compound/cookie=0x0/0x6a85e333 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9668] fid=[0x200000403:0xde:0x0] dfid=[0x200000403:0xde:0x0] compound/cookie=0x0/0x6a85e334 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9669] fid=[0x200000403:0xdf:0x0] dfid=[0x200000403:0xdf:0x0] compound/cookie=0x0/0x6a85e335 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9670] fid=[0x200000403:0xe0:0x0] dfid=[0x200000403:0xe0:0x0] compound/cookie=0x0/0x6a85e336 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9671] fid=[0x200000403:0xe1:0x0] dfid=[0x200000403:0xe1:0x0] compound/cookie=0x0/0x6a85e337 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9672] fid=[0x200000403:0xe2:0x0] dfid=[0x200000403:0xe2:0x0] compound/cookie=0x0/0x6a85e338 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9673] fid=[0x200000403:0xe3:0x0] dfid=[0x200000403:0xe3:0x0] compound/cookie=0x0/0x6a85e339 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9674] fid=[0x200000403:0xe4:0x0] dfid=[0x200000403:0xe4:0x0] compound/cookie=0x0/0x6a85e33a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9675] fid=[0x200000403:0xe5:0x0] dfid=[0x200000403:0xe5:0x0] compound/cookie=0x0/0x6a85e33b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9676] fid=[0x200000403:0xe6:0x0] dfid=[0x200000403:0xe6:0x0] compound/cookie=0x0/0x6a85e33c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9677] fid=[0x200000403:0xe7:0x0] dfid=[0x200000403:0xe7:0x0] compound/cookie=0x0/0x6a85e33d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9678] fid=[0x200000403:0xe8:0x0] dfid=[0x200000403:0xe8:0x0] compound/cookie=0x0/0x6a85e33e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9679] fid=[0x200000403:0xe9:0x0] dfid=[0x200000403:0xe9:0x0] compound/cookie=0x0/0x6a85e33f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9680] fid=[0x200000403:0xea:0x0] dfid=[0x200000403:0xea:0x0] compound/cookie=0x0/0x6a85e340 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9681] fid=[0x200000403:0xeb:0x0] dfid=[0x200000403:0xeb:0x0] compound/cookie=0x0/0x6a85e341 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9682] fid=[0x200000403:0xec:0x0] dfid=[0x200000403:0xec:0x0] compound/cookie=0x0/0x6a85e342 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9683] fid=[0x200000403:0xed:0x0] dfid=[0x200000403:0xed:0x0] compound/cookie=0x0/0x6a85e343 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9684] fid=[0x200000403:0xee:0x0] dfid=[0x200000403:0xee:0x0] compound/cookie=0x0/0x6a85e344 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9685] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a85e345 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9686] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a85e346 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9687] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a85e347 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9688] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a85e348 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9689] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a85e349 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9690] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a85e34a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9691] fid=[0x200000403:0xf5:0x0] dfid=[0x200000403:0xf5:0x0] compound/cookie=0x0/0x6a85e34b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9692] fid=[0x200000403:0xf6:0x0] dfid=[0x200000403:0xf6:0x0] compound/cookie=0x0/0x6a85e34c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9693] fid=[0x200000403:0xf7:0x0] dfid=[0x200000403:0xf7:0x0] compound/cookie=0x0/0x6a85e34d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9694] fid=[0x200000403:0xf8:0x0] dfid=[0x200000403:0xf8:0x0] compound/cookie=0x0/0x6a85e34e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9695] fid=[0x200000403:0xf9:0x0] dfid=[0x200000403:0xf9:0x0] compound/cookie=0x0/0x6a85e34f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9696] fid=[0x200000403:0xfa:0x0] dfid=[0x200000403:0xfa:0x0] compound/cookie=0x0/0x6a85e350 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9697] fid=[0x200000403:0xfb:0x0] dfid=[0x200000403:0xfb:0x0] compound/cookie=0x0/0x6a85e351 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9698] fid=[0x200000403:0xfc:0x0] dfid=[0x200000403:0xfc:0x0] compound/cookie=0x0/0x6a85e352 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9700] fid=[0x200000403:0xfd:0x0] dfid=[0x200000403:0xfd:0x0] compound/cookie=0x0/0x6a85e353 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9701] fid=[0x200000403:0xfe:0x0] dfid=[0x200000403:0xfe:0x0] compound/cookie=0x0/0x6a85e354 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9702] fid=[0x200000403:0xff:0x0] dfid=[0x200000403:0xff:0x0] compound/cookie=0x0/0x6a85e355 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9703] fid=[0x200000403:0x100:0x0] dfid=[0x200000403:0x100:0x0] compound/cookie=0x0/0x6a85e356 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' Changed after 4s: from 'lrh=[type=10680000 len=136 idx=4/9667] fid=[0x200000403:0xdd:0x0] dfid=[0x200000403:0xdd:0x0] compound/cookie=0x0/0x6a85e333 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9668] fid=[0x200000403:0xde:0x0] dfid=[0x200000403:0xde:0x0] compound/cookie=0x0/0x6a85e334 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9669] fid=[0x200000403:0xdf:0x0] dfid=[0x200000403:0xdf:0x0] compound/cookie=0x0/0x6a85e335 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9670] fid=[0x200000403:0xe0:0x0] dfid=[0x200000403:0xe0:0x0] compound/cookie=0x0/0x6a85e336 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9671] fid=[0x200000403:0xe1:0x0] dfid=[0x200000403:0xe1:0x0] compound/cookie=0x0/0x6a85e337 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9672] fid=[0x200000403:0xe2:0x0] dfid=[0x200000403:0xe2:0x0] compound/cookie=0x0/0x6a85e338 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9673] fid=[0x200000403:0xe3:0x0] dfid=[0x200000403:0xe3:0x0] compound/cookie=0x0/0x6a85e339 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9674] fid=[0x200000403:0xe4:0x0] dfid=[0x200000403:0xe4:0x0] compound/cookie=0x0/0x6a85e33a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9675] fid=[0x200000403:0xe5:0x0] dfid=[0x200000403:0xe5:0x0] compound/cookie=0x0/0x6a85e33b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9676] fid=[0x200000403:0xe6:0x0] dfid=[0x200000403:0xe6:0x0] compound/cookie=0x0/0x6a85e33c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9677] fid=[0x200000403:0xe7:0x0] dfid=[0x200000403:0xe7:0x0] compound/cookie=0x0/0x6a85e33d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9678] fid=[0x200000403:0xe8:0x0] dfid=[0x200000403:0xe8:0x0] compound/cookie=0x0/0x6a85e33e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9679] fid=[0x200000403:0xe9:0x0] dfid=[0x200000403:0xe9:0x0] compound/cookie=0x0/0x6a85e33f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9680] fid=[0x200000403:0xea:0x0] dfid=[0x200000403:0xea:0x0] compound/cookie=0x0/0x6a85e340 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9681] fid=[0x200000403:0xeb:0x0] dfid=[0x200000403:0xeb:0x0] compound/cookie=0x0/0x6a85e341 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9682] fid=[0x200000403:0xec:0x0] dfid=[0x200000403:0xec:0x0] compound/cookie=0x0/0x6a85e342 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9683] fid=[0x200000403:0xed:0x0] dfid=[0x200000403:0xed:0x0] compound/cookie=0x0/0x6a85e343 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9684] fid=[0x200000403:0xee:0x0] dfid=[0x200000403:0xee:0x0] compound/cookie=0x0/0x6a85e344 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9685] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a85e345 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9686] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a85e346 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9687] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a85e347 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9688] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a85e348 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9689] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a85e349 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9690] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a85e34a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9691] fid=[0x200000403:0xf5:0x0] dfid=[0x200000403:0xf5:0x0] compound/cookie=0x0/0x6a85e34b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9692] fid=[0x200000403:0xf6:0x0] dfid=[0x200000403:0xf6:0x0] compound/cookie=0x0/0x6a85e34c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9693] fid=[0x200000403:0xf7:0x0] dfid=[0x200000403:0xf7:0x0] compound/cookie=0x0/0x6a85e34d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9694] fid=[0x200000403:0xf8:0x0] dfid=[0x200000403:0xf8:0x0] compound/cookie=0x0/0x6a85e34e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9695] fid=[0x200000403:0xf9:0x0] dfid=[0x200000403:0xf9:0x0] compound/cookie=0x0/0x6a85e34f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9696] fid=[0x200000403:0xfa:0x0] dfid=[0x200000403:0xfa:0x0] compound/cookie=0x0/0x6a85e350 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9697] fid=[0x200000403:0xfb:0x0] dfid=[0x200000403:0xfb:0x0] compound/cookie=0x0/0x6a85e351 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9698] fid=[0x200000403:0xfc:0x0] dfid=[0x200000403:0xfc:0x0] compound/cookie=0x0/0x6a85e352 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9700] fid=[0x200000403:0xfd:0x0] dfid=[0x200000403:0xfd:0x0] compound/cookie=0x0/0x6a85e353 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9701] fid=[0x200000403:0xfe:0x0] dfid=[0x200000403:0xfe:0x0] compound/cookie=0x0/0x6a85e354 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9702] fid=[0x200000403:0xff:0x0] dfid=[0x200000403:0xff:0x0] compound/cookie=0x0/0x6a85e355 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9703] fid=[0x200000403:0x100:0x0] dfid=[0x200000403:0x100:0x0] compound/cookie=0x0/0x6a85e356 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/9682] fid=[0x200000403:0xec:0x0] dfid=[0x200000403:0xec:0x0] compound/cookie=0x0/0x6a85e342 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9683] fid=[0x200000403:0xed:0x0] dfid=[0x200000403:0xed:0x0] compound/cookie=0x0/0x6a85e343 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9684] fid=[0x200000403:0xee:0x0] dfid=[0x200000403:0xee:0x0] compound/cookie=0x0/0x6a85e344 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9685] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a85e345 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9686] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a85e346 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9687] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a85e347 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9688] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a85e348 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9689] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a85e349 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9690] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a85e34a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9691] fid=[0x200000403:0xf5:0x0] dfid=[0x200000403:0xf5:0x0] compound/cookie=0x0/0x6a85e34b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9692] fid=[0x200000403:0xf6:0x0] dfid=[0x200000403:0xf6:0x0] compound/cookie=0x0/0x6a85e34c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9693] fid=[0x200000403:0xf7:0x0] dfid=[0x200000403:0xf7:0x0] compound/cookie=0x0/0x6a85e34d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9694] fid=[0x200000403:0xf8:0x0] dfid=[0x200000403:0xf8:0x0] compound/cookie=0x0/0x6a85e34e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9695] fid=[0x200000403:0xf9:0x0] dfid=[0x200000403:0xf9:0x0] compound/cookie=0x0/0x6a85e34f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9696] fid=[0x200000403:0xfa:0x0] dfid=[0x200000403:0xfa:0x0] compound/cookie=0x0/0x6a85e350 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9697] fid=[0x200000403:0xfb:0x0] dfid=[0x200000403:0xfb:0x0] compound/cookie=0x0/0x6a85e351 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9698] fid=[0x200000403:0xfc:0x0] dfid=[0x200000403:0xfc:0x0] compound/cookie=0x0/0x6a85e352 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9700] fid=[0x200000403:0xfd:0x0] dfid=[0x200000403:0xfd:0x0] compound/cookie=0x0/0x6a85e353 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9701] fid=[0x200000403:0xfe:0x0] dfid=[0x200000403:0xfe:0x0] compound/cookie=0x0/0x6a85e354 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9702] fid=[0x200000403:0xff:0x0] dfid=[0x200000403:0xff:0x0] compound/cookie=0x0/0x6a85e355 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9703] fid=[0x200000403:0x100:0x0] dfid=[0x200000403:0x100:0x0] compound/cookie=0x0/0x6a85e356 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' Changed after 6s: from 'lrh=[type=10680000 len=136 idx=4/9682] fid=[0x200000403:0xec:0x0] dfid=[0x200000403:0xec:0x0] compound/cookie=0x0/0x6a85e342 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9683] fid=[0x200000403:0xed:0x0] dfid=[0x200000403:0xed:0x0] compound/cookie=0x0/0x6a85e343 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9684] fid=[0x200000403:0xee:0x0] dfid=[0x200000403:0xee:0x0] compound/cookie=0x0/0x6a85e344 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9685] fid=[0x200000403:0xef:0x0] dfid=[0x200000403:0xef:0x0] compound/cookie=0x0/0x6a85e345 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9686] fid=[0x200000403:0xf0:0x0] dfid=[0x200000403:0xf0:0x0] compound/cookie=0x0/0x6a85e346 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9687] fid=[0x200000403:0xf1:0x0] dfid=[0x200000403:0xf1:0x0] compound/cookie=0x0/0x6a85e347 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9688] fid=[0x200000403:0xf2:0x0] dfid=[0x200000403:0xf2:0x0] compound/cookie=0x0/0x6a85e348 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9689] fid=[0x200000403:0xf3:0x0] dfid=[0x200000403:0xf3:0x0] compound/cookie=0x0/0x6a85e349 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9690] fid=[0x200000403:0xf4:0x0] dfid=[0x200000403:0xf4:0x0] compound/cookie=0x0/0x6a85e34a action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9691] fid=[0x200000403:0xf5:0x0] dfid=[0x200000403:0xf5:0x0] compound/cookie=0x0/0x6a85e34b action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9692] fid=[0x200000403:0xf6:0x0] dfid=[0x200000403:0xf6:0x0] compound/cookie=0x0/0x6a85e34c action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9693] fid=[0x200000403:0xf7:0x0] dfid=[0x200000403:0xf7:0x0] compound/cookie=0x0/0x6a85e34d action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9694] fid=[0x200000403:0xf8:0x0] dfid=[0x200000403:0xf8:0x0] compound/cookie=0x0/0x6a85e34e action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9695] fid=[0x200000403:0xf9:0x0] dfid=[0x200000403:0xf9:0x0] compound/cookie=0x0/0x6a85e34f action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9696] fid=[0x200000403:0xfa:0x0] dfid=[0x200000403:0xfa:0x0] compound/cookie=0x0/0x6a85e350 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9697] fid=[0x200000403:0xfb:0x0] dfid=[0x200000403:0xfb:0x0] compound/cookie=0x0/0x6a85e351 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9698] fid=[0x200000403:0xfc:0x0] dfid=[0x200000403:0xfc:0x0] compound/cookie=0x0/0x6a85e352 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9700] fid=[0x200000403:0xfd:0x0] dfid=[0x200000403:0xfd:0x0] compound/cookie=0x0/0x6a85e353 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9701] fid=[0x200000403:0xfe:0x0] dfid=[0x200000403:0xfe:0x0] compound/cookie=0x0/0x6a85e354 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9702] fid=[0x200000403:0xff:0x0] dfid=[0x200000403:0xff:0x0] compound/cookie=0x0/0x6a85e355 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=4/9703] fid=[0x200000403:0x100:0x0] dfid=[0x200000403:0x100:0x0] compound/cookie=0x0/0x6a85e356 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[]' to 'lrh=[type=10680000 len=136 idx=4/9701] fid=[0x200000403:0xfe:0x0] dfid=[0x200000403:0xfe:0x0] compound/cookie=0x0/0x6a85e354 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9702] fid=[0x200000403:0xff:0x0] dfid=[0x200000403:0xff:0x0] compound/cookie=0x0/0x6a85e355 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] lrh=[type=10680000 len=136 idx=4/9703] fid=[0x200000403:0x100:0x0] dfid=[0x200000403:0x100:0x0] compound/cookie=0x0/0x6a85e356 action=RESTORE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[]' pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 PASS 90 (101s) == sanity-hsm test 100: Set coordinator /proc tunables === 02:41:25 (1787121685) Testing mdt.lustre-MDT0000.hsm.loop_period Set loop_period to 0 must failed oleg248-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/loop_period=0: Invalid argument oleg248-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/loop_period'='0': Invalid argument pdsh@oleg248-client: oleg248-server: ssh exited with exit code 22 oleg248-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/loop_period=0: Invalid argument oleg248-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/loop_period'='0': Invalid argument pdsh@oleg248-client: oleg248-server: ssh exited with exit code 22 Testing mdt.lustre-MDT0000.hsm.grace_delay Set grace_delay to 0 must failed oleg248-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/grace_delay=0: Invalid argument oleg248-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/grace_delay'='0': Invalid argument pdsh@oleg248-client: oleg248-server: ssh exited with exit code 22 oleg248-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/grace_delay=0: Invalid argument oleg248-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/grace_delay'='0': Invalid argument pdsh@oleg248-client: oleg248-server: ssh exited with exit code 22 Testing mdt.lustre-MDT0000.hsm.active_request_timeout Set active_request_timeout to 0 must failed oleg248-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/active_request_timeout=0: Invalid argument oleg248-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/active_request_timeout'='0': Invalid argument pdsh@oleg248-client: oleg248-server: ssh exited with exit code 22 oleg248-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/active_request_timeout=0: Invalid argument oleg248-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/active_request_timeout'='0': Invalid argument pdsh@oleg248-client: oleg248-server: ssh exited with exit code 22 Testing mdt.lustre-MDT0000.hsm.max_requests Set max_requests to 0 must failed oleg248-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/max_requests=0: Invalid argument oleg248-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/max_requests'='0': Invalid argument pdsh@oleg248-client: oleg248-server: ssh exited with exit code 22 oleg248-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/max_requests=0: Invalid argument oleg248-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/max_requests'='0': Invalid argument pdsh@oleg248-client: oleg248-server: ssh exited with exit code 22 Testing mdt.lustre-MDT0000.hsm.default_archive_id Set default_archive_id to 0 must failed oleg248-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0000/hsm/default_archive_id=0: Invalid argument oleg248-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/default_archive_id'='0': Invalid argument pdsh@oleg248-client: oleg248-server: ssh exited with exit code 22 oleg248-server: error: set_param: setting /sys/fs/lustre/mdt/lustre-MDT0001/hsm/default_archive_id=0: Invalid argument oleg248-server: error: set_param: setting 'mdt/lustre-MDT0001/hsm/default_archive_id'='0': Invalid argument pdsh@oleg248-client: oleg248-server: ssh exited with exit code 22 PASS 100 (59s) == sanity-hsm test 102: Verify coordinator control ======= 02:42:24 (1787121744) mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled PASS 102 (23s) == sanity-hsm test 103: Purge all requests =============== 02:42:47 (1787121767) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_103/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=purge mdt.lustre-MDT0001.hsm_control=purge Current requests pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 PASS 103 (20s) == sanity-hsm test 103a: Purge pending restore requests == 02:43:07 (1787121787) mdt.lustre-MDT0000.hsm.policy=-NBR mdt.lustre-MDT0001.hsm.policy=-NBR Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_103a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' (0x200000403:0x148:0x0|0x200000403:0x149:0x0|0x200000403:0x14a:0x0|0x200000403:0x14b:0x0|0x200000403:0x14c:0x0|0x200000403:0x14d:0x0|0x200000403:0x14e:0x0|0x200000403:0x14f:0x0).*action=ARCHIVE.*status=SUCCEED Killing existing copytools on oleg248-client.virtnet with signal TERM copytools stopped in 0s cat: '/mnt/lustre/.lustre/fid/0x200000403:0x149:0x0': No data available cat: '/mnt/lustre/.lustre/fid/0x200000403:0x14b:0x0': No data available cat: '/mnt/lustre/.lustre/fid/0x200000403:0x14a:0x0': No data available cat: '/mnt/lustre/.lustre/fid/0x200000403:0x14c:0x0': No data available cat: '/mnt/lustre/.lustre/fid/0x200000403:0x14e:0x0': No data available cat: '/mnt/lustre/.lustre/fid/0x200000403:0x14f:0x0'cat: '/mnt/lustre/.lustre/fid/0x200000403:0x148:0x0': No data available : No data available cat: '/mnt/lustre/.lustre/fid/0x200000403:0x14d:0x0': No data available mdt.lustre-MDT0000.hsm_control=purge mdt.lustre-MDT0001.hsm_control=purge PASS 103a (22s) == sanity-hsm test 104: Copy tool data field ============= 02:43:29 (1787121809) 0+0 records in 0+0 records out 0 bytes copied, 0.00423769 s, 0.0 kB/s mdt.lustre-MDT0000.hsm_control=purge mdt.lustre-MDT0001.hsm_control=purge PASS 104 (14s) == sanity-hsm test 105: Restart of coordinator =========== 02:43:43 (1787121823) mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled mdt.lustre-MDT0000.hsm_control=purge mdt.lustre-MDT0001.hsm_control=purge PASS 105 (40s) == sanity-hsm test 106a: Copytool register/unregister ==== 02:44:23 (1787121863) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' oleg248-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg248-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2 oleg248-client.virtnet: 89610 Killing existing copytools on oleg248-client.virtnet with signal TERM copytools stopped in 1s pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 uuid not found in agent list on mds1 pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 uuid not found in agent list on mds2 Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' oleg248-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg248-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2 PASS 106a (39s) == sanity-hsm test 106b: Unregister agent after a copytool crash ========================================================== 02:45:02 (1787121902) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' oleg248-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg248-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2 oleg248-client.virtnet: 91349 Killing existing copytools on oleg248-client.virtnet with signal KILL copytools stopped in 0s pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 uuid not found in agent list on mds1 pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 uuid not found in agent list on mds2 Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2 PASS 106b (30s) == sanity-hsm test 106c: Unregister copytool on client eviction ========================================================== 02:45:32 (1787121932) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_106c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' oleg248-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg248-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2 oleg248-client.virtnet: 92583 oleg248-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg248-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg248-client.virtnet: executing get_client_uuid /mnt/lustre2 mdc.lustre-MDT0000-mdc-ffff8da01854b800.active=0 mdc.lustre-MDT0001-mdc-ffff8da01854b800.active=0 mdt.lustre-MDT0000.evict_client=036a1a8d-2bd8-4874-b438-26a444fc1a18 mdt.lustre-MDT0001.evict_client=036a1a8d-2bd8-4874-b438-26a444fc1a18 pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 uuid not found in agent list on mds1 pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 uuid not found in agent list on mds2 mdc.lustre-MDT0000-mdc-ffff8da01854b800.active=1 mdc.lustre-MDT0001-mdc-ffff8da01854b800.active=1 oleg248-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2 mdc.lustre-MDT0000-mdc-ffff8da01854b800.active=1 mdc.lustre-MDT0001-mdc-ffff8da01854b800.active=1 PASS 106c (60s) == sanity-hsm test 107: Copytool re-register after MDS restart ========================================================== 02:46:33 (1787121993) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_107/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Failing mds1 on oleg248-server Stopping /mnt/lustre-mds1 (opts:) on oleg248-server 02:46:41 (1787122001) shut down facet: mds1 facet_host: oleg248-server facet_failover_host: oleg248-server Failover mds1 to oleg248-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg248-server: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 Started lustre-MDT0000 02:47:06 (1787122026) targets are mounted 02:47:06 (1787122026) facet_failover done oleg248-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 107 (54s) == sanity-hsm test 109: Policy display/change ============ 02:47:26 (1787122046) mdt.lustre-MDT0000.hsm.policy=+NBR mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0000.hsm.policy=-NBR mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0000.hsm.policy=NRA NBR Next set_param must failed oleg248-server: error: set_param: setting /sys/kernel/debug/lustre/mdt/lustre-MDT0000/hsm/policy=wrong: Invalid argument oleg248-server: error: set_param: setting 'mdt/lustre-MDT0000/hsm/policy'='wrong': Invalid argument pdsh@oleg248-client: oleg248-server: ssh exited with exit code 22 Back to default policy mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0001.hsm.policy=+NRA mdt.lustre-MDT0000.hsm.policy=-NBR mdt.lustre-MDT0001.hsm.policy=-NBR PASS 109 (26s) == sanity-hsm test 110a: Non blocking restore policy (import case) ========================================================== 02:47:52 (1787122072) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_110a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1787122075.046199 [97194]: action=1 src=d110a.sanity-hsm/f110a.sanity-hsm dst=/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787122075.071011 [97194]: importing '/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_110a//d110a.sanity-hsm/f110a.sanity-hsm' lhsmtool_posix: 1787122075.146241 [97194]: imported '/mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_110a//0bb6/0x200000bd2:0x64:0x0'=='/tmp/arc1/sanity-hsm.test_110a//d110a.sanity-hsm/f110a.sanity-hsm' lhsmtool_posix: 1787122075.146365 [97194]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdt.lustre-MDT0000.hsm.policy=+NBR mdt.lustre-MDT0001.hsm.policy=+NBR md5sum: /mnt/lustre/d110a.sanity-hsm/f110a.sanity-hsm: No data available Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' mdt.lustre-MDT0000.hsm.policy=-NBR mdt.lustre-MDT0001.hsm.policy=-NBR PASS 110a (15s) == sanity-hsm test 110b: Non blocking restore policy (release case) ========================================================== 02:48:08 (1787122088) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_110b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=+NBR mdt.lustre-MDT0001.hsm.policy=+NBR md5sum: /mnt/lustre/d110b.sanity-hsm/f110b.sanity-hsm: No data available Waiting 200s for 'SUCCEED' Updated after 3s: want 'SUCCEED' got 'SUCCEED' mdt.lustre-MDT0000.hsm.policy=-NBR mdt.lustre-MDT0001.hsm.policy=-NBR PASS 110b (16s) == sanity-hsm test 111a: No retry policy (import case), restore will error ========================================================== 02:48:24 (1787122104) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_111a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1787122106.808767 [98601]: action=1 src=d111a.sanity-hsm/f111a.sanity-hsm dst=/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787122106.815049 [98601]: importing '/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_111a//d111a.sanity-hsm/f111a.sanity-hsm' lhsmtool_posix: 1787122106.848206 [98601]: imported '/mnt/lustre/d111a.sanity-hsm/f111a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_111a//0bbb/0x200000bd2:0x69:0x0'=='/tmp/arc1/sanity-hsm.test_111a//d111a.sanity-hsm/f111a.sanity-hsm' lhsmtool_posix: 1787122106.848598 [98601]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0001.hsm.policy=+NRA Remove from backend: 0x200000bd2:0x69:0x0 = /tmp/arc1/sanity-hsm.test_111a/0bbb/0x200000bd2:0x69:0x0 Waiting 200s for 'FAILED' Updated after 2s: want 'FAILED' got 'FAILED' mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0001.hsm.policy=-NRA PASS 111a (15s) == sanity-hsm test 111b: No retry policy (release case), restore will error ========================================================== 02:48:39 (1787122119) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_111b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm.policy=+NRA mdt.lustre-MDT0001.hsm.policy=+NRA Remove from backend: 0x200000bd3:0x7:0x0 = /tmp/arc1/sanity-hsm.test_111b/0bd4/0x200000bd3:0x7:0x0 mdt.lustre-MDT0000.hsm.policy=-NRA mdt.lustre-MDT0001.hsm.policy=-NRA PASS 111b (16s) == sanity-hsm test 112: State of recorded request ======== 02:48:55 (1787122135) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_112/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled /mnt/lustre/d112.sanity-hsm/f112.sanity-hsm: ARCHIVE waiting (from 0 to EOF) mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled PASS 112 (19s) == sanity-hsm test 113: wrong stat after restore ========= 02:49:14 (1787122154) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0410583 s, 25.5 MB/s Starting client: oleg248-client.virtnet: -o user_xattr,flock 192.168.202.148@tcp:/lustre /mnt/lustre3 Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_113/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre3"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Verifying released state: multiop /mnt/lustre/d113.sanity-hsm/f113.sanity-hsm voO_WRONLY:O_APPEND:_w4c TMPPIPE=/tmp/multiop_open_wait_pipe.8221 File: /mnt/lustre2/d113.sanity-hsm/f113.sanity-hsm Size: 1048576 Blocks: 1 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115238860488714 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-08-19 02:49:16.000000000 -0400 Modify: 2026-08-19 02:49:16.000000000 -0400 Change: 2026-08-19 02:49:16.000000000 -0400 Birth: 2026-08-19 02:49:15.000000000 -0400 Stopping client oleg248-client.virtnet /mnt/lustre3 (opts:) PASS 113 (18s) == sanity-hsm test 114: Incompatible request does not set other requests as STARTED ========================================================== 02:49:32 (1787122172) 0+0 records in 0+0 records out 0 bytes copied, 0.0108461 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00869309 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_114/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled PASS 114 (19s) == sanity-hsm test 200: Register/Cancel archive ========== 02:49:52 (1787122192) 0+0 records in 0+0 records out 0 bytes copied, 0.015834 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_200/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Copytool is suspended on oleg248-client.virtnet Waiting 200s for 'STARTED' Updated after 2s: want 'STARTED' got 'STARTED' Waiting 200s for 'CANCELED' Updated after 2s: want 'CANCELED' got 'CANCELED' Copytool is continued on oleg248-client.virtnet PASS 200 (14s) == sanity-hsm test 201: Register/Cancel restore ========== 02:50:05 (1787122205) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_201/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB, 39 MiB) copied, 1.30249 s, 31.4 MB/s lhsmtool_posix: 1787122209.003608 [103016]: action=1 src=d201.sanity-hsm/f201.sanity-hsm dst=/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787122209.019051 [103016]: importing '/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_201//d201.sanity-hsm/f201.sanity-hsm' lhsmtool_posix: 1787122209.118662 [103016]: imported '/mnt/lustre/d201.sanity-hsm/f201.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_201//0ba0/0x200000bd2:0x72:0x0'=='/tmp/arc1/sanity-hsm.test_201//d201.sanity-hsm/f201.sanity-hsm' lhsmtool_posix: 1787122209.118713 [103016]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled PASS 201 (20s) == sanity-hsm test 202: Register/Cancel remove =========== 02:50:25 (1787122225) 0+0 records in 0+0 records out 0 bytes copied, 0.00811035 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_202/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Copytool is suspended on oleg248-client.virtnet PASS 202 (13s) == sanity-hsm test 220A: Changelog for archive =========== 02:50:38 (1787122238) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_220A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' lustre-MDT0000.3 16HSM 06:50:46.585173306 2026.08.19 0x0 t=[0x200000bd3:0x12:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 PASS 220A (23s) == sanity-hsm test 220a: Changelog for failed archive ==== 02:51:01 (1787122261) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_220a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl2 cl2' Copytool is suspended on oleg248-client.virtnet Copytool is continued on oleg248-client.virtnet lustre-MDT0000.6 16HSM 06:51:08.927579513 2026.08.19 0x2 t=[0x200000bd3:0x13:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0001: clear the changelog for cl2 of all records lustre-MDT0001: Deregistered changelog user #2 lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0000: Deregistered changelog user #2 PASS 220a (20s) == sanity-hsm test 221: Changelog for archive canceled === 02:51:22 (1787122282) 0+0 records in 0+0 records out 0 bytes copied, 0.0161167 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_221/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl3 cl3' Copytool is suspended on oleg248-client.virtnet Waiting 200s for 'CANCELED' Updated after 2s: want 'CANCELED' got 'CANCELED' Copytool is continued on oleg248-client.virtnet lustre-MDT0000.8 16HSM 06:51:32.812320977 2026.08.19 0x7d t=[0x200000bd3:0x14:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0001: clear the changelog for cl3 of all records lustre-MDT0001: Deregistered changelog user #3 lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000: Deregistered changelog user #3 PASS 221 (24s) == sanity-hsm test 222a: Changelog for explicit restore == 02:51:45 (1787122305) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1787122308.435110 [106863]: action=1 src=d222a.sanity-hsm/f222a.sanity-hsm dst=/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787122308.444865 [106863]: importing '/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222a//d222a.sanity-hsm/f222a.sanity-hsm' lhsmtool_posix: 1787122308.488762 [106863]: imported '/mnt/lustre/d222a.sanity-hsm/f222a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222a//0bab/0x200000bd2:0x79:0x0'=='/tmp/arc1/sanity-hsm.test_222a//d222a.sanity-hsm/f222a.sanity-hsm' lhsmtool_posix: 1787122308.488823 [106863]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl4 cl4' lustre-MDT0000.11 16HSM 06:51:53.618149019 2026.08.19 0x80 t=[0x200000bd2:0x79:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0001: clear the changelog for cl4 of all records lustre-MDT0001: Deregistered changelog user #4 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 PASS 222a (20s) == sanity-hsm test 222b: Changelog for implicit restore == 02:52:05 (1787122325) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl5 cl5' 4ef076ad20e5d4a2f4729d6ed41a3bf9 /mnt/lustre/d222b.sanity-hsm/f222b.sanity-hsm lustre-MDT0000.20 16HSM 06:52:12.437253705 2026.08.19 0x80 t=[0x200000bd3:0x16:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp p=[0x200000bd2:0x75:0x0] lustre-MDT0001: clear the changelog for cl5 of all records lustre-MDT0001: Deregistered changelog user #5 lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0000: Deregistered changelog user #5 PASS 222b (19s) == sanity-hsm test 222c: Changelog for failed explicit restore ========================================================== 02:52:24 (1787122344) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lhsmtool_posix: 1787122347.894716 [108492]: action=1 src=d222c.sanity-hsm/f222c.sanity-hsm dst=/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787122347.914820 [108492]: importing '/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222c//d222c.sanity-hsm/f222c.sanity-hsm' lhsmtool_posix: 1787122347.952840 [108492]: imported '/mnt/lustre/d222c.sanity-hsm/f222c.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_222c//0baf/0x200000bd2:0x7d:0x0'=='/tmp/arc1/sanity-hsm.test_222c//d222c.sanity-hsm/f222c.sanity-hsm' lhsmtool_posix: 1787122347.952898 [108492]: process finished, errs: 0 major, 0 minor, rc=0 (Success) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl6 cl6' Copytool is suspended on oleg248-client.virtnet Copytool is continued on oleg248-client.virtnet lustre-MDT0000.22 16HSM 06:52:35.966720205 2026.08.19 0x82 t=[0x200000bd2:0x7d:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0001: clear the changelog for cl6 of all records lustre-MDT0001: Deregistered changelog user #6 lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000: Deregistered changelog user #6 PASS 222c (23s) == sanity-hsm test 222d: Changelog for failed implicit restore ========================================================== 02:52:47 (1787122367) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_222d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl7 cl7' Remove from backend: 0x200000bd3:0x18:0x0 = /tmp/arc1/sanity-hsm.test_222d/0bcb/0x200000bd3:0x18:0x0 md5sum: /mnt/lustre/d222d.sanity-hsm/f222d.sanity-hsm: No data available lustre-MDT0000.29 16HSM 06:52:56.718005274 2026.08.19 0x82 t=[0x200000bd3:0x18:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp p=[0x200000bd2:0x7c:0x0] lustre-MDT0001: clear the changelog for cl7 of all records lustre-MDT0001: Deregistered changelog user #7 lustre-MDT0000: clear the changelog for cl7 of all records lustre-MDT0000: Deregistered changelog user #7 PASS 222d (24s) == sanity-hsm test 223a: Changelog for restore canceled (import case) ========================================================== 02:53:11 (1787122391) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_223a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' 39+0 records in 39+0 records out 40894464 bytes (41 MB, 39 MiB) copied, 1.24968 s, 32.7 MB/s mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl8 cl8' lhsmtool_posix: 1787122401.091883 [110236]: action=1 src=d223a.sanity-hsm/f223a.sanity-hsm dst=/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm mount_point=/mnt/lustre2 lhsmtool_posix: 1787122401.098061 [110236]: importing '/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_223a//d223a.sanity-hsm/f223a.sanity-hsm' lhsmtool_posix: 1787122401.134815 [110236]: imported '/mnt/lustre/d223a.sanity-hsm/f223a.sanity-hsm' from '/tmp/arc1/sanity-hsm.test_223a//0b50/0x200000bd2:0x82:0x0'=='/tmp/arc1/sanity-hsm.test_223a//d223a.sanity-hsm/f223a.sanity-hsm' lhsmtool_posix: 1787122401.135902 [110236]: process finished, errs: 0 major, 0 minor, rc=0 (Success) Waiting 200s for 'STARTED' Waiting 200s for 'SUCCEED' Waiting 190s for 'SUCCEED' Updated after 29s: want 'SUCCEED' got 'SUCCEED' lustre-MDT0000.36 16HSM 06:53:51.799103157 2026.08.19 0xfd t=[0x200000bd2:0x82:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0001: clear the changelog for cl8 of all records lustre-MDT0001: Deregistered changelog user #8 lustre-MDT0000: clear the changelog for cl8 of all records lustre-MDT0000: Deregistered changelog user #8 PASS 223a (55s) == sanity-hsm test 223b: Changelog for restore canceled (release case) ========================================================== 02:54:06 (1787122446) 0+0 records in 0+0 records out 0 bytes copied, 0.0133447 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_223b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --bandwidth 1 "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl9 cl9' Copytool is suspended on oleg248-client.virtnet Copytool is continued on oleg248-client.virtnet lustre-MDT0000.43 16HSM 06:54:16.485325780 2026.08.19 0xfd t=[0x200000bd3:0x1c:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0001: clear the changelog for cl9 of all records lustre-MDT0001: Deregistered changelog user #9 lustre-MDT0000: clear the changelog for cl9 of all records lustre-MDT0000: Deregistered changelog user #9 PASS 223b (22s) == sanity-hsm test 224A: Changelog for remove ============ 02:54:28 (1787122468) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_224A/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl10 cl10' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' lustre-MDT0000.48 16HSM 06:54:37.178077127 2026.08.19 0x200 t=[0x200000bd3:0x1e:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0001: clear the changelog for cl10 of all records lustre-MDT0001: Deregistered changelog user #10 lustre-MDT0000: clear the changelog for cl10 of all records lustre-MDT0000: Deregistered changelog user #10 PASS 224A (22s) == sanity-hsm test 224a: Changelog for failed remove ===== 02:54:51 (1787122491) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_224a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl11 cl11' Remove from backend: 0x200000bd3:0x1f:0x0 = /tmp/arc1/sanity-hsm.test_224a/0bcc/0x200000bd3:0x1f:0x0 Copytool is suspended on oleg248-client.virtnet Copytool is continued on oleg248-client.virtnet lustre-MDT0000.53 16HSM 06:54:59.779333233 2026.08.19 0x202 t=[0x200000bd3:0x1f:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0001: clear the changelog for cl11 of all records lustre-MDT0001: Deregistered changelog user #11 lustre-MDT0000: clear the changelog for cl11 of all records lustre-MDT0000: Deregistered changelog user #11 PASS 224a (19s) == sanity-hsm test 225: Changelog for remove canceled ==== 02:55:11 (1787122511) Test disabled PASS 225 (6s) == sanity-hsm test 226: changelog for last rm/mv with exiting archive ========================================================== 02:55:16 (1787122516) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_226/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0x200000bd3:0x22:0x0 mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl12 cl12' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' lustre-MDT0000.54 16HSM 06:55:25.398558273 2026.08.19 0x280 t=[0x200000bd3:0x20:0x0] ef=0x13 u=0:0 nid=0@<0:0> lustre-MDT0000.55 16HSM 06:55:25.578459109 2026.08.19 0x280 t=[0x200000bd3:0x20:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0000.56 16HSM 06:55:25.578530051 2026.08.19 0x0 t=[0x200000bd3:0x20:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0000.57 16HSM 06:55:27.649928486 2026.08.19 0x280 t=[0x200000bd3:0x21:0x0] ef=0x13 u=0:0 nid=0@<0:0> lustre-MDT0000.58 16HSM 06:55:27.839674670 2026.08.19 0x280 t=[0x200000bd3:0x21:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0000.59 16HSM 06:55:27.839800090 2026.08.19 0x0 t=[0x200000bd3:0x21:0x0] j=lhsmtool_posix.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0000.60 06UNLNK 06:55:28.816261304 2026.08.19 0x3 t=[0x200000bd3:0x20:0x0] j=rm.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp p=[0x200000bd2:0x87:0x0] f226.sanity-hsm-1 lustre-MDT0000.60 06UNLNK 06:55:28.816261304 2026.08.19 0x3 t=[0x200000bd3:0x20:0x0] j=rm.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp p=[0x200000bd2:0x87:0x0] f226.sanity-hsm-1 lustre-MDT0000.61 08RENME 06:55:29.605213135 2026.08.19 0x3 t=[0x200000bd3:0x21:0x0] j=mv.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp p=[0x200000bd2:0x87:0x0] f226.sanity-hsm-2 s=[0x200000bd3:0x22:0x0] sp=[0x200000bd2:0x87:0x0] f226.sanity-hsm-3 lustre-MDT0001: clear the changelog for cl12 of all records lustre-MDT0001: Deregistered changelog user #12 lustre-MDT0000: clear the changelog for cl12 of all records lustre-MDT0000: Deregistered changelog user #12 PASS 226 (26s) == sanity-hsm test 227: changelog when explicit setting of HSM flags ========================================================== 02:55:43 (1787122543) 0+0 records in 0+0 records out 0 bytes copied, 0.0210699 s, 0.0 kB/s mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl13 cl13' lustre-MDT0001: clear the changelog for cl13 of all records lustre-MDT0001: Deregistered changelog user #13 lustre-MDT0000: clear the changelog for cl13 of all records lustre-MDT0000: Deregistered changelog user #13 PASS 227 (24s) == sanity-hsm test 228: On released file, return extend to FIEMAP. For [cp,tar] --sparse ========================================================== 02:56:06 (1787122566) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_228/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0451989 s, 23.2 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' /mnt/lustre/f228.sanity-hsm: 1 extent found tar: Removing leading `/' from member names mnt/lustre/f228.sanity-hsm PASS 228 (15s) == sanity-hsm test 250: Coordinator max request ========== 02:56:21 (1787122581) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_250/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 0+0 records in 0+0 records out 0 bytes copied, 0.00955465 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00357951 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.0055576 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00496759 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00873256 s, 0.0 kB/s 0+0 records in 0+0 records out 0 bytes copied, 0.00406666 s, 0.0 kB/s Waiting 200s for 'SUCCEED' Updated after 3s: want 'SUCCEED' got 'SUCCEED' Copytool is suspended on oleg248-client.virtnet Copytool is continued on oleg248-client.virtnet PASS 250 (34s) == sanity-hsm test 251: Coordinator request timeout ====== 02:56:56 (1787122616) 0+0 records in 0+0 records out 0 bytes copied, 0.00306214 s, 0.0 kB/s mdt.lustre-MDT0000.hsm_control=disabled mdt.lustre-MDT0001.hsm_control=disabled mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_251/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Copytool is suspended on oleg248-client.virtnet Waiting 200s for 'STARTED' Updated after 2s: want 'STARTED' got 'STARTED' Waiting 200s for 'CANCELED' Updated after 2s: want 'CANCELED' got 'CANCELED' PASS 251 (27s) == sanity-hsm test 252: Timeout'ed running archive of a removed file should be canceled ========================================================== 02:57:23 (1787122643) 0+0 records in 0+0 records out 0 bytes copied, 0.00591028 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_252/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Copytool is suspended on oleg248-client.virtnet Copytool is continued on oleg248-client.virtnet PASS 252 (17s) == sanity-hsm test 253: Check for wrong file size after release ========================================================== 02:57:40 (1787122660) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_253/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 10+0 records in 10+0 records out 10000000 bytes (10 MB, 9.5 MiB) copied, 0.593042 s, 16.9 MB/s fail_loc=0x807 Cannot send HSM request (use of /mnt/lustre/d253.sanity-hsm/f253.sanity-hsm): Invalid argument could not release file PASS 253 (10s) == sanity-hsm test 254a: Request counters are initialized to zero ========================================================== 02:57:51 (1787122671) PASS 254a (11s) == sanity-hsm test 254b: Request counters are correctly incremented and decremented ========================================================== 02:58:02 (1787122682) Will launch 59 requests of each type Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_254b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Checking archive requests Copytool is suspended on oleg248-client.virtnet Copytool is continued on oleg248-client.virtnet Checking restore requests Copytool is suspended on oleg248-client.virtnet Copytool is continued on oleg248-client.virtnet Waiting 90s for '0' Updated after 2s: want '0' got '0' Checking remove requests Copytool is suspended on oleg248-client.virtnet Copytool is continued on oleg248-client.virtnet PASS 254b (41s) == sanity-hsm test 255: Copytool registration wakes the coordinator up ========================================================== 02:58:43 (1787122723) 0+0 records in 0+0 records out 0 bytes copied, 0.00708498 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_255/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Killing existing copytools on oleg248-client.virtnet with signal TERM copytools stopped in 0s 0+0 records in 0+0 records out 0 bytes copied, 0.0076055 s, 0.0 kB/s 0x200000bd3:0xaa:0x0 mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_255/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 255 (31s) == sanity-hsm test 256: HSM copytool register on DNE with stopped MDT must not panic ========================================================== 02:59:14 (1787122754) mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=enabled PASS 256 (31s) == sanity-hsm test 260a: Restore request have priority over other requests ========================================================== 02:59:45 (1787122785) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152462 s, 6.9 MB/s 0x200000bd3:0xab:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.166042 s, 6.3 MB/s 0x200000bd3:0xac:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101257 s, 10.4 MB/s 0x200000bd3:0xad:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117135 s, 9.0 MB/s 0x200000bd3:0xae:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104609 s, 10.0 MB/s 0x200000bd3:0xaf:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0830116 s, 12.6 MB/s 0x200000bd3:0xb0:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100206 s, 10.5 MB/s 0x200000bd3:0xb1:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.159581 s, 6.6 MB/s 0x200000bd3:0xb2:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0661859 s, 15.8 MB/s 0x200000bd3:0xb3:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.136564 s, 7.7 MB/s 0x200000bd3:0xb4:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107327 s, 9.8 MB/s 0x200000bd3:0xb5:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111171 s, 9.4 MB/s 0x200000bd3:0xb6:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.168319 s, 6.2 MB/s 0x200000bd3:0xb7:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134879 s, 7.8 MB/s 0x200000bd3:0xb8:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.150923 s, 6.9 MB/s 0x200000bd3:0xb9:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129307 s, 8.1 MB/s 0x200000bd3:0xba:0x0 Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Killing existing copytools on oleg248-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' ARCHIVE ARCHIVE RESTORE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE PASS 260a (48s) == sanity-hsm test 260b: Restore request have priority over other requests ========================================================== 03:00:33 (1787122833) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.144792 s, 7.2 MB/s 0x200000bd3:0xbd:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.239805 s, 4.4 MB/s 0x200000bd3:0xbe:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.212149 s, 4.9 MB/s 0x200000bd3:0xbf:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157812 s, 6.6 MB/s 0x200000bd3:0xc0:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.231428 s, 4.5 MB/s 0x200000bd3:0xc1:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.169488 s, 6.2 MB/s 0x200000bd3:0xc2:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161381 s, 6.5 MB/s 0x200000bd3:0xc3:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.237948 s, 4.4 MB/s 0x200000bd3:0xc4:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.185928 s, 5.6 MB/s 0x200000bd3:0xc5:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124699 s, 8.4 MB/s 0x200000bd3:0xc6:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.213621 s, 4.9 MB/s 0x200000bd3:0xc7:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.232639 s, 4.5 MB/s 0x200000bd3:0xc8:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.236798 s, 4.4 MB/s 0x200000bd3:0xc9:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143813 s, 7.3 MB/s 0x200000bd3:0xca:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129336 s, 8.1 MB/s 0x200000bd3:0xcb:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.198165 s, 5.3 MB/s 0x200000bd3:0xcc:0x0 Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2 "/mnt/lustre2"' Killing existing copytools on oleg248-client.virtnet with signal TERM copytools stopped in 1s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2 "/mnt/lustre2"' RESTORE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE PASS 260b (49s) == sanity-hsm test 260c: Requests are not reordered on the 'hot' path of the coordinator ========================================================== 03:01:22 (1787122882) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0878062 s, 11.9 MB/s 0x200000bd3:0xce:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0734001 s, 14.3 MB/s 0x200000bd3:0xcf:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.181224 s, 5.8 MB/s 0x200000bd3:0xd0:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0946206 s, 11.1 MB/s 0x200000bd3:0xd1:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.184643 s, 5.7 MB/s 0x200000bd3:0xd2:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100743 s, 10.4 MB/s 0x200000bd3:0xd3:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.149443 s, 7.0 MB/s 0x200000bd3:0xd4:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104746 s, 10.0 MB/s 0x200000bd3:0xd5:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180952 s, 5.8 MB/s 0x200000bd3:0xd6:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.18057 s, 5.8 MB/s 0x200000bd3:0xd7:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152113 s, 6.9 MB/s 0x200000bd3:0xd8:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0858485 s, 12.2 MB/s 0x200000bd3:0xd9:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.089666 s, 11.7 MB/s 0x200000bd3:0xda:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179189 s, 5.9 MB/s 0x200000bd3:0xdb:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14058 s, 7.5 MB/s 0x200000bd3:0xdc:0x0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.19359 s, 5.4 MB/s 0x200000bd3:0xdd:0x0 Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2 "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Killing existing copytools on oleg248-client.virtnet with signal TERM copytools stopped in 0s mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_260c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2 "/mnt/lustre2"' ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE ARCHIVE RESTORE PASS 260c (52s) == sanity-hsm test 261: Report 0 bytes size after HSM release ========================================================== 03:02:15 (1787122935) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_261/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 2+0 records in 2+0 records out 8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0194938 s, 420 kB/s /mnt/lustre/d261.sanity-hsm/f261.sanity-hsm: (0x00000009) exists archived, archive_id:2 /mnt/lustre/d261.sanity-hsm/f261.sanity-hsm: (0x0000000d) released exists archived, archive_id:2 PASS 261 (11s) == sanity-hsm test 262: The client should return 1 block for HSM released files ========================================================== 03:02:27 (1787122947) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_262/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 2+0 records in 2+0 records out 8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0310857 s, 264 kB/s PASS 262 (10s) == sanity-hsm test 300: On disk coordinator state kept between MDT umount/mount ========================================================== 03:02:37 (1787122957) Stop coordinator and remove coordinator state at mount mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=shutdown Failing mds1 on oleg248-server Stopping /mnt/lustre-mds1 (opts:) on oleg248-server 03:02:51 (1787122971) shut down facet: mds1 facet_host: oleg248-server facet_failover_host: oleg248-server Failover mds1 to oleg248-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg248-server: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 Started lustre-MDT0000 03:03:24 (1787123004) targets are mounted 03:03:24 (1787123004) facet_failover done oleg248-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Set coordinator start at mount, and start coordinator Failing mds1 on oleg248-server Stopping /mnt/lustre-mds1 (opts:) on oleg248-server 03:04:08 (1787123048) shut down facet: mds1 facet_host: oleg248-server facet_failover_host: oleg248-server Failover mds1 to oleg248-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg248-server: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 Started lustre-MDT0000 03:04:42 (1787123082) targets are mounted 03:04:42 (1787123082) facet_failover done oleg248-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 300 (147s) == sanity-hsm test 301: HSM tunnable are persistent ====== 03:05:04 (1787123104) Failing mds1 on oleg248-server Stopping /mnt/lustre-mds1 (opts:) on oleg248-server 03:05:16 (1787123116) shut down facet: mds1 facet_host: oleg248-server facet_failover_host: oleg248-server Failover mds1 to oleg248-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg248-server: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 Started lustre-MDT0000 03:05:50 (1787123150) targets are mounted 03:05:50 (1787123150) facet_failover done oleg248-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 301 (68s) == sanity-hsm test 302: HSM tunnable are persistent when CDT is off ========================================================== 03:06:12 (1787123172) mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=shutdown Failing mds1 on oleg248-server Stopping /mnt/lustre-mds1 (opts:) on oleg248-server 03:06:26 (1787123186) shut down facet: mds1 facet_host: oleg248-server facet_failover_host: oleg248-server Failover mds1 to oleg248-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg248-server: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 Started lustre-MDT0000 03:07:00 (1787123220) targets are mounted 03:07:00 (1787123220) facet_failover done oleg248-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Failing mds2 on oleg248-server Stopping /mnt/lustre-mds2 (opts:) on oleg248-server 03:07:17 (1787123237) shut down facet: mds2 facet_host: oleg248-server facet_failover_host: oleg248-server Failover mds2 to oleg248-server mount facets: mds2 Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg248-server: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 Started lustre-MDT0001 03:07:45 (1787123265) targets are mounted 03:07:45 (1787123265) facet_failover done oleg248-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec PASS 302 (119s) == sanity-hsm test 400: Single request is sent to the right MDT ========================================================== 03:08:11 (1787123291) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_400/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.136728 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.144068 s, 7.3 MB/s archive successful on mdt0 Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' archive successful on mdt1 PASS 400 (12s) == sanity-hsm test 401: Compound requests split and sent to their respective MDTs ========================================================== 03:08:23 (1787123303) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_401/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.224581 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109839 s, 9.5 MB/s archive successful on mdt0 archive successful on mdt1 PASS 401 (12s) == sanity-hsm test 402a: Copytool start fails if all MDTs are inactive ========================================================== 03:08:36 (1787123316) deactivate lustre-MDT0000-mdc-ffff8da006cee000 on oleg248-client.virtnet deactivate lustre-MDT0001-mdc-ffff8da006cee000 on oleg248-client.virtnet deactivate lustre-MDT0000-mdc-ffff8da01854b800 on oleg248-client.virtnet deactivate lustre-MDT0001-mdc-ffff8da01854b800 on oleg248-client.virtnet Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_402a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Failed to start copytool agt1 on 'oleg248-client.virtnet' pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 uuid not found in agent list on mds1 pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 uuid not found in agent list on mds2 activate lustre-MDT0000-mdc-ffff8da006cee000 on oleg248-client.virtnet activate lustre-MDT0001-mdc-ffff8da006cee000 on oleg248-client.virtnet activate lustre-MDT0000-mdc-ffff8da01854b800 on oleg248-client.virtnet activate lustre-MDT0001-mdc-ffff8da01854b800 on oleg248-client.virtnet PASS 402a (12s) == sanity-hsm test 402b: CDT must retry request upon slow start of CT ========================================================== 03:08:47 (1787123327) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_402b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' fail_loc=0x14d fail_loc=0 PASS 402b (24s) == sanity-hsm test 403: Copytool starts with inactive MDT and register on reconnect ========================================================== 03:09:11 (1787123351) deactivate lustre-MDT0001-mdc-ffff8da006cee000 on oleg248-client.virtnet deactivate lustre-MDT0001-mdc-ffff8da01854b800 on oleg248-client.virtnet Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_403/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' oleg248-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool oleg248-client.virtnet: executing get_client_uuid /mnt/lustre2 found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 uuid not found in agent list on mds2 oleg248-client.virtnet: 137282 activate lustre-MDT0001-mdc-ffff8da006cee000 on oleg248-client.virtnet activate lustre-MDT0001-mdc-ffff8da01854b800 on oleg248-client.virtnet found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds1 found agent uuid=036a1a8d-2bd8-4874-b438-26a444fc1a18 archive_id=ANY requests=[current:0 ok:0 errors:0] on mds2 PASS 403 (24s) == sanity-hsm test 404: Inactive MDT does not block requests for active MDTs ========================================================== 03:09:35 (1787123375) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_404/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.136952 s, 7.7 MB/s deactivate lustre-MDT0001-mdc-ffff8da006cee000 on oleg248-client.virtnet deactivate lustre-MDT0001-mdc-ffff8da01854b800 on oleg248-client.virtnet archive successful on mdt0 activate lustre-MDT0001-mdc-ffff8da006cee000 on oleg248-client.virtnet activate lustre-MDT0001-mdc-ffff8da01854b800 on oleg248-client.virtnet PASS 404 (10s) == sanity-hsm test 405: archive and release under striped directory ========================================================== 03:09:45 (1787123385) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_405/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103974 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0398609 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0407173 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.043285 s, 24.2 MB/s Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' archive successful on 0x240000bd2:0x1:0x0 archive successful on 0x240000bd2:0x2:0x0 archive successful on 0x240000bd2:0x3:0x0 archive successful on 0x2000032e3:0x6:0x0 PASS 405 (21s) == sanity-hsm test 406: attempting to migrate HSM archived files is safe ========================================================== 03:10:06 (1787123406) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0829707 s, 12.6 MB/s old fid 0x2000032e3:0x9:0x0 Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_406/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' lfs migrate: /mnt/lustre/d406.sanity-hsm/f406.sanity-hsm migrate failed: Operation not supported (95) lfs migrate: cb_migrate_mdt_fini: error completing migration of /mnt/lustre/d406.sanity-hsm: Directory not empty (39) Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' new fid 0x240000bd3:0x7:0x0 debug=+trace Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' PASS 406 (22s) == sanity-hsm test 407: Check for double RESTORE records in llog ========================================================== 03:10:28 (1787123428) 0+0 records in 0+0 records out 0 bytes copied, 0.0290702 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_407/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' fail_val=5 fail_loc=0x164 Copytool is suspended on oleg248-client.virtnet mdt.lustre-MDT0000.hsm.actions= lrh=[type=10680000 len=136 idx=6/4] fid=[0x2000032e3:0x3:0x0] dfid=[0x2000032e3:0x3:0x0] compound/cookie=0x0/0x6a855610 action=ARCHIVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/5] fid=[0x2000032e3:0x6:0x0] dfid=[0x2000032e3:0x6:0x0] compound/cookie=0x0/0x6a855611 action=ARCHIVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/6] fid=[0x2000032e3:0x6:0x0] dfid=[0x2000032e3:0x7:0x0] compound/cookie=0x0/0x6a855612 action=RESTORE archive#=3 flags=0x4 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/7] fid=[0x2000032e3:0x9:0x0] dfid=[0x2000032e3:0x9:0x0] compound/cookie=0x0/0x6a855613 action=ARCHIVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/8] fid=[0x2000032e3:0x9:0x0] dfid=[0x2000032e3:0xa:0x0] compound/cookie=0x0/0x6a855614 action=RESTORE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/9] fid=[0x2000032e3:0x9:0x0] dfid=[0x2000032e3:0x9:0x0] compound/cookie=0x0/0x6a855615 action=REMOVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/10] fid=[0x2000032e3:0xb:0x0] dfid=[0x2000032e3:0xb:0x0] compound/cookie=0x0/0x6a855616 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] Failing mds1 on oleg248-server Stopping /mnt/lustre-mds1 (opts:) on oleg248-server 03:10:43 (1787123443) shut down facet: mds1 facet_host: oleg248-server facet_failover_host: oleg248-server Failover mds1 to oleg248-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg248-server: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 mdt.lustre-MDT0000.hsm.actions= lrh=[type=10680000 len=136 idx=6/7] fid=[0x2000032e3:0x9:0x0] dfid=[0x2000032e3:0x9:0x0] compound/cookie=0x0/0x6a855613 action=ARCHIVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/8] fid=[0x2000032e3:0x9:0x0] dfid=[0x2000032e3:0xa:0x0] compound/cookie=0x0/0x6a855614 action=RESTORE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/9] fid=[0x2000032e3:0x9:0x0] dfid=[0x2000032e3:0x9:0x0] compound/cookie=0x0/0x6a855615 action=REMOVE archive#=3 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/10] fid=[0x2000032e3:0xb:0x0] dfid=[0x2000032e3:0xb:0x0] compound/cookie=0x0/0x6a855616 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/11] fid=[0x2000032e3:0xb:0x0] dfid=[0x2000032e3:0xb:0x0] compound/cookie=0x0/0x6a855617 action=RESTORE archive#=2 flags=0x4 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] Started lustre-MDT0000 03:11:10 (1787123470) targets are mounted 03:11:10 (1787123470) facet_failover done oleg248-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec fail_loc=0 mdt.lustre-MDT0000.hsm.actions= lrh=[type=10680000 len=136 idx=6/10] fid=[0x2000032e3:0xb:0x0] dfid=[0x2000032e3:0xb:0x0] compound/cookie=0x0/0x6a855616 action=ARCHIVE archive#=2 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=SUCCEED data=[] lrh=[type=10680000 len=136 idx=6/11] fid=[0x2000032e3:0xb:0x0] dfid=[0x2000032e3:0xb:0x0] compound/cookie=0x0/0x6a855617 action=RESTORE archive#=2 flags=0x4 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=STARTED data=[] Copytool is continued on oleg248-client.virtnet d41d8cd98f00b204e9800998ecf8427e /mnt/lustre/d407.sanity-hsm/f407.sanity-hsm d41d8cd98f00b204e9800998ecf8427e /mnt/lustre2/d407.sanity-hsm/f407.sanity-hsm pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 PASS 407 (63s) == sanity-hsm test 408: Verify fiemap on release file ==== 03:11:32 (1787123492) Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_408/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.0608894 s, 1.1 MB/s 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.0456257 s, 1.4 MB/s File: /mnt/lustre/f408.sanity-hsm Size: 262144 Blocks: 256 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115406615871500 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-08-19 03:11:33.000000000 -0400 Modify: 2026-08-19 03:11:34.000000000 -0400 Change: 2026-08-19 03:11:34.000000000 -0400 Birth: 2026-08-19 03:11:33.000000000 -0400 disk usage: 131072 /mnt/lustre/f408.sanity-hsm file size: 262144 /mnt/lustre/f408.sanity-hsm extent 0 in offset 0, length 262144 flags (0x3): LAST UNKNOWN No unwritten extents, extents number 1, sum of lengths 262144, expected sum 262144 PASS 408 (13s) == sanity-hsm test 409a: Coordinator should not stop when in use ========================================================== 03:11:44 (1787123504) 0+0 records in 0+0 records out 0 bytes copied, 0.00416073 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' fail_val=5 fail_loc=0x164 cat: /mnt/lustre/d409a.sanity-hsm/f409a.sanity-hsm: No data available mdt.lustre-MDT0000.hsm_control=shutdown mdt.lustre-MDT0001.hsm_control=shutdown mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled Killing existing copytools on oleg248-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' mdt.lustre-MDT0000.hsm_control=enabled mdt.lustre-MDT0001.hsm_control=enabled PASS 409a (32s) == sanity-hsm test 409b: getattr released file with CDT stopped after remount ========================================================== 03:12:16 (1787123536) 0+0 records in 0+0 records out 0 bytes copied, 0.00616805 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_409b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Killing existing copytools on oleg248-client.virtnet with signal TERM copytools stopped in 0s Failing mds1 on oleg248-server Stopping /mnt/lustre-mds1 (opts:) on oleg248-server 03:12:53 (1787123573) shut down facet: mds1 facet_host: oleg248-server facet_failover_host: oleg248-server Failover mds1 to oleg248-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg248-server: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 Started lustre-MDT0000 03:13:27 (1787123607) targets are mounted 03:13:27 (1787123607) facet_failover done oleg248-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec File: /mnt/lustre/d409b.sanity-hsm/f409b.sanity-hsm Size: 0 Blocks: 0 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115406632648720 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-08-19 03:12:18.000000000 -0400 Modify: 2026-08-19 03:12:18.000000000 -0400 Change: 2026-08-19 03:12:18.000000000 -0400 Birth: 2026-08-19 03:12:17.000000000 -0400 PASS 409b (114s) == sanity-hsm test 410: lfs data_version -s allows release of force-archived file ========================================================== 03:14:10 (1787123650) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.271223 s, 3.9 MB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_410/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Cannot send HSM request (use of /mnt/lustre/d410.sanity-hsm/f410.sanity-hsm): Operation not permitted PASS 410 (10s) == sanity-hsm test 411: hsm_ops rbac role ================ 03:14:20 (1787123660) On MGS 192.168.202.148, active = nodemap.active=1 On MGS 192.168.202.148, test_411.trusted_nodemap = nodemap.test_411.trusted_nodemap=1 Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_411/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' /mnt/lustre/d411.sanity-hsm/fileA: (0x00000000) Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' Killing existing copytools on oleg248-client.virtnet with signal TERM copytools stopped in 0s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_411/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' On MGS 192.168.202.148, test_411.rbac = nodemap.test_411.rbac=file_perms,dne_ops,quota_ops,byfid_ops,chlg_ops,fscrypt_admin,server_upcall,ignore_root_prjquota,immutable_flags,local_admin,pool_quota_ops,lqa_quota_ops,projid_set,foreign_ops /mnt/lustre/d411.sanity-hsm/fileB: (0x00000000) Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Operation not permitted Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied Cannot send HSM request (use of /mnt/lustre/d411.sanity-hsm/fileB): Permission denied lfs hsm_set: change hsm flags for '/mnt/lustre/d411.sanity-hsm/fileB' failed: Permission denied lfs hsm_clear: change hsm flags for '/mnt/lustre/d411.sanity-hsm/fileB' failed: Permission denied On MGS 192.168.202.148, active = nodemap.active=0 oleg248-server: error: nodemap 'test_411' does not exist oleg248-server: nodemap_del: Invalid argument pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 On MGS 192.168.202.148, active = nodemap.active=0 PASS 411 (48s) == sanity-hsm test 500: various LLAPI HSM tests ========== 03:15:08 (1787123708) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d500.sanity-hsm test1 @1787123788: Register/unregister copytool 2000x to check for leaks ...... pass test2 @1787123788: Re/un-register copytool multiple times without error ....... pass llapi_hsm_test: NULL archive numbers llapi_hsm_test: NULL archive numbers llapi_hsm_test: -1 requested when archive id >= 0 is supported test3 @1787123788: Pass bad parameters to llapi_hsm_copytool_register() ....... pass test4 @1787123788: Bad parameters to llapi_hsm_copytool_unregister() .......... pass test5 @1787123788: Test llapi_hsm_copytool_recv() in non-blocking mode ........ pass test6 @1787123788: Test llapi_hsm_copytool_recv() with bogus parameters ....... pass test7 @1787123789: Test event polling (without actual traffic) ................ pass test50 @1787123789: Test llapi_hsm_state_get()/get_fd() ....................... pass test51 @1787123790: Test llapi_hsm_state_set_fd() ............................. pass test52 @1787123790: Test llapi_hsm_current_action() ........................... pass test100 @1787123790: Simple archive creation with no progress reported. ....... pass test101 @1787123795: Simple archive creation with progress every byte. ........ pass test102 @1787123800: Archive creation with progress every byte, backwards ..... pass test103 @1787123801: Archive creation with a single progress report ........... pass test104 @1787123803: Archive creation with two progress reports ............... pass test105 @1787123804: Archive creation with one bogus progress report .......... pass test106 @1787123805: Archive creation with one empty progress report .......... pass test107 @1787123806: Archive creation with one bogus progress report .......... pass test108 @1787123813: Archive creation with same progress report each time ..... pass test109 @1787123814: Archive creation with one report, with large number ...... pass test110 @1787123816: Archive with 10 progress reports, checking progress ...... pass test111 @1787123817: Archive with 10 reports in reverse, checking progress .... pass test112 @1787123818: Archive with 10 reports, duplicated, check progress ...... pass test113 @1787123820: Archive with 9 reports, with 20% overlapping coverage .... pass PASS 500 (118s) == sanity-hsm test 600: Changelog fields 'u=' and 'nid=' ========================================================== 03:17:06 (1787123826) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d600.sanity-hsm/f600.sanity-hsm] Got NID '192.168.202.48@tcp' lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 PASS 600 (25s) == sanity-hsm test 601: OPEN Changelog entry ============= 03:17:31 (1787123851) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl2 cl2' mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0001: clear the changelog for cl2 of all records lustre-MDT0001.4 10OPEN 07:17:41.242148371 2026.08.19 0x1 t=[0x240000bd3:0x1b:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.202.48@tcp m=r-- p=[0x200000bd2:0x86:0x0] lustre-MDT0001: clear the changelog for cl2 of all records lustre-MDT0001: Deregistered changelog user #2 lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0000: Deregistered changelog user #2 PASS 601 (22s) == sanity-hsm test 602: Changelog record CLOSE only if open+write or OPEN recorded ========================================================== 03:17:53 (1787123873) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl3 cl3' mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0001: clear the changelog for cl3 of all records lustre-MDT0000.9 11CLOSE 07:18:01.446141957 2026.08.19 0x1 t=[0x2000032e2:0x1d:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0001: clear the changelog for cl3 of all records lustre-MDT0000.10 10OPEN 07:18:01.840370372 2026.08.19 0x242 t=[0x2000032e2:0x1d:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.202.48@tcp m=-w- lustre-MDT0000.11 23GXATR 07:18:01.849428362 2026.08.19 0x0 t=[0x2000032e2:0x1d:0x0] j=bash.0 ef=0x1b u=0:0 nid=192.168.202.48@tcp x=user.job lustre-MDT0000.12 13TRUNC 07:18:01.854078937 2026.08.19 0xe t=[0x2000032e2:0x1d:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp p=[0x2000032e2:0x1c:0x0] lustre-MDT0000.13 11CLOSE 07:18:01.874788318 2026.08.19 0x242 t=[0x2000032e2:0x1d:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0000.13 11CLOSE 07:18:01.874788318 2026.08.19 0x242 t=[0x2000032e2:0x1d:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp mdd.lustre-MDT0000.changelog_mask=-OPEN mdd.lustre-MDT0001.changelog_mask=-OPEN lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0001: clear the changelog for cl3 of all records f lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0001: clear the changelog for cl3 of all records lustre-MDT0000.14 13TRUNC 07:18:04.476354920 2026.08.19 0xe t=[0x2000032e2:0x1d:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp p=[0x2000032e2:0x1c:0x0] lustre-MDT0000.15 11CLOSE 07:18:04.485691989 2026.08.19 0x242 t=[0x2000032e2:0x1d:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0000.15 11CLOSE 07:18:04.485691989 2026.08.19 0x242 t=[0x2000032e2:0x1d:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0001: clear the changelog for cl3 of all records lustre-MDT0001: Deregistered changelog user #3 lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000: Deregistered changelog user #3 PASS 602 (23s) == sanity-hsm test 603: GETXATTR Changelog entry ========= 03:18:17 (1787123897) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl4 cl4' mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0001: clear the changelog for cl4 of all records getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/d603.sanity-hsm/f603.sanity-hsm user.xattr1="value1" lustre-MDT0001.11 23GXATR 07:18:25.719114672 2026.08.19 0x0 t=[0x240000bd3:0x1d:0x0] j=getfattr.0 ef=0x1b u=0:0 nid=192.168.202.48@tcp x=user.xattr1 lustre-MDT0001: clear the changelog for cl4 of all records lustre-MDT0001: Deregistered changelog user #4 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 PASS 603 (20s) == sanity-hsm test 604: NOPEN Changelog entry ============ 03:18:37 (1787123917) mdd.lustre-MDT0000.changelog_deniednext=20 mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl5 cl5' mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0001: clear the changelog for cl5 of all records running as uid/gid/euid/egid 500/500/500/500, groups: 500 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm] cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied lustre-MDT0000.20 24NOPEN 07:18:47.291834474 2026.08.19 0x1 t=[0x2000032e2:0x1f:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.202.48@tcp m=r-- p=[0x200000bd2:0x80:0x0] Got NID '192.168.202.48@tcp' lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0001: clear the changelog for cl5 of all records running as uid/gid/euid/egid 500/500/500/500, groups: 500 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm] cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0001: clear the changelog for cl5 of all records running as uid/gid/euid/egid 500/500/500/500, groups: 500 [cat] [/mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm] cat: /mnt/lustre2/d604.sanity-hsm/f604.sanity-hsm: Permission denied lustre-MDT0000.21 24NOPEN 07:19:08.785540289 2026.08.19 0x1 t=[0x2000032e2:0x1f:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.202.48@tcp m=r-- p=[0x2000032e2:0x1c:0x0] Got NID '192.168.202.48@tcp' lustre-MDT0001: clear the changelog for cl5 of all records lustre-MDT0001: Deregistered changelog user #5 lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0000: Deregistered changelog user #5 mdd.lustre-MDT0000.changelog_deniednext=60 PASS 604 (44s) == sanity-hsm test 605: Test OPEN and CLOSE rate limit in Changelogs ========================================================== 03:19:21 (1787123961) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl6 cl6' mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0001: clear the changelog for cl6 of all records lustre-MDT0000.25 10OPEN 07:19:29.594913388 2026.08.19 0x43 t=[0x2000032e2:0x21:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.202.48@tcp m=rw- lustre-MDT0000.25 10OPEN 07:19:29.594913388 2026.08.19 0x43 t=[0x2000032e2:0x21:0x0] j=bash.0 ef=0x17 u=0:0 nid=192.168.202.48@tcp m=rw- lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0001: clear the changelog for cl6 of all records lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0001: clear the changelog for cl6 of all records lustre-MDT0000.26 10OPEN 07:19:31.143880926 2026.08.19 0x1 t=[0x2000032e2:0x21:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.202.48@tcp m=r-- p=[0x240000bd3:0x1a:0x0] lustre-MDT0000.27 11CLOSE 07:19:31.180664794 2026.08.19 0x1 t=[0x2000032e2:0x21:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0000.26 10OPEN 07:19:31.143880926 2026.08.19 0x1 t=[0x2000032e2:0x21:0x0] j=cat.0 ef=0x17 u=0:0 nid=192.168.202.48@tcp m=r-- p=[0x240000bd3:0x1a:0x0] lustre-MDT0000.27 11CLOSE 07:19:31.180664794 2026.08.19 0x1 t=[0x2000032e2:0x21:0x0] j=cat.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0001: clear the changelog for cl6 of all records lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0001: clear the changelog for cl6 of all records running as uid/gid/euid/egid 500/500/500/500, groups: 500 [cat] [/mnt/lustre/d605.sanity-hsm/f605.sanity-hsm] lustre-MDT0000.28 10OPEN 07:19:32.568248569 2026.08.19 0x1 t=[0x2000032e2:0x21:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.202.48@tcp m=r-- p=[0x200000bd2:0x80:0x0] lustre-MDT0000.29 11CLOSE 07:19:32.578685232 2026.08.19 0x1 t=[0x2000032e2:0x21:0x0] j=cat.500 ef=0x13 u=500:500 nid=192.168.202.48@tcp lustre-MDT0000.28 10OPEN 07:19:32.568248569 2026.08.19 0x1 t=[0x2000032e2:0x21:0x0] j=cat.500 ef=0x17 u=500:500 nid=192.168.202.48@tcp m=r-- p=[0x200000bd2:0x80:0x0] lustre-MDT0000.29 11CLOSE 07:19:32.578685232 2026.08.19 0x1 t=[0x2000032e2:0x21:0x0] j=cat.500 ef=0x13 u=500:500 nid=192.168.202.48@tcp lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0001: clear the changelog for cl6 of all records lustre-MDT0000.30 11CLOSE 07:19:33.485573306 2026.08.19 0x43 t=[0x2000032e2:0x21:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0000.30 11CLOSE 07:19:33.485573306 2026.08.19 0x43 t=[0x2000032e2:0x21:0x0] j=bash.0 ef=0x13 u=0:0 nid=192.168.202.48@tcp lustre-MDT0001: clear the changelog for cl6 of all records lustre-MDT0001: Deregistered changelog user #6 lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000: Deregistered changelog user #6 PASS 605 (24s) == sanity-hsm test 606: llog_reader groks changelog fields ========================================================== 03:19:45 (1787123985) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl7 cl7' mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d606.sanity-hsm/f606.sanity-hsm] Stopping /mnt/lustre-mds1 (opts:) on oleg248-server rec #2 type=1064553b len=64 offset 8256 Header size : 8192 llh_size : 64 Time : Wed Aug 19 02:46:58 2026 Number of records: 1 cat_idx: 0 last_idx: 2 Flags: 0x2012 Target uuid : ----------------------- #02 (064)fid=[0x1:0x3b:0x0] path=O/1/d27/59 Got UID/GID 500:500 Got NID 192.168.202.48@tcp Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg248-server: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg248-client: oleg248-server: ssh exited with exit code 1 Started lustre-MDT0000 lustre-MDT0001: clear the changelog for cl7 of all records lustre-MDT0001: Deregistered changelog user #7 lustre-MDT0000: clear the changelog for cl7 of all records lustre-MDT0000: Deregistered changelog user #7 PASS 606 (53s) == sanity-hsm test 607a: release file migrated after archive (non-blocking migrate) ========================================================== 03:20:38 (1787124038) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.304211 s, 3.4 MB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' PASS 607a (12s) == sanity-hsm test 607b: Migrate should not change the HSM attribute of dirty files ========================================================== 03:20:50 (1787124050) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.265297 s, 4.0 MB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' llite.lustre-ffff8da006cee000.xattr_cache=0 llite.lustre-ffff8da01854b800.xattr_cache=0 /mnt/lustre/d607b.sanity-hsm/f607b.sanity-hsm: (0x0000000b) exists dirty archived, archive_id:1 llite.lustre-ffff8da006cee000.xattr_cache=1 llite.lustre-ffff8da01854b800.xattr_cache=1 PASS 607b (13s) == sanity-hsm test 607c: 'lfs swap_layouts' should set dirty flag on HSM file ========================================================== 03:21:03 (1787124063) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.214818 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.442408 s, 2.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.250547 s, 4.2 MB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607c/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' Waiting 200s for 'SUCCEED' Updated after 2s: want 'SUCCEED' got 'SUCCEED' lfs swap_layouts: error: cannot swap layout between '/mnt/lustre/d607c.sanity-hsm/f607c.sanity-hsm-1' and '/mnt/lustre/d607c.sanity-hsm/f607c.sanity-hsm-3': Operation not permitted (1) PASS 607c (15s) == sanity-hsm test 607d: Migrate should not set HSM dirty flag for an empty file ========================================================== 03:21:18 (1787124078) 0+0 records in 0+0 records out 0 bytes copied, 0.00924058 s, 0.0 kB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607d/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 607d (11s) == sanity-hsm test 607e: release file migrated after archive (blocking migrate) ========================================================== 03:21:29 (1787124089) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.17757 s, 5.9 MB/s Starting copytool 'agt1' on 'oleg248-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-hsm.test_607e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid "/mnt/lustre2"' PASS 607e (11s) == sanity-hsm test complete, duration 5085 sec =========== 03:21:40 (1787124100) === sanity-hsm: start cleanup 03:21:42 (1787124102) === Stopping clients: oleg248-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg248-client.virtnet /mnt/lustre2 opts: === sanity-hsm: finish cleanup 03:22:17 (1787124137) ===