-----============= acceptance-small: sanity-ec ============----- Mon Jun 22 01:40:43 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg343-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanity-ec.*ex': No such file or directory excepting tests: 12a 12b === sanity-ec: start setup 01:41:01 (1782106861) === oleg343-client.virtnet: executing check_config_client /mnt/lustre oleg343-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg343-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff935d47879800.idle_timeout=debug osc.lustre-OST0001-osc-ffff935d47879800.idle_timeout=debug disable quota as required oleg343-server: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-ec: finish setup 01:41:43 (1782106903) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f8209] == sanity-ec test 1a: basic setstripe with single component and EC ========================================================== 01:41:45 (1782106905) llite.lustre-ffff935d47879800.enable_erasure_coding=1 lfs setstripe: error setting 192-byte layout on '/mnt/lustre/f1a.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f1a.sanity-ec': No space left on device (28) sanity-ec test_1a: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:206:test_1a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:225:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_1a.*.1782106908.log rsync: chown "/tmp/testlogs/.sanity-ec.test_1a.debug_log.oleg343-server.1782106908.log.kmnzUO" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_1a.dmesg.oleg343-server.1782106908.log.eT6Mpf" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 1a (6s) == sanity-ec test 1b: setstripe with --ec before -E (order independence) ========================================================== 01:41:51 (1782106911) llite.lustre-ffff935d47879800.enable_erasure_coding=1 lfs setstripe: error setting 192-byte layout on '/mnt/lustre/f1b.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f1b.sanity-ec': No space left on device (28) sanity-ec test_1b: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:236:test_1b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:252:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_1b.*.1782106915.log rsync: chown "/tmp/testlogs/.sanity-ec.test_1b.debug_log.oleg343-server.1782106915.log.ngcesH" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_1b.dmesg.oleg343-server.1782106915.log.AaIXy0" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 1b (6s) == sanity-ec test 1c: setstripe with colon separator (--ec 4:2) ========================================================== 01:41:58 (1782106918) llite.lustre-ffff935d47879800.enable_erasure_coding=1 lfs setstripe: error setting 192-byte layout on '/mnt/lustre/f1c.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f1c.sanity-ec': No space left on device (28) sanity-ec test_1c: @@@@@@ FAIL: setstripe with colon separator failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:263:test_1c() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:279:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_1c.*.1782106921.log rsync: chown "/tmp/testlogs/.sanity-ec.test_1c.debug_log.oleg343-server.1782106921.log.yKwvic" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_1c.dmesg.oleg343-server.1782106921.log.NpcxHN" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 1c (6s) == sanity-ec test 1d: setstripe with multiple components and single EC spec ========================================================== 01:42:04 (1782106924) llite.lustre-ffff935d47879800.enable_erasure_coding=1 lfs setstripe: error setting 352-byte layout on '/mnt/lustre/f1d.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f1d.sanity-ec': No space left on device (28) sanity-ec test_1d: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:290:test_1d() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:313:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_1d.*.1782106927.log rsync: chown "/tmp/testlogs/.sanity-ec.test_1d.debug_log.oleg343-server.1782106927.log.UWI9nj" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_1d.dmesg.oleg343-server.1782106927.log.kmAYFy" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 1d (5s) == sanity-ec test 1e: setstripe with EC inheriting to second component ========================================================== 01:42:09 (1782106929) SKIP: sanity-ec test_1e needs >= 6 OSTs SKIP 1e (3s) == sanity-ec test 1f: setstripe with different EC for different components ========================================================== 01:42:12 (1782106932) SKIP: sanity-ec test_1f needs >= 6 OSTs SKIP 1f (3s) == sanity-ec test 1g: setstripe with different parity counts ========================================================== 01:42:15 (1782106935) llite.lustre-ffff935d47879800.enable_erasure_coding=1 lfs setstripe: error setting 352-byte layout on '/mnt/lustre/f1g.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f1g.sanity-ec': No space left on device (28) sanity-ec test_1g: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:401:test_1g() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:424:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_1g.*.1782106938.log rsync: chown "/tmp/testlogs/.sanity-ec.test_1g.debug_log.oleg343-server.1782106938.log.awjNGh" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_1g.dmesg.oleg343-server.1782106938.log.gD3laP" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 1g (6s) == sanity-ec test 1h: setstripe with -N flag and explicit stripe counts with --ec ========================================================== 01:42:21 (1782106941) SKIP: sanity-ec test_1h needs >= 6 OSTs SKIP 1h (3s) == sanity-ec test 1i: default EC layout on directory ===== 01:42:24 (1782106944) SKIP: sanity-ec test_1i needs >= 6 OSTs SKIP 1i (4s) == sanity-ec test 1j: verify EC component inherits stripe size from data component ========================================================== 01:42:28 (1782106948) SKIP: sanity-ec test_1j needs >= 6 OSTs SKIP 1j (3s) == sanity-ec test 1k: test we can create -c (n-2) --ec (n-2)+2 with n OSTs ========================================================== 01:42:31 (1782106951) llite.lustre-ffff935d47879800.enable_erasure_coding=1 SKIP: sanity-ec test_1k needs 8 OSTs SKIP 1k (3s) == sanity-ec test 1l: test stripe creation fails when parity needs one stripe too many ========================================================== 01:42:35 (1782106955) llite.lustre-ffff935d47879800.enable_erasure_coding=1 SKIP: sanity-ec test_1l needs 8 OSTs SKIP 1l (3s) == sanity-ec test 2a: setstripe with -N and EC =========== 01:42:38 (1782106958) SKIP: sanity-ec test_2a needs >= 8 OSTs SKIP 2a (3s) == sanity-ec test 2b: setstripe with -N: two data mirrors, one with EC ========================================================== 01:42:41 (1782106961) SKIP: sanity-ec test_2b needs >= 8 OSTs SKIP 2b (4s) == sanity-ec test 2c: setstripe with -N: two data mirrors, both with EC ========================================================== 01:42:45 (1782106965) SKIP: sanity-ec test_2c needs >= 8 OSTs SKIP 2c (3s) == sanity-ec test 2d: setstripe with -N2: multiple identical EC mirrors ========================================================== 01:42:48 (1782106968) SKIP: sanity-ec test_2d needs >= 8 OSTs SKIP 2d (3s) == sanity-ec test 2e: setstripe with -N: mixed regular and EC mirrors ========================================================== 01:42:52 (1782106972) SKIP: sanity-ec test_2e needs >= 8 OSTs SKIP 2e (4s) == sanity-ec test 2f: default EC layout on directory using mirror mode ========================================================== 01:42:56 (1782106976) SKIP: sanity-ec test_2f needs >= 8 OSTs SKIP 2f (4s) == sanity-ec test 3a: lfs mirror create with single EC mirror ========================================================== 01:43:00 (1782106980) SKIP: sanity-ec test_3a needs >= 8 OSTs SKIP 3a (4s) == sanity-ec test 3b: lfs mirror create with -N2 and EC == 01:43:05 (1782106985) SKIP: sanity-ec test_3b needs >= 8 OSTs SKIP 3b (5s) == sanity-ec test 3c: lfs mirror create with mixed EC and regular mirrors ========================================================== 01:43:09 (1782106989) SKIP: sanity-ec test_3c needs >= 8 OSTs SKIP 3c (4s) == sanity-ec test 3d: lfs mirror create with different EC configs per mirror ========================================================== 01:43:13 (1782106993) SKIP: sanity-ec test_3d needs >= 8 OSTs SKIP 3d (3s) == sanity-ec test 3e: lfs mirror create with multiple EC specs in one mirror ========================================================== 01:43:17 (1782106997) SKIP: sanity-ec test_3e needs >= 8 OSTs SKIP 3e (3s) == sanity-ec test 3f: EC inheritance with holes ========== 01:43:20 (1782107000) SKIP: sanity-ec test_3f needs >= 8 OSTs SKIP 3f (4s) == sanity-ec test 3g: EC parity mirror inherits pool from data mirror ========================================================== 01:43:24 (1782107004) SKIP: sanity-ec test_3g needs >= 6 OSTs SKIP 3g (2s) == sanity-ec test 4a: reject invalid EC parameters: parity > data ========================================================== 01:43:27 (1782107007) llite.lustre-ffff935d47879800.enable_erasure_coding=1 PASS 4a (6s) == sanity-ec test 4b: reject invalid EC parameters: data count < 2 ========================================================== 01:43:33 (1782107013) llite.lustre-ffff935d47879800.enable_erasure_coding=1 PASS 4b (6s) == sanity-ec test 4c: reject invalid EC parameters: parity = 0 ========================================================== 01:43:39 (1782107019) llite.lustre-ffff935d47879800.enable_erasure_coding=1 PASS 4c (5s) == sanity-ec test 4d: reject malformed EC specifications ========================================================== 01:43:44 (1782107024) llite.lustre-ffff935d47879800.enable_erasure_coding=1 PASS 4d (6s) == sanity-ec test 4e: auto-create [0,EOF] component when --ec without -E ========================================================== 01:43:50 (1782107030) llite.lustre-ffff935d47879800.enable_erasure_coding=1 lfs setstripe: error setting 192-byte layout on '/mnt/lustre/f4e.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f4e.sanity-ec': No space left on device (28) sanity-ec test_4e: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1156:test_4e() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1172:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_4e.*.1782107035.log rsync: chown "/tmp/testlogs/.sanity-ec.test_4e.debug_log.oleg343-server.1782107035.log.kOx97i" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_4e.dmesg.oleg343-server.1782107035.log.b9n0XJ" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 4e (9s) == sanity-ec test 4f: reject --ec with incompatible options (--foreign) ========================================================== 01:44:00 (1782107040) llite.lustre-ffff935d47879800.enable_erasure_coding=1 PASS 4f (9s) == sanity-ec test 4g: reject EC stripe counts exceeding limits without --ec-expert ========================================================== 01:44:10 (1782107050) llite.lustre-ffff935d47879800.enable_erasure_coding=1 PASS 4g (10s) == sanity-ec test 5a: EC mirror read/write commands ====== 01:44:20 (1782107060) llite.lustre-ffff935d47879800.enable_erasure_coding=1 lfs setstripe: error setting 512-byte layout on '/mnt/lustre/f5a.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f5a.sanity-ec': No space left on device (28) mirror create error: lfs setstripe: create file '/mnt/lustre/f5a.sanity-ec' failed: No space left on device sanity-ec test_5a: @@@@@@ FAIL: create EC file failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1239:test_5a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1281:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_5a.*.1782107066.log rsync: chown "/tmp/testlogs/.sanity-ec.test_5a.debug_log.oleg343-server.1782107066.log.5yHV4U" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_5a.dmesg.oleg343-server.1782107066.log.9IO3QI" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 5a (10s) == sanity-ec test 5b: EC FLR state transitions with writes to different components ========================================================== 01:44:30 (1782107070) llite.lustre-ffff935d47879800.enable_erasure_coding=1 lfs setstripe: error setting 512-byte layout on '/mnt/lustre/f5b.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f5b.sanity-ec': No space left on device (28) sanity-ec test_5b: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1296:test_5b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1385:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_5b.*.1782107074.log rsync: chown "/tmp/testlogs/.sanity-ec.test_5b.debug_log.oleg343-server.1782107074.log.tZi1PN" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_5b.dmesg.oleg343-server.1782107074.log.LbmV3g" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 5b (7s) == sanity-ec test 6a: Block setting prefer flags on parity components ========================================================== 01:44:37 (1782107077) llite.lustre-ffff935d47879800.enable_erasure_coding=1 lfs setstripe: error setting 352-byte layout on '/mnt/lustre/f6a.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f6a.sanity-ec': No space left on device (28) sanity-ec test_6a: @@@@@@ FAIL: create EC file failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1398:test_6a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1457:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_6a.*.1782107081.log rsync: chown "/tmp/testlogs/.sanity-ec.test_6a.debug_log.oleg343-server.1782107081.log.GQ3ykS" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_6a.dmesg.oleg343-server.1782107081.log.HbX3TJ" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 6a (6s) == sanity-ec test 6b: EC write selects data mirror, not parity mirror ========================================================== 01:44:44 (1782107084) llite.lustre-ffff935d47879800.enable_erasure_coding=1 lfs setstripe: error setting 192-byte layout on '/mnt/lustre/f6b.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f6b.sanity-ec': No space left on device (28) sanity-ec test_6b: @@@@@@ FAIL: create EC file failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1468:test_6b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1521:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_6b.*.1782107087.log rsync: chown "/tmp/testlogs/.sanity-ec.test_6b.debug_log.oleg343-server.1782107087.log.u9ospy" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_6b.dmesg.oleg343-server.1782107087.log.spR5Sz" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 6b (7s) == sanity-ec test 6c: EC with multiple data mirrors - parity never selected ========================================================== 01:44:50 (1782107090) SKIP: sanity-ec test_6c needs >= 8 OSTs SKIP 6c (3s) == sanity-ec test 6d: Manually mark parity mirror stale and resync ========================================================== 01:44:53 (1782107093) llite.lustre-ffff935d47879800.enable_erasure_coding=1 lfs setstripe: error setting 192-byte layout on '/mnt/lustre/f6d.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f6d.sanity-ec': No space left on device (28) sanity-ec test_6d: @@@@@@ FAIL: create EC file failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1621:test_6d() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1684:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_6d.*.1782107096.log rsync: chown "/tmp/testlogs/.sanity-ec.test_6d.debug_log.oleg343-server.1782107096.log.ZGvAbp" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_6d.dmesg.oleg343-server.1782107096.log.kSBuDd" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 6d (6s) == sanity-ec test 6e: Write fails when only parity mirror is non-stale ========================================================== 01:44:59 (1782107099) llite.lustre-ffff935d47879800.enable_erasure_coding=1 lfs setstripe: error setting 192-byte layout on '/mnt/lustre/f6e.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f6e.sanity-ec': No space left on device (28) sanity-ec test_6e: @@@@@@ FAIL: create EC file failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1695:test_6e() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1754:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_6e.*.1782107102.log rsync: chown "/tmp/testlogs/.sanity-ec.test_6e.debug_log.oleg343-server.1782107102.log.ePnazW" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_6e.dmesg.oleg343-server.1782107102.log.olefF6" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 6e (5s) == sanity-ec test 7: nosync flag on parity mirror prevents resync updates ========================================================== 01:45:05 (1782107105) llite.lustre-ffff935d47879800.enable_erasure_coding=1 lfs setstripe: error setting 192-byte layout on '/mnt/lustre/f7.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f7.sanity-ec': No space left on device (28) sanity-ec test_7: @@@@@@ FAIL: create EC file failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1765:test_7() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1850:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_7.*.1782107108.log rsync: chown "/tmp/testlogs/.sanity-ec.test_7.debug_log.oleg343-server.1782107108.log.z7PJHG" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_7.dmesg.oleg343-server.1782107108.log.hpRFuF" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 7 (7s) == sanity-ec test 10: cannot create overly large ec mirrors ========================================================== 01:45:11 (1782107111) SKIP: sanity-ec test_10 needs >= 5 OSTs SKIP 10 (3s) == sanity-ec test 11: can create --ec 2+2 ================ 01:45:14 (1782107114) SKIP: sanity-ec test_11 needs >= 4 OSTs SKIP 11 (3s) SKIP: sanity-ec test_12a skipping ALWAYS excluded test 12a SKIP: sanity-ec test_12b skipping ALWAYS excluded test 12b == sanity-ec test 13: parity of single stripe data is just a copy ========================================================== 01:45:19 (1782107119) SKIP: sanity-ec test_13 needs >= 4 OSTs SKIP 13 (3s) == sanity-ec test 20: test that stripe size of parity mirror is set correctly ========================================================== 01:45:22 (1782107122) SKIP: sanity-ec test_20 needs >= 4 OSTs SKIP 20 (3s) == sanity-ec test 22: test that lfs mirror read from ec does not change eof ========================================================== 01:45:25 (1782107125) SKIP: sanity-ec test_22 needs >= 8 OSTs SKIP 22 (3s) == sanity-ec test 28b: test that lfs mirror verify for ec does not change eof ========================================================== 01:45:28 (1782107128) SKIP: sanity-ec test_28b needs >= 8 OSTs SKIP 28b (2s) == sanity-ec test 28c: test that reading past parity data returns zeros ========================================================== 01:45:31 (1782107131) SKIP: sanity-ec test_28c needs >= 8 OSTs SKIP 28c (2s) == sanity-ec test 31b: test that size of parity mirror is 1*2*1M ========================================================== 01:45:33 (1782107133) SKIP: sanity-ec test_31b needs >= 8 OSTs SKIP 31b (3s) == sanity-ec test 31c: test that size of parity mirror is 1*2*64k ========================================================== 01:45:37 (1782107137) SKIP: sanity-ec test_31c needs >= 8 OSTs SKIP 31c (3s) == sanity-ec test 31d: test that size of parity mirror is 1*2*64k ========================================================== 01:45:40 (1782107140) SKIP: sanity-ec test_31d needs >= 8 OSTs SKIP 31d (4s) == sanity-ec test 30d: test that size of parity mirror is 22*64k ========================================================== 01:45:44 (1782107144) SKIP: sanity-ec test_30d needs >= 8 OSTs SKIP 30d (3s) == sanity-ec test 21a: migrate plain file to EC layout === 01:45:48 (1782107148) SKIP: sanity-ec test_21a needs >= 3 OSTs SKIP 21a (4s) == sanity-ec test 21b: migrate EC file to plain layout === 01:45:51 (1782107151) SKIP: sanity-ec test_21b needs >= 3 OSTs SKIP 21b (3s) == sanity-ec test 21c: migrate between different EC configurations ========================================================== 01:45:54 (1782107154) SKIP: sanity-ec test_21c needs >= 4 OSTs SKIP 21c (4s) == sanity-ec test 21d: migrate PFL file to EC layout ===== 01:45:58 (1782107158) SKIP: sanity-ec test_21d needs >= 3 OSTs SKIP 21d (3s) == sanity-ec test 22a: mirror split removes plain mirror, keeps EC ========================================================== 01:46:01 (1782107161) SKIP: sanity-ec test_22a needs >= 6 OSTs SKIP 22a (3s) == sanity-ec test 23a: truncate EC file to smaller size == 01:46:05 (1782107165) llite.lustre-ffff935d47879800.enable_erasure_coding=1 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d23a.sanity-ec lfs setstripe: error setting 192-byte layout on '/mnt/lustre/d23a.sanity-ec/f23a.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d23a.sanity-ec/f23a.sanity-ec': No space left on device (28) sanity-ec test_23a: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2730:test_23a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2772:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_23a.*.1782107169.log rsync: chown "/tmp/testlogs/.sanity-ec.test_23a.debug_log.oleg343-server.1782107169.log.6TURDa" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_23a.dmesg.oleg343-server.1782107169.log.vyBSST" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 23a (6s) == sanity-ec test 23b: truncate EC file to larger size === 01:46:12 (1782107172) llite.lustre-ffff935d47879800.enable_erasure_coding=1 striped dir -i1 -c2 -H crush /mnt/lustre/d23b.sanity-ec lfs setstripe: error setting 192-byte layout on '/mnt/lustre/d23b.sanity-ec/f23b.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d23b.sanity-ec/f23b.sanity-ec': No space left on device (28) sanity-ec test_23b: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2785:test_23b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2832:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_23b.*.1782107175.log rsync: chown "/tmp/testlogs/.sanity-ec.test_23b.debug_log.oleg343-server.1782107175.log.l3JdPF" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_23b.dmesg.oleg343-server.1782107175.log.odwc5m" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 23b (6s) == sanity-ec test 23c: fallocate on EC file ============== 01:46:18 (1782107178) llite.lustre-ffff935d47879800.enable_erasure_coding=1 keep default fallocate mode: 0 striped dir -i1 -c2 -H crush2 /mnt/lustre/d23c.sanity-ec lfs setstripe: error setting 192-byte layout on '/mnt/lustre/d23c.sanity-ec/f23c.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d23c.sanity-ec/f23c.sanity-ec': No space left on device (28) sanity-ec test_23c: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2846:test_23c() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2886:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_23c.*.1782107183.log rsync: chown "/tmp/testlogs/.sanity-ec.test_23c.debug_log.oleg343-server.1782107183.log.n2Ud1W" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_23c.dmesg.oleg343-server.1782107183.log.8dBWLB" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 23c (8s) == sanity-ec test 24a: reject --ec with --comp-add ======= 01:46:26 (1782107186) llite.lustre-ffff935d47879800.enable_erasure_coding=1 striped dir -i0 -c2 -H crush /mnt/lustre/d24a.sanity-ec lfs setstripe: error setting 192-byte layout on '/mnt/lustre/d24a.sanity-ec/f24a.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d24a.sanity-ec/f24a.sanity-ec': No space left on device (28) sanity-ec test_24a: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2899:test_24a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2910:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_24a.*.1782107189.log rsync: chown "/tmp/testlogs/.sanity-ec.test_24a.debug_log.oleg343-server.1782107189.log.dStwkD" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_24a.dmesg.oleg343-server.1782107189.log.wzc3WY" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 24a (7s) == sanity-ec test 24b: reject deleting data component protected by parity ========================================================== 01:46:33 (1782107193) llite.lustre-ffff935d47879800.enable_erasure_coding=1 striped dir -i0 -c2 -H crush2 /mnt/lustre/d24b.sanity-ec lfs setstripe: error setting 352-byte layout on '/mnt/lustre/d24b.sanity-ec/f24b.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d24b.sanity-ec/f24b.sanity-ec': No space left on device (28) sanity-ec test_24b: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2924:test_24b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2951:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_24b.*.1782107196.log rsync: chown "/tmp/testlogs/.sanity-ec.test_24b.debug_log.oleg343-server.1782107196.log.gIFHfC" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_24b.dmesg.oleg343-server.1782107196.log.lVoryt" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 24b (5s) == sanity-ec test 25a: lfs find with --component-flags parity ========================================================== 01:46:39 (1782107199) llite.lustre-ffff935d47879800.enable_erasure_coding=1 striped dir -i1 -c2 -H all_char /mnt/lustre/d25a.sanity-ec lfs setstripe: error setting 192-byte layout on '/mnt/lustre/d25a.sanity-ec/ec_file': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d25a.sanity-ec/ec_file': No space left on device (28) sanity-ec test_25a: @@@@@@ FAIL: setstripe EC failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2964:test_25a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2992:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_25a.*.1782107202.log rsync: chown "/tmp/testlogs/.sanity-ec.test_25a.debug_log.oleg343-server.1782107202.log.WWPra4" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_25a.dmesg.oleg343-server.1782107202.log.22oABn" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 25a (7s) == sanity-ec test 26a: multi-stripe EC data integrity with 20M file ========================================================== 01:46:45 (1782107205) llite.lustre-ffff935d47879800.enable_erasure_coding=1 striped dir -i0 -c2 -H all_char /mnt/lustre/d26a.sanity-ec lfs setstripe: error setting 192-byte layout on '/mnt/lustre/d26a.sanity-ec/f26a.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d26a.sanity-ec/f26a.sanity-ec': No space left on device (28) sanity-ec test_26a: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3008:test_26a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3057:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_26a.*.1782107209.log rsync: chown "/tmp/testlogs/.sanity-ec.test_26a.debug_log.oleg343-server.1782107209.log.74wFJZ" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_26a.dmesg.oleg343-server.1782107209.log.59QwTb" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 26a (7s) == sanity-ec test 26b: EC data integrity with patterned data and 4M stripes ========================================================== 01:46:52 (1782107212) llite.lustre-ffff935d47879800.enable_erasure_coding=1 striped dir -i0 -c2 -H all_char /mnt/lustre/d26b.sanity-ec lfs setstripe: error setting 192-byte layout on '/mnt/lustre/d26b.sanity-ec/f26b.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d26b.sanity-ec/f26b.sanity-ec': No space left on device (28) sanity-ec test_26b: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3072:test_26b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3121:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_26b.*.1782107216.log rsync: chown "/tmp/testlogs/.sanity-ec.test_26b.debug_log.oleg343-server.1782107216.log.KjvZUo" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_26b.dmesg.oleg343-server.1782107216.log.FCIwoT" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 26b (7s) == sanity-ec test 27a: PFL lazy instantiation with EC across multiple components ========================================================== 01:46:59 (1782107219) llite.lustre-ffff935d47879800.enable_erasure_coding=1 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d27a.sanity-ec 1+0 records in 1+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0188949 s, 27.7 MB/s Compute/verify raidset range=0-1048576 Wrote parity #0 range=0x0-0x80000 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0962446 s, 10.9 MB/s lfs mirror mirror: cannot get WRITE lease, ext 1 for [0x240000402:0xa:0x0]: No space left on device (28) lfs: '/mnt/lustre/d27a.sanity-ec/f27a.sanity-ec' llapi_lease_get_ext resync failed: No space left on device. sanity-ec test_27a: @@@@@@ FAIL: resync after second write failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3189:test_27a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3217:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_27a.*.1782107224.log rsync: chown "/tmp/testlogs/.sanity-ec.test_27a.debug_log.oleg343-server.1782107224.log.c9IIRd" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_27a.dmesg.oleg343-server.1782107224.log.c1bBzs" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 27a (9s) == sanity-ec test 27b: test we can create -c n --ec 4+2 with n OSTs ========================================================== 01:47:08 (1782107228) llite.lustre-ffff935d47879800.enable_erasure_coding=1 SKIP: sanity-ec test_27b needs >= 8 OSTs SKIP 27b (3s) == sanity-ec test 27c: test creating with n+2 OSTs ======= 01:47:11 (1782107231) llite.lustre-ffff935d47879800.enable_erasure_coding=1 SKIP: sanity-ec test_27c needs >= 8 OSTs SKIP 27c (4s) == sanity-ec test 27d: test raidset OSTs allocations are valid for -C 8 --ec 5+2 ========================================================== 01:47:15 (1782107235) llite.lustre-ffff935d47879800.enable_erasure_coding=1 SKIP: sanity-ec test_27d needs >= 8 OSTs SKIP 27d (3s) == sanity-ec test 27e: test raidset OSTs allocations are valid for -C 13 --ec 5+2 ========================================================== 01:47:18 (1782107238) llite.lustre-ffff935d47879800.enable_erasure_coding=1 SKIP: sanity-ec test_27e needs >= 8 OSTs SKIP 27e (3s) == sanity-ec test 27f: test raidset OSTs allocations are valid for -C 20 --ec 5+2 ========================================================== 01:47:21 (1782107241) llite.lustre-ffff935d47879800.enable_erasure_coding=1 SKIP: sanity-ec test_27f needs >= 8 OSTs SKIP 27f (3s) == sanity-ec test 28a: EC parity correctly tracks writes through hardlinks ========================================================== 01:47:24 (1782107244) llite.lustre-ffff935d47879800.enable_erasure_coding=1 striped dir -i0 -c2 -H crush /mnt/lustre/d28a.sanity-ec lfs setstripe: error setting 192-byte layout on '/mnt/lustre/d28a.sanity-ec/f28a.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d28a.sanity-ec/f28a.sanity-ec': No space left on device (28) sanity-ec test_28a: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7440:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3391:test_28a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7816:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7879:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3433:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_28a.*.1782107249.log rsync: chown "/tmp/testlogs/.sanity-ec.test_28a.debug_log.oleg343-server.1782107249.log.q02Qg0" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_28a.dmesg.oleg343-server.1782107249.log.8hvKfp" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 28a (9s) == sanity-ec test 29a: EC read fails when OST losses exceed parity tolerance ========================================================== 01:47:33 (1782107253) SKIP: sanity-ec test_29a need >= 4 OSTs SKIP 29a (3s) == sanity-ec test 30a: write makes parity stale, resync recovers ========================================================== 01:47:36 (1782107256) SKIP: sanity-ec test_30a need >= 4 OSTs SKIP 30a (3s) == sanity-ec test 30b: resync succeeds after parity OST recovery ========================================================== 01:47:39 (1782107259) SKIP: sanity-ec test_30b need >= 4 OSTs SKIP 30b (3s) == sanity-ec test 30c: data survives OST restart cycle, resync works after recovery ========================================================== 01:47:43 (1782107263) SKIP: sanity-ec test_30c need >= 4 OSTs SKIP 30c (2s) == sanity-ec test 31a: data mirror intact after write failure on parity OST during resync ========================================================== 01:47:46 (1782107266) SKIP: sanity-ec test_31a need >= 4 OSTs SKIP 31a (2s) == sanity-ec test 32a: full write+resync cycle correct after OST recovery ========================================================== 01:47:48 (1782107268) SKIP: sanity-ec test_32a need >= 4 OSTs SKIP 32a (3s) == sanity-ec test 33a: EC survives repeated write/resync/OST-failure cycles ========================================================== 01:47:51 (1782107271) SKIP: sanity-ec test_33a need >= 4 OSTs SKIP 33a (3s) == sanity-ec test 40a: test recovery read ================ 01:47:54 (1782107274) llite.lustre-ffff935d47879800.enable_erasure_coding=1 SKIP: sanity-ec test_40a needs >= 6 OSTs SKIP 40a (3s) == sanity-ec test 42a: strict SOM does not hang with inactive OST ========================================================== 01:47:57 (1782107277) SKIP: sanity-ec test_42a need >= 3 OSTs SKIP 42a (3s) == sanity-ec test 42b: avoid partial glimpse with deactivated import ========================================================== 01:48:00 (1782107280) SKIP: sanity-ec test_42b need >= 3 OSTs SKIP 42b (4s) == sanity-ec test 60a: test a single block at start of each stripe in the first raidset ========================================================== 01:48:04 (1782107284) SKIP: sanity-ec test_60a needs >= 8 OSTs SKIP 60a (3s) == sanity-ec test 60b: test a single block at start of each stripe in the second raidset ========================================================== 01:48:07 (1782107287) SKIP: sanity-ec test_60b needs >= 8 OSTs SKIP 60b (3s) == sanity-ec test 60c: test a single block at end of each stripe in the first raidset ========================================================== 01:48:10 (1782107290) SKIP: sanity-ec test_60c needs >= 8 OSTs SKIP 60c (4s) == sanity-ec test 60d: test a single block at start of each stripe in the first raidset but EOF is at the end of the raidset ========================================================== 01:48:14 (1782107294) SKIP: sanity-ec test_60d needs >= 8 OSTs SKIP 60d (3s) == sanity-ec test 60e: test two adjacent blocks are merged into one ========================================================== 01:48:17 (1782107297) SKIP: sanity-ec test_60e needs >= 8 OSTs SKIP 60e (3s) == sanity-ec test 60f: test two adjacent blocks are merged into one, reverse order ========================================================== 01:48:20 (1782107300) SKIP: sanity-ec test_60f needs >= 8 OSTs SKIP 60f (3s) == sanity-ec test 60g: test a fully mapped raidset results in a single full stripe of parity ========================================================== 01:48:24 (1782107304) SKIP: sanity-ec test_60g needs >= 8 OSTs SKIP 60g (3s) == sanity-ec test 60h: filling in a hole merges with the ranges on each side ========================================================== 01:48:27 (1782107307) SKIP: sanity-ec test_60h needs >= 8 OSTs SKIP 60h (3s) == sanity-ec test 60i: a large write covering several smaller ranges merges them all ========================================================== 01:48:30 (1782107310) SKIP: sanity-ec test_60i needs >= 8 OSTs SKIP 60i (4s) == sanity-ec test complete, duration 470 sec ============= 01:48:34 (1782107314) sanity-ec: FAIL: test_1a setstripe failed sanity-ec: FAIL: test_1b setstripe failed sanity-ec: FAIL: test_1c setstripe with colon separator failed sanity-ec: FAIL: test_1d setstripe failed sanity-ec: FAIL: test_1g setstripe failed sanity-ec: FAIL: test_4e setstripe failed sanity-ec: FAIL: test_5a create EC file failed sanity-ec: FAIL: test_5b setstripe failed sanity-ec: FAIL: test_6a create EC file failed sanity-ec: FAIL: test_6b create EC file failed sanity-ec: FAIL: test_6d create EC file failed sanity-ec: FAIL: test_6e create EC file failed sanity-ec: FAIL: test_7 create EC file failed sanity-ec: FAIL: test_23a setstripe failed sanity-ec: FAIL: test_23b setstripe failed sanity-ec: FAIL: test_23c setstripe failed sanity-ec: FAIL: test_24a setstripe failed sanity-ec: FAIL: test_24b setstripe failed sanity-ec: FAIL: test_25a setstripe EC failed sanity-ec: FAIL: test_26a setstripe failed sanity-ec: FAIL: test_26b setstripe failed sanity-ec: FAIL: test_27a resync after second write failed sanity-ec: FAIL: test_28a setstripe failed === sanity-ec: start cleanup 01:48:35 (1782107315) === === sanity-ec: finish cleanup 01:48:38 (1782107318) ===