-----============= acceptance-small: sanity-ec ============----- Tue Aug 18 19:40:31 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg140-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanity-ec.*ex': No such file or directory excepting tests: 12a 12b === sanity-ec: start setup 19:40:37 (1787096437) === oleg140-client.virtnet: executing check_config_client /mnt/lustre oleg140-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg140-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9119c3ff3800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9119c3ff3800.idle_timeout=debug disable quota as required oleg140-server: oleg140-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-ec: finish setup 19:40:48 (1787096448) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f8198] == sanity-ec test 1a: basic setstripe with single component and EC ========================================================== 19:40:49 (1787096449) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 lfs setstripe: error setting 192-byte layout on '/mnt/lustre/f1a.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f1a.sanity-ec': No space left on device (28) sanity-ec test_1a: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:206:test_1a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:225:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_1a.*.1787096450.log rsync: chown "/tmp/testlogs/.sanity-ec.test_1a.debug_log.oleg140-server.1787096450.log.DcmJ2q" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_1a.dmesg.oleg140-server.1787096450.log.xm7gHe" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 1a (2s) == sanity-ec test 1b: setstripe with --ec before -E (order independence) ========================================================== 19:40:51 (1787096451) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 lfs setstripe: error setting 192-byte layout on '/mnt/lustre/f1b.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f1b.sanity-ec': No space left on device (28) sanity-ec test_1b: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:236:test_1b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:252:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_1b.*.1787096453.log rsync: chown "/tmp/testlogs/.sanity-ec.test_1b.debug_log.oleg140-server.1787096453.log.Ry5Egu" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_1b.dmesg.oleg140-server.1787096453.log.kiUWtf" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 1b (2s) == sanity-ec test 1c: setstripe with colon separator (--ec 4:2) ========================================================== 19:40:53 (1787096453) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 lfs setstripe: error setting 192-byte layout on '/mnt/lustre/f1c.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f1c.sanity-ec': No space left on device (28) sanity-ec test_1c: @@@@@@ FAIL: setstripe with colon separator failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:263:test_1c() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:279:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_1c.*.1787096455.log rsync: chown "/tmp/testlogs/.sanity-ec.test_1c.debug_log.oleg140-server.1787096455.log.u5iVzc" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_1c.dmesg.oleg140-server.1787096455.log.NaxMcV" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 1c (3s) == sanity-ec test 1d: setstripe with multiple components and single EC spec ========================================================== 19:40:56 (1787096456) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 lfs setstripe: error setting 352-byte layout on '/mnt/lustre/f1d.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f1d.sanity-ec': No space left on device (28) sanity-ec test_1d: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:290:test_1d() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:313:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_1d.*.1787096457.log rsync: chown "/tmp/testlogs/.sanity-ec.test_1d.debug_log.oleg140-server.1787096457.log.S1LBtb" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_1d.dmesg.oleg140-server.1787096457.log.QrB56c" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 1d (3s) == sanity-ec test 1e: setstripe with EC inheriting to second component ========================================================== 19:40:59 (1787096459) SKIP: sanity-ec test_1e needs >= 6 OSTs SKIP 1e (2s) == sanity-ec test 1f: setstripe with different EC for different components ========================================================== 19:41:01 (1787096461) SKIP: sanity-ec test_1f needs >= 6 OSTs SKIP 1f (2s) == sanity-ec test 1g: setstripe with different parity counts ========================================================== 19:41:03 (1787096463) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 lfs setstripe: error setting 352-byte layout on '/mnt/lustre/f1g.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f1g.sanity-ec': No space left on device (28) sanity-ec test_1g: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:401:test_1g() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:424:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_1g.*.1787096465.log rsync: chown "/tmp/testlogs/.sanity-ec.test_1g.debug_log.oleg140-server.1787096465.log.WLqk8G" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_1g.dmesg.oleg140-server.1787096465.log.fWnc5m" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 1g (3s) == sanity-ec test 1h: setstripe with -N flag and explicit stripe counts with --ec ========================================================== 19:41:06 (1787096466) SKIP: sanity-ec test_1h needs >= 6 OSTs SKIP 1h (2s) == sanity-ec test 1i: default EC layout on directory ===== 19:41:08 (1787096468) SKIP: sanity-ec test_1i needs >= 6 OSTs SKIP 1i (3s) == sanity-ec test 1j: verify EC component inherits stripe size from data component ========================================================== 19:41:11 (1787096471) SKIP: sanity-ec test_1j needs >= 6 OSTs SKIP 1j (2s) == sanity-ec test 1k: test we can create -c (n-2) --ec (n-2)+2 with n OSTs ========================================================== 19:41:13 (1787096473) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 SKIP: sanity-ec test_1k needs 8 OSTs SKIP 1k (3s) == sanity-ec test 1l: test stripe creation fails when parity needs one stripe too many ========================================================== 19:41:16 (1787096476) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 SKIP: sanity-ec test_1l needs 8 OSTs SKIP 1l (2s) == sanity-ec test 2a: setstripe with -N and EC =========== 19:41:18 (1787096478) SKIP: sanity-ec test_2a needs >= 8 OSTs SKIP 2a (3s) == sanity-ec test 2b: setstripe with -N: two data mirrors, one with EC ========================================================== 19:41:21 (1787096481) SKIP: sanity-ec test_2b needs >= 8 OSTs SKIP 2b (3s) == sanity-ec test 2c: setstripe with -N: two data mirrors, both with EC ========================================================== 19:41:24 (1787096484) SKIP: sanity-ec test_2c needs >= 8 OSTs SKIP 2c (3s) == sanity-ec test 2d: setstripe with -N2: multiple identical EC mirrors ========================================================== 19:41:27 (1787096487) SKIP: sanity-ec test_2d needs >= 8 OSTs SKIP 2d (3s) == sanity-ec test 2e: setstripe with -N: mixed regular and EC mirrors ========================================================== 19:41:30 (1787096490) SKIP: sanity-ec test_2e needs >= 8 OSTs SKIP 2e (3s) == sanity-ec test 2f: default EC layout on directory using mirror mode ========================================================== 19:41:33 (1787096493) SKIP: sanity-ec test_2f needs >= 8 OSTs SKIP 2f (3s) == sanity-ec test 3a: lfs mirror create with single EC mirror ========================================================== 19:41:36 (1787096496) SKIP: sanity-ec test_3a needs >= 8 OSTs SKIP 3a (2s) == sanity-ec test 3b: lfs mirror create with -N2 and EC == 19:41:38 (1787096498) SKIP: sanity-ec test_3b needs >= 8 OSTs SKIP 3b (3s) == sanity-ec test 3c: lfs mirror create with mixed EC and regular mirrors ========================================================== 19:41:41 (1787096501) SKIP: sanity-ec test_3c needs >= 8 OSTs SKIP 3c (2s) == sanity-ec test 3d: lfs mirror create with different EC configs per mirror ========================================================== 19:41:43 (1787096503) SKIP: sanity-ec test_3d needs >= 8 OSTs SKIP 3d (2s) == sanity-ec test 3e: lfs mirror create with multiple EC specs in one mirror ========================================================== 19:41:45 (1787096505) SKIP: sanity-ec test_3e needs >= 8 OSTs SKIP 3e (2s) == sanity-ec test 3f: EC inheritance with holes ========== 19:41:47 (1787096507) SKIP: sanity-ec test_3f needs >= 8 OSTs SKIP 3f (2s) == sanity-ec test 3g: EC parity mirror inherits pool from data mirror ========================================================== 19:41:49 (1787096509) SKIP: sanity-ec test_3g needs >= 6 OSTs SKIP 3g (1s) == sanity-ec test 4a: reject invalid EC parameters: parity > data ========================================================== 19:41:50 (1787096510) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 PASS 4a (4s) == sanity-ec test 4b: reject invalid EC parameters: data count < 2 ========================================================== 19:41:54 (1787096514) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 PASS 4b (3s) == sanity-ec test 4c: reject invalid EC parameters: parity = 0 ========================================================== 19:41:57 (1787096517) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 PASS 4c (3s) == sanity-ec test 4d: reject malformed EC specifications ========================================================== 19:42:00 (1787096520) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 PASS 4d (3s) == sanity-ec test 4e: auto-create [0,EOF] component when --ec without -E ========================================================== 19:42:03 (1787096523) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 lfs setstripe: error setting 192-byte layout on '/mnt/lustre/f4e.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f4e.sanity-ec': No space left on device (28) sanity-ec test_4e: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1156:test_4e() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1172:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_4e.*.1787096524.log rsync: chown "/tmp/testlogs/.sanity-ec.test_4e.debug_log.oleg140-server.1787096524.log.THAULP" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_4e.dmesg.oleg140-server.1787096524.log.QGbFSt" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 4e (2s) == sanity-ec test 4f: reject --ec with incompatible options (--foreign) ========================================================== 19:42:05 (1787096525) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 PASS 4f (2s) == sanity-ec test 4g: reject EC stripe counts exceeding limits without --ec-expert ========================================================== 19:42:07 (1787096527) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 PASS 4g (3s) == sanity-ec test 5a: EC mirror read/write commands ====== 19:42:10 (1787096530) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 lfs setstripe: error setting 512-byte layout on '/mnt/lustre/f5a.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f5a.sanity-ec': No space left on device (28) mirror create error: lfs setstripe: create file '/mnt/lustre/f5a.sanity-ec' failed: No space left on device sanity-ec test_5a: @@@@@@ FAIL: create EC file failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1239:test_5a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1281:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_5a.*.1787096531.log rsync: chown "/tmp/testlogs/.sanity-ec.test_5a.debug_log.oleg140-server.1787096531.log.64f5JI" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_5a.dmesg.oleg140-server.1787096531.log.vBRFGG" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 5a (2s) == sanity-ec test 5b: EC FLR state transitions with writes to different components ========================================================== 19:42:12 (1787096532) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 lfs setstripe: error setting 512-byte layout on '/mnt/lustre/f5b.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f5b.sanity-ec': No space left on device (28) sanity-ec test_5b: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1296:test_5b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1385:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_5b.*.1787096534.log rsync: chown "/tmp/testlogs/.sanity-ec.test_5b.debug_log.oleg140-server.1787096534.log.syjWgm" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_5b.dmesg.oleg140-server.1787096534.log.nhk0B6" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 5b (3s) == sanity-ec test 6a: Block setting prefer flags on parity components ========================================================== 19:42:15 (1787096535) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 lfs setstripe: error setting 352-byte layout on '/mnt/lustre/f6a.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f6a.sanity-ec': No space left on device (28) sanity-ec test_6a: @@@@@@ FAIL: create EC file failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1398:test_6a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1457:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_6a.*.1787096536.log rsync: chown "/tmp/testlogs/.sanity-ec.test_6a.debug_log.oleg140-server.1787096536.log.WyxMKC" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_6a.dmesg.oleg140-server.1787096536.log.YjGKvf" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 6a (3s) == sanity-ec test 6b: EC write selects data mirror, not parity mirror ========================================================== 19:42:18 (1787096538) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 lfs setstripe: error setting 192-byte layout on '/mnt/lustre/f6b.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f6b.sanity-ec': No space left on device (28) sanity-ec test_6b: @@@@@@ FAIL: create EC file failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1468:test_6b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1521:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_6b.*.1787096539.log rsync: chown "/tmp/testlogs/.sanity-ec.test_6b.debug_log.oleg140-server.1787096539.log.t2HYjC" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_6b.dmesg.oleg140-server.1787096539.log.lwmmBa" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 6b (2s) == sanity-ec test 6c: EC with multiple data mirrors - parity never selected ========================================================== 19:42:20 (1787096540) SKIP: sanity-ec test_6c needs >= 8 OSTs SKIP 6c (2s) == sanity-ec test 6d: Manually mark parity mirror stale and resync ========================================================== 19:42:22 (1787096542) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 lfs setstripe: error setting 192-byte layout on '/mnt/lustre/f6d.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f6d.sanity-ec': No space left on device (28) sanity-ec test_6d: @@@@@@ FAIL: create EC file failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1621:test_6d() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1684:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_6d.*.1787096543.log rsync: chown "/tmp/testlogs/.sanity-ec.test_6d.debug_log.oleg140-server.1787096543.log.c2jef2" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_6d.dmesg.oleg140-server.1787096543.log.3Rvck1" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 6d (2s) == sanity-ec test 6e: Write fails when only parity mirror is non-stale ========================================================== 19:42:24 (1787096544) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 lfs setstripe: error setting 192-byte layout on '/mnt/lustre/f6e.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f6e.sanity-ec': No space left on device (28) sanity-ec test_6e: @@@@@@ FAIL: create EC file failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1695:test_6e() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1754:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_6e.*.1787096546.log rsync: chown "/tmp/testlogs/.sanity-ec.test_6e.debug_log.oleg140-server.1787096546.log.puDBXb" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_6e.dmesg.oleg140-server.1787096546.log.U6VIxJ" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 6e (3s) == sanity-ec test 7: nosync flag on parity mirror prevents resync updates ========================================================== 19:42:27 (1787096547) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 lfs setstripe: error setting 192-byte layout on '/mnt/lustre/f7.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/f7.sanity-ec': No space left on device (28) sanity-ec test_7: @@@@@@ FAIL: create EC file failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1765:test_7() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:1850:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_7.*.1787096549.log rsync: chown "/tmp/testlogs/.sanity-ec.test_7.debug_log.oleg140-server.1787096549.log.wAAHh9" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_7.dmesg.oleg140-server.1787096549.log.8guhTj" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 7 (3s) == sanity-ec test 10: cannot create overly large ec mirrors ========================================================== 19:42:30 (1787096550) SKIP: sanity-ec test_10 needs >= 5 OSTs SKIP 10 (2s) == sanity-ec test 11: can create --ec 2+2 ================ 19:42:32 (1787096552) SKIP: sanity-ec test_11 needs >= 4 OSTs SKIP 11 (1s) SKIP: sanity-ec test_12a skipping ALWAYS excluded test 12a SKIP: sanity-ec test_12b skipping ALWAYS excluded test 12b == sanity-ec test 12c: resync a file using both FLR and EC (without overstriping) ========================================================== 19:42:35 (1787096555) SKIP: sanity-ec test_12c needs >= 8 OSTs SKIP 12c (1s) == sanity-ec test 12d: resync a file using both FLR and EC (with overstriping) ========================================================== 19:42:36 (1787096556) SKIP: sanity-ec test_12d needs >= 8 OSTs SKIP 12d (2s) == sanity-ec test 13: parity of single stripe data is just a copy ========================================================== 19:42:38 (1787096558) SKIP: sanity-ec test_13 needs >= 4 OSTs SKIP 13 (1s) == sanity-ec test 20: test that stripe size of parity mirror is set correctly ========================================================== 19:42:39 (1787096559) SKIP: sanity-ec test_20 needs >= 4 OSTs SKIP 20 (2s) == sanity-ec test 22: test that lfs mirror read from ec does not change eof ========================================================== 19:42:41 (1787096561) SKIP: sanity-ec test_22 needs >= 8 OSTs SKIP 22 (2s) == sanity-ec test 28b: test that lfs mirror verify for ec does not change eof ========================================================== 19:42:43 (1787096563) SKIP: sanity-ec test_28b needs >= 8 OSTs SKIP 28b (1s) == sanity-ec test 28c: test that reading past parity data returns zeros ========================================================== 19:42:44 (1787096564) SKIP: sanity-ec test_28c needs >= 8 OSTs SKIP 28c (1s) == sanity-ec test 31b: test that size of parity mirror is 1*2*1M ========================================================== 19:42:46 (1787096566) SKIP: sanity-ec test_31b needs >= 8 OSTs SKIP 31b (2s) == sanity-ec test 31c: test that size of parity mirror is 1*2*64k ========================================================== 19:42:47 (1787096567) SKIP: sanity-ec test_31c needs >= 8 OSTs SKIP 31c (1s) == sanity-ec test 31d: test that size of parity mirror is 1*2*64k ========================================================== 19:42:48 (1787096568) SKIP: sanity-ec test_31d needs >= 8 OSTs SKIP 31d (1s) == sanity-ec test 30d: test that size of parity mirror is 22*64k ========================================================== 19:42:49 (1787096569) SKIP: sanity-ec test_30d needs >= 8 OSTs SKIP 30d (2s) == sanity-ec test 21a: migrate plain file to EC layout === 19:42:51 (1787096571) SKIP: sanity-ec test_21a needs >= 3 OSTs SKIP 21a (1s) == sanity-ec test 21b: migrate EC file to plain layout === 19:42:52 (1787096572) SKIP: sanity-ec test_21b needs >= 3 OSTs SKIP 21b (2s) == sanity-ec test 21c: migrate between different EC configurations ========================================================== 19:42:54 (1787096574) SKIP: sanity-ec test_21c needs >= 4 OSTs SKIP 21c (1s) == sanity-ec test 21d: migrate PFL file to EC layout ===== 19:42:55 (1787096575) SKIP: sanity-ec test_21d needs >= 3 OSTs SKIP 21d (1s) == sanity-ec test 22a: mirror split removes plain mirror, keeps EC ========================================================== 19:42:56 (1787096576) SKIP: sanity-ec test_22a needs >= 6 OSTs SKIP 22a (1s) == sanity-ec test 23a: truncate EC file to smaller size == 19:42:57 (1787096577) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d23a.sanity-ec lfs setstripe: error setting 192-byte layout on '/mnt/lustre/d23a.sanity-ec/f23a.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d23a.sanity-ec/f23a.sanity-ec': No space left on device (28) sanity-ec test_23a: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2878:test_23a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2920:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_23a.*.1787096579.log rsync: chown "/tmp/testlogs/.sanity-ec.test_23a.debug_log.oleg140-server.1787096579.log.Elzn5a" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_23a.dmesg.oleg140-server.1787096579.log.7uWN4z" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 23a (3s) == sanity-ec test 23b: truncate EC file to larger size === 19:43:00 (1787096580) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 striped dir -i1 -c2 -H crush /mnt/lustre/d23b.sanity-ec lfs setstripe: error setting 192-byte layout on '/mnt/lustre/d23b.sanity-ec/f23b.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d23b.sanity-ec/f23b.sanity-ec': No space left on device (28) sanity-ec test_23b: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2933:test_23b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2980:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_23b.*.1787096582.log rsync: chown "/tmp/testlogs/.sanity-ec.test_23b.debug_log.oleg140-server.1787096582.log.zEgpiM" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_23b.dmesg.oleg140-server.1787096582.log.EqXii2" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 23b (3s) == sanity-ec test 23c: fallocate on EC file ============== 19:43:03 (1787096583) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 keep default fallocate mode: 0 striped dir -i1 -c2 -H crush2 /mnt/lustre/d23c.sanity-ec lfs setstripe: error setting 192-byte layout on '/mnt/lustre/d23c.sanity-ec/f23c.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d23c.sanity-ec/f23c.sanity-ec': No space left on device (28) sanity-ec test_23c: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:2994:test_23c() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3034:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_23c.*.1787096585.log rsync: chown "/tmp/testlogs/.sanity-ec.test_23c.debug_log.oleg140-server.1787096585.log.Ks0Cen" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_23c.dmesg.oleg140-server.1787096585.log.KLay2K" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 23c (3s) == sanity-ec test 24a: reject --ec with --comp-add ======= 19:43:06 (1787096586) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 striped dir -i0 -c2 -H crush2 /mnt/lustre/d24a.sanity-ec lfs setstripe: error setting 192-byte layout on '/mnt/lustre/d24a.sanity-ec/f24a.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d24a.sanity-ec/f24a.sanity-ec': No space left on device (28) sanity-ec test_24a: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3047:test_24a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3058:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_24a.*.1787096588.log rsync: chown "/tmp/testlogs/.sanity-ec.test_24a.debug_log.oleg140-server.1787096588.log.536OZh" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_24a.dmesg.oleg140-server.1787096588.log.CxvYEU" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 24a (3s) == sanity-ec test 24b: reject deleting data component protected by parity ========================================================== 19:43:10 (1787096590) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 striped dir -i0 -c2 -H crush /mnt/lustre/d24b.sanity-ec lfs setstripe: error setting 352-byte layout on '/mnt/lustre/d24b.sanity-ec/f24b.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d24b.sanity-ec/f24b.sanity-ec': No space left on device (28) sanity-ec test_24b: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3072:test_24b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3099:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_24b.*.1787096591.log rsync: chown "/tmp/testlogs/.sanity-ec.test_24b.debug_log.oleg140-server.1787096591.log.usQus0" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_24b.dmesg.oleg140-server.1787096591.log.O4MKkL" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 24b (3s) == sanity-ec test 25a: lfs find with --component-flags parity ========================================================== 19:43:12 (1787096592) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 striped dir -i1 -c2 -H all_char /mnt/lustre/d25a.sanity-ec lfs setstripe: error setting 192-byte layout on '/mnt/lustre/d25a.sanity-ec/ec_file': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d25a.sanity-ec/ec_file': No space left on device (28) sanity-ec test_25a: @@@@@@ FAIL: setstripe EC failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3112:test_25a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3140:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_25a.*.1787096594.log rsync: chown "/tmp/testlogs/.sanity-ec.test_25a.debug_log.oleg140-server.1787096594.log.p9d6qp" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_25a.dmesg.oleg140-server.1787096594.log.cRVAoG" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 25a (3s) == sanity-ec test 26a: multi-stripe EC data integrity with 20M file ========================================================== 19:43:15 (1787096595) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d26a.sanity-ec lfs setstripe: error setting 192-byte layout on '/mnt/lustre/d26a.sanity-ec/f26a.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d26a.sanity-ec/f26a.sanity-ec': No space left on device (28) sanity-ec test_26a: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3156:test_26a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3205:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_26a.*.1787096596.log rsync: chown "/tmp/testlogs/.sanity-ec.test_26a.debug_log.oleg140-server.1787096596.log.dV9fg4" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_26a.dmesg.oleg140-server.1787096596.log.qtubMC" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 26a (2s) == sanity-ec test 26b: EC data integrity with patterned data and 4M stripes ========================================================== 19:43:18 (1787096598) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 striped dir -i0 -c2 -H crush2 /mnt/lustre/d26b.sanity-ec lfs setstripe: error setting 192-byte layout on '/mnt/lustre/d26b.sanity-ec/f26b.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d26b.sanity-ec/f26b.sanity-ec': No space left on device (28) sanity-ec test_26b: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3220:test_26b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3269:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_26b.*.1787096599.log rsync: chown "/tmp/testlogs/.sanity-ec.test_26b.debug_log.oleg140-server.1787096599.log.epmzaM" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_26b.dmesg.oleg140-server.1787096599.log.3n5jbQ" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 26b (2s) == sanity-ec test 27a: PFL lazy instantiation with EC across multiple components ========================================================== 19:43:20 (1787096600) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 striped dir -i1 -c2 -H all_char /mnt/lustre/d27a.sanity-ec 1+0 records in 1+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0131959 s, 39.7 MB/s Compute/verify raidset range=0-1048576 Wrote parity #0 range=0x0-0x80000 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319105 s, 32.9 MB/s lfs mirror mirror: cannot get WRITE lease, ext 1 for [0x200000402:0x19:0x0]: No space left on device (28) lfs: '/mnt/lustre/d27a.sanity-ec/f27a.sanity-ec' llapi_lease_get_ext resync failed: No space left on device. sanity-ec test_27a: @@@@@@ FAIL: resync after second write failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3337:test_27a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3365:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_27a.*.1787096602.log rsync: chown "/tmp/testlogs/.sanity-ec.test_27a.debug_log.oleg140-server.1787096602.log.DPvhzy" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_27a.dmesg.oleg140-server.1787096602.log.IjtXUG" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 27a (3s) == sanity-ec test 27b: test we can create -c n --ec 4+2 with n OSTs ========================================================== 19:43:23 (1787096603) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 SKIP: sanity-ec test_27b needs >= 8 OSTs SKIP 27b (1s) == sanity-ec test 27c: test creating with n+2 OSTs ======= 19:43:24 (1787096604) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 SKIP: sanity-ec test_27c needs >= 8 OSTs SKIP 27c (2s) == sanity-ec test 27d: test raidset OSTs allocations are valid for -C 8 --ec 5+2 ========================================================== 19:43:26 (1787096606) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 SKIP: sanity-ec test_27d needs >= 8 OSTs SKIP 27d (2s) == sanity-ec test 27e: test raidset OSTs allocations are valid for -C 13 --ec 5+2 ========================================================== 19:43:28 (1787096608) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 SKIP: sanity-ec test_27e needs >= 8 OSTs SKIP 27e (1s) == sanity-ec test 27f: test raidset OSTs allocations are valid for -C 20 --ec 5+2 ========================================================== 19:43:29 (1787096609) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 SKIP: sanity-ec test_27f needs >= 8 OSTs SKIP 27f (2s) == sanity-ec test 28a: EC parity correctly tracks writes through hardlinks ========================================================== 19:43:31 (1787096611) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 striped dir -i0 -c2 -H all_char /mnt/lustre/d28a.sanity-ec lfs setstripe: error setting 192-byte layout on '/mnt/lustre/d28a.sanity-ec/f28a.sanity-ec': No space left on device (28) lfs setstripe: lfs setstripe: cannot create composite file '/mnt/lustre/d28a.sanity-ec/f28a.sanity-ec': No space left on device (28) sanity-ec test_28a: @@@@@@ FAIL: setstripe failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7409:error() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3539:test_28a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7785:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7848:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7663:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-ec.sh:3581:main() Dumping lctl log to /tmp/testlogs//sanity-ec.test_28a.*.1787096613.log rsync: chown "/tmp/testlogs/.sanity-ec.test_28a.debug_log.oleg140-server.1787096613.log.3Pou7u" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-ec.test_28a.dmesg.oleg140-server.1787096613.log.eGTy5r" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] FAIL 28a (3s) == sanity-ec test 29a: EC read fails when OST losses exceed parity tolerance ========================================================== 19:43:34 (1787096614) SKIP: sanity-ec test_29a need >= 4 OSTs SKIP 29a (2s) == sanity-ec test 30a: write makes parity stale, resync recovers ========================================================== 19:43:36 (1787096616) SKIP: sanity-ec test_30a need >= 4 OSTs SKIP 30a (1s) == sanity-ec test 30b: resync succeeds after parity OST recovery ========================================================== 19:43:37 (1787096617) SKIP: sanity-ec test_30b need >= 4 OSTs SKIP 30b (2s) == sanity-ec test 30c: data survives OST restart cycle, resync works after recovery ========================================================== 19:43:39 (1787096619) SKIP: sanity-ec test_30c need >= 4 OSTs SKIP 30c (1s) == sanity-ec test 31a: data mirror intact after write failure on parity OST during resync ========================================================== 19:43:40 (1787096620) SKIP: sanity-ec test_31a need >= 4 OSTs SKIP 31a (2s) == sanity-ec test 32a: full write+resync cycle correct after OST recovery ========================================================== 19:43:42 (1787096622) SKIP: sanity-ec test_32a need >= 4 OSTs SKIP 32a (1s) == sanity-ec test 33a: EC survives repeated write/resync/OST-failure cycles ========================================================== 19:43:43 (1787096623) SKIP: sanity-ec test_33a need >= 4 OSTs SKIP 33a (2s) == sanity-ec test 40a: test recovery read ================ 19:43:45 (1787096625) llite.lustre-ffff9119c3ff3800.enable_erasure_coding=1 SKIP: sanity-ec test_40a needs >= 6 OSTs SKIP 40a (1s) == sanity-ec test 60a: test a single block at start of each stripe in the first raidset ========================================================== 19:43:46 (1787096626) SKIP: sanity-ec test_60a needs >= 8 OSTs SKIP 60a (2s) == sanity-ec test 60b: test a single block at start of each stripe in the second raidset ========================================================== 19:43:48 (1787096628) SKIP: sanity-ec test_60b needs >= 8 OSTs SKIP 60b (1s) == sanity-ec test 60c: test a single block at end of each stripe in the first raidset ========================================================== 19:43:49 (1787096629) SKIP: sanity-ec test_60c needs >= 8 OSTs SKIP 60c (1s) == sanity-ec test 60d: test a single block at start of each stripe in the first raidset but EOF is at the end of the raidset ========================================================== 19:43:51 (1787096631) SKIP: sanity-ec test_60d needs >= 8 OSTs SKIP 60d (1s) == sanity-ec test 60e: test two adjacent blocks are merged into one ========================================================== 19:43:52 (1787096632) SKIP: sanity-ec test_60e needs >= 8 OSTs SKIP 60e (1s) == sanity-ec test 60f: test two adjacent blocks are merged into one, reverse order ========================================================== 19:43:53 (1787096633) SKIP: sanity-ec test_60f needs >= 8 OSTs SKIP 60f (2s) == sanity-ec test 60g: test a fully mapped raidset results in a single full stripe of parity ========================================================== 19:43:55 (1787096635) SKIP: sanity-ec test_60g needs >= 8 OSTs SKIP 60g (1s) == sanity-ec test 60h: filling in a hole merges with the ranges on each side ========================================================== 19:43:56 (1787096636) SKIP: sanity-ec test_60h needs >= 8 OSTs SKIP 60h (2s) == sanity-ec test 60i: a large write covering several smaller ranges merges them all ========================================================== 19:43:58 (1787096638) SKIP: sanity-ec test_60i needs >= 8 OSTs SKIP 60i (1s) == sanity-ec test complete, duration 208 sec ============= 19:43:59 (1787096639) sanity-ec: FAIL: test_1a setstripe failed sanity-ec: FAIL: test_1b setstripe failed sanity-ec: FAIL: test_1c setstripe with colon separator failed sanity-ec: FAIL: test_1d setstripe failed sanity-ec: FAIL: test_1g setstripe failed sanity-ec: FAIL: test_4e setstripe failed sanity-ec: FAIL: test_5a create EC file failed sanity-ec: FAIL: test_5b setstripe failed sanity-ec: FAIL: test_6a create EC file failed sanity-ec: FAIL: test_6b create EC file failed sanity-ec: FAIL: test_6d create EC file failed sanity-ec: FAIL: test_6e create EC file failed sanity-ec: FAIL: test_7 create EC file failed sanity-ec: FAIL: test_23a setstripe failed sanity-ec: FAIL: test_23b setstripe failed sanity-ec: FAIL: test_23c setstripe failed sanity-ec: FAIL: test_24a setstripe failed sanity-ec: FAIL: test_24b setstripe failed sanity-ec: FAIL: test_25a setstripe EC failed sanity-ec: FAIL: test_26a setstripe failed sanity-ec: FAIL: test_26b setstripe failed sanity-ec: FAIL: test_27a resync after second write failed sanity-ec: FAIL: test_28a setstripe failed === sanity-ec: start cleanup 19:44:00 (1787096640) === === sanity-ec: finish cleanup 19:44:01 (1787096641) ===