-----============= acceptance-small: sanity-ec ============----- Tue Sep 22 13:06:12 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky use SANITY_EC_ONLY='' SANITY_EC_EXCEPT='' oleg347-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanity-ec.*ex': No such file or directory excepting tests: 12a 41d 53a 41j 41k 41l 41m 41n === sanity-ec: start setup 13:06:32 (1790096792) === oleg347-client.virtnet: executing check_config_client /mnt/lustre oleg347-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg347-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8c5451f7d800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8c5451f7d800.idle_timeout=debug disable quota as required oleg347-server: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-ec: finish setup 13:07:11 (1790096831) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f8241] == sanity-ec test 1a: basic setstripe with single component and EC ========================================================== 13:07:14 (1790096834) SKIP: sanity-ec test_1a needs >= 3 OSTs for EC SKIP 1a (3s) == sanity-ec test 1b: setstripe with --ec before -E (order independence) ========================================================== 13:07:17 (1790096837) SKIP: sanity-ec test_1b needs >= 3 OSTs for EC SKIP 1b (3s) == sanity-ec test 1c: setstripe with colon separator (--ec dstripe:cstripe) ========================================================== 13:07:20 (1790096840) SKIP: sanity-ec test_1c needs >= 3 OSTs for EC SKIP 1c (4s) == sanity-ec test 1d: setstripe with multiple components and single EC spec ========================================================== 13:07:24 (1790096844) SKIP: sanity-ec test_1d needs >= 3 OSTs for EC SKIP 1d (3s) == sanity-ec test 1e: setstripe with EC inheriting to second component ========================================================== 13:07:28 (1790096848) SKIP: sanity-ec test_1e needs >= 3 OSTs for EC SKIP 1e (4s) == sanity-ec test 1f: setstripe with different EC for different components ========================================================== 13:07:31 (1790096851) SKIP: sanity-ec test_1f needs >= 6 OSTs SKIP 1f (3s) == sanity-ec test 1g: setstripe with different parity counts ========================================================== 13:07:35 (1790096855) SKIP: sanity-ec test_1g needs >= 5 OSTs SKIP 1g (3s) == sanity-ec test 1h: setstripe with -N flag and explicit stripe counts with --ec ========================================================== 13:07:38 (1790096858) SKIP: sanity-ec test_1h needs >= 7 OSTs SKIP 1h (4s) == sanity-ec test 1i: default EC layout on directory ===== 13:07:42 (1790096862) SKIP: sanity-ec test_1i needs >= 3 OSTs for EC SKIP 1i (4s) == sanity-ec test 1j: verify EC component inherits stripe size from data component ========================================================== 13:07:46 (1790096866) SKIP: sanity-ec test_1j needs >= 6 OSTs SKIP 1j (3s) == sanity-ec test 1k: default EC layout inherited through nested directories ========================================================== 13:07:50 (1790096870) SKIP: sanity-ec test_1k needs >= 6 OSTs SKIP 1k (3s) == sanity-ec test 1l: default EC layout inherited through nested dirs (complex) ========================================================== 13:07:53 (1790096873) SKIP: sanity-ec test_1l needs >= 8 OSTs SKIP 1l (3s) == sanity-ec test 2a: setstripe with -N and EC =========== 13:07:56 (1790096876) SKIP: sanity-ec test_2a needs >= 3 OSTs for EC SKIP 2a (4s) == sanity-ec test 2b: setstripe with -N: two data mirrors, one with EC ========================================================== 13:08:00 (1790096880) SKIP: sanity-ec test_2b needs >= 7 OSTs SKIP 2b (3s) == sanity-ec test 2c: setstripe with -N: two data mirrors, both with EC ========================================================== 13:08:03 (1790096883) SKIP: sanity-ec test_2c needs >= 8 OSTs SKIP 2c (3s) == sanity-ec test 2d: setstripe with -N2: multiple identical EC mirrors ========================================================== 13:08:07 (1790096887) SKIP: sanity-ec test_2d needs >= 6 OSTs SKIP 2d (4s) == sanity-ec test 2e: setstripe with -N: mixed regular and EC mirrors ========================================================== 13:08:11 (1790096891) SKIP: sanity-ec test_2e needs >= 8 OSTs SKIP 2e (5s) == sanity-ec test 2f: default EC layout on directory using mirror mode ========================================================== 13:08:16 (1790096896) SKIP: sanity-ec test_2f needs >= 8 OSTs SKIP 2f (4s) == sanity-ec test 3a: lfs mirror create with single EC mirror ========================================================== 13:08:20 (1790096900) SKIP: sanity-ec test_3a needs >= 3 OSTs for EC SKIP 3a (4s) == sanity-ec test 3b: lfs mirror create with -N2 and EC == 13:08:25 (1790096905) SKIP: sanity-ec test_3b needs >= 6 OSTs SKIP 3b (4s) == sanity-ec test 3c: lfs mirror create with mixed EC and regular mirrors ========================================================== 13:08:29 (1790096909) SKIP: sanity-ec test_3c needs >= 3 OSTs for EC SKIP 3c (4s) == sanity-ec test 3d: lfs mirror create with different EC configs per mirror ========================================================== 13:08:34 (1790096914) SKIP: sanity-ec test_3d needs >= 6 OSTs SKIP 3d (4s) == sanity-ec test 3e: lfs mirror create with multiple EC specs in one mirror ========================================================== 13:08:38 (1790096918) SKIP: sanity-ec test_3e needs >= 6 OSTs SKIP 3e (4s) == sanity-ec test 3f: EC inheritance with holes ========== 13:08:43 (1790096923) SKIP: sanity-ec test_3f needs >= 3 OSTs for EC SKIP 3f (5s) == sanity-ec test 3g: EC parity mirror inherits pool from data mirror ========================================================== 13:08:48 (1790096928) SKIP: sanity-ec test_3g needs >= 6 OSTs SKIP 3g (4s) == sanity-ec test 4a: reject invalid EC parameters: parity > data ========================================================== 13:08:52 (1790096932) SKIP: sanity-ec test_4a needs >= 3 OSTs for EC SKIP 4a (4s) == sanity-ec test 4b: reject invalid EC parameters: data count < 2 ========================================================== 13:08:56 (1790096936) SKIP: sanity-ec test_4b needs >= 3 OSTs for EC SKIP 4b (3s) == sanity-ec test 4c: reject invalid EC parameters: parity = 0 ========================================================== 13:08:59 (1790096939) SKIP: sanity-ec test_4c needs >= 3 OSTs for EC SKIP 4c (4s) == sanity-ec test 4d: reject malformed EC specifications ========================================================== 13:09:03 (1790096943) SKIP: sanity-ec test_4d needs >= 3 OSTs for EC SKIP 4d (3s) == sanity-ec test 4e: auto-create [0,EOF] component when --ec without -E ========================================================== 13:09:06 (1790096946) SKIP: sanity-ec test_4e needs >= 3 OSTs for EC SKIP 4e (4s) == sanity-ec test 4f: reject --ec with incompatible options (--foreign) ========================================================== 13:09:10 (1790096950) SKIP: sanity-ec test_4f needs >= 3 OSTs for EC SKIP 4f (4s) == sanity-ec test 4g: reject EC stripe counts exceeding limits without --ec-expert ========================================================== 13:09:14 (1790096954) SKIP: sanity-ec test_4g needs >= 3 OSTs for EC SKIP 4g (4s) == sanity-ec test 5a: EC mirror read/write commands ====== 13:09:18 (1790096958) SKIP: sanity-ec test_5a needs >= 3 OSTs for EC SKIP 5a (3s) == sanity-ec test 5b: EC FLR state transitions with writes to different components ========================================================== 13:09:21 (1790096961) SKIP: sanity-ec test_5b needs >= 3 OSTs for EC SKIP 5b (4s) == sanity-ec test 6a: Block setting prefer flags on parity components ========================================================== 13:09:25 (1790096965) SKIP: sanity-ec test_6a needs >= 3 OSTs for EC SKIP 6a (4s) == sanity-ec test 6b: EC write selects data mirror, not parity mirror ========================================================== 13:09:29 (1790096969) SKIP: sanity-ec test_6b needs >= 3 OSTs for EC SKIP 6b (4s) == sanity-ec test 6c: EC with multiple data mirrors - parity never selected ========================================================== 13:09:34 (1790096974) SKIP: sanity-ec test_6c needs >= 8 OSTs SKIP 6c (4s) == sanity-ec test 6d: Manually mark parity mirror stale and resync ========================================================== 13:09:38 (1790096978) SKIP: sanity-ec test_6d needs >= 3 OSTs for EC SKIP 6d (4s) == sanity-ec test 6e: Write fails when only parity mirror is non-stale ========================================================== 13:09:42 (1790096982) SKIP: sanity-ec test_6e needs >= 3 OSTs for EC SKIP 6e (3s) == sanity-ec test 7a: nosync flag on parity mirror prevents resync updates ========================================================== 13:09:45 (1790096985) SKIP: sanity-ec test_7a needs >= 3 OSTs for EC SKIP 7a (4s) == sanity-ec test 7b: mirror split of a parity mirror to a file is refused ========================================================== 13:09:49 (1790096989) SKIP: sanity-ec test_7b needs >= 6 OSTs SKIP 7b (4s) == sanity-ec test 7c: mirror split -d works for multi-component parity mirrors ========================================================== 13:09:53 (1790096993) SKIP: sanity-ec test_7c needs >= 6 OSTs SKIP 7c (4s) == sanity-ec test 7d: mirror split -d works with mixed regular and EC mirrors ========================================================== 13:09:57 (1790096997) SKIP: sanity-ec test_7d needs >= 6 OSTs SKIP 7d (5s) == sanity-ec test 7e: split data mirror -d co-splits its EC parity mirror ========================================================== 13:10:02 (1790097002) SKIP: sanity-ec test_7e needs >= 6 OSTs SKIP 7e (5s) == sanity-ec test 7f: mirror delete of a parity mirror warns only if redundancy lost ========================================================== 13:10:07 (1790097007) SKIP: sanity-ec test_7f needs >= 6 OSTs SKIP 7f (4s) == sanity-ec test 7g: split data mirror -f co-splits its EC parity mirror to victim ========================================================== 13:10:11 (1790097011) SKIP: sanity-ec test_7g needs >= 6 OSTs SKIP 7g (4s) == sanity-ec test 7h: split of a stale EC data mirror leaves a usable victim ========================================================== 13:10:15 (1790097015) SKIP: sanity-ec test_7h needs >= 6 OSTs SKIP 7h (3s) == sanity-ec test 7i: split resyncs when only parity mirrors are non-stale ========================================================== 13:10:19 (1790097019) SKIP: sanity-ec test_7i needs >= 6 OSTs SKIP 7i (4s) == sanity-ec test 10: cannot create overly large ec mirrors ========================================================== 13:10:22 (1790097022) SKIP: sanity-ec test_10 needs >= 5 OSTs SKIP 10 (4s) == sanity-ec test 11: can create --ec 2+2 ================ 13:10:26 (1790097026) SKIP: sanity-ec test_11 needs >= 4 OSTs SKIP 11 (4s) SKIP: sanity-ec test_12a skipping ALWAYS excluded test 12a == sanity-ec test 12b: resync huge sparse file (10 TiB) == 13:10:32 (1790097032) SKIP: sanity-ec test_12b needs >= 3 OSTs SKIP 12b (4s) == sanity-ec test 12c: resync skips holed stripe sets ==== 13:10:36 (1790097036) SKIP: sanity-ec test_12c needs >= 6 OSTs SKIP 12c (4s) == sanity-ec test 12d: resync skips holed raidsets ======= 13:10:40 (1790097040) SKIP: sanity-ec test_12d needs >= 6 OSTs SKIP 12d (4s) == sanity-ec test 12e: overlapping data holes punch parity gap verify ========================================================== 13:10:44 (1790097044) SKIP: sanity-ec test_12e needs >= 3 OSTs SKIP 12e (4s) == sanity-ec test 12f: short write resync parity spans [0, 4k) verify ========================================================== 13:10:48 (1790097048) SKIP: sanity-ec test_12f needs >= 3 OSTs SKIP 12f (5s) == sanity-ec test 12g: lfs mirror resync --stats for EC parity ========================================================== 13:10:53 (1790097053) SKIP: sanity-ec test_12g needs >= 3 OSTs SKIP 12g (5s) == sanity-ec test 12h: lfs mirror resync -W for EC parity ========================================================== 13:10:58 (1790097058) SKIP: sanity-ec test_12h needs >= 3 OSTs SKIP 12h (4s) == sanity-ec test 13: parity of single stripe data is just a copy ========================================================== 13:11:02 (1790097062) SKIP: sanity-ec test_13 needs >= 4 OSTs SKIP 13 (4s) == sanity-ec test 20: test that stripe size of parity mirror is set correctly ========================================================== 13:11:06 (1790097066) SKIP: sanity-ec test_20 needs >= 4 OSTs SKIP 20 (4s) == sanity-ec test 21a: migrate plain file to EC layout === 13:11:11 (1790097071) SKIP: sanity-ec test_21a needs >= 3 OSTs SKIP 21a (4s) == sanity-ec test 21b: migrate EC file to plain layout === 13:11:14 (1790097074) SKIP: sanity-ec test_21b needs >= 3 OSTs SKIP 21b (4s) == sanity-ec test 21c: migrate between different EC configurations ========================================================== 13:11:18 (1790097078) SKIP: sanity-ec test_21c needs >= 4 OSTs SKIP 21c (4s) == sanity-ec test 21d: migrate PFL file to EC layout ===== 13:11:22 (1790097082) SKIP: sanity-ec test_21d needs >= 3 OSTs SKIP 21d (4s) == sanity-ec test 22a: mirror split removes plain mirror, keeps EC ========================================================== 13:11:27 (1790097087) SKIP: sanity-ec test_22a needs >= 6 OSTs SKIP 22a (4s) == sanity-ec test 23a: truncate EC file to smaller size == 13:11:30 (1790097090) SKIP: sanity-ec test_23a needs >= 3 OSTs for EC SKIP 23a (4s) == sanity-ec test 23b: truncate EC file to larger size === 13:11:34 (1790097094) SKIP: sanity-ec test_23b needs >= 3 OSTs for EC SKIP 23b (4s) == sanity-ec test 23c: fallocate on EC file ============== 13:11:38 (1790097098) SKIP: sanity-ec test_23c needs >= 3 OSTs for EC SKIP 23c (3s) == sanity-ec test 24a: reject --ec with --comp-add ======= 13:11:41 (1790097101) SKIP: sanity-ec test_24a needs >= 3 OSTs for EC SKIP 24a (4s) == sanity-ec test 24b: reject deleting data component protected by parity ========================================================== 13:11:45 (1790097105) SKIP: sanity-ec test_24b needs >= 3 OSTs for EC SKIP 24b (3s) == sanity-ec test 25a: lfs find with --component-flags parity ========================================================== 13:11:49 (1790097109) SKIP: sanity-ec test_25a needs >= 3 OSTs for EC SKIP 25a (3s) == sanity-ec test 26a: multi-stripe EC data integrity with 20M file ========================================================== 13:11:52 (1790097112) SKIP: sanity-ec test_26a needs >= 3 OSTs for EC SKIP 26a (3s) == sanity-ec test 26b: EC data integrity with patterned data and 4M stripes ========================================================== 13:11:55 (1790097115) SKIP: sanity-ec test_26b needs >= 3 OSTs for EC SKIP 26b (4s) == sanity-ec test 27a: PFL lazy instantiation with EC across multiple components ========================================================== 13:11:59 (1790097119) SKIP: sanity-ec test_27a needs >= 5 OSTs SKIP 27a (3s) == sanity-ec test 27b: test we can create -c n --ec 4+2 with n OSTs ========================================================== 13:12:02 (1790097122) SKIP: sanity-ec test_27b needs >= 6 OSTs SKIP 27b (3s) == sanity-ec test 27c: test creating with n+2 OSTs ======= 13:12:05 (1790097125) SKIP: sanity-ec test_27c needs >= 6 OSTs SKIP 27c (4s) == sanity-ec test 27d: test raidset OSTs allocations are valid for -C 8 --ec 4+2 ========================================================== 13:12:09 (1790097129) SKIP: sanity-ec test_27d needs >= 6 OSTs SKIP 27d (4s) == sanity-ec test 27e: test raidset OSTs allocations are valid for -C 13 --ec 5+2 ========================================================== 13:12:13 (1790097133) SKIP: sanity-ec test_27e needs >= 7 OSTs SKIP 27e (3s) == sanity-ec test 27f: test raidset OSTs allocations are valid for -C 20 --ec 5+2 ========================================================== 13:12:16 (1790097136) SKIP: sanity-ec test_27f needs >= 7 OSTs SKIP 27f (4s) == sanity-ec test 27g: test we can create -c (n-2) --ec (n-2)+2 with n OSTs ========================================================== 13:12:20 (1790097140) SKIP: sanity-ec test_27g needs >= 4 OSTs SKIP 27g (4s) == sanity-ec test 27h: test stripe creation fails when parity needs one stripe too many ========================================================== 13:12:24 (1790097144) SKIP: sanity-ec test_27h needs >= 5 OSTs SKIP 27h (4s) == sanity-ec test 28a: EC parity correctly tracks writes through hardlinks ========================================================== 13:12:28 (1790097148) SKIP: sanity-ec test_28a needs >= 3 OSTs for EC SKIP 28a (4s) == sanity-ec test 29a: EC read fails when OST losses exceed parity tolerance ========================================================== 13:12:32 (1790097152) SKIP: sanity-ec test_29a need >= 4 OSTs SKIP 29a (4s) == sanity-ec test 30a: write makes parity stale, resync recovers ========================================================== 13:12:36 (1790097156) SKIP: sanity-ec test_30a need >= 4 OSTs SKIP 30a (4s) == sanity-ec test 30b: resync succeeds after parity OST recovery ========================================================== 13:12:41 (1790097161) SKIP: sanity-ec test_30b need >= 4 OSTs SKIP 30b (4s) == sanity-ec test 30c: data survives OST restart cycle, resync works after recovery ========================================================== 13:12:44 (1790097164) SKIP: sanity-ec test_30c need >= 4 OSTs SKIP 30c (3s) == sanity-ec test 30d: test that size of parity mirror is 11*4*64k ========================================================== 13:12:47 (1790097167) SKIP: sanity-ec test_30d needs >= 4 OSTs SKIP 30d (4s) == sanity-ec test 31a: data mirror intact after write failure on parity OST during resync ========================================================== 13:12:51 (1790097171) SKIP: sanity-ec test_31a need >= 4 OSTs SKIP 31a (3s) == sanity-ec test 31b: test that size of parity mirror is 1*2*1M ========================================================== 13:12:54 (1790097174) SKIP: sanity-ec test_31b needs >= 6 OSTs SKIP 31b (4s) == sanity-ec test 31c: test that size of parity mirror is 1*2*64k ========================================================== 13:12:59 (1790097179) SKIP: sanity-ec test_31c needs >= 6 OSTs SKIP 31c (4s) == sanity-ec test 31d: test that size of parity mirror is 2*2*64k ========================================================== 13:13:03 (1790097183) SKIP: sanity-ec test_31d needs >= 4 OSTs SKIP 31d (4s) == sanity-ec test 31e: test parity mirror size with multiple PFL components ========================================================== 13:13:07 (1790097187) SKIP: sanity-ec test_31e needs >= 6 OSTs SKIP 31e (3s) == sanity-ec test 31f: test getstripe EC raidset map ===== 13:13:10 (1790097190) SKIP: sanity-ec test_31f needs >= 8 OSTs SKIP 31f (4s) == sanity-ec test 31g: test getstripe --ec-map empty and uninstantiated ========================================================== 13:13:14 (1790097194) SKIP: sanity-ec test_31g needs >= 6 OSTs SKIP 31g (4s) == sanity-ec test 32a: full write+resync cycle correct after OST recovery ========================================================== 13:13:18 (1790097198) SKIP: sanity-ec test_32a need >= 4 OSTs SKIP 32a (4s) == sanity-ec test 33a: EC survives repeated write/resync/OST-failure cycles ========================================================== 13:13:22 (1790097202) SKIP: sanity-ec test_33a need >= 4 OSTs SKIP 33a (4s) == sanity-ec test 34a: test that lfs mirror read from ec does not change eof ========================================================== 13:13:26 (1790097206) SKIP: sanity-ec test_34a needs >= 5 OSTs SKIP 34a (3s) == sanity-ec test 34b: test that lfs mirror verify for ec does not change eof ========================================================== 13:13:30 (1790097210) SKIP: sanity-ec test_34b needs >= 6 OSTs SKIP 34b (3s) == sanity-ec test 34c: test that reading past parity data returns zeros ========================================================== 13:13:33 (1790097213) SKIP: sanity-ec test_34c needs >= 8 OSTs SKIP 34c (4s) == sanity-ec test 40a: test recovery read ================ 13:13:37 (1790097217) SKIP: sanity-ec test_40a needs >= 3 OSTs for EC rebuild SKIP 40a (3s) == sanity-ec test 40b: test recovery read with 2+1 EC ==== 13:13:41 (1790097221) SKIP: sanity-ec test_40b needs >= 3 OSTs for 2+1 SKIP 40b (3s) == sanity-ec test 40c: test recovery read with 2+2 EC ==== 13:13:44 (1790097224) SKIP: sanity-ec test_40c needs >= 4 OSTs for 2+2 SKIP 40c (4s) == sanity-ec test 40d: test recovery read with 4+1 EC ==== 13:13:48 (1790097228) SKIP: sanity-ec test_40d needs >= 5 OSTs for 4+1 SKIP 40d (4s) == sanity-ec test 41a: test partial reads with recovery == 13:13:53 (1790097233) SKIP: sanity-ec test_41a needs >= 6 OSTs SKIP 41a (4s) == sanity-ec test 41b: test reads spanning multiple raid sets with recovery ========================================================== 13:13:57 (1790097237) SKIP: sanity-ec test_41b needs >= 6 OSTs SKIP 41b (4s) == sanity-ec test 41c: test reads at different offsets with recovery ========================================================== 13:14:01 (1790097241) SKIP: sanity-ec test_41c needs >= 6 OSTs SKIP 41c (4s) SKIP: sanity-ec test_41d skipping ALWAYS excluded test 41d == sanity-ec test 41e: test Direct I/O reads with recovery ========================================================== 13:14:07 (1790097247) SKIP: sanity-ec test_41e needs >= 6 OSTs SKIP 41e (4s) == sanity-ec test 41f: test DIO read recovery after buffered write ========================================================== 13:14:11 (1790097251) SKIP: sanity-ec test_41f needs >= 6 OSTs SKIP 41f (4s) == sanity-ec test 41g: test DIO recovery with 2+1 EC ===== 13:14:15 (1790097255) SKIP: sanity-ec test_41g needs >= 8 OSTs SKIP 41g (4s) == sanity-ec test 41h: test DIO recovery spanning multiple raid sets ========================================================== 13:14:19 (1790097259) SKIP: sanity-ec test_41h needs >= 6 OSTs SKIP 41h (3s) == sanity-ec test 41i: test DIO vs buffered recovery on same file ========================================================== 13:14:22 (1790097262) SKIP: sanity-ec test_41i needs >= 6 OSTs SKIP 41i (4s) SKIP: sanity-ec test_41j skipping ALWAYS excluded test 41j SKIP: sanity-ec test_41k skipping ALWAYS excluded test 41k SKIP: sanity-ec test_41l skipping ALWAYS excluded test 41l SKIP: sanity-ec test_41m skipping ALWAYS excluded test 41m SKIP: sanity-ec test_41n skipping ALWAYS excluded test 41n == sanity-ec test 42a: test recovery with file smaller than stripe size ========================================================== 13:14:34 (1790097274) SKIP: sanity-ec test_42a needs >= 6 OSTs SKIP 42a (4s) == sanity-ec test 42b: test recovery with partial stripes ========================================================== 13:14:38 (1790097278) SKIP: sanity-ec test_42b needs >= 6 OSTs SKIP 42b (4s) == sanity-ec test 42c: test recovery with incomplete raid set ========================================================== 13:14:42 (1790097282) SKIP: sanity-ec test_42c needs >= 6 OSTs SKIP 42c (4s) == sanity-ec test 42d: test recovery at PFL component boundaries ========================================================== 13:14:47 (1790097287) SKIP: sanity-ec test_42d needs >= 6 OSTs SKIP 42d (3s) == sanity-ec test 43a: test recovery with single OST failure (1 of 6 OSTs) ========================================================== 13:14:50 (1790097290) SKIP: sanity-ec test_43a needs >= 6 OSTs SKIP 43a (4s) == sanity-ec test 43b: test recovery at maximum (2 OST failures with 4+2 EC) ========================================================== 13:14:54 (1790097294) SKIP: sanity-ec test_43b needs >= 6 OSTs SKIP 43b (4s) == sanity-ec test 43c: test graceful failure with too many OST failures (3+ OSTs) ========================================================== 13:14:58 (1790097298) SKIP: sanity-ec test_43c needs >= 6 OSTs SKIP 43c (4s) == sanity-ec test 43d: test progressive failures (fail 1, verify, fail 2nd, verify) ========================================================== 13:15:02 (1790097302) SKIP: sanity-ec test_43d needs >= 6 OSTs SKIP 43d (3s) == sanity-ec test 44a: test error handling with too many OST failures ========================================================== 13:15:05 (1790097305) SKIP: sanity-ec test_44a needs >= 6 OSTs SKIP 44a (4s) == sanity-ec test 44b: test repeated recovery with read fault injection ========================================================== 13:15:10 (1790097310) SKIP: sanity-ec test_44b needs >= 6 OSTs SKIP 44b (4s) == sanity-ec test 44c: test error handling with read failures during recovery ========================================================== 13:15:14 (1790097314) SKIP: sanity-ec test_44c needs >= 6 OSTs SKIP 44c (3s) == sanity-ec test 45a: test recovery with consecutive OST failures (OST0 and OST1) ========================================================== 13:15:18 (1790097318) SKIP: sanity-ec test_45a needs >= 6 OSTs SKIP 45a (3s) == sanity-ec test 45b: test recovery with non-consecutive OST failures (OST0 and OST3) ========================================================== 13:15:22 (1790097322) SKIP: sanity-ec test_45b needs >= 6 OSTs SKIP 45b (3s) == sanity-ec test 45c: test recovery with only parity OSTs failed (transparent) ========================================================== 13:15:25 (1790097325) SKIP: sanity-ec test_45c needs >= 6 OSTs SKIP 45c (3s) == sanity-ec test 45d: test recovery with specific data OST failures (OST0 and OST2) ========================================================== 13:15:28 (1790097328) SKIP: sanity-ec test_45d needs >= 6 OSTs SKIP 45d (4s) == sanity-ec test 46a: test EC recovery with 64K stripe size ========================================================== 13:15:32 (1790097332) SKIP: sanity-ec test_46a needs >= 6 OSTs SKIP 46a (4s) == sanity-ec test 46b: test EC recovery with 256K stripe size ========================================================== 13:15:36 (1790097336) SKIP: sanity-ec test_46b needs >= 6 OSTs SKIP 46b (4s) == sanity-ec test 46c: test EC recovery with 4M stripe size ========================================================== 13:15:40 (1790097340) SKIP: sanity-ec test_46c needs >= 6 OSTs SKIP 46c (4s) == sanity-ec test 46d: test EC recovery with mixed stripe sizes in PFL layout ========================================================== 13:15:44 (1790097344) SKIP: sanity-ec test_46d needs >= 6 OSTs SKIP 46d (4s) == sanity-ec test 47a: test EC recovery with multiple EC components in PFL ========================================================== 13:15:48 (1790097348) SKIP: sanity-ec test_47a needs >= 6 OSTs SKIP 47a (4s) == sanity-ec test 47b: test EC recovery with EC and non-EC components in PFL ========================================================== 13:15:53 (1790097353) SKIP: sanity-ec test_47b needs >= 6 OSTs SKIP 47b (5s) == sanity-ec test 47c: test EC recovery with different stripe sizes per PFL component ========================================================== 13:15:57 (1790097357) SKIP: sanity-ec test_47c needs >= 6 OSTs SKIP 47c (4s) == sanity-ec test 47d: test EC recovery with reads spanning PFL component boundaries ========================================================== 13:16:01 (1790097361) SKIP: sanity-ec test_47d needs >= 6 OSTs SKIP 47d (4s) == sanity-ec test 48a: test recovery behavior with stale parity ========================================================== 13:16:06 (1790097366) SKIP: sanity-ec test_48a needs >= 6 OSTs SKIP 48a (4s) == sanity-ec test 48b: test recovery with partially stale parity ========================================================== 13:16:10 (1790097370) SKIP: sanity-ec test_48b needs >= 6 OSTs SKIP 48b (5s) == sanity-ec test 48c: test recovery after overwrite without resync ========================================================== 13:16:14 (1790097374) SKIP: sanity-ec test_48c needs >= 6 OSTs SKIP 48c (4s) == sanity-ec test 49a: test concurrent reads during EC recovery ========================================================== 13:16:19 (1790097379) SKIP: sanity-ec test_49a needs >= 6 OSTs SKIP 49a (3s) == sanity-ec test 49b: test writes to other files during EC recovery ========================================================== 13:16:22 (1790097382) SKIP: sanity-ec test_49b needs >= 6 OSTs SKIP 49b (4s) == sanity-ec test 49c: test mirror resync during EC recovery ========================================================== 13:16:27 (1790097387) SKIP: sanity-ec test_49c needs >= 6 OSTs SKIP 49c (4s) == sanity-ec test 49d: test OST reactivation during EC recovery ========================================================== 13:16:31 (1790097391) SKIP: sanity-ec test_49d needs >= 6 OSTs SKIP 49d (4s) == sanity-ec test 50a: test both mounts read same EC file during recovery ========================================================== 13:16:34 (1790097394) SKIP: sanity-ec test_50a needs >= 6 OSTs SKIP 50a (4s) == sanity-ec test 50b: test interleaved partial reads from both mounts during recovery ========================================================== 13:16:38 (1790097398) SKIP: sanity-ec test_50b needs >= 6 OSTs SKIP 50b (3s) == sanity-ec test 51a: test EC recovery with EOF inside RAID / stripe sets ========================================================== 13:16:42 (1790097402) SKIP: sanity-ec test_51a needs >= 8 OSTs SKIP 51a (4s) == sanity-ec test 52a: test EC recovery at max degradation (pcount data OSTs down) ========================================================== 13:16:46 (1790097406) SKIP: sanity-ec test_52a needs >= 8 OSTs SKIP 52a (4s) == sanity-ec test 52b: test EC over-degradation (pcount+1 data OSTs down) ========================================================== 13:16:50 (1790097410) SKIP: sanity-ec test_52b needs >= 8 OSTs SKIP 52b (4s) == sanity-ec test 52c: test EC recovery with mixed parity and data OST failure ========================================================== 13:16:54 (1790097414) SKIP: sanity-ec test_52c needs >= 8 OSTs SKIP 52c (4s) SKIP: sanity-ec test_53a skipping ALWAYS excluded test 53a == sanity-ec test 55a: test EC recovery with tiny files (1 byte, one page) ========================================================== 13:17:00 (1790097420) SKIP: sanity-ec test_55a needs >= 8 OSTs SKIP 55a (4s) == sanity-ec test 58a: EC parity_used[] with 2-OST combos in 4+2 layout ========================================================== 13:17:04 (1790097424) SKIP: sanity-ec test_58a needs >= 8 OSTs SKIP 58a (5s) == sanity-ec test 58b: EC combined PFL 4+2 with 2 degraded + rotation ========================================================== 13:17:09 (1790097429) SKIP: sanity-ec test_58b needs >= 8 OSTs SKIP 58b (4s) == sanity-ec test 59a: EC recovery with sparse PFL file spanning components ========================================================== 13:17:13 (1790097433) SKIP: sanity-ec test_59a needs >= 8 OSTs SKIP 59a (4s) == sanity-ec test 60a: EC recovery after mid-stripe truncate ========================================================== 13:17:17 (1790097437) SKIP: sanity-ec test_60a needs >= 6 OSTs SKIP 60a (3s) == sanity-ec test 60b: EC recovery after stripe-boundary truncate ========================================================== 13:17:20 (1790097440) SKIP: sanity-ec test_60b needs >= 6 OSTs SKIP 60b (5s) == sanity-ec test 60c: EC recovery after truncate to zero and re-write ========================================================== 13:17:25 (1790097445) SKIP: sanity-ec test_60c needs >= 6 OSTs SKIP 60c (4s) == sanity-ec test 60d: EC recovery after PFL component-boundary truncate ========================================================== 13:17:29 (1790097449) SKIP: sanity-ec test_60d needs >= 6 OSTs SKIP 60d (4s) == sanity-ec test 61a: EC recovery with various sub-stripe file sizes ========================================================== 13:17:33 (1790097453) SKIP: sanity-ec test_61a needs >= 8 OSTs SKIP 61a (3s) == sanity-ec test 61b: EC recovery with sub-stripe files and 64K stripe ========================================================== 13:17:37 (1790097457) SKIP: sanity-ec test_61b needs >= 8 OSTs SKIP 61b (4s) == sanity-ec test 61c: EC recovery sub-stripe file in PFL with 64K stripes ========================================================== 13:17:40 (1790097460) SKIP: sanity-ec test_61c needs >= 8 OSTs SKIP 61c (4s) == sanity-ec test 61d: EC recovery sub-stripe file with 2 OST failures ========================================================== 13:17:44 (1790097464) SKIP: sanity-ec test_61d needs >= 8 OSTs SKIP 61d (4s) == sanity-ec test 62a: EC recovery after multiple append writes ========================================================== 13:17:48 (1790097468) SKIP: sanity-ec test_62a needs >= 8 OSTs SKIP 62a (4s) == sanity-ec test 62b: EC recovery after unaligned append writes ========================================================== 13:17:52 (1790097472) SKIP: sanity-ec test_62b needs >= 8 OSTs SKIP 62b (4s) == sanity-ec test 62c: EC recovery after append crossing PFL boundary ========================================================== 13:17:56 (1790097476) SKIP: sanity-ec test_62c needs >= 8 OSTs SKIP 62c (4s) == sanity-ec test 62d: EC recovery after many sub-stripe appends ========================================================== 13:18:00 (1790097480) SKIP: sanity-ec test_62d needs >= 8 OSTs SKIP 62d (3s) == sanity-ec test 63a: EC recovery cycling through each data OST ========================================================== 13:18:04 (1790097484) SKIP: sanity-ec test_63a needs >= 8 OSTs SKIP 63a (3s) == sanity-ec test 63b: EC recovery cycling all 2-OST failure pairs ========================================================== 13:18:07 (1790097487) SKIP: sanity-ec test_63b needs >= 8 OSTs SKIP 63b (4s) == sanity-ec test 63c: EC recovery with progressive failure and partial recovery ========================================================== 13:18:11 (1790097491) SKIP: sanity-ec test_63c needs >= 8 OSTs SKIP 63c (4s) == sanity-ec test 63d: EC recovery cycling OSTs with PFL layout ========================================================== 13:18:16 (1790097496) SKIP: sanity-ec test_63d needs >= 8 OSTs SKIP 63d (4s) == sanity-ec test 64a: mount2 EC recovery after mount1 write+resync cycles ========================================================== 13:18:20 (1790097500) SKIP: sanity-ec test_64a needs >= 8 OSTs SKIP 64a (4s) == sanity-ec test 64b: EC stale-parity read returns current data or fails ========================================================== 13:18:24 (1790097504) SKIP: sanity-ec test_64b needs >= 8 OSTs SKIP 64b (3s) == sanity-ec test 64c: EC recovery stability across write+resync iterations ========================================================== 13:18:28 (1790097508) SKIP: sanity-ec test_64c needs >= 8 OSTs SKIP 64c (3s) == sanity-ec test 64d: EC recovery after multi-mount append ========================================================== 13:18:31 (1790097511) SKIP: sanity-ec test_64d needs >= 8 OSTs SKIP 64d (3s) == sanity-ec test 65a: EC recovery with 3-component PFL layout ========================================================== 13:18:35 (1790097515) SKIP: sanity-ec test_65a needs >= 8 OSTs SKIP 65a (3s) == sanity-ec test 65b: EC recovery with 4-component PFL layout ========================================================== 13:18:38 (1790097518) SKIP: sanity-ec test_65b needs >= 8 OSTs SKIP 65b (4s) == sanity-ec test 65c: EC recovery with sparse 3-component PFL layout ========================================================== 13:18:42 (1790097522) SKIP: sanity-ec test_65c needs >= 8 OSTs SKIP 65c (4s) == sanity-ec test 65d: EC recovery with 3-comp PFL and 2 OST failures ========================================================== 13:18:46 (1790097526) SKIP: sanity-ec test_65d needs >= 8 OSTs SKIP 65d (3s) == sanity-ec test 66a: EC recovery with two EC data mirrors ========================================================== 13:18:50 (1790097530) SKIP: sanity-ec test_66a needs >= 8 OSTs SKIP 66a (3s) == sanity-ec test 66b: EC recovery with mixed regular and EC mirrors ========================================================== 13:18:53 (1790097533) SKIP: sanity-ec test_66b needs >= 8 OSTs SKIP 66b (3s) == sanity-ec test 66c: EC recovery with two different EC configs ========================================================== 13:18:56 (1790097536) SKIP: sanity-ec test_66c needs >= 8 OSTs SKIP 66c (3s) == sanity-ec test 66d: EC recovery with two EC mirrors and 2 OST failures ========================================================== 13:18:59 (1790097539) SKIP: sanity-ec test_66d needs >= 8 OSTs SKIP 66d (3s) == sanity-ec test 67a: EC write to available stripes with one OST unreadable ========================================================== 13:19:02 (1790097542) SKIP: sanity-ec test_67a needs >= 8 OSTs SKIP 67a (3s) == sanity-ec test 67b: EC recovery after multiple rewrite+resync cycles ========================================================== 13:19:05 (1790097545) SKIP: sanity-ec test_67b needs >= 8 OSTs SKIP 67b (3s) == sanity-ec test 67c: EC recovery after partial overwrite of PFL component ========================================================== 13:19:09 (1790097549) SKIP: sanity-ec test_67c needs >= 8 OSTs SKIP 67c (3s) == sanity-ec test 67d: EC recovery after partial overwrite with 1 and 2 OST failures ========================================================== 13:19:12 (1790097552) SKIP: sanity-ec test_67d needs >= 8 OSTs SKIP 67d (4s) == sanity-ec test 68a: EC 2+1 recovery cycling all safe data OSTs ========================================================== 13:19:16 (1790097556) SKIP: sanity-ec test_68a needs >= 8 OSTs SKIP 68a (4s) == sanity-ec test 68b: EC 2+2 recovery with all 2-OST failure pairs ========================================================== 13:19:20 (1790097560) SKIP: sanity-ec test_68b needs >= 8 OSTs SKIP 68b (3s) == sanity-ec test 68c: EC 4+1 recovery cycling all safe data OSTs ========================================================== 13:19:23 (1790097563) SKIP: sanity-ec test_68c needs >= 8 OSTs SKIP 68c (3s) == sanity-ec test 68d: EC recovery with mixed 2+1 and 4+2 PFL components ========================================================== 13:19:26 (1790097566) SKIP: sanity-ec test_68d needs >= 8 OSTs SKIP 68d (4s) == sanity-ec test 69a: EC recovery after O_DIRECT writes ========================================================== 13:19:30 (1790097570) SKIP: sanity-ec test_69a needs >= 8 OSTs SKIP 69a (4s) == sanity-ec test 69b: EC recovery after O_DIRECT write with 2 OST failures ========================================================== 13:19:34 (1790097574) SKIP: sanity-ec test_69b needs >= 8 OSTs SKIP 69b (3s) == sanity-ec test 69c: EC recovery after buffered write then O_DIRECT overwrite ========================================================== 13:19:37 (1790097577) SKIP: sanity-ec test_69c needs >= 8 OSTs SKIP 69c (3s) == sanity-ec test 69d: EC recovery after O_DIRECT write to PFL layout ========================================================== 13:19:40 (1790097580) SKIP: sanity-ec test_69d needs >= 8 OSTs SKIP 69d (3s) == sanity-ec test 70a: EC recovery after mid-file overwrite ========================================================== 13:19:43 (1790097583) SKIP: sanity-ec test_70a needs >= 8 OSTs SKIP 70a (4s) == sanity-ec test 70b: EC recovery after non-stripe-aligned overwrite ========================================================== 13:19:47 (1790097587) SKIP: sanity-ec test_70b needs >= 8 OSTs SKIP 70b (4s) == sanity-ec test 70c: EC recovery after extend then re-overwrite original data ========================================================== 13:19:51 (1790097591) SKIP: sanity-ec test_70c needs >= 8 OSTs SKIP 70c (4s) == sanity-ec test 70d: EC recovery after overwriting only PFL comp2 ========================================================== 13:19:55 (1790097595) SKIP: sanity-ec test_70d needs >= 8 OSTs SKIP 70d (3s) == sanity-ec test 71a: EC batch recovery: 8 files with 1 OST failure ========================================================== 13:19:59 (1790097599) SKIP: sanity-ec test_71a needs >= 8 OSTs SKIP 71a (4s) == sanity-ec test 71b: EC batch recovery: mixed geometries with 1 OST failure ========================================================== 13:20:03 (1790097603) SKIP: sanity-ec test_71b needs >= 8 OSTs SKIP 71b (4s) == sanity-ec test 71c: EC batch recovery: 5 varied files with 2 OST failures ========================================================== 13:20:08 (1790097608) SKIP: sanity-ec test_71c needs >= 8 OSTs SKIP 71c (4s) == sanity-ec test 71d: EC batch recovery: plain and PFL files cycling OSTs ========================================================== 13:20:11 (1790097611) SKIP: sanity-ec test_71d needs >= 8 OSTs SKIP 71d (4s) == sanity-ec test 73a: EC random/non-sequential reads during recovery ========================================================== 13:20:15 (1790097615) SKIP: sanity-ec test_73a needs >= 8 OSTs SKIP 73a (4s) == sanity-ec test 73b: EC recovery after fallocate ======= 13:20:20 (1790097620) SKIP: sanity-ec test_73b needs >= 8 OSTs SKIP 73b (3s) == sanity-ec test 73c: EC truncate-then-extend recovery == 13:20:23 (1790097623) SKIP: sanity-ec test_73c needs >= 8 OSTs SKIP 73c (4s) == sanity-ec test 73d: EC O_APPEND during degraded mode == 13:20:27 (1790097627) SKIP: sanity-ec test_73d needs >= 8 OSTs SKIP 73d (3s) == sanity-ec test 73e: EC large file recovery (128M) ===== 13:20:31 (1790097631) SKIP: sanity-ec test_73e needs >= 8 OSTs SKIP 73e (4s) == sanity-ec test 74a: EC reads racing with OST deactivation ========================================================== 13:20:34 (1790097634) SKIP: sanity-ec test_74a needs >= 8 OSTs SKIP 74a (4s) == sanity-ec test 75a: EC stat/getattr during degraded mode ========================================================== 13:20:38 (1790097638) SKIP: sanity-ec test_75a needs >= 6 OSTs SKIP 75a (4s) == sanity-ec test 75b: EC stress/repeatability degraded read loop ========================================================== 13:20:42 (1790097642) SKIP: sanity-ec test_75b needs >= 6 OSTs SKIP 75b (3s) == sanity-ec test 75c: EC stripe rotation collision in PFL ========================================================== 13:20:46 (1790097646) SKIP: sanity-ec test_75c needs >= 8 OSTs SKIP 75c (3s) == sanity-ec test 75d: EC lfs mirror verify in degraded mode ========================================================== 13:20:50 (1790097650) SKIP: sanity-ec test_75d needs >= 6 OSTs SKIP 75d (4s) == sanity-ec test 75e: EC directory-inherited layout recovery ========================================================== 13:20:54 (1790097654) SKIP: sanity-ec test_75e needs >= 6 OSTs SKIP 75e (3s) == sanity-ec test 75f: EC stripe rotation across files === 13:20:57 (1790097657) SKIP: sanity-ec test_75f needs >= 6 OSTs SKIP 75f (4s) == sanity-ec test complete, duration 887 sec ============= 13:21:01 (1790097661) === sanity-ec: start cleanup 13:21:03 (1790097663) === === sanity-ec: finish cleanup 13:21:07 (1790097667) ===