-----============= acceptance-small: ost-pools ============----- Thu Oct 23 13:03:33 EDT 2025 oleg652-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/ost-pools.*ex': No such file or directory excepting tests: oleg652-client.virtnet: executing check_config_client /mnt/lustre oleg652-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg652-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8c7c4a058800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8c7c4a058800.idle_timeout=debug disable quota as required oleg652-server: oleg652-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 stripe_count: 1 stripe_size: 1048576 pattern: 0 stripe_offset: -1 == ost-pools test 1a: Create a pool with a 1 character pool name ========================================================== 13:04:07 (1761239047) oleg652-server: Pool lustre.p created lustre.p oleg652-server: Pool lustre.p destroyed PASS 1a (18s) == ost-pools test 1b: Create a pool with a 10 char pool name ========================================================== 13:04:25 (1761239065) oleg652-server: Pool lustre.testpool12 created lustre.testpool12 oleg652-server: Pool lustre.testpool12 destroyed PASS 1b (17s) == ost-pools test 1c: Create a pool with a 15 char pool name ========================================================== 13:04:43 (1761239083) oleg652-server: Pool lustre.testpool1234567 created lustre.testpool1234567 oleg652-server: Pool lustre.testpool1234567 destroyed PASS 1c (17s) == ost-pools test 1d: Create a pool with a 16 char pool name; should fail ========================================================== 13:04:59 (1761239099) oleg652-server: error: pool_new: either the pool or file system name is too long (max pool name len is 15 and file system name is 8) oleg652-server: pool_new: File name too long pdsh@oleg652-client: oleg652-server: ssh exited with exit code 36 PASS 1d (6s) == ost-pools test 1e: Create a pool with a 1000 char pool name; should fail ========================================================== 13:05:05 (1761239105) oleg652-server: error: pool_new: either the pool or file system name is too long (max pool name len is 15 and file system name is 8) oleg652-server: pool_new: File name too long pdsh@oleg652-client: oleg652-server: ssh exited with exit code 36 PASS 1e (5s) == ost-pools test 1f: pool_new should fail if fs-name is missing ========================================================== 13:05:10 (1761239110) oleg652-server: fsname is empty oleg652-server: argument .testpool must be . oleg652-server: pool_new: Invalid argument pdsh@oleg652-client: oleg652-server: ssh exited with exit code 22 PASS 1f (5s) == ost-pools test 1g: pool_new should fail if fs-name is missing ========================================================== 13:05:15 (1761239115) oleg652-server: . is missing in testpool oleg652-server: argument testpool must be . oleg652-server: pool_new: Invalid argument pdsh@oleg652-client: oleg652-server: ssh exited with exit code 22 PASS 1g (5s) == ost-pools test 1h: pool_new should fail if poolname is missing ========================================================== 13:05:20 (1761239120) oleg652-server: poolname is empty oleg652-server: argument lustre. must be . oleg652-server: pool_new: Invalid argument pdsh@oleg652-client: oleg652-server: ssh exited with exit code 22 PASS 1h (5s) == ost-pools test 1i: pool_new should fail if poolname and fs-name are missing ========================================================== 13:05:25 (1761239125) oleg652-server: fsname is empty oleg652-server: argument . must be . oleg652-server: pool_new: Invalid argument pdsh@oleg652-client: oleg652-server: ssh exited with exit code 22 PASS 1i (5s) == ost-pools test 1j: pool_new should fail if poolname format is wrong ========================================================== 13:05:30 (1761239130) oleg652-server: . is missing in lustre,testpool oleg652-server: argument lustre,testpool must be . oleg652-server: pool_new: Invalid argument pdsh@oleg652-client: oleg652-server: ssh exited with exit code 22 PASS 1j (5s) == ost-pools test 1k: pool_new should fail if poolname format is wrong ========================================================== 13:05:35 (1761239135) oleg652-server: . is missing in lustre/testpool oleg652-server: argument lustre/testpool must be . oleg652-server: pool_new: Invalid argument pdsh@oleg652-client: oleg652-server: ssh exited with exit code 22 PASS 1k (6s) == ost-pools test 1m: pool_new did not fail even though testpool2 existed ========================================================== 13:05:41 (1761239141) oleg652-server: Pool lustre.testpool2 created oleg652-server: Pool lustre.testpool2 already exists oleg652-server: pool_new: File exists pdsh@oleg652-client: oleg652-server: ssh exited with exit code 17 lustre.testpool2 oleg652-server: Pool lustre.testpool2 destroyed PASS 1m (17s) == ost-pools test 1n: Pool with a 15 char pool name works well ========================================================== 13:05:58 (1761239158) oleg652-server: Pool lustre.testpool1234567 created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool1234567 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 2.52241 s, 41.6 MB/s oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool1234567 Waiting 90s for '' lustre.testpool1234567 oleg652-server: Pool lustre.testpool1234567 destroyed PASS 1n (31s) == ost-pools test 2a: pool_add: non-existant pool testpool ========================================================== 13:06:29 (1761239189) PASS 2a (8s) == ost-pools test 2b: pool_add: Invalid pool name ======== 13:06:37 (1761239197) PASS 2b (6s) == ost-pools test 2c: pool_add: OST index combinations === 13:06:43 (1761239203) oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID added to pool lustre.testpool Waiting 90s for 'lustre-OST0000_UUID lustre-OST0001_UUID ' oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool lustre.testpool oleg652-server: Pool lustre.testpool destroyed PASS 2c (40s) == ost-pools test 2d: pool_add: OSTs that don't exist should be rejected ========================================================== 13:07:23 (1761239243) oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0002_UUID is not part of the 'lustre' fs. oleg652-server: pool_add: No such file or directory pdsh@oleg652-client: oleg652-server: ssh exited with exit code 2 lustre.testpool oleg652-server: Pool lustre.testpool destroyed PASS 2d (17s) == ost-pools test 2e: pool_add: OST already in a pool should be rejected ========================================================== 13:07:40 (1761239260) oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool pdsh@oleg652-client: oleg652-server: ssh exited with exit code 17 OST lustre-OST0000_UUID is already in pool lustre.testpool pool_add: File exists lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed PASS 2e (26s) == ost-pools test 3a: pool_remove: non-existant pool ===== 13:08:06 (1761239286) PASS 3a (6s) == ost-pools test 3b: pool_remove: non-existant fsname === 13:08:13 (1761239293) PASS 3b (7s) == ost-pools test 3c: pool_remove: Invalid pool name ===== 13:08:19 (1761239299) PASS 3c (5s) == ost-pools test 3d: pool_remove: OST index combinations ========================================================== 13:08:24 (1761239304) oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool Waiting 90s for '' oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool lustre.testpool oleg652-server: Pool lustre.testpool destroyed PASS 3d (38s) == ost-pools test 4a: pool_destroy: non-existant pool ==== 13:09:02 (1761239342) PASS 4a (5s) == ost-pools test 4b: pool_destroy: non-existant fs-name ========================================================== 13:09:07 (1761239347) PASS 4b (6s) == ost-pools test 4c: pool_destroy: non-empty pool ======= 13:09:13 (1761239353) oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: Pool lustre.testpool not empty, please remove all members oleg652-server: pool_destroy: Directory not empty pdsh@oleg652-client: oleg652-server: ssh exited with exit code 39 lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed PASS 4c (24s) == ost-pools test 5a: lfs pool_list from client ========== 13:09:37 (1761239377) oleg652-server: Pool lustre.testpool created oleg652-server: Pool lustre.testpool2 created Pools from lustre: lustre.testpool lustre.testpool2 oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID added to pool lustre.testpool Pool: lustre.testpool lustre-OST0000_UUID lustre-OST0001_UUID Pool: lustre.nonexistantpool /home/green/git/lustre-release/lustre/utils/lfs pool_list /mnt/lustre Pools from lustre: lustre.testpool lustre.testpool2 Pools from lustre: lustre.testpool lustre.testpool2 lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed lustre.testpool2 oleg652-server: Pool lustre.testpool2 destroyed PASS 5a (39s) == ost-pools test 5b: lctl pool_list from MDS ============ 13:10:16 (1761239416) oleg652-server: Pool lustre.testpool created oleg652-server: Pool lustre.testpool2 created Pools from lustre: lustre.testpool lustre.testpool2 oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID added to pool lustre.testpool Pool: lustre.testpool lustre-OST0000_UUID lustre-OST0001_UUID Pools from nonexistantfs: Pool: lustre.nonexistantpool Pools from /mnt/lustrenonexistant: lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed lustre.testpool2 oleg652-server: Pool lustre.testpool2 destroyed PASS 5b (44s) == ost-pools test 6: getstripe/setstripe ================= 13:11:00 (1761239460) oleg652-server: Pool lustre.testpool created Pools from lustre: lustre.testpool oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg652-server: Pool lustre.testpool2 created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool2 Destroy the created pools: testpool,testpool2 lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed lustre.testpool2 oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool2 oleg652-server: Pool lustre.testpool2 destroyed PASS 6 (51s) == ost-pools test 7a: create various pool name =========== 13:11:51 (1761239511) set poolname to 7 Creating new pool oleg652-server: Pool lustre.7 created Adding targets to pool oleg652-server: OST lustre-OST0000_UUID added to pool lustre.7 oleg652-server: OST lustre-OST0001_UUID added to pool lustre.7 oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.7 oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.7 oleg652-server: Pool lustre.7 destroyed set poolname to 786711642 Creating new pool oleg652-server: Pool lustre.786711642 created Adding targets to pool oleg652-server: OST lustre-OST0000_UUID added to pool lustre.786711642 oleg652-server: OST lustre-OST0001_UUID added to pool lustre.786711642 oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.786711642 oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.786711642 oleg652-server: Pool lustre.786711642 destroyed set poolname to 78672481222601 Creating new pool oleg652-server: Pool lustre.78672481222601 created Adding targets to pool oleg652-server: OST lustre-OST0000_UUID added to pool lustre.78672481222601 oleg652-server: OST lustre-OST0001_UUID added to pool lustre.78672481222601 oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.78672481222601 oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.78672481222601 oleg652-server: Pool lustre.78672481222601 destroyed Destroy the created pools: 7,786711642,78672481222601 Destroy the created pools: 7,786711642,78672481222601 Destroy the created pools: 7,786711642,78672481222601 PASS 7a (64s) == ost-pools test 7b: try to create pool name with invalid lengths or names ========================================================== 13:12:55 (1761239575) oleg652-server: . is missing in qwerty oleg652-server: argument qwerty must be . oleg652-server: pool_new: Invalid argument pdsh@oleg652-client: oleg652-server: ssh exited with exit code 22 oleg652-server: poolname is empty oleg652-server: argument lustre. must be . oleg652-server: pool_new: Invalid argument pdsh@oleg652-client: oleg652-server: ssh exited with exit code 22 oleg652-server: error: pool_new can contain only alphanumeric characters, underscores, and dashes besides the required '.' oleg652-server: pool_new: Invalid argument pdsh@oleg652-client: oleg652-server: ssh exited with exit code 22 oleg652-server: error: pool_new: either the pool or file system name is too long (max pool name len is 15 and file system name is 8) oleg652-server: pool_new: File name too long pdsh@oleg652-client: oleg652-server: ssh exited with exit code 36 PASS 7b (7s) == ost-pools test 7c: create a valid pool name and setstripe with a bad one ========================================================== 13:13:02 (1761239582) Creating new pool oleg652-server: Pool lustre.0123456789abcde created Adding targets to pool oleg652-server: OST lustre-OST0000_UUID added to pool lustre.0123456789abcde oleg652-server: OST lustre-OST0001_UUID added to pool lustre.0123456789abcde lfs setstripe: Invalid Poolname '0123456789abcdeX': Invalid argument (22) oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.0123456789abcde oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.0123456789abcde oleg652-server: Pool lustre.0123456789abcde destroyed Destroy the created pools: 0123456789abcde PASS 7c (22s) == ost-pools test 11: OSTs in overlapping/multiple pools ========================================================== 13:13:24 (1761239604) oleg652-server: Pool lustre.testpool created oleg652-server: Pool lustre.testpool2 created oleg652-server: OST lustre-OST0001_UUID added to pool lustre.testpool2 oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool total: 100 open/close in 1.40 seconds: 71.48 ops/second total: 100 open/close in 1.47 seconds: 67.82 ops/second Destroy the created pools: testpool,testpool2 lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed lustre.testpool2 oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool2 oleg652-server: Pool lustre.testpool2 destroyed PASS 11 (362s) == ost-pools test 12: OST Pool Membership ================ 13:19:26 (1761239966) SKIP: ost-pools test_12 needs >=3 OSTs SKIP 12 (2s) == ost-pools test 13: Striping characteristics in a pool ========================================================== 13:19:29 (1761239969) SKIP: ost-pools test_13 needs >= 3 OSTs SKIP 13 (2s) == ost-pools test 14: Round robin and QOS striping within a pool ========================================================== 13:19:31 (1761239971) SKIP: ost-pools test_14 needs >= 3 OSTs SKIP 14 (3s) == ost-pools test 15: One directory per OST/pool ========= 13:19:34 (1761239974) oleg652-server: Pool lustre.testpool0 created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool0 open(/mnt/lustre/d15.ost-pools/dir0/f15.ost-pools0) error: No space left on device total: 0 open/close in 20.31 seconds: 0.00 ops/second ost-pools test_15: @@@@@@ FAIL: createmany /mnt/lustre/d15.ost-pools/dir0/f15.ost-pools failed! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6459:error() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:923:test_15() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6817:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6864:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6705:run_test() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:934:main() Dumping lctl log to /tmp/testlogs//ost-pools.test_15.*.1761240006.log Destroy the created pools: testpool0 rsync: chown "/tmp/testlogs/.ost-pools.test_15.debug_log.oleg652-server.1761240006.log.Sba9Dy" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.ost-pools.test_15.dmesg.oleg652-server.1761240006.log.bPrjRr" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] lustre.testpool0 oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool0 oleg652-server: Pool lustre.testpool0 destroyed FAIL 15 (43s) == ost-pools test 16: Inheritance of pool properties ===== 13:20:22 (1761240022) oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool open(/mnt/lustre/d16.ost-pools/d16.ost-pools/dir1/dir2/dir3/dir4/dir5/dir6/dir7/dir8/dir9/dir10/f16.ost-pools0) error: No space left on device total: 0 open/close in 20.26 seconds: 0.00 ops/second ost-pools test_16: @@@@@@ FAIL: createmany /mnt/lustre/d16.ost-pools/d16.ost-pools/dir1/dir2/dir3/dir4/dir5/dir6/dir7/dir8/dir9/dir10/f16.ost-pools failed! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6459:error() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:954:test_16() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6817:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6864:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6705:run_test() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:964:main() Dumping lctl log to /tmp/testlogs//ost-pools.test_16.*.1761240056.log rsync: chown "/tmp/testlogs/.ost-pools.test_16.debug_log.oleg652-server.1761240056.log.N7LygV" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.ost-pools.test_16.dmesg.oleg652-server.1761240056.log.ASElR1" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] Destroy the created pools: testpool lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed FAIL 16 (42s) == ost-pools test 17: Referencing an empty pool ========== 13:21:09 (1761240069) oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID added to pool lustre.testpool - open/close 0 (time 1761240099.93 total 20.36 last 0.00) - open/close 1 (time 1761240120.41 total 40.84 last 0.05) - open/close 2 (time 1761240140.90 total 61.33 last 0.05) - open/close 3 (time 1761240161.38 total 81.80 last 0.05) - open/close 4 (time 1761240181.87 total 102.29 last 0.05) - open/close 5 (time 1761240202.34 total 122.76 last 0.05) - open/close 6 (time 1761240222.81 total 143.24 last 0.05) - open/close 7 (time 1761240243.29 total 163.71 last 0.05) - open/close 8 (time 1761240263.78 total 184.20 last 0.05) - open/close 9 (time 1761240284.25 total 204.67 last 0.05) total: 10 open/close in 204.67 seconds: 0.05 ops/second lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed - open/close 0 (time 1761240335.47 total 20.34 last 0.00) - open/close 1 (time 1761240355.93 total 40.80 last 0.05) - open/close 2 (time 1761240376.41 total 61.28 last 0.05) - open/close 3 (time 1761240396.90 total 81.77 last 0.05) - open/close 4 (time 1761240417.39 total 102.26 last 0.05) - open/close 5 (time 1761240437.87 total 122.74 last 0.05) - open/close 6 (time 1761240458.35 total 143.22 last 0.05) - open/close 7 (time 1761240478.81 total 163.68 last 0.05) - open/close 8 (time 1761240499.30 total 184.17 last 0.05) - open/close 9 (time 1761240519.78 total 204.65 last 0.05) total: 10 open/close in 204.65 seconds: 0.05 ops/second PASS 17 (455s) == ost-pools test 18: File create in a directory which references a deleted pool ========================================================== 13:28:45 (1761240525) Create performance, iteration 1, 15 seconds x 3 total: 886 open/close in 15.02 seconds: 59.00 ops/second iter 1: 886 creates without pool oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 810 open/close in 15.01 seconds: 53.97 ops/second iter 1: 810 creates with pool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed total: 935 open/close in 15.01 seconds: 62.29 ops/second iter 1: 935 creates with missing pool Create performance, iteration 2, 15 seconds x 3 total: 771 open/close in 15.01 seconds: 51.36 ops/second iter 2: 771 creates without pool oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 888 open/close in 15.01 seconds: 59.18 ops/second iter 2: 888 creates with pool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed total: 914 open/close in 15.00 seconds: 60.92 ops/second iter 2: 914 creates with missing pool Create performance, iteration 3, 15 seconds x 3 total: 930 open/close in 15.01 seconds: 61.97 ops/second iter 3: 930 creates without pool oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 839 open/close in 15.01 seconds: 55.91 ops/second iter 3: 839 creates with pool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed total: 794 open/close in 15.04 seconds: 52.80 ops/second iter 3: 794 creates with missing pool Avg files created in 15 seconds without pool: 862 Avg files created in 15 seconds with pool: 845 Avg files created in 15 seconds missing pool: 881 No pool / wide pool: 1 %. No pool / missing pool: -2 %. PASS 18 (457s) == ost-pools test 19: Pools should not come into play when not specified ========================================================== 13:36:22 (1761240982) oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool total: 12 open/close in 0.18 seconds: 66.13 ops/second total: 12 open/close in 0.31 seconds: 39.05 ops/second Destroy the created pools: testpool lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed PASS 19 (49s) == ost-pools test 20: Different pools in a directory hierarchy. ========================================================== 13:37:11 (1761241031) oleg652-server: Pool lustre.testpool created oleg652-server: Pool lustre.testpool2 created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID added to pool lustre.testpool2 touch: cannot touch '/mnt/lustre/d20.ost-pools/dir1/dir3/file3': No space left on device error: getstripe failed for /mnt/lustre/d20.ost-pools/dir1/dir3/file3. error: getstripe failed for /mnt/lustre/d20.ost-pools/dir1/dir3/file3. ost-pools test_20: @@@@@@ FAIL: file '/mnt/lustre/d20.ost-pools/dir1/dir3/file3' not in any pool Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6459:error() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:111:check_file_in_pool() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1143:test_20() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6817:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6864:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6705:run_test() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1152:main() Dumping lctl log to /tmp/testlogs//ost-pools.test_20.*.1761241082.log Destroy the created pools: testpool,testpool2 rsync: chown "/tmp/testlogs/.ost-pools.test_20.debug_log.oleg652-server.1761241082.log.YknOob" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.ost-pools.test_20.dmesg.oleg652-server.1761241082.log.dmmnus" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed lustre.testpool2 oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool2 oleg652-server: Pool lustre.testpool2 destroyed FAIL 20 (76s) == ost-pools test 21: OST pool with fewer OSTs than stripe count ========================================================== 13:38:34 (1761241114) oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool lfs setstripe: setstripe error for '/mnt/lustre/d21.ost-pools/dir/file1': No space left on device ost-pools test_21: @@@@@@ FAIL: /home/green/git/lustre-release/lustre/utils/lfs setstripe -p testpool /mnt/lustre/d21.ost-pools/dir/file1 failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6459:error() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:78:create_file() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1167:test_21() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6817:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6864:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6705:run_test() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1175:main() Dumping lctl log to /tmp/testlogs//ost-pools.test_21.*.1761241150.log rsync: chown "/tmp/testlogs/.ost-pools.test_21.debug_log.oleg652-server.1761241150.log.hJvTjs" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.ost-pools.test_21.dmesg.oleg652-server.1761241150.log.Zxy0Sk" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] Destroy the created pools: testpool lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed FAIL 21 (48s) == ost-pools test 22: Simultaneous manipulation of a pool ========================================================== 13:39:28 (1761241168) oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: Pool lustre.testpool2 created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool2 loop for testpool loop for testpool2 Pool testpool, iteration 1 Pool testpool2, iteration 1 Pool testpool2, iteration 2 Pool testpool2, iteration 3 Pool testpool2, iteration 4 Pool testpool2, iteration 5 Pool testpool2, iteration 6 Pool testpool2, iteration 7 Pool testpool2, iteration 8 Pool testpool2, iteration 9 Pool testpool2, iteration 10 oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 2 loop for testpool2 complete total: 100 open/close in 1.61 seconds: 62.25 ops/second oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 3 oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 4 oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 5 oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 6 oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 7 oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 8 oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 9 oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 10 oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool loop for testpool complete Destroy the created pools: testpool,testpool2 lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed lustre.testpool2 oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool2 oleg652-server: Pool lustre.testpool2 destroyed PASS 22 (83s) == ost-pools test 23a: OST pools and quota =============== 13:40:51 (1761241251) running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7867] oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool Disk quotas for usr 500 (uid 500): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre/d23a.ost-pools/dir 0 3072 3072 - 0 0 0 - lustre-MDT0000_UUID 0 - 0 - 0 - 0 - lustre-MDT0001_UUID 0 - 0 - 0 - 0 - lustre-OST0000_UUID 0 - 0 - - - - - lustre-OST0001_UUID 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 uid 500 is using default file quota setting -rw-r--r-- 1 sanityusr sanityusr 0 Oct 23 13:41 /mnt/lustre/d23a.ost-pools/dir/f23a.ost-pools-quota first dd failed with EDQUOT. Disk quotas for usr 500 (uid 500): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre/d23a.ost-pools/dir 2 3072 3072 - 1 0 0 - lustre-MDT0000_UUID 2 - 0 - 1 - 0 - lustre-MDT0001_UUID 0 - 0 - 0 - 0 - lustre-OST0000_UUID 0 - 2048 - - - - - lustre-OST0001_UUID 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 2048 uid 500 is using default file quota setting Destroy the created pools: testpool lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed PASS 23a (33s) == ost-pools test 23b: OST pools and OOS ================= 13:41:24 (1761241284) running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7867] oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool OSTCOUNT=2, OSTSIZE=0, AVAIL=3762176 MAXFREE=31457280, SLOW=yes [1 iteration] dd: error writing '/mnt/lustre/d23b.ost-pools/dir/f23b.ost-pools-quota1': No space left on device 3656+0 records in 3655+0 records out 3832545280 bytes (3.8 GB, 3.6 GiB) copied, 62.9237 s, 60.9 MB/s total written: 5242880 stime=1761241300, etime=1761241363, elapsed=63 Filesystem Size Used Avail Use% Mounted on devtmpfs 1.9G 0 1.9G 0% /dev tmpfs 1.9G 0 1.9G 0% /dev/shm tmpfs 1.9G 15M 1.8G 1% /run tmpfs 1.9G 0 1.9G 0% /sys/fs/cgroup /dev/nbd0 30G 17G 12G 60% / /dev/vda 34M 34M 0 100% /home/green/git/lustre-release none 1.9G 24M 1.8G 2% /var/lib/stateless/writable 192.168.200.253:/exports/state/oleg652-client.virtnet 138G 121G 11G 93% /var/lib/stateless/state 192.168.200.253:/exports/state/oleg652-client.virtnet/boot 138G 121G 11G 93% /boot 192.168.200.253:/exports/state/oleg652-client.virtnet/etc/kdump.conf 138G 121G 11G 93% /etc/kdump.conf tmpfs 370M 0 370M 0% /run/user/0 192.168.200.253:/exports/testreports/56307/testresults/ost-pools-zfs-DNE-rocky8.10_x86_64-rocky8.10_x86_64 51T 34T 18T 66% /tmp/testlogs 192.168.206.152@tcp:/lustre 7.2G 3.3G 3.9G 46% /mnt/lustre Destroy the created pools: testpool lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed PASS 23b (93s) == ost-pools test 24: Independence of pool from other setstripe parameters ========================================================== 13:42:58 (1761241378) oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 10 open/close in 0.13 seconds: 75.53 ops/second total: 10 open/close in 0.14 seconds: 70.29 ops/second - open/close 0 (time 1761241438.81 total 20.31 last 0.00) - open/close 1 (time 1761241459.29 total 40.79 last 0.05) - open/close 2 (time 1761241479.78 total 61.28 last 0.05) - open/close 3 (time 1761241500.25 total 81.75 last 0.05) - open/close 4 (time 1761241520.73 total 102.23 last 0.05) - open/close 5 (time 1761241541.21 total 122.71 last 0.05) - open/close 6 (time 1761241561.70 total 143.19 last 0.05) - open/close 7 (time 1761241582.18 total 163.68 last 0.05) - open/close 8 (time 1761241602.65 total 184.15 last 0.05) - open/close 9 (time 1761241623.13 total 204.62 last 0.05) total: 10 open/close in 204.62 seconds: 0.05 ops/second total: 10 open/close in 0.20 seconds: 50.56 ops/second Destroy the created pools: testpool lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed PASS 24 (262s) == ost-pools test 25: Create new pool and restart MDS ==== 13:47:20 (1761241640) oleg652-server: Pool lustre.testpool1 created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool1 Failing mds1 on oleg652-server Stopping /mnt/lustre-mds1 (opts:) on oleg652-server reboot facets: mds1 Failover mds1 to oleg652-server mount facets: mds1 Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg652-server: oleg652-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg652-client: oleg652-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg652-server: oleg652-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 40 oleg652-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0000-osc-MDT0001.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0001.old_sync_processed wait 40 secs maximumly for oleg652-server mds-ost sync done. Creating a file in pool1 Destroy the created pools: testpool1 lustre.testpool1 oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool1 oleg652-server: Pool lustre.testpool1 destroyed PASS 25 (61s) == ost-pools test 26: Choose other OSTs in the pool first in the creation remedy ========================================================== 13:48:21 (1761241701) SKIP: ost-pools test_26 needs >= 3 OSTs SKIP 26 (3s) == ost-pools test 27: Race pool_list and pool_remove ===== 13:48:24 (1761241704) oleg652-server: Pool lustre.testpool created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool fail_loc=0x239 fail_val=10 fail_loc=0 lustre-OST0001_UUID oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool fail_val=0 lustre.testpool oleg652-server: Pool lustre.testpool destroyed PASS 27 (34s) == ost-pools test 28: lfs_migrate with pool name ========= 13:48:58 (1761241738) oleg652-server: Pool lustre.testpool created oleg652-server: Pool lustre.testpool2 created oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg652-server: OST lustre-OST0000_UUID added to pool lustre.testpool2 oleg652-server: OST lustre-OST0001_UUID added to pool lustre.testpool2 debug=-1 debug_mb=150 debug=-1 debug_mb=150 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.206049 s, 5.1 MB/s /mnt/lustre/f28.ost-pools lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_pool: testpool obdidx objid objid group 1 6562 0x19a2 0 /mnt/lustre/f28.ost-pools: done /mnt/lustre/f28.ost-pools lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 1 lmm_stripe_offset: 1 lmm_pool: testpool2 obdidx objid objid group 1 6563 0x19a3 0 debug_mb=8 debug_mb=8 debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck Destroy the created pools: testpool,testpool2 lustre.testpool oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg652-server: Pool lustre.testpool destroyed lustre.testpool2 oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.testpool2 oleg652-server: OST lustre-OST0001_UUID removed from pool lustre.testpool2 oleg652-server: Pool lustre.testpool2 destroyed PASS 28 (63s) == ost-pools test 29: check OST pool spilling ============ 13:50:01 (1761241801) SKIP: ost-pools test_29 needs >= 4 OSTs SKIP 29 (2s) == ost-pools test 30: persistent OST pool spilling ======= 13:50:03 (1761241803) SKIP: ost-pools test_30 needs >= 4 OSTs SKIP 30 (3s) == ost-pools test 31: OST pool spilling chained ========== 13:50:06 (1761241806) SKIP: ost-pools test_31 needs >= 4 OSTs SKIP 31 (2s) == ost-pools test 32: force to create a file without pool (no inheritance) ========================================================== 13:50:08 (1761241808) Creating new pool oleg652-server: Pool lustre.test_32 created Adding targets to pool oleg652-server: OST lustre-OST0000_UUID added to pool lustre.test_32 striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d32.ost-pools Destroy the created pools: test_32 lustre.test_32 oleg652-server: OST lustre-OST0000_UUID removed from pool lustre.test_32 oleg652-server: Pool lustre.test_32 destroyed PASS 32 (24s) == ost-pools test complete, duration 2817 sec ============ 13:50:32 (1761241832) ost-pools: FAIL: test_15 createmany /mnt/lustre/d15.ost-pools/dir0/f15.ost-pools failed! ost-pools: FAIL: test_16 createmany /mnt/lustre/d16.ost-pools/d16.ost-pools/dir1/dir2/dir3/dir4/dir5/dir6/dir7/dir8/dir9/dir10/f16.ost-pools failed! ost-pools: FAIL: test_20 file '/mnt/lustre/d20.ost-pools/dir1/dir3/file3' not in any pool ost-pools: FAIL: test_21 /home/green/git/lustre-release/lustre/utils/lfs setstripe -p testpool /mnt/lustre/d21.ost-pools/dir/file1 failed