-----============= acceptance-small: ost-pools ============----- Fri May 16 08:45:01 EDT 2025 oleg460-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/ost-pools.*ex: No such file or directory excepting tests: oleg460-client.virtnet: executing check_config_client /mnt/lustre oleg460-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg460-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b65c8800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b65c8800.idle_timeout=debug disable quota as required oleg460-server: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 stripe_count: 1 stripe_size: 1048576 pattern: 0 stripe_offset: -1 == ost-pools test 1a: Create a pool with a 1 character pool name ========================================================== 08:45:25 (1747399525) oleg460-server: Pool lustre.p created lustre.p oleg460-server: Pool lustre.p destroyed PASS 1a (12s) == ost-pools test 1b: Create a pool with a 10 char pool name ========================================================== 08:45:37 (1747399537) oleg460-server: Pool lustre.testpool12 created lustre.testpool12 oleg460-server: Pool lustre.testpool12 destroyed PASS 1b (13s) == ost-pools test 1c: Create a pool with a 15 char pool name ========================================================== 08:45:50 (1747399550) oleg460-server: Pool lustre.testpool1234567 created lustre.testpool1234567 oleg460-server: Pool lustre.testpool1234567 destroyed PASS 1c (14s) == ost-pools test 1d: Create a pool with a 16 char pool name; should fail ========================================================== 08:46:04 (1747399564) oleg460-server: error: pool_new: either the pool or file system name is too long (max pool name len is 15 and file system name is 8) oleg460-server: pool_new: File name too long pdsh@oleg460-client: oleg460-server: ssh exited with exit code 36 PASS 1d (6s) == ost-pools test 1e: Create a pool with a 1000 char pool name; should fail ========================================================== 08:46:10 (1747399570) oleg460-server: error: pool_new: either the pool or file system name is too long (max pool name len is 15 and file system name is 8) oleg460-server: pool_new: File name too long pdsh@oleg460-client: oleg460-server: ssh exited with exit code 36 PASS 1e (5s) == ost-pools test 1f: pool_new should fail if fs-name is missing ========================================================== 08:46:15 (1747399575) oleg460-server: fsname is empty oleg460-server: argument .testpool must be . oleg460-server: pool_new: Invalid argument pdsh@oleg460-client: oleg460-server: ssh exited with exit code 22 PASS 1f (5s) == ost-pools test 1g: pool_new should fail if fs-name is missing ========================================================== 08:46:20 (1747399580) oleg460-server: . is missing in testpool oleg460-server: argument testpool must be . oleg460-server: pool_new: Invalid argument pdsh@oleg460-client: oleg460-server: ssh exited with exit code 22 PASS 1g (5s) == ost-pools test 1h: pool_new should fail if poolname is missing ========================================================== 08:46:25 (1747399585) oleg460-server: poolname is empty oleg460-server: argument lustre. must be . oleg460-server: pool_new: Invalid argument pdsh@oleg460-client: oleg460-server: ssh exited with exit code 22 PASS 1h (5s) == ost-pools test 1i: pool_new should fail if poolname and fs-name are missing ========================================================== 08:46:30 (1747399590) oleg460-server: fsname is empty oleg460-server: argument . must be . oleg460-server: pool_new: Invalid argument pdsh@oleg460-client: oleg460-server: ssh exited with exit code 22 PASS 1i (5s) == ost-pools test 1j: pool_new should fail if poolname format is wrong ========================================================== 08:46:36 (1747399596) oleg460-server: . is missing in lustre,testpool oleg460-server: argument lustre,testpool must be . oleg460-server: pool_new: Invalid argument pdsh@oleg460-client: oleg460-server: ssh exited with exit code 22 PASS 1j (4s) == ost-pools test 1k: pool_new should fail if poolname format is wrong ========================================================== 08:46:40 (1747399600) oleg460-server: . is missing in lustre/testpool oleg460-server: argument lustre/testpool must be . oleg460-server: pool_new: Invalid argument pdsh@oleg460-client: oleg460-server: ssh exited with exit code 22 PASS 1k (5s) == ost-pools test 1m: pool_new did not fail even though testpool2 existed ========================================================== 08:46:45 (1747399605) oleg460-server: Pool lustre.testpool2 created oleg460-server: Pool lustre.testpool2 already exists oleg460-server: pool_new: File exists pdsh@oleg460-client: oleg460-server: ssh exited with exit code 17 lustre.testpool2 oleg460-server: Pool lustre.testpool2 destroyed PASS 1m (13s) == ost-pools test 1n: Pool with a 15 char pool name works well ========================================================== 08:46:58 (1747399618) oleg460-server: Pool lustre.testpool1234567 created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool1234567 dd: failed to open '/mnt/lustre/d1n.ost-pools/file': No space left on device ost-pools test_1n: @@@@@@ FAIL: failed to write to /mnt/lustre/d1n.ost-pools/file: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6440:error() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:308:test_1n() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6798:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6845:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6686:run_test() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:314:main() Dumping lctl log to /tmp/testlogs//ost-pools.test_1n.*.1747399648.log Destroy the created pools: testpool1234567 rsync: chown "/tmp/testlogs/.ost-pools.test_1n.debug_log.oleg460-server.1747399648.log.jnQbCy" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.ost-pools.test_1n.dmesg.oleg460-server.1747399648.log.qzLGzA" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] lustre.testpool1234567 oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool1234567 oleg460-server: Pool lustre.testpool1234567 destroyed FAIL 1n (40s) == ost-pools test 2a: pool_add: non-existant pool testpool ========================================================== 08:47:42 (1747399662) PASS 2a (5s) == ost-pools test 2b: pool_add: Invalid pool name ======== 08:47:47 (1747399667) PASS 2b (4s) == ost-pools test 2c: pool_add: OST index combinations === 08:47:51 (1747399671) oleg460-server: Pool lustre.testpool created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool Waiting 90s for '' oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Waiting 90s for '' oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool lustre.testpool oleg460-server: Pool lustre.testpool destroyed PASS 2c (36s) == ost-pools test 2d: pool_add: OSTs that don't exist should be rejected ========================================================== 08:48:27 (1747399707) oleg460-server: Pool lustre.testpool created oleg460-server: OST lustre-OST0002_UUID is not part of the 'lustre' fs. oleg460-server: pool_add: No such file or directory pdsh@oleg460-client: oleg460-server: ssh exited with exit code 2 lustre.testpool oleg460-server: Pool lustre.testpool destroyed PASS 2d (13s) == ost-pools test 2e: pool_add: OST already in a pool should be rejected ========================================================== 08:48:40 (1747399720) oleg460-server: Pool lustre.testpool created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool pdsh@oleg460-client: oleg460-server: ssh exited with exit code 17 OST lustre-OST0000_UUID is already in pool lustre.testpool pool_add: File exists lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' PASS 2e (15s) == ost-pools test 3a: pool_remove: non-existant pool ===== 08:48:55 (1747399735) PASS 3a (4s) == ost-pools test 3b: pool_remove: non-existant fsname === 08:48:59 (1747399739) PASS 3b (3s) == ost-pools test 3c: pool_remove: Invalid pool name ===== 08:49:02 (1747399742) PASS 3c (4s) == ost-pools test 3d: pool_remove: OST index combinations ========================================================== 08:49:06 (1747399746) oleg460-server: Pool lustre.testpool created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool lustre.testpool oleg460-server: Pool lustre.testpool destroyed PASS 3d (29s) == ost-pools test 4a: pool_destroy: non-existant pool ==== 08:49:35 (1747399775) PASS 4a (3s) == ost-pools test 4b: pool_destroy: non-existant fs-name ========================================================== 08:49:38 (1747399778) PASS 4b (4s) == ost-pools test 4c: pool_destroy: non-empty pool ======= 08:49:42 (1747399782) oleg460-server: Pool lustre.testpool created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: Pool lustre.testpool not empty, please remove all members oleg460-server: pool_destroy: Directory not empty pdsh@oleg460-client: oleg460-server: ssh exited with exit code 39 lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' PASS 4c (16s) == ost-pools test 5a: lfs pool_list from client ========== 08:49:59 (1747399799) oleg460-server: Pool lustre.testpool created oleg460-server: Pool lustre.testpool2 created Pools from lustre: lustre.testpool lustre.testpool2 oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID added to pool lustre.testpool Pool: lustre.testpool lustre-OST0000_UUID lustre-OST0001_UUID Pool: lustre.nonexistantpool /home/green/git/lustre-release/lustre/utils/lfs pool_list /mnt/lustre Pools from lustre: lustre.testpool lustre.testpool2 Pools from lustre: lustre.testpool lustre.testpool2 lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg460-server: Pool lustre.testpool destroyed lustre.testpool2 oleg460-server: Pool lustre.testpool2 destroyed PASS 5a (27s) == ost-pools test 5b: lctl pool_list from MDS ============ 08:50:25 (1747399825) oleg460-server: Pool lustre.testpool created oleg460-server: Pool lustre.testpool2 created Pools from lustre: lustre.testpool lustre.testpool2 oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID added to pool lustre.testpool Pool: lustre.testpool lustre-OST0000_UUID lustre-OST0001_UUID Pools from nonexistantfs: Pool: lustre.nonexistantpool Pools from /mnt/lustrenonexistant: lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg460-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' lustre.testpool2 oleg460-server: Pool lustre.testpool2 destroyed PASS 5b (28s) == ost-pools test 6: getstripe/setstripe ================= 08:50:54 (1747399854) oleg460-server: Pool lustre.testpool created Pools from lustre: lustre.testpool oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg460-server: Pool lustre.testpool2 created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool2 Destroy the created pools: testpool,testpool2 lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg460-server: Pool lustre.testpool destroyed lustre.testpool2 oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool2 oleg460-server: Pool lustre.testpool2 destroyed PASS 6 (45s) == ost-pools test 7a: create various pool name =========== 08:51:39 (1747399899) set poolname to 6 Creating new pool oleg460-server: Pool lustre.6 created Adding targets to pool oleg460-server: OST lustre-OST0000_UUID added to pool lustre.6 oleg460-server: OST lustre-OST0001_UUID added to pool lustre.6 oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.6 oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.6 oleg460-server: Pool lustre.6 destroyed set poolname to 689522837 Creating new pool oleg460-server: Pool lustre.689522837 created Adding targets to pool oleg460-server: OST lustre-OST0000_UUID added to pool lustre.689522837 oleg460-server: OST lustre-OST0001_UUID added to pool lustre.689522837 oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.689522837 oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.689522837 oleg460-server: Pool lustre.689522837 destroyed set poolname to 68951524028271 Creating new pool oleg460-server: Pool lustre.68951524028271 created Adding targets to pool oleg460-server: OST lustre-OST0000_UUID added to pool lustre.68951524028271 oleg460-server: OST lustre-OST0001_UUID added to pool lustre.68951524028271 oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.68951524028271 oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.68951524028271 oleg460-server: Pool lustre.68951524028271 destroyed Destroy the created pools: 6,68951524028271,689522837 Destroy the created pools: 6,68951524028271,689522837 Destroy the created pools: 6,68951524028271,689522837 PASS 7a (38s) == ost-pools test 7b: try to create pool name with invalid lengths or names ========================================================== 08:52:17 (1747399937) oleg460-server: . is missing in qwerty oleg460-server: argument qwerty must be . oleg460-server: pool_new: Invalid argument pdsh@oleg460-client: oleg460-server: ssh exited with exit code 22 oleg460-server: poolname is empty oleg460-server: argument lustre. must be . oleg460-server: pool_new: Invalid argument pdsh@oleg460-client: oleg460-server: ssh exited with exit code 22 oleg460-server: error: pool_new can contain only alphanumeric characters, underscores, and dashes besides the required '.' oleg460-server: pool_new: Invalid argument pdsh@oleg460-client: oleg460-server: ssh exited with exit code 22 oleg460-server: error: pool_new: either the pool or file system name is too long (max pool name len is 15 and file system name is 8) oleg460-server: pool_new: File name too long pdsh@oleg460-client: oleg460-server: ssh exited with exit code 36 PASS 7b (3s) == ost-pools test 7c: create a valid pool name and setstripe with a bad one ========================================================== 08:52:21 (1747399941) Creating new pool oleg460-server: Pool lustre.0123456789abcde created Adding targets to pool oleg460-server: OST lustre-OST0000_UUID added to pool lustre.0123456789abcde oleg460-server: OST lustre-OST0001_UUID added to pool lustre.0123456789abcde lfs setstripe: Invalid Poolname '0123456789abcdeX': Invalid argument (22) oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.0123456789abcde oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.0123456789abcde oleg460-server: Pool lustre.0123456789abcde destroyed Destroy the created pools: 0123456789abcde PASS 7c (11s) == ost-pools test 11: OSTs in overlapping/multiple pools ========================================================== 08:52:32 (1747399952) oleg460-server: Pool lustre.testpool created oleg460-server: Pool lustre.testpool2 created oleg460-server: OST lustre-OST0001_UUID added to pool lustre.testpool2 oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool open(/mnt/lustre/d11.ost-pools/dir1/f11.ost-pools0) error: No space left on device total: 0 open/close in 20.01 seconds: 0.00 ops/second ost-pools test_11: @@@@@@ FAIL: createmany /mnt/lustre/d11.ost-pools/dir1/f11.ost-pools failed! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6440:error() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:723:test_11() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6798:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6845:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6686:run_test() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:739:main() Dumping lctl log to /tmp/testlogs//ost-pools.test_11.*.1747399982.log Destroy the created pools: testpool,testpool2 rsync: chown "/tmp/testlogs/.ost-pools.test_11.debug_log.oleg460-server.1747399982.log.xTvLks" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.ost-pools.test_11.dmesg.oleg460-server.1747399982.log.einTWx" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: Pool lustre.testpool destroyed lustre.testpool2 oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool2 oleg460-server: Pool lustre.testpool2 destroyed FAIL 11 (41s) == ost-pools test 12: OST Pool Membership ================ 08:53:16 (1747399996) SKIP: ost-pools test_12 needs >=3 OSTs SKIP 12 (1s) == ost-pools test 13: Striping characteristics in a pool ========================================================== 08:53:17 (1747399997) SKIP: ost-pools test_13 needs >= 3 OSTs SKIP 13 (1s) == ost-pools test 14: Round robin and QOS striping within a pool ========================================================== 08:53:18 (1747399998) SKIP: ost-pools test_14 needs >= 3 OSTs SKIP 14 (1s) == ost-pools test 15: One directory per OST/pool ========= 08:53:19 (1747399999) oleg460-server: Pool lustre.testpool0 created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool0 open(/mnt/lustre/d15.ost-pools/dir0/f15.ost-pools0) error: No space left on device total: 0 open/close in 20.01 seconds: 0.00 ops/second ost-pools test_15: @@@@@@ FAIL: createmany /mnt/lustre/d15.ost-pools/dir0/f15.ost-pools failed! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6440:error() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:923:test_15() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6798:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6845:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6686:run_test() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:934:main() Dumping lctl log to /tmp/testlogs//ost-pools.test_15.*.1747400026.log rsync: chown "/tmp/testlogs/.ost-pools.test_15.debug_log.oleg460-server.1747400026.log.n0PCz7" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.ost-pools.test_15.dmesg.oleg460-server.1747400026.log.xV6sS5" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] Destroy the created pools: testpool0 lustre.testpool0 oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool0 oleg460-server: Pool lustre.testpool0 destroyed Waiting 90s for 'foo' FAIL 15 (35s) == ost-pools test 16: Inheritance of pool properties ===== 08:53:57 (1747400037) oleg460-server: Pool lustre.testpool created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool open(/mnt/lustre/d16.ost-pools/d16.ost-pools/dir1/dir2/dir3/dir4/dir5/dir6/dir7/dir8/dir9/dir10/f16.ost-pools0) error: No space left on device total: 0 open/close in 20.03 seconds: 0.00 ops/second ost-pools test_16: @@@@@@ FAIL: createmany /mnt/lustre/d16.ost-pools/d16.ost-pools/dir1/dir2/dir3/dir4/dir5/dir6/dir7/dir8/dir9/dir10/f16.ost-pools failed! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6440:error() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:954:test_16() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6798:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6845:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6686:run_test() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:964:main() Dumping lctl log to /tmp/testlogs//ost-pools.test_16.*.1747400063.log rsync: chown "/tmp/testlogs/.ost-pools.test_16.debug_log.oleg460-server.1747400063.log.RHze0f" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.ost-pools.test_16.dmesg.oleg460-server.1747400063.log.8VaShM" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] Destroy the created pools: testpool lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: Pool lustre.testpool destroyed FAIL 16 (33s) == ost-pools test 17: Referencing an empty pool ========== 08:54:32 (1747400072) oleg460-server: Pool lustre.testpool created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID added to pool lustre.testpool - open/close 0 (time 1747400099.18 total 20.01 last 0.00) - open/close 1 (time 1747400119.19 total 40.02 last 0.05) - open/close 2 (time 1747400139.20 total 60.02 last 0.05) - open/close 3 (time 1747400159.21 total 80.03 last 0.05) - open/close 4 (time 1747400179.21 total 100.04 last 0.05) - open/close 5 (time 1747400199.22 total 120.05 last 0.05) - open/close 6 (time 1747400219.23 total 140.06 last 0.05) - open/close 7 (time 1747400239.24 total 160.07 last 0.05) - open/close 8 (time 1747400259.25 total 180.08 last 0.05) - open/close 9 (time 1747400279.26 total 200.08 last 0.05) total: 10 open/close in 200.08 seconds: 0.05 ops/second lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg460-server: Pool lustre.testpool destroyed - open/close 0 (time 1747400311.51 total 20.01 last 0.00) - open/close 1 (time 1747400331.51 total 40.01 last 0.05) - open/close 2 (time 1747400351.52 total 60.02 last 0.05) - open/close 3 (time 1747400371.52 total 80.02 last 0.05) - open/close 4 (time 1747400391.53 total 100.03 last 0.05) - open/close 5 (time 1747400411.53 total 120.04 last 0.05) - open/close 6 (time 1747400431.54 total 140.04 last 0.05) - open/close 7 (time 1747400451.55 total 160.05 last 0.05) - open/close 8 (time 1747400471.55 total 180.05 last 0.05) - open/close 9 (time 1747400491.55 total 200.06 last 0.05) total: 10 open/close in 200.06 seconds: 0.05 ops/second PASS 17 (420s) == ost-pools test 18: File create in a directory which references a deleted pool ========================================================== 09:01:32 (1747400492) Create performance, iteration 1, 15 seconds x 3 total: 4328 open/close in 15.00 seconds: 288.52 ops/second iter 1: 4328 creates without pool oleg460-server: Pool lustre.testpool created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 1 open/close in 20.01 seconds: 0.05 ops/second iter 1: 1 creates with pool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg460-server: Pool lustre.testpool destroyed total: 1 open/close in 20.02 seconds: 0.05 ops/second iter 1: 1 creates with missing pool Create performance, iteration 2, 15 seconds x 3 total: 2588 open/close in 15.01 seconds: 172.47 ops/second iter 2: 2588 creates without pool oleg460-server: Pool lustre.testpool created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 1 open/close in 20.01 seconds: 0.05 ops/second iter 2: 1 creates with pool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg460-server: Pool lustre.testpool destroyed total: 1 open/close in 20.01 seconds: 0.05 ops/second iter 2: 1 creates with missing pool Create performance, iteration 3, 15 seconds x 3 total: 3461 open/close in 15.00 seconds: 230.70 ops/second iter 3: 3461 creates without pool oleg460-server: Pool lustre.testpool created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 1 open/close in 20.01 seconds: 0.05 ops/second iter 3: 1 creates with pool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg460-server: Pool lustre.testpool destroyed total: 1 open/close in 20.01 seconds: 0.05 ops/second iter 3: 1 creates with missing pool Avg files created in 15 seconds without pool: 3459 Avg files created in 15 seconds with pool: 1 Avg files created in 15 seconds missing pool: 1 No pool / wide pool: 99 %. ost-pools test_18: @@@@@@ IGNORE (bz23408): Degradation with wide pool is 99% > 30% Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6456:error_ignore() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1060:test_18() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6798:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6845:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6686:run_test() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1070:main() Dumping lctl log to /tmp/testlogs//ost-pools.test_18.*.1747400841.log No pool / missing pool: 99 %. ost-pools test_18: @@@@@@ IGNORE (bz23408): Degradation with wide pool is 99% > 30% rsync: chown "/tmp/testlogs/.ost-pools.test_18.debug_log.oleg460-server.1747400841.log.g1UoGC" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.ost-pools.test_18.dmesg.oleg460-server.1747400841.log.ZQF5h0" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6456:error_ignore() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1066:test_18() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6798:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6845:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6686:run_test() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1070:main() Dumping lctl log to /tmp/testlogs//ost-pools.test_18.*.1747400842.log rsync: chown "/tmp/testlogs/.ost-pools.test_18.debug_log.oleg460-server.1747400842.log.BoOhRS" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.ost-pools.test_18.dmesg.oleg460-server.1747400842.log.vhwq5i" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] PASS 18 (352s) == ost-pools test 19: Pools should not come into play when not specified ========================================================== 09:07:24 (1747400844) oleg460-server: Pool lustre.testpool created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool open(/mnt/lustre/d19.ost-pools/dir1/f19.ost-pools0) error: No space left on device total: 0 open/close in 20.01 seconds: 0.00 ops/second ost-pools test_19: @@@@@@ FAIL: createmany /mnt/lustre/d19.ost-pools/dir1/f19.ost-pools failed! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6440:error() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1085:test_19() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6798:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6845:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6686:run_test() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1101:main() Dumping lctl log to /tmp/testlogs//ost-pools.test_19.*.1747400869.log rsync: chown "/tmp/testlogs/.ost-pools.test_19.debug_log.oleg460-server.1747400869.log.pNZ7IM" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.ost-pools.test_19.dmesg.oleg460-server.1747400869.log.uQoxbl" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] Destroy the created pools: testpool lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: Pool lustre.testpool destroyed FAIL 19 (30s) == ost-pools test 20: Different pools in a directory hierarchy. ========================================================== 09:07:55 (1747400875) oleg460-server: Pool lustre.testpool created oleg460-server: Pool lustre.testpool2 created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: OST lustre-OST0001_UUID added to pool lustre.testpool2 touch: cannot touch '/mnt/lustre/d20.ost-pools/dir1/dir3/file3': No space left on device lfs setstripe: setstripe error for '/mnt/lustre/d20.ost-pools/dir1/file5': No space left on device error: getstripe failed for /mnt/lustre/d20.ost-pools/dir1/dir3/file3. error: getstripe failed for /mnt/lustre/d20.ost-pools/dir1/dir3/file3. ost-pools test_20: @@@@@@ FAIL: file '/mnt/lustre/d20.ost-pools/dir1/dir3/file3' not in any pool Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6440:error() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:111:check_file_in_pool() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1143:test_20() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6798:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6845:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6686:run_test() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1152:main() Dumping lctl log to /tmp/testlogs//ost-pools.test_20.*.1747400928.log rsync: chown "/tmp/testlogs/.ost-pools.test_20.debug_log.oleg460-server.1747400928.log.N4Nxgh" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.ost-pools.test_20.dmesg.oleg460-server.1747400928.log.xrLW3j" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] Destroy the created pools: testpool,testpool2 lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: Pool lustre.testpool destroyed lustre.testpool2 oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool2 oleg460-server: Pool lustre.testpool2 destroyed Waiting 90s for 'foo' FAIL 20 (63s) == ost-pools test 21: OST pool with fewer OSTs than stripe count ========================================================== 09:09:00 (1747400940) oleg460-server: Pool lustre.testpool created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool lfs setstripe: setstripe error for '/mnt/lustre/d21.ost-pools/dir/file1': No space left on device ost-pools test_21: @@@@@@ FAIL: /home/green/git/lustre-release/lustre/utils/lfs setstripe -p testpool /mnt/lustre/d21.ost-pools/dir/file1 failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6440:error() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:78:create_file() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1167:test_21() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6798:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6845:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6686:run_test() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1175:main() Dumping lctl log to /tmp/testlogs//ost-pools.test_21.*.1747400965.log rsync: chown "/tmp/testlogs/.ost-pools.test_21.debug_log.oleg460-server.1747400965.log.AYdImv" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.ost-pools.test_21.dmesg.oleg460-server.1747400965.log.r7xrf6" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] Destroy the created pools: testpool lustre.testpool oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg460-server: Pool lustre.testpool destroyed FAIL 21 (30s) == ost-pools test 22: Simultaneous manipulation of a pool ========================================================== 09:09:31 (1747400971) oleg460-server: Pool lustre.testpool created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg460-server: Pool lustre.testpool2 created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool2 loop for testpool loop for testpool2 Pool testpool2, iteration 1 Pool testpool, iteration 1 Pool testpool2, iteration 2 Pool testpool2, iteration 3 Pool testpool2, iteration 4 Pool testpool2, iteration 5 Pool testpool2, iteration 6 Pool testpool2, iteration 7 Pool testpool2, iteration 8 Pool testpool2, iteration 9 Pool testpool2, iteration 10 loop for testpool2 complete oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 2 oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 3 - open/close 0 (time 1747401006.67 total 20.01 last 0.00) open(/mnt/lustre/d22.ost-pools/f22.ost-pools1) error: No space left on device total: 1 open/close in 40.01 seconds: 0.02 ops/second ost-pools test_22: @@@@@@ FAIL: createmany /mnt/lustre/d22.ost-pools/f22.ost-pools failed! Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6440:error() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1212:test_22() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6798:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6845:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6686:run_test() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1217:main() Dumping lctl log to /tmp/testlogs//ost-pools.test_22.*.1747401027.log rsync: chown "/tmp/testlogs/.ost-pools.test_22.debug_log.oleg460-server.1747401027.log.XJWAIb" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.ost-pools.test_22.dmesg.oleg460-server.1747401027.log.735Mip" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] Destroy the created pools: testpool,testpool2 lustre.testpool oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 4 oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool Waiting 90s for '1' oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 5 oleg460-server: Pool lustre.testpool destroyed lustre.testpool2 oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool2 oleg460-server: Pool lustre.testpool2 destroyed oleg460-server: Pool lustre.testpool not found oleg460-server: pool_remove: No such file or directory pdsh@oleg460-client: oleg460-server: ssh exited with exit code 2 Pool testpool, iteration 6 oleg460-server: Pool lustre.testpool not found oleg460-server: pool_remove: No such file or directory pdsh@oleg460-client: oleg460-server: ssh exited with exit code 2 Pool testpool, iteration 7 oleg460-server: Pool lustre.testpool not found oleg460-server: pool_remove: No such file or directory pdsh@oleg460-client: oleg460-server: ssh exited with exit code 2 Pool testpool, iteration 8 oleg460-server: Pool lustre.testpool not found oleg460-server: pool_remove: No such file or directory pdsh@oleg460-client: oleg460-server: ssh exited with exit code 2 Pool testpool, iteration 9 oleg460-server: Pool lustre.testpool not found oleg460-server: pool_remove: No such file or directory pdsh@oleg460-client: oleg460-server: ssh exited with exit code 2 Pool testpool, iteration 10 oleg460-server: Pool lustre.testpool not found oleg460-server: pool_remove: No such file or directory pdsh@oleg460-client: oleg460-server: ssh exited with exit code 2 loop for testpool complete FAIL 22 (84s) == ost-pools test 23a: OST pools and quota =============== 09:10:56 (1747401056) running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6895] oleg460-server: Pool lustre.testpool created oleg460-server: pool_add: File exists pdsh@oleg460-client: oleg460-server: ssh exited with exit code 17 Disk quotas for usr 500 (uid 500): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre/d23a.ost-pools/dir 0 3072 3072 - 0 0 0 - lustre-MDT0000_UUID 0 - 0 - 0 - 0 - lustre-OST0000_UUID 0 - 0 - - - - - lustre-OST0001_UUID 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 uid 500 is using default file quota setting -rw-r--r-- 1 sanityusr sanityusr 0 May 16 09:11 /mnt/lustre/d23a.ost-pools/dir/f23a.ost-pools-quota first dd failed with EDQUOT. Disk quotas for usr 500 (uid 500): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre/d23a.ost-pools/dir 0 3072 3072 - 0 0 0 - lustre-MDT0000_UUID 0 - 0 - 0 - 0 - lustre-OST0000_UUID 0 - 0 - - - - - lustre-OST0001_UUID 0 - 2049 - - - - - Total allocated inode limit: 0, total allocated block limit: 2049 uid 500 is using default file quota setting Destroy the created pools: testpool lustre.testpool oleg460-server: Pool lustre.testpool destroyed PASS 23a (16s) == ost-pools test 23b: OST pools and OOS ================= 09:11:12 (1747401072) running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6895] oleg460-server: Pool lustre.testpool created oleg460-server: pool_add: File exists pdsh@oleg460-client: oleg460-server: ssh exited with exit code 17 OSTCOUNT=2, OSTSIZE=0, AVAIL=0 MAXFREE=31457280, SLOW=yes [1 iteration] dd: error writing '/mnt/lustre/d23b.ost-pools/dir/f23b.ost-pools-quota1': No space left on device 3654+0 records in 3653+0 records out 3830448128 bytes (3.8 GB) copied, 20.1121 s, 190 MB/s total written: 5242880 stime=1747401081, etime=1747401121, elapsed=40 Filesystem Size Used Avail Use% Mounted on devtmpfs 1.9G 0 1.9G 0% /dev tmpfs 1.9G 0 1.9G 0% /dev/shm tmpfs 1.9G 17M 1.9G 1% /run tmpfs 1.9G 0 1.9G 0% /sys/fs/cgroup /dev/nbd0 30G 12G 16G 43% / none 1.9G 32M 1.8G 2% /var/lib/stateless/writable /dev/vda 27M 27M 0 100% /home/green/git/lustre-release 192.168.200.253:/exports/state/oleg460-client.virtnet 118G 96G 17G 86% /var/lib/stateless/state 192.168.200.253:/exports/state/oleg460-client.virtnet/boot 118G 96G 17G 86% /boot 192.168.200.253:/exports/state/oleg460-client.virtnet/etc/kdump.conf 118G 96G 17G 86% /etc/kdump.conf 192.168.200.253:/exports/testreports/51737/testresults/ost-pools-zfs-centos7_x86_64-centos7_x86_64 51T 27T 24T 54% /tmp/testlogs tmpfs 374M 0 374M 0% /run/user/0 192.168.204.160@tcp:/lustre 3.6G 3.3G 268M 93% /mnt/lustre Destroy the created pools: testpool lustre.testpool oleg460-server: Pool lustre.testpool destroyed PASS 23b (54s) == ost-pools test 24: Independence of pool from other setstripe parameters ========================================================== 09:12:06 (1747401126) oleg460-server: Pool lustre.testpool created oleg460-server: pool_add: File exists pdsh@oleg460-client: oleg460-server: ssh exited with exit code 17 - open/close 0 (time 1747401150.10 total 20.00 last 0.00) - open/close 1 (time 1747401170.10 total 40.01 last 0.05) - open/close 2 (time 1747401190.10 total 60.01 last 0.05) - open/close 3 (time 1747401210.11 total 80.02 last 0.05) - open/close 4 (time 1747401230.11 total 100.02 last 0.05) - open/close 5 (time 1747401250.12 total 120.03 last 0.05) - open/close 6 (time 1747401270.12 total 140.03 last 0.05) - open/close 7 (time 1747401290.13 total 160.04 last 0.05) - open/close 8 (time 1747401310.13 total 180.04 last 0.05) - open/close 9 (time 1747401330.14 total 200.05 last 0.05) total: 10 open/close in 200.05 seconds: 0.05 ops/second ost-pools test_24: @@@@@@ FAIL: Stripe count 2 not on /mnt/lustre/d24.ost-pools/dir1/f24.ost-pools0:1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6440:error() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1433:test_24() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6798:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6845:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6686:run_test() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1447:main() Dumping lctl log to /tmp/testlogs//ost-pools.test_24.*.1747401331.log Destroy the created pools: testpool rsync: chown "/tmp/testlogs/.ost-pools.test_24.debug_log.oleg460-server.1747401331.log.8HLHFg" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.ost-pools.test_24.dmesg.oleg460-server.1747401331.log.PMg0ql" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] lustre.testpool oleg460-server: Pool lustre.testpool destroyed FAIL 24 (209s) == ost-pools test 25: Create new pool and restart MDS ==== 09:15:36 (1747401336) oleg460-server: Pool lustre.testpool1 created oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool1 Failing mds1 on oleg460-server Stopping /mnt/lustre-mds1 (opts:) on oleg460-server reboot facets: mds1 Failover mds1 to oleg460-server mount facets: mds1 Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg460-server: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg460-client: oleg460-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg460-server: oleg460-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 40 oleg460-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg460-server mds-ost sync done. Creating a file in pool1 Destroy the created pools: testpool1 lustre.testpool1 oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool1 oleg460-server: Pool lustre.testpool1 destroyed PASS 25 (40s) == ost-pools test 26: Choose other OSTs in the pool first in the creation remedy ========================================================== 09:16:16 (1747401376) SKIP: ost-pools test_26 needs >= 3 OSTs SKIP 26 (1s) == ost-pools test 27: Race pool_list and pool_remove ===== 09:16:17 (1747401377) oleg460-server: Pool lustre.testpool created oleg460-server: pool_add: File exists pdsh@oleg460-client: oleg460-server: ssh exited with exit code 17 Waiting 90s for '3' Waiting 80s for '3' Waiting 70s for '3' Waiting 60s for '3' Waiting 50s for '3' Waiting 30s for '3' Waiting 20s for '3' Waiting 10s for '3' Waiting 0s for '3' Update not seen after 90s: want '3' got '1' ost-pools test_27: @@@@@@ FAIL: MDS: pool_list lustre.testpool failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6440:error() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1539:test_27() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6798:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6845:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6686:run_test() = /home/green/git/lustre-release/lustre/tests/ost-pools.sh:1560:main() Dumping lctl log to /tmp/testlogs//ost-pools.test_27.*.1747401472.log rsync: chown "/tmp/testlogs/.ost-pools.test_27.debug_log.oleg460-server.1747401472.log.ZC5X5U" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.ost-pools.test_27.dmesg.oleg460-server.1747401472.log.UsjeiW" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] Destroy the created pools: testpool lustre.testpool oleg460-server: Pool lustre.testpool destroyed FAIL 27 (98s) == ost-pools test 28: lfs_migrate with pool name ========= 09:17:57 (1747401477) oleg460-server: Pool lustre.testpool created oleg460-server: Pool lustre.testpool2 created oleg460-server: pool_add: File exists pdsh@oleg460-client: oleg460-server: ssh exited with exit code 17 oleg460-server: OST lustre-OST0000_UUID added to pool lustre.testpool2 oleg460-server: OST lustre-OST0001_UUID added to pool lustre.testpool2 debug=-1 debug_mb=150 debug=-1 debug_mb=150 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0291785 s, 35.9 MB/s /mnt/lustre/f28.ost-pools lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 lmm_pool: testpool obdidx objid objid group 0 4 0x4 0 /mnt/lustre/f28.ost-pools: done /mnt/lustre/f28.ost-pools lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 1 lmm_stripe_offset: 1 lmm_pool: testpool2 obdidx objid objid group 1 10466 0x28e2 0 debug_mb=8 debug_mb=8 debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck Destroy the created pools: testpool,testpool2 lustre.testpool oleg460-server: Pool lustre.testpool destroyed lustre.testpool2 oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.testpool2 oleg460-server: OST lustre-OST0001_UUID removed from pool lustre.testpool2 oleg460-server: Pool lustre.testpool2 destroyed PASS 28 (21s) == ost-pools test 29: check OST pool spilling ============ 09:18:18 (1747401498) SKIP: ost-pools test_29 needs >= 4 OSTs SKIP 29 (1s) == ost-pools test 30: persistent OST pool spilling ======= 09:18:19 (1747401499) SKIP: ost-pools test_30 needs >= 4 OSTs SKIP 30 (1s) == ost-pools test 31: OST pool spilling chained ========== 09:18:20 (1747401500) SKIP: ost-pools test_31 needs >= 4 OSTs SKIP 31 (1s) == ost-pools test 32: force to create a file without pool (no inheritance) ========================================================== 09:18:21 (1747401501) Creating new pool oleg460-server: Pool lustre.test_32 created Adding targets to pool oleg460-server: OST lustre-OST0000_UUID added to pool lustre.test_32 Waiting 90s for 'lustre-OST0000_UUID ' Destroy the created pools: test_32 lustre.test_32 oleg460-server: OST lustre-OST0000_UUID removed from pool lustre.test_32 oleg460-server: Pool lustre.test_32 destroyed Waiting 90s for 'foo' PASS 32 (12s) == ost-pools test complete, duration 2011 sec ============ 09:18:33 (1747401513) ost-pools: FAIL: test_1n failed to write to /mnt/lustre/d1n.ost-pools/file: 1 ost-pools: FAIL: test_11 createmany /mnt/lustre/d11.ost-pools/dir1/f11.ost-pools failed! ost-pools: FAIL: test_15 createmany /mnt/lustre/d15.ost-pools/dir0/f15.ost-pools failed! ost-pools: FAIL: test_16 createmany /mnt/lustre/d16.ost-pools/d16.ost-pools/dir1/dir2/dir3/dir4/dir5/dir6/dir7/dir8/dir9/dir10/f16.ost-pools failed! ost-pools: FAIL: test_19 createmany /mnt/lustre/d19.ost-pools/dir1/f19.ost-pools failed! ost-pools: FAIL: test_20 file '/mnt/lustre/d20.ost-pools/dir1/dir3/file3' not in any pool ost-pools: FAIL: test_21 /home/green/git/lustre-release/lustre/utils/lfs setstripe -p testpool /mnt/lustre/d21.ost-pools/dir/file1 failed ost-pools: FAIL: test_22 createmany /mnt/lustre/d22.ost-pools/f22.ost-pools failed! ost-pools: FAIL: test_24 Stripe count 2 not on /mnt/lustre/d24.ost-pools/dir1/f24.ost-pools0:1 ost-pools: FAIL: test_27 MDS: pool_list lustre.testpool failed