-----============= acceptance-small: ost-pools ============----- Tue Feb 25 07:00:18 EST 2025 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg250-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/ost-pools.*ex: No such file or directory excepting tests: === ost-pools: start setup 07:00:22 (1740484822) === oleg250-client.virtnet: executing check_config_client /mnt/lustre oleg250-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg250-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b35ec000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b35ec000.idle_timeout=debug disable quota as required oleg250-server: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === ost-pools: finish setup 07:00:31 (1740484831) === stripe_count: 1 stripe_size: 4194304 pattern: 0 stripe_offset: -1 == ost-pools test 1a: Create a pool with a 1 character pool name ========================================================== 07:00:31 (1740484831) oleg250-server: Pool lustre.p created Waiting 90s for '' lustre.p oleg250-server: Pool lustre.p destroyed PASS 1a (7s) == ost-pools test 1b: Create a pool with a 10 char pool name ========================================================== 07:00:38 (1740484838) oleg250-server: Pool lustre.testpool12 created lustre.testpool12 oleg250-server: Pool lustre.testpool12 destroyed PASS 1b (8s) == ost-pools test 1c: Create a pool with a 15 char pool name ========================================================== 07:00:46 (1740484846) oleg250-server: Pool lustre.testpool1234567 created lustre.testpool1234567 oleg250-server: Pool lustre.testpool1234567 destroyed Waiting 90s for 'foo' PASS 1c (7s) == ost-pools test 1d: Create a pool with a 16 char pool name; should fail ========================================================== 07:00:53 (1740484853) oleg250-server: pool_new: poolname is too long oleg250-server: pool_new: File name too long pdsh@oleg250-client: oleg250-server: ssh exited with exit code 36 PASS 1d (1s) == ost-pools test 1e: Create a pool with a 1000 char pool name; should fail ========================================================== 07:00:54 (1740484854) oleg250-server: pool_new: poolname is too long oleg250-server: pool_new: File name too long pdsh@oleg250-client: oleg250-server: ssh exited with exit code 36 PASS 1e (2s) == ost-pools test 1f: pool_new should fail if fs-name is missing ========================================================== 07:00:56 (1740484856) oleg250-server: pool_new: Invalid argument pdsh@oleg250-client: oleg250-server: ssh exited with exit code 22 PASS 1f (2s) == ost-pools test 1g: pool_new should fail if fs-name is missing ========================================================== 07:00:58 (1740484858) oleg250-server: pool_new: Invalid argument pdsh@oleg250-client: oleg250-server: ssh exited with exit code 22 PASS 1g (2s) == ost-pools test 1h: pool_new should fail if poolname is missing ========================================================== 07:01:00 (1740484860) oleg250-server: pool_new: Invalid argument pdsh@oleg250-client: oleg250-server: ssh exited with exit code 22 PASS 1h (1s) == ost-pools test 1i: pool_new should fail if poolname and fs-name are missing ========================================================== 07:01:01 (1740484861) oleg250-server: pool_new: Invalid argument pdsh@oleg250-client: oleg250-server: ssh exited with exit code 22 PASS 1i (2s) == ost-pools test 1j: pool_new should fail if poolname format is wrong ========================================================== 07:01:03 (1740484863) oleg250-server: pool_new: Invalid argument pdsh@oleg250-client: oleg250-server: ssh exited with exit code 22 PASS 1j (2s) == ost-pools test 1k: pool_new should fail if poolname format is wrong ========================================================== 07:01:05 (1740484865) oleg250-server: pool_new: Invalid argument pdsh@oleg250-client: oleg250-server: ssh exited with exit code 22 PASS 1k (2s) == ost-pools test 1m: pool_new did not fail even though testpool2 existed ========================================================== 07:01:07 (1740484867) oleg250-server: Pool lustre.testpool2 created oleg250-server: pool_new: pool lustre.testpool2 already exists pdsh@oleg250-client: oleg250-server: ssh exited with exit code 17 lustre.testpool2 oleg250-server: Pool lustre.testpool2 destroyed PASS 1m (7s) == ost-pools test 1n: Pool with a 15 char pool name works well ========================================================== 07:01:14 (1740484874) oleg250-server: Pool lustre.testpool1234567 created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool1234567 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.679389 s, 154 MB/s oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool1234567 lustre.testpool1234567 oleg250-server: Pool lustre.testpool1234567 destroyed Waiting 90s for 'foo' PASS 1n (13s) == ost-pools test 2a: pool_add: non-existant pool testpool ========================================================== 07:01:27 (1740484887) PASS 2a (2s) == ost-pools test 2b: pool_add: Invalid pool name ======== 07:01:29 (1740484889) PASS 2b (2s) == ost-pools test 2c: pool_add: OST index combinations === 07:01:31 (1740484891) oleg250-server: Pool lustre.testpool created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Waiting 90s for '' oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool lustre.testpool oleg250-server: Pool lustre.testpool destroyed PASS 2c (21s) == ost-pools test 2d: pool_add: OSTs that don't exist should be rejected ========================================================== 07:01:52 (1740484912) oleg250-server: Pool lustre.testpool created oleg250-server: pool_add: lustre-OST0002_UUID is not part of the 'lustre' fs. pdsh@oleg250-client: oleg250-server: ssh exited with exit code 19 lustre.testpool oleg250-server: Pool lustre.testpool destroyed PASS 2d (7s) == ost-pools test 2e: pool_add: OST already in a pool should be rejected ========================================================== 07:01:59 (1740484919) oleg250-server: Pool lustre.testpool created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool pdsh@oleg250-client: oleg250-server: ssh exited with exit code 17 pool_add: lustre-OST0000_UUID is already in pool lustre.testpool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed PASS 2e (10s) == ost-pools test 2f: check -n|--nowait option =========== 07:02:09 (1740484929) Waiting 90s for 'lustre-OST0000_UUID' Updated after 3s: want 'lustre-OST0000_UUID' got 'lustre-OST0000_UUID' PASS 2f (6s) == ost-pools test 3a: pool_remove: non-existant pool ===== 07:02:15 (1740484935) PASS 3a (1s) == ost-pools test 3b: pool_remove: non-existant fsname === 07:02:16 (1740484936) PASS 3b (2s) == ost-pools test 3c: pool_remove: Invalid pool name ===== 07:02:18 (1740484938) PASS 3c (2s) == ost-pools test 3d: pool_remove: OST index combinations ========================================================== 07:02:20 (1740484940) oleg250-server: Pool lustre.testpool created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Waiting 90s for '' lustre.testpool oleg250-server: Pool lustre.testpool destroyed PASS 3d (21s) == ost-pools test 4a: pool_destroy: non-existant pool ==== 07:02:41 (1740484961) PASS 4a (2s) == ost-pools test 4b: pool_destroy: non-existant fs-name ========================================================== 07:02:43 (1740484963) PASS 4b (1s) == ost-pools test 4c: pool_destroy: non-empty pool ======= 07:02:44 (1740484964) oleg250-server: Pool lustre.testpool created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: pool_destroy: pool lustre.testpool not empty, please remove all members pdsh@oleg250-client: oleg250-server: ssh exited with exit code 39 lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' PASS 4c (11s) == ost-pools test 5a: lfs pool_list from client ========== 07:02:56 (1740484976) List pools or pool OSTs usage: pool_list [.] | oleg250-server: Pool lustre.testpool created oleg250-server: Pool lustre.testpool2 created Waiting 90s for '' Pools from lustre: lustre.testpool lustre.testpool2 oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool Pool: lustre.testpool Pool: lustre.nonexistantpool /home/green/git/lustre-release/lustre/utils/lfs pool_list /mnt/lustre Pools from lustre: lustre.testpool lustre.testpool2 Pools from lustre: lustre.testpool lustre.testpool2 lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed lustre.testpool2 oleg250-server: Pool lustre.testpool2 destroyed Waiting 90s for 'foo' PASS 5a (17s) == ost-pools test 5b: lctl pool_list from MDS ============ 07:03:13 (1740484993) list pools and pools members usage: pool_list [.] | oleg250-server: Pool lustre.testpool created oleg250-server: Pool lustre.testpool2 created Pools from lustre: lustre.testpool lustre.testpool2 oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool Pool: lustre.testpool lustre-OST0000_UUID lustre-OST0001_UUID Pool: lustre.nonexistantpool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed lustre.testpool2 oleg250-server: Pool lustre.testpool2 destroyed PASS 5b (20s) == ost-pools test 6: getstripe/setstripe ================= 07:03:33 (1740485013) oleg250-server: Pool lustre.testpool created Pools from lustre: lustre.testpool oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg250-server: Pool lustre.testpool2 created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool2 Destroy the created pools: testpool,testpool2 lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed lustre.testpool2 oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool2 oleg250-server: Pool lustre.testpool2 destroyed Waiting 90s for 'foo' PASS 6 (22s) == ost-pools test 7a: create various pool name =========== 07:03:55 (1740485035) set poolname to 7 Creating new pool 7 oleg250-server: Pool lustre.7 created Adding targets to pool oleg250-server: OST lustre-OST0000_UUID added to pool lustre.7 oleg250-server: OST lustre-OST0001_UUID added to pool lustre.7 Waiting 90s for 'lustre-OST0000_UUID lustre-OST0001_UUID ' oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.7 oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.7 oleg250-server: Pool lustre.7 destroyed set poolname to 761728382 Creating new pool 761728382 oleg250-server: Pool lustre.761728382 created Waiting 90s for '' Adding targets to pool oleg250-server: OST lustre-OST0000_UUID added to pool lustre.761728382 oleg250-server: OST lustre-OST0001_UUID added to pool lustre.761728382 oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.761728382 oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.761728382 oleg250-server: Pool lustre.761728382 destroyed set poolname to 7617310427142 Creating new pool 7617310427142 oleg250-server: Pool lustre.7617310427142 created Adding targets to pool oleg250-server: OST lustre-OST0000_UUID added to pool lustre.7617310427142 oleg250-server: OST lustre-OST0001_UUID added to pool lustre.7617310427142 Waiting 90s for 'lustre-OST0000_UUID lustre-OST0001_UUID ' oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.7617310427142 oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.7617310427142 oleg250-server: Pool lustre.7617310427142 destroyed Destroy the created pools: 7,761728382,7617310427142 Destroy the created pools: 7,761728382,7617310427142 Destroy the created pools: 7,761728382,7617310427142 PASS 7a (37s) == ost-pools test 7b: try to create pool name with invalid lengths or names ========================================================== 07:04:33 (1740485073) oleg250-server: pool_new: Invalid argument pdsh@oleg250-client: oleg250-server: ssh exited with exit code 22 oleg250-server: pool_new: Invalid argument pdsh@oleg250-client: oleg250-server: ssh exited with exit code 22 oleg250-server: pool_new: can contain only alphanumeric characters, underscores, and dashes besides the required '.' pdsh@oleg250-client: oleg250-server: ssh exited with exit code 22 oleg250-server: pool_new: poolname is too long oleg250-server: pool_new: File name too long pdsh@oleg250-client: oleg250-server: ssh exited with exit code 36 PASS 7b (2s) == ost-pools test 7c: create a valid pool name and setstripe with a bad one ========================================================== 07:04:35 (1740485075) Creating new pool 0123456789abcde oleg250-server: Pool lustre.0123456789abcde created Adding targets to pool oleg250-server: OST lustre-OST0000_UUID added to pool lustre.0123456789abcde oleg250-server: OST lustre-OST0001_UUID added to pool lustre.0123456789abcde lfs setstripe: Invalid Poolname '0123456789abcdeX': Invalid argument (22) oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.0123456789abcde oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.0123456789abcde oleg250-server: Pool lustre.0123456789abcde destroyed Destroy the created pools: 0123456789abcde PASS 7c (10s) == ost-pools test 11: OSTs in overlapping/multiple pools ========================================================== 07:04:45 (1740485085) oleg250-server: Pool lustre.testpool created oleg250-server: Pool lustre.testpool2 created Waiting 90s for '' oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool2 oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool total: 100 open/close in 0.30 seconds: 328.26 ops/second total: 100 open/close in 0.35 seconds: 282.83 ops/second Destroy the created pools: testpool,testpool2 lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' lustre.testpool2 oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool2 oleg250-server: Pool lustre.testpool2 destroyed Waiting 90s for 'foo' PASS 11 (125s) == ost-pools test 12: OST Pool Membership ================ 07:06:50 (1740485210) SKIP: ost-pools test_12 needs >=3 OSTs SKIP 12 (1s) == ost-pools test 13: Striping characteristics in a pool ========================================================== 07:06:51 (1740485211) SKIP: ost-pools test_13 needs >= 3 OSTs SKIP 13 (1s) == ost-pools test 14: Round robin and QOS striping within a pool ========================================================== 07:06:52 (1740485212) SKIP: ost-pools test_14 needs >= 3 OSTs SKIP 14 (1s) == ost-pools test 15: One directory per OST/pool ========= 07:06:53 (1740485213) oleg250-server: Pool lustre.testpool0 created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool0 total: 100 open/close in 0.24 seconds: 414.34 ops/second oleg250-server: Pool lustre.testpool1 created oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool1 total: 100 open/close in 0.21 seconds: 472.38 ops/second Destroy the created pools: testpool0,testpool1 lustre.testpool0 oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool0 oleg250-server: Pool lustre.testpool0 destroyed lustre.testpool1 oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool1 oleg250-server: Pool lustre.testpool1 destroyed PASS 15 (22s) == ost-pools test 16: Inheritance of pool properties ===== 07:07:15 (1740485235) oleg250-server: Pool lustre.testpool created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool total: 10 open/close in 0.04 seconds: 235.31 ops/second Destroy the created pools: testpool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' PASS 16 (17s) == ost-pools test 17: Referencing an empty pool ========== 07:07:32 (1740485252) oleg250-server: Pool lustre.testpool created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 10 open/close in 0.02 seconds: 403.00 ops/second lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed total: 10 open/close in 0.04 seconds: 281.84 ops/second PASS 17 (17s) == ost-pools test 18: File create in a directory which references a deleted pool ========================================================== 07:07:49 (1740485269) Create performance, iteration 1, 15 seconds x 3 oleg250-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg250-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 total: 6223 open/close in 15.00 seconds: 414.79 ops/second iter 1: 6223 creates without pool oleg250-server: Pool lustre.testpool created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg250-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg250-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 total: 5865 open/close in 15.00 seconds: 390.99 ops/second iter 1: 5865 creates with pool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed oleg250-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg250-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 total: 7250 open/close in 15.00 seconds: 483.30 ops/second iter 1: 7250 creates with missing pool Create performance, iteration 2, 15 seconds x 3 oleg250-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg250-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 total: 5770 open/close in 15.00 seconds: 384.61 ops/second iter 2: 5770 creates without pool oleg250-server: Pool lustre.testpool created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg250-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg250-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 total: 6037 open/close in 15.00 seconds: 402.47 ops/second iter 2: 6037 creates with pool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed oleg250-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg250-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 total: 6140 open/close in 15.00 seconds: 409.30 ops/second iter 2: 6140 creates with missing pool Create performance, iteration 3, 15 seconds x 3 oleg250-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg250-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 total: 6461 open/close in 15.00 seconds: 430.72 ops/second iter 3: 6461 creates without pool oleg250-server: Pool lustre.testpool created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg250-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg250-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 total: 6621 open/close in 15.00 seconds: 441.34 ops/second iter 3: 6621 creates with pool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed oleg250-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg250-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 total: 6412 open/close in 15.00 seconds: 427.41 ops/second iter 3: 6412 creates with missing pool Avg files created in 15 seconds without pool: 6151 Avg files created in 15 seconds with pool: 6174 Avg files created in 15 seconds missing pool: 6600 No pool / wide pool: 0 %. No pool / missing pool: -7 %. PASS 18 (335s) == ost-pools test 19: Pools should not come into play when not specified ========================================================== 07:13:24 (1740485604) oleg250-server: Pool lustre.testpool created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool total: 12 open/close in 0.03 seconds: 428.14 ops/second total: 12 open/close in 0.03 seconds: 441.35 ops/second Destroy the created pools: testpool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' Updated after 2s: want 'foo' got 'foo' PASS 19 (19s) == ost-pools test 20: Different pools in a directory hierarchy. ========================================================== 07:13:43 (1740485623) oleg250-server: Pool lustre.testpool created oleg250-server: Pool lustre.testpool2 created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool2 Destroy the created pools: testpool,testpool2 lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' lustre.testpool2 oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool2 oleg250-server: Pool lustre.testpool2 destroyed Waiting 90s for 'foo' PASS 20 (25s) == ost-pools test 21: OST pool with fewer OSTs than stripe count ========================================================== 07:14:08 (1740485648) oleg250-server: Pool lustre.testpool created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool /mnt/lustre/d21.ost-pools/dir/file1 lmm_magic: 0x0BD30BD0 lmm_seq: 0x240000402 lmm_object_id: 0x111 lmm_fid: [0x240000402:0x111:0x0] lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 lmm_pool: testpool obdidx objid objid group 0 140 0x8c 0x280000400 Destroy the created pools: testpool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed PASS 21 (11s) == ost-pools test 22: Simultaneous manipulation of a pool ========================================================== 07:14:19 (1740485659) oleg250-server: Pool lustre.testpool created Waiting 90s for '' oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: Pool lustre.testpool2 created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool2 loop for testpool loop for testpool2 Pool testpool, iteration 1 Pool testpool2, iteration 1 Pool testpool2, iteration 2 oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 2 Pool testpool2, iteration 3 Pool testpool2, iteration 4 oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool2, iteration 5 Pool testpool, iteration 3 Pool testpool2, iteration 6 Pool testpool2, iteration 7 Pool testpool2, iteration 8 Pool testpool2, iteration 9 Pool testpool2, iteration 10 loop for testpool2 complete oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 4 oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 5 total: 100 open/close in 0.26 seconds: 388.23 ops/second oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 6 oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 7 oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 8 oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 9 oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 10 oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool loop for testpool complete Destroy the created pools: testpool,testpool2 lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed lustre.testpool2 oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool2 oleg250-server: Pool lustre.testpool2 destroyed PASS 22 (33s) == ost-pools test 23a: OST pools and quota =============== 07:14:52 (1740485692) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7617] oleg250-server: Pool lustre.testpool created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool Disk quotas for usr 500 (uid 500): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre/d23a.ost-pools/dir 0 3072 3072 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - 0 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 -rw-r--r-- 1 sanityusr sanityusr 0 Feb 25 07:15 /mnt/lustre/d23a.ost-pools/dir/f23a.ost-pools-quota first dd failed with EDQUOT. Disk quotas for usr 500 (uid 500): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre/d23a.ost-pools/dir 0 3072 3072 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - 0 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Destroy the created pools: testpool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' PASS 23a (22s) == ost-pools test 23b: OST pools and OOS ================= 07:15:14 (1740485714) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7617] oleg250-server: Pool lustre.testpool created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 5732 1281956 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1860 1285828 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1536 3605484 1% /mnt/lustre[OST:0] filesystem_summary: 3833116 1536 3605484 1% /mnt/lustre OSTCOUNT=2, OSTSIZE=0, SLOW=yes, POOL=testpool pool_avail=3605484, maxfree=31457280 iteration 1: dd: error writing '/mnt/lustre/d23b.ost-pools/dir/f23b.ost-pools-quota.1': No space left on device 3519+0 records in 3518+0 records out 3689160704 bytes (3.7 GB) copied, 24.0468 s, 153 MB/s 3602700 -rw-r--r-- 1 root root 3689160704 Feb 25 07:15 /mnt/lustre/d23b.ost-pools/dir/f23b.ost-pools-quota.1 total written: 5242880 start=907, end=931, elapsed=24 Filesystem Size Used Avail Use% Mounted on devtmpfs 1.9G 0 1.9G 0% /dev tmpfs 1.9G 0 1.9G 0% /dev/shm tmpfs 1.9G 17M 1.9G 1% /run tmpfs 1.9G 0 1.9G 0% /sys/fs/cgroup /dev/nbd0 30G 12G 16G 43% / none 1.9G 32M 1.8G 2% /var/lib/stateless/writable /dev/vda 57M 57M 0 100% /home/green/git/lustre-release 192.168.200.253:/exports/state/oleg250-client.virtnet 118G 93G 20G 83% /var/lib/stateless/state 192.168.200.253:/exports/state/oleg250-client.virtnet/boot 118G 93G 20G 83% /boot 192.168.200.253:/exports/state/oleg250-client.virtnet/etc/kdump.conf 118G 93G 20G 83% /etc/kdump.conf 192.168.200.253:/exports/testreports/49584/testresults/ost-pools-ldiskfs-DNE-centos7_x86_64-centos7_x86_64 51T 24T 27T 48% /tmp/testlogs tmpfs 374M 0 374M 0% /run/user/0 192.168.202.150@tcp:/lustre 7.4G 3.1G 3.7G 46% /mnt/lustre Waiting for MDT destroys to complete oleg250-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg250-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 Destroy the created pools: testpool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' PASS 23b (53s) == ost-pools test 24: Independence of pool from other setstripe parameters ========================================================== 07:16:07 (1740485767) oleg250-server: Pool lustre.testpool created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 10 open/close in 0.02 seconds: 418.92 ops/second total: 10 open/close in 0.02 seconds: 413.91 ops/second total: 10 open/close in 0.02 seconds: 469.00 ops/second total: 10 open/close in 0.03 seconds: 389.20 ops/second Destroy the created pools: testpool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' PASS 24 (26s) == ost-pools test 25: Create new pool and restart MDS ==== 07:16:33 (1740485793) oleg250-server: Pool lustre.testpool1 created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool1 Failing mds1 on oleg250-server Stopping /mnt/lustre-mds1 (opts:) on oleg250-server 07:16:39 (1740485799) shut down facet: mds1 facet_host: oleg250-server facet_failover_host: oleg250-server Failover mds1 to oleg250-server mount facets: mds1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg250-server: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg250-client: oleg250-server: ssh exited with exit code 1 Started lustre-MDT0000 07:16:52 (1740485812) targets are mounted 07:16:52 (1740485812) facet_failover done oleg250-server: oleg250-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg250-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0000-osc-MDT0001.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0001.old_sync_processed wait 40 secs maximumly for oleg250-server mds-ost sync done. Creating a file in pool1 Destroy the created pools: testpool1 lustre.testpool1 oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool1 oleg250-server: Pool lustre.testpool1 destroyed Waiting 90s for 'foo' PASS 25 (37s) == ost-pools test 26: Choose other OSTs in the pool first in the creation remedy ========================================================== 07:17:10 (1740485830) SKIP: ost-pools test_26 needs >= 3 OSTs SKIP 26 (1s) == ost-pools test 27: Race pool_list and pool_remove ===== 07:17:11 (1740485831) oleg250-server: Pool lustre.testpool created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool fail_loc=0x239 fail_val=10 fail_loc=0 lustre-OST0001_UUID oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool fail_val=0 lustre.testpool oleg250-server: Pool lustre.testpool destroyed PASS 27 (19s) == ost-pools test 28: lfs_migrate with pool name ========= 07:17:30 (1740485850) oleg250-server: Pool lustre.testpool created oleg250-server: Pool lustre.testpool2 created oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg250-server: OST lustre-OST0000_UUID added to pool lustre.testpool2 oleg250-server: OST lustre-OST0001_UUID added to pool lustre.testpool2 debug=-1 debug_mb=150 debug=-1 debug_mb=150 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0290796 s, 36.1 MB/s /mnt/lustre/f28.ost-pools lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_pool: testpool obdidx objid objid group 1 47810 0xbac2 0x2c0000401 /mnt/lustre/f28.ost-pools: done /mnt/lustre/f28.ost-pools lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 1 lmm_stripe_offset: 1 lmm_pool: testpool2 obdidx objid objid group 1 47811 0xbac3 0x2c0000401 /mnt/lustre/f28.ost-pools: 0: lcm_mirror_count: mirror=1 1: 1 2: lcm_entry_count: comp=0 3: 0 4: components: 5: - 6: lcme_id: 7: N/A 8: sub_layout: 9: lmm_stripe_count: count=1 10: 1 11: lmm_stripe_size: size=4194304 12: 4194304 13: lmm_pool: pool=testpool2 14: testpool2 stripe_count=1,stripe_size=4194304,pool=testpool2 /home/green/git/lustre-release/lustre/utils/lfs migrate -c 1 -S 4194304 -p testpool2 "/mnt/lustre/f28.ost-pools" done /mnt/lustre/f28.ost-pools lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 2 lmm_stripe_offset: 0 lmm_pool: testpool2 obdidx objid objid group 0 47844 0xbae4 0x280000401 debug_mb=21 debug_mb=21 Destroy the created pools: testpool,testpool2 lustre.testpool oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg250-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' lustre.testpool2 oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.testpool2 oleg250-server: OST lustre-OST0001_UUID removed from pool lustre.testpool2 oleg250-server: Pool lustre.testpool2 destroyed Waiting 90s for 'foo' PASS 28 (29s) == ost-pools test 29: check OST pool spilling ============ 07:17:59 (1740485879) SKIP: ost-pools test_29 needs >= 4 OSTs SKIP 29 (1s) == ost-pools test 30: persistent OST pool spilling ======= 07:18:00 (1740485880) SKIP: ost-pools test_30 needs >= 4 OSTs SKIP 30 (1s) == ost-pools test 31: OST pool spilling chained ========== 07:18:01 (1740485881) SKIP: ost-pools test_31 needs >= 4 OSTs SKIP 31 (0s) == ost-pools test 32: force to create a file without pool (no inheritance) ========================================================== 07:18:01 (1740485881) Creating new pool test_32 oleg250-server: Pool lustre.test_32 created Adding targets to pool oleg250-server: OST lustre-OST0000_UUID added to pool lustre.test_32 Waiting 90s for 'lustre-OST0000_UUID ' striped dir -i0 -c2 -H crush /mnt/lustre/d32.ost-pools Destroy the created pools: test_32 lustre.test_32 oleg250-server: OST lustre-OST0000_UUID removed from pool lustre.test_32 oleg250-server: Pool lustre.test_32 destroyed Waiting 90s for 'foo' PASS 32 (13s) == ost-pools test complete, duration 1076 sec ============ 07:18:14 (1740485894) === ost-pools: start cleanup 07:18:14 (1740485894) === === ost-pools: finish cleanup 07:18:16 (1740485896) ===