-----============= acceptance-small: ost-pools ============----- Sun Feb 25 00:27:46 EST 2024 excepting tests: === ost-pools: start setup 00:27:48 (1708838868) === oleg112-client.virtnet: executing check_config_client /mnt/lustre oleg112-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg112-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012aaa9000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012aaa9000.idle_timeout=debug disable quota as required oleg112-server: oleg112-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === ost-pools: finish setup 00:27:55 (1708838875) === stripe_count: 1 stripe_size: 4194304 pattern: 0 stripe_offset: -1 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 1a: Create a pool with a 1 character pool name ========================================================== 00:27:56 (1708838876) oleg112-server: Pool lustre.p created lustre.p oleg112-server: Pool lustre.p destroyed PASS 1a (7s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 1b: Create a pool with a 10 char pool name ========================================================== 00:28:05 (1708838885) oleg112-server: Pool lustre.testpool12 created lustre.testpool12 oleg112-server: Pool lustre.testpool12 destroyed PASS 1b (7s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 1c: Create a pool with a 15 char pool name ========================================================== 00:28:14 (1708838894) oleg112-server: Pool lustre.testpool1234567 created lustre.testpool1234567 oleg112-server: Pool lustre.testpool1234567 destroyed PASS 1c (6s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 1d: Create a pool with a 16 char pool name; should fail ========================================================== 00:28:22 (1708838902) oleg112-server: pool_new: poolname is too long oleg112-server: pool_new: File name too long pdsh@oleg112-client: oleg112-server: ssh exited with exit code 36 PASS 1d (1s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 1e: Create a pool with a 1000 char pool name; should fail ========================================================== 00:28:25 (1708838905) oleg112-server: pool_new: poolname is too long oleg112-server: pool_new: File name too long pdsh@oleg112-client: oleg112-server: ssh exited with exit code 36 PASS 1e (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 1f: pool_new should fail if fs-name is missing ========================================================== 00:28:28 (1708838908) oleg112-server: pool_new: Invalid argument pdsh@oleg112-client: oleg112-server: ssh exited with exit code 22 PASS 1f (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 1g: pool_new should fail if fs-name is missing ========================================================== 00:28:31 (1708838911) oleg112-server: pool_new: Invalid argument pdsh@oleg112-client: oleg112-server: ssh exited with exit code 22 PASS 1g (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 1h: pool_new should fail if poolname is missing ========================================================== 00:28:34 (1708838914) oleg112-server: pool_new: Invalid argument pdsh@oleg112-client: oleg112-server: ssh exited with exit code 22 PASS 1h (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 1i: pool_new should fail if poolname and fs-name are missing ========================================================== 00:28:37 (1708838917) oleg112-server: pool_new: Invalid argument pdsh@oleg112-client: oleg112-server: ssh exited with exit code 22 PASS 1i (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 1j: pool_new should fail if poolname format is wrong ========================================================== 00:28:40 (1708838920) oleg112-server: pool_new: Invalid argument pdsh@oleg112-client: oleg112-server: ssh exited with exit code 22 PASS 1j (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 1k: pool_new should fail if poolname format is wrong ========================================================== 00:28:43 (1708838923) oleg112-server: pool_new: Invalid argument pdsh@oleg112-client: oleg112-server: ssh exited with exit code 22 PASS 1k (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 1m: pool_new did not fail even though testpool2 existed ========================================================== 00:28:46 (1708838926) oleg112-server: Pool lustre.testpool2 created oleg112-server: pool_new: pool lustre.testpool2 already exists pdsh@oleg112-client: oleg112-server: ssh exited with exit code 17 lustre.testpool2 oleg112-server: Pool lustre.testpool2 destroyed PASS 1m (8s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 1n: Pool with a 15 char pool name works well ========================================================== 00:28:55 (1708838935) oleg112-server: Pool lustre.testpool1234567 created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool1234567 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.551371 s, 190 MB/s oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool1234567 lustre.testpool1234567 oleg112-server: Pool lustre.testpool1234567 destroyed Waiting 90s for 'foo' PASS 1n (11s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 2a: pool_add: non-existant pool testpool ========================================================== 00:29:07 (1708838947) PASS 2a (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 2b: pool_add: Invalid pool name ======== 00:29:11 (1708838951) PASS 2b (1s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 2c: pool_add: OST index combinations === 00:29:14 (1708838954) oleg112-server: Pool lustre.testpool created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool lustre.testpool oleg112-server: Pool lustre.testpool destroyed PASS 2c (22s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 2d: pool_add: OSTs that don't exist should be rejected ========================================================== 00:29:38 (1708838978) oleg112-server: Pool lustre.testpool created oleg112-server: pool_add: lustre-OST0002_UUID is not part of the 'lustre' fs. pdsh@oleg112-client: oleg112-server: ssh exited with exit code 19 lustre.testpool oleg112-server: Pool lustre.testpool destroyed PASS 2d (7s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 2e: pool_add: OST already in a pool should be rejected ========================================================== 00:29:46 (1708838986) oleg112-server: Pool lustre.testpool created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool pdsh@oleg112-client: oleg112-server: ssh exited with exit code 17 pool_add: lustre-OST0000_UUID is already in pool lustre.testpool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed PASS 2e (12s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 2f: check -n|--nowait option =========== 00:30:00 (1708839000) Waiting 90s for 'lustre-OST0000_UUID' Updated after 2s: want 'lustre-OST0000_UUID' got 'lustre-OST0000_UUID' PASS 2f (5s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 3a: pool_remove: non-existant pool ===== 00:30:07 (1708839007) PASS 3a (1s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 3b: pool_remove: non-existant fsname === 00:30:10 (1708839010) PASS 3b (1s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 3c: pool_remove: Invalid pool name ===== 00:30:13 (1708839013) PASS 3c (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 3d: pool_remove: OST index combinations ========================================================== 00:30:16 (1708839016) oleg112-server: Pool lustre.testpool created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool Waiting 90s for '' oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Waiting 90s for '' lustre.testpool oleg112-server: Pool lustre.testpool destroyed PASS 3d (23s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 4a: pool_destroy: non-existant pool ==== 00:30:41 (1708839041) PASS 4a (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 4b: pool_destroy: non-existant fs-name ========================================================== 00:30:44 (1708839044) PASS 4b (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 4c: pool_destroy: non-empty pool ======= 00:30:47 (1708839047) oleg112-server: Pool lustre.testpool created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: pool_destroy: pool lustre.testpool not empty, please remove all members pdsh@oleg112-client: oleg112-server: ssh exited with exit code 39 lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed PASS 4c (10s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 5a: lfs pool_list from client ========== 00:30:59 (1708839059) List pools or pool OSTs usage: pool_list [.] | oleg112-server: Pool lustre.testpool created oleg112-server: Pool lustre.testpool2 created Pools from lustre: lustre.testpool lustre.testpool2 oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool Pool: lustre.testpool lustre-OST0000_UUID lustre-OST0001_UUID Pool: lustre.nonexistantpool /home/green/git/lustre-release/lustre/utils/lfs pool_list /mnt/lustre Pools from lustre: lustre.testpool lustre.testpool2 Pools from lustre: lustre.testpool lustre.testpool2 lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed lustre.testpool2 oleg112-server: Pool lustre.testpool2 destroyed PASS 5a (16s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 5b: lctl pool_list from MDS ============ 00:31:17 (1708839077) list pools and pools members usage: pool_list [.] | oleg112-server: Pool lustre.testpool created oleg112-server: Pool lustre.testpool2 created Waiting 90s for '' Pools from lustre: lustre.testpool lustre.testpool2 oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool Pool: lustre.testpool lustre-OST0000_UUID lustre-OST0001_UUID Pool: lustre.nonexistantpool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' lustre.testpool2 oleg112-server: Pool lustre.testpool2 destroyed PASS 5b (21s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 6: getstripe/setstripe ================= 00:31:40 (1708839100) oleg112-server: Pool lustre.testpool created Pools from lustre: lustre.testpool oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg112-server: Pool lustre.testpool2 created Waiting 90s for '' oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool2 Destroy the created pools: testpool,testpool2 lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' lustre.testpool2 oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool2 oleg112-server: Pool lustre.testpool2 destroyed PASS 6 (24s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 7a: create various pool name =========== 00:32:05 (1708839125) set poolname to 6 Creating new pool oleg112-server: Pool lustre.6 created Adding targets to pool oleg112-server: OST lustre-OST0000_UUID added to pool lustre.6 oleg112-server: OST lustre-OST0001_UUID added to pool lustre.6 oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.6 oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.6 oleg112-server: Pool lustre.6 destroyed set poolname to 669018759 Creating new pool oleg112-server: Pool lustre.669018759 created Adding targets to pool oleg112-server: OST lustre-OST0000_UUID added to pool lustre.669018759 oleg112-server: OST lustre-OST0001_UUID added to pool lustre.669018759 oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.669018759 oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.669018759 oleg112-server: Pool lustre.669018759 destroyed set poolname to 66901924214457 Creating new pool oleg112-server: Pool lustre.66901924214457 created Adding targets to pool oleg112-server: OST lustre-OST0000_UUID added to pool lustre.66901924214457 oleg112-server: OST lustre-OST0001_UUID added to pool lustre.66901924214457 Waiting 90s for 'lustre-OST0000_UUID lustre-OST0001_UUID ' oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.66901924214457 oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.66901924214457 oleg112-server: Pool lustre.66901924214457 destroyed Destroy the created pools: 6,669018759,66901924214457 Destroy the created pools: 6,669018759,66901924214457 Destroy the created pools: 6,669018759,66901924214457 PASS 7a (32s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 7b: try to create pool name with invalid lengths or names ========================================================== 00:32:38 (1708839158) oleg112-server: pool_new: Invalid argument pdsh@oleg112-client: oleg112-server: ssh exited with exit code 22 oleg112-server: pool_new: Invalid argument pdsh@oleg112-client: oleg112-server: ssh exited with exit code 22 oleg112-server: pool_new: can contain only alphanumeric characters, underscores, and dashes besides the required '.' pdsh@oleg112-client: oleg112-server: ssh exited with exit code 22 oleg112-server: pool_new: poolname is too long oleg112-server: pool_new: File name too long pdsh@oleg112-client: oleg112-server: ssh exited with exit code 36 PASS 7b (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 7c: create a valid pool name and setstripe with a bad one ========================================================== 00:32:42 (1708839162) Creating new pool oleg112-server: Pool lustre.0123456789abcde created Adding targets to pool oleg112-server: OST lustre-OST0000_UUID added to pool lustre.0123456789abcde oleg112-server: OST lustre-OST0001_UUID added to pool lustre.0123456789abcde Waiting 90s for 'lustre-OST0000_UUID lustre-OST0001_UUID ' lfs setstripe: Invalid Poolname '0123456789abcdeX': Invalid argument (22) oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.0123456789abcde oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.0123456789abcde oleg112-server: Pool lustre.0123456789abcde destroyed Destroy the created pools: 0123456789abcde PASS 7c (12s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 11: OSTs in overlapping/multiple pools ========================================================== 00:32:55 (1708839175) oleg112-server: Pool lustre.testpool created oleg112-server: Pool lustre.testpool2 created Waiting 90s for '' oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool2 oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool total: 100 open/close in 0.24 seconds: 417.96 ops/second total: 100 open/close in 0.24 seconds: 422.26 ops/second Destroy the created pools: testpool,testpool2 lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' lustre.testpool2 oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool2 oleg112-server: Pool lustre.testpool2 destroyed PASS 11 (121s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 12: OST Pool Membership ================ 00:34:58 (1708839298) SKIP: ost-pools test_12 needs >=3 OSTs SKIP 12 (1s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 13: Striping characteristics in a pool ========================================================== 00:35:00 (1708839300) SKIP: ost-pools test_13 needs >= 3 OSTs SKIP 13 (1s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 14: Round robin and QOS striping within a pool ========================================================== 00:35:02 (1708839302) SKIP: ost-pools test_14 needs >= 3 OSTs SKIP 14 (1s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 15: One directory per OST/pool ========= 00:35:04 (1708839304) oleg112-server: Pool lustre.testpool0 created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool0 total: 100 open/close in 0.34 seconds: 293.90 ops/second oleg112-server: Pool lustre.testpool1 created oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool1 total: 100 open/close in 0.28 seconds: 357.10 ops/second Destroy the created pools: testpool0,testpool1 lustre.testpool0 oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool0 oleg112-server: Pool lustre.testpool0 destroyed Waiting 90s for 'foo' lustre.testpool1 oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool1 oleg112-server: Pool lustre.testpool1 destroyed PASS 15 (27s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 16: Inheritance of pool properties ===== 00:35:33 (1708839333) oleg112-server: Pool lustre.testpool created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool total: 10 open/close in 0.04 seconds: 261.17 ops/second Destroy the created pools: testpool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' PASS 16 (17s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 17: Referencing an empty pool ========== 00:35:51 (1708839351) oleg112-server: Pool lustre.testpool created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 10 open/close in 0.03 seconds: 331.87 ops/second lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed total: 10 open/close in 0.02 seconds: 431.82 ops/second PASS 17 (19s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 18: File create in a directory which references a deleted pool ========================================================== 00:36:12 (1708839372) Create performance, iteration 1, 15 seconds x 3 total: 5313 open/close in 15.00 seconds: 354.14 ops/second iter 1: 5313 creates without pool oleg112-server: Pool lustre.testpool created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 5619 open/close in 15.00 seconds: 374.54 ops/second iter 1: 5619 creates with pool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed total: 5448 open/close in 15.00 seconds: 363.17 ops/second iter 1: 5448 creates with missing pool Create performance, iteration 2, 15 seconds x 3 total: 5517 open/close in 15.00 seconds: 367.77 ops/second iter 2: 5517 creates without pool oleg112-server: Pool lustre.testpool created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 5182 open/close in 15.00 seconds: 345.46 ops/second iter 2: 5182 creates with pool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed total: 5085 open/close in 15.00 seconds: 338.95 ops/second iter 2: 5085 creates with missing pool Create performance, iteration 3, 15 seconds x 3 total: 5136 open/close in 15.00 seconds: 342.38 ops/second iter 3: 5136 creates without pool oleg112-server: Pool lustre.testpool created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 3477 open/close in 15.00 seconds: 231.76 ops/second iter 3: 3477 creates with pool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed total: 4016 open/close in 15.00 seconds: 267.70 ops/second iter 3: 4016 creates with missing pool Avg files created in 15 seconds without pool: 5322 Avg files created in 15 seconds with pool: 4759 Avg files created in 15 seconds missing pool: 4849 No pool / wide pool: 10 %. No pool / missing pool: 8 %. PASS 18 (390s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 19: Pools should not come into play when not specified ========================================================== 00:42:44 (1708839764) oleg112-server: Pool lustre.testpool created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool total: 12 open/close in 0.05 seconds: 237.50 ops/second total: 12 open/close in 0.03 seconds: 384.08 ops/second Destroy the created pools: testpool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed PASS 19 (20s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 20: Different pools in a directory hierarchy. ========================================================== 00:43:06 (1708839786) oleg112-server: Pool lustre.testpool created oleg112-server: Pool lustre.testpool2 created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool2 Destroy the created pools: testpool,testpool2 lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' lustre.testpool2 oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool2 oleg112-server: Pool lustre.testpool2 destroyed PASS 20 (26s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 21: OST pool with fewer OSTs than stripe count ========================================================== 00:43:34 (1708839814) oleg112-server: Pool lustre.testpool created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool /mnt/lustre/d21.ost-pools/dir/file1 lmm_magic: 0x0BD30BD0 lmm_seq: 0x200000401 lmm_object_id: 0xb0fc lmm_fid: [0x200000401:0xb0fc:0x0] lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 lmm_pool: testpool obdidx objid objid group 0 37068 0x90cc 0x240000400 Destroy the created pools: testpool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed PASS 21 (14s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 22: Simultaneous manipulation of a pool ========================================================== 00:43:50 (1708839830) oleg112-server: Pool lustre.testpool created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: Pool lustre.testpool2 created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool2 loop for testpool loop for testpool2 Pool testpool2, iteration 1 Pool testpool, iteration 1 Pool testpool2, iteration 2 Pool testpool2, iteration 3 oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 2 Pool testpool2, iteration 4 Pool testpool2, iteration 5 oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 3 Pool testpool2, iteration 6 oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool2, iteration 7 Pool testpool, iteration 4 Pool testpool2, iteration 8 Pool testpool2, iteration 9 Pool testpool2, iteration 10 loop for testpool2 complete oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 5 oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 6 oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 7 total: 100 open/close in 0.44 seconds: 228.59 ops/second oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 8 oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 9 oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 10 oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool loop for testpool complete Destroy the created pools: testpool,testpool2 lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' lustre.testpool2 oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool2 oleg112-server: Pool lustre.testpool2 destroyed PASS 22 (32s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 23a: OST pools and quota =============== 00:44:24 (1708839864) running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6690] oleg112-server: Pool lustre.testpool created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool Disk quotas for usr 500 (uid 500): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre/d23a.ost-pools/dir 0 3072 3072 - 0 0 0 - lustre-MDT0000_UUID 0 - 0 - 0 - 0 - lustre-OST0000_UUID 0 - 0 - - - - - lustre-OST0001_UUID 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 uid 500 is using default file quota setting -rw-r--r-- 1 sanityusr sanityusr 0 Feb 25 00:44 /mnt/lustre/d23a.ost-pools/dir/f23a.ost-pools-quota Disk quotas for usr 500 (uid 500): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre/d23a.ost-pools/dir 2053 3072 3072 - 1 0 0 - lustre-MDT0000_UUID 2 - 0 - 1 - 0 - lustre-OST0000_UUID 2052 - 3072 - - - - - lustre-OST0001_UUID 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 3072 uid 500 is using default file quota setting running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d23a.ost-pools/dir/f23a.ost-pools-quota] [bs=1024] [count=1024] [seek=2048] dd: error writing '/mnt/lustre/d23a.ost-pools/dir/f23a.ost-pools-quota': Disk quota exceeded 1+0 records in 0+0 records out 0 bytes (0 B) copied, 0.0066713 s, 0.0 kB/s Disk quotas for usr 500 (uid 500): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre/d23a.ost-pools/dir 2053 3072 3072 - 1 0 0 - lustre-MDT0000_UUID 2 - 0 - 1 - 0 - lustre-OST0000_UUID 2052 - 3072 - - - - - lustre-OST0001_UUID 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 3072 uid 500 is using default file quota setting Destroy the created pools: testpool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' PASS 23a (22s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 23b: OST pools and OOS ================= 00:44:48 (1708839888) running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6690] oleg112-server: Pool lustre.testpool created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool OSTCOUNT=2, OSTSIZE=0, AVAIL=3766272 MAXFREE=31457280, SLOW=yes [1 iteration] dd: error writing '/mnt/lustre/d23b.ost-pools/dir/f23b.ost-pools-quota1': No space left on device 3656+0 records in 3655+0 records out 3832545280 bytes (3.8 GB) copied, 18.8077 s, 204 MB/s total written: 5242880 stime=1708839900, etime=1708839919, elapsed=19 Filesystem Size Used Avail Use% Mounted on devtmpfs 1.9G 0 1.9G 0% /dev tmpfs 1.9G 0 1.9G 0% /dev/shm tmpfs 1.9G 17M 1.9G 1% /run tmpfs 1.9G 0 1.9G 0% /sys/fs/cgroup /dev/nbd0 30G 12G 17G 42% / none 1.9G 32M 1.8G 2% /var/lib/stateless/writable /dev/vda 33M 33M 0 100% /home/green/git/lustre-release 192.168.200.253:/exports/state/oleg112-client.virtnet 98G 71G 23G 77% /var/lib/stateless/state 192.168.200.253:/exports/state/oleg112-client.virtnet/boot 98G 71G 23G 77% /boot 192.168.200.253:/exports/state/oleg112-client.virtnet/etc/kdump.conf 98G 71G 23G 77% /etc/kdump.conf 192.168.200.253:/exports/testreports/40120/testresults/ost-pools-zfs-centos7_x86_64-centos7_x86_64 51T 12T 40T 23% /tmp/testlogs tmpfs 374M 0 374M 0% /run/user/0 192.168.201.112@tcp:/lustre 7.2G 3.6G 3.7G 50% /mnt/lustre Destroy the created pools: testpool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed PASS 23b (38s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 24: Independence of pool from other setstripe parameters ========================================================== 00:45:28 (1708839928) oleg112-server: Pool lustre.testpool created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 10 open/close in 0.06 seconds: 166.23 ops/second total: 10 open/close in 0.05 seconds: 186.53 ops/second total: 10 open/close in 0.03 seconds: 358.01 ops/second total: 10 open/close in 0.03 seconds: 286.84 ops/second Destroy the created pools: testpool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed PASS 24 (28s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 25: Create new pool and restart MDS ==== 00:45:58 (1708839958) oleg112-server: Pool lustre.testpool1 created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool1 Failing mds1 on oleg112-server Stopping /mnt/lustre-mds1 (opts:) on oleg112-server 00:46:05 (1708839965) shut down Failover mds1 to oleg112-server mount facets: mds1 Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg112-server: oleg112-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg112-client: oleg112-server: ssh exited with exit code 1 Started lustre-MDT0000 00:46:18 (1708839978) targets are mounted 00:46:18 (1708839978) facet_failover done oleg112-server: oleg112-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg112-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg112-server mds-ost sync done. Creating a file in pool1 Destroy the created pools: testpool1 lustre.testpool1 oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool1 oleg112-server: Pool lustre.testpool1 destroyed Waiting 90s for 'foo' PASS 25 (39s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 26: Choose other OSTs in the pool first in the creation remedy ========================================================== 00:46:39 (1708839999) SKIP: ost-pools test_26 needs >= 3 OSTs SKIP 26 (1s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 27: Race pool_list and pool_remove ===== 00:46:42 (1708840002) oleg112-server: Pool lustre.testpool created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool fail_loc=0x239 fail_val=10 fail_loc=0 lustre-OST0001_UUID oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool fail_val=0 lustre.testpool oleg112-server: Pool lustre.testpool destroyed PASS 27 (20s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 28: lfs_migrate with pool name ========= 00:47:03 (1708840023) oleg112-server: Pool lustre.testpool created oleg112-server: Pool lustre.testpool2 created oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg112-server: OST lustre-OST0000_UUID added to pool lustre.testpool2 oleg112-server: OST lustre-OST0001_UUID added to pool lustre.testpool2 debug=-1 debug_mb=150 debug=-1 debug_mb=150 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0646364 s, 16.2 MB/s /mnt/lustre/f28.ost-pools lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_pool: testpool obdidx objid objid group 1 37090 0x90e2 0x280000400 /mnt/lustre/f28.ost-pools: done /mnt/lustre/f28.ost-pools lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 1 lmm_stripe_offset: 0 lmm_pool: testpool2 obdidx objid objid group 0 37252 0x9184 0x240000400 debug_mb=21 debug_mb=21 debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck Destroy the created pools: testpool,testpool2 lustre.testpool oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg112-server: Pool lustre.testpool destroyed lustre.testpool2 oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.testpool2 oleg112-server: OST lustre-OST0001_UUID removed from pool lustre.testpool2 oleg112-server: Pool lustre.testpool2 destroyed PASS 28 (28s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 29: check OST pool spilling ============ 00:47:33 (1708840053) SKIP: ost-pools test_29 needs >= 4 OSTs SKIP 29 (1s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 30: persistent OST pool spilling ======= 00:47:37 (1708840057) SKIP: ost-pools test_30 needs >= 4 OSTs SKIP 30 (1s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 31: OST pool spilling chained ========== 00:47:40 (1708840060) SKIP: ost-pools test_31 needs >= 4 OSTs SKIP 31 (1s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == ost-pools test 32: force to create a file without pool (no inheritance) ========================================================== 00:47:44 (1708840064) Creating new pool oleg112-server: Pool lustre.test_32 created Adding targets to pool oleg112-server: OST lustre-OST0000_UUID added to pool lustre.test_32 Creating new pool oleg112-server: Pool lustre.ignore_pool created Destroy the created pools: ignore_pool,test_32 lustre.ignore_pool oleg112-server: Pool lustre.ignore_pool destroyed lustre.test_32 oleg112-server: OST lustre-OST0000_UUID removed from pool lustre.test_32 oleg112-server: Pool lustre.test_32 destroyed Waiting 90s for 'foo' PASS 32 (19s) debug_raw_pointers=0 debug_raw_pointers=0 == ost-pools test complete, duration 1217 sec ============ 00:48:04 (1708840084) === ost-pools: start cleanup 00:48:05 (1708840085) === === ost-pools: finish cleanup 00:48:07 (1708840087) ===