-----============= acceptance-small: ost-pools ============----- Wed Jan 15 18:14:44 EST 2025 excepting tests: oleg149-client.virtnet: executing check_config_client /mnt/lustre oleg149-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg149-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a5ad000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a5ad000.idle_timeout=debug disable quota as required oleg149-server: oleg149-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 stripe_count: 1 stripe_size: 1048576 pattern: 0 stripe_offset: -1 == ost-pools test 1a: Create a pool with a 1 character pool name ========================================================== 18:15:01 (1736982901) oleg149-server: Pool lustre.p created lustre.p oleg149-server: Pool lustre.p destroyed PASS 1a (9s) == ost-pools test 1b: Create a pool with a 10 char pool name ========================================================== 18:15:10 (1736982910) oleg149-server: Pool lustre.testpool12 created lustre.testpool12 oleg149-server: Pool lustre.testpool12 destroyed PASS 1b (9s) == ost-pools test 1c: Create a pool with a 15 char pool name ========================================================== 18:15:19 (1736982919) oleg149-server: Pool lustre.testpool1234567 created lustre.testpool1234567 oleg149-server: Pool lustre.testpool1234567 destroyed PASS 1c (10s) == ost-pools test 1d: Create a pool with a 16 char pool name; should fail ========================================================== 18:15:29 (1736982929) oleg149-server: error: pool_new: either the pool or file system name is too long (max pool name len is 15 and file system name is 8) oleg149-server: pool_new: File name too long pdsh@oleg149-client: oleg149-server: ssh exited with exit code 36 PASS 1d (3s) == ost-pools test 1e: Create a pool with a 1000 char pool name; should fail ========================================================== 18:15:32 (1736982932) oleg149-server: error: pool_new: either the pool or file system name is too long (max pool name len is 15 and file system name is 8) oleg149-server: pool_new: File name too long pdsh@oleg149-client: oleg149-server: ssh exited with exit code 36 PASS 1e (3s) == ost-pools test 1f: pool_new should fail if fs-name is missing ========================================================== 18:15:35 (1736982935) oleg149-server: fsname is empty oleg149-server: argument .testpool must be . oleg149-server: pool_new: Invalid argument pdsh@oleg149-client: oleg149-server: ssh exited with exit code 22 PASS 1f (3s) == ost-pools test 1g: pool_new should fail if fs-name is missing ========================================================== 18:15:38 (1736982938) oleg149-server: . is missing in testpool oleg149-server: argument testpool must be . oleg149-server: pool_new: Invalid argument pdsh@oleg149-client: oleg149-server: ssh exited with exit code 22 PASS 1g (3s) == ost-pools test 1h: pool_new should fail if poolname is missing ========================================================== 18:15:41 (1736982941) oleg149-server: poolname is empty oleg149-server: argument lustre. must be . oleg149-server: pool_new: Invalid argument pdsh@oleg149-client: oleg149-server: ssh exited with exit code 22 PASS 1h (2s) == ost-pools test 1i: pool_new should fail if poolname and fs-name are missing ========================================================== 18:15:44 (1736982944) oleg149-server: fsname is empty oleg149-server: argument . must be . oleg149-server: pool_new: Invalid argument pdsh@oleg149-client: oleg149-server: ssh exited with exit code 22 PASS 1i (3s) == ost-pools test 1j: pool_new should fail if poolname format is wrong ========================================================== 18:15:46 (1736982946) oleg149-server: . is missing in lustre,testpool oleg149-server: argument lustre,testpool must be . oleg149-server: pool_new: Invalid argument pdsh@oleg149-client: oleg149-server: ssh exited with exit code 22 PASS 1j (3s) == ost-pools test 1k: pool_new should fail if poolname format is wrong ========================================================== 18:15:49 (1736982949) oleg149-server: . is missing in lustre/testpool oleg149-server: argument lustre/testpool must be . oleg149-server: pool_new: Invalid argument pdsh@oleg149-client: oleg149-server: ssh exited with exit code 22 PASS 1k (3s) == ost-pools test 1m: pool_new did not fail even though testpool2 existed ========================================================== 18:15:52 (1736982952) oleg149-server: Pool lustre.testpool2 created oleg149-server: Pool lustre.testpool2 already exists oleg149-server: pool_new: File exists pdsh@oleg149-client: oleg149-server: ssh exited with exit code 17 lustre.testpool2 oleg149-server: Pool lustre.testpool2 destroyed PASS 1m (10s) == ost-pools test 1n: Pool with a 15 char pool name works well ========================================================== 18:16:02 (1736982962) oleg149-server: Pool lustre.testpool1234567 created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool1234567 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.923513 s, 114 MB/s oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool1234567 lustre.testpool1234567 oleg149-server: Pool lustre.testpool1234567 destroyed PASS 1n (16s) == ost-pools test 2a: pool_add: non-existant pool testpool ========================================================== 18:16:18 (1736982978) PASS 2a (2s) == ost-pools test 2b: pool_add: Invalid pool name ======== 18:16:20 (1736982980) PASS 2b (2s) == ost-pools test 2c: pool_add: OST index combinations === 18:16:22 (1736982982) oleg149-server: Pool lustre.testpool created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool Waiting 90s for '' oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool Waiting 90s for 'lustre-OST0000_UUID lustre-OST0001_UUID ' oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool lustre.testpool oleg149-server: Pool lustre.testpool destroyed PASS 2c (27s) == ost-pools test 2d: pool_add: OSTs that don't exist should be rejected ========================================================== 18:16:49 (1736983009) oleg149-server: Pool lustre.testpool created oleg149-server: OST lustre-OST0002_UUID is not part of the 'lustre' fs. oleg149-server: pool_add: No such file or directory pdsh@oleg149-client: oleg149-server: ssh exited with exit code 2 lustre.testpool oleg149-server: Pool lustre.testpool destroyed PASS 2d (9s) == ost-pools test 2e: pool_add: OST already in a pool should be rejected ========================================================== 18:16:58 (1736983018) oleg149-server: Pool lustre.testpool created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool pdsh@oleg149-client: oleg149-server: ssh exited with exit code 17 OST lustre-OST0000_UUID is already in pool lustre.testpool pool_add: File exists lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed PASS 2e (14s) == ost-pools test 3a: pool_remove: non-existant pool ===== 18:17:12 (1736983032) PASS 3a (2s) == ost-pools test 3b: pool_remove: non-existant fsname === 18:17:14 (1736983034) PASS 3b (2s) == ost-pools test 3c: pool_remove: Invalid pool name ===== 18:17:16 (1736983036) PASS 3c (3s) == ost-pools test 3d: pool_remove: OST index combinations ========================================================== 18:17:19 (1736983039) oleg149-server: Pool lustre.testpool created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool lustre.testpool oleg149-server: Pool lustre.testpool destroyed PASS 3d (25s) == ost-pools test 4a: pool_destroy: non-existant pool ==== 18:17:44 (1736983064) PASS 4a (4s) == ost-pools test 4b: pool_destroy: non-existant fs-name ========================================================== 18:17:48 (1736983068) PASS 4b (4s) == ost-pools test 4c: pool_destroy: non-empty pool ======= 18:17:52 (1736983072) oleg149-server: Pool lustre.testpool created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: Pool lustre.testpool not empty, please remove all members oleg149-server: pool_destroy: Directory not empty pdsh@oleg149-client: oleg149-server: ssh exited with exit code 39 lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed PASS 4c (18s) == ost-pools test 5a: lfs pool_list from client ========== 18:18:10 (1736983090) oleg149-server: Pool lustre.testpool created oleg149-server: Pool lustre.testpool2 created Pools from lustre: lustre.testpool lustre.testpool2 oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool Pool: lustre.testpool lustre-OST0000_UUID lustre-OST0001_UUID Pool: lustre.nonexistantpool /home/green/git/lustre-release/lustre/utils/lfs pool_list /mnt/lustre Pools from lustre: lustre.testpool lustre.testpool2 Pools from lustre: lustre.testpool lustre.testpool2 lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed lustre.testpool2 oleg149-server: Pool lustre.testpool2 destroyed PASS 5a (24s) == ost-pools test 5b: lctl pool_list from MDS ============ 18:18:34 (1736983114) oleg149-server: Pool lustre.testpool created oleg149-server: Pool lustre.testpool2 created Pools from lustre: lustre.testpool lustre.testpool2 oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool Pool: lustre.testpool lustre-OST0000_UUID lustre-OST0001_UUID Pools from nonexistantfs: Pool: lustre.nonexistantpool Pools from /mnt/lustrenonexistant: lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed lustre.testpool2 oleg149-server: Pool lustre.testpool2 destroyed PASS 5b (26s) == ost-pools test 6: getstripe/setstripe ================= 18:19:00 (1736983140) oleg149-server: Pool lustre.testpool created Pools from lustre: lustre.testpool oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg149-server: Pool lustre.testpool2 created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool2 Destroy the created pools: testpool,testpool2 lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed lustre.testpool2 oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool2 oleg149-server: Pool lustre.testpool2 destroyed PASS 6 (29s) == ost-pools test 7a: create various pool name =========== 18:19:29 (1736983169) set poolname to 7 Creating new pool oleg149-server: Pool lustre.7 created Adding targets to pool oleg149-server: OST lustre-OST0000_UUID added to pool lustre.7 oleg149-server: OST lustre-OST0001_UUID added to pool lustre.7 oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.7 oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.7 oleg149-server: Pool lustre.7 destroyed set poolname to 746022896 Creating new pool oleg149-server: Pool lustre.746022896 created Adding targets to pool oleg149-server: OST lustre-OST0000_UUID added to pool lustre.746022896 oleg149-server: OST lustre-OST0001_UUID added to pool lustre.746022896 oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.746022896 oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.746022896 oleg149-server: Pool lustre.746022896 destroyed set poolname to 74601922622429 Creating new pool oleg149-server: Pool lustre.74601922622429 created Adding targets to pool oleg149-server: OST lustre-OST0000_UUID added to pool lustre.74601922622429 oleg149-server: OST lustre-OST0001_UUID added to pool lustre.74601922622429 oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.74601922622429 oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.74601922622429 oleg149-server: Pool lustre.74601922622429 destroyed Destroy the created pools: 7,74601922622429,746022896 Destroy the created pools: 7,74601922622429,746022896 Destroy the created pools: 7,74601922622429,746022896 PASS 7a (48s) == ost-pools test 7b: try to create pool name with invalid lengths or names ========================================================== 18:20:17 (1736983217) oleg149-server: . is missing in qwerty oleg149-server: argument qwerty must be . oleg149-server: pool_new: Invalid argument pdsh@oleg149-client: oleg149-server: ssh exited with exit code 22 oleg149-server: poolname is empty oleg149-server: argument lustre. must be . oleg149-server: pool_new: Invalid argument pdsh@oleg149-client: oleg149-server: ssh exited with exit code 22 oleg149-server: error: pool_new can contain only alphanumeric characters, underscores, and dashes besides the required '.' oleg149-server: pool_new: Invalid argument pdsh@oleg149-client: oleg149-server: ssh exited with exit code 22 oleg149-server: error: pool_new: either the pool or file system name is too long (max pool name len is 15 and file system name is 8) oleg149-server: pool_new: File name too long pdsh@oleg149-client: oleg149-server: ssh exited with exit code 36 PASS 7b (3s) == ost-pools test 7c: create a valid pool name and setstripe with a bad one ========================================================== 18:20:20 (1736983220) Creating new pool oleg149-server: Pool lustre.0123456789abcde created Adding targets to pool oleg149-server: OST lustre-OST0000_UUID added to pool lustre.0123456789abcde oleg149-server: OST lustre-OST0001_UUID added to pool lustre.0123456789abcde lfs setstripe: Invalid Poolname '0123456789abcdeX': Invalid argument (22) oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.0123456789abcde oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.0123456789abcde oleg149-server: Pool lustre.0123456789abcde destroyed Destroy the created pools: 0123456789abcde PASS 7c (17s) == ost-pools test 11: OSTs in overlapping/multiple pools ========================================================== 18:20:37 (1736983237) oleg149-server: Pool lustre.testpool created oleg149-server: Pool lustre.testpool2 created oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool2 oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool total: 100 open/close in 0.56 seconds: 179.78 ops/second total: 100 open/close in 0.79 seconds: 126.99 ops/second Destroy the created pools: testpool,testpool2 lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' lustre.testpool2 oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool2 oleg149-server: Pool lustre.testpool2 destroyed PASS 11 (164s) == ost-pools test 12: OST Pool Membership ================ 18:23:21 (1736983401) SKIP: ost-pools test_12 needs >=3 OSTs SKIP 12 (1s) == ost-pools test 13: Striping characteristics in a pool ========================================================== 18:23:22 (1736983402) SKIP: ost-pools test_13 needs >= 3 OSTs SKIP 13 (1s) == ost-pools test 14: Round robin and QOS striping within a pool ========================================================== 18:23:23 (1736983403) SKIP: ost-pools test_14 needs >= 3 OSTs SKIP 14 (1s) == ost-pools test 15: One directory per OST/pool ========= 18:23:24 (1736983404) oleg149-server: Pool lustre.testpool0 created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool0 total: 100 open/close in 0.37 seconds: 272.23 ops/second oleg149-server: Pool lustre.testpool1 created oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool1 total: 100 open/close in 0.40 seconds: 247.38 ops/second Destroy the created pools: testpool0,testpool1 lustre.testpool0 oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool0 oleg149-server: Pool lustre.testpool0 destroyed Waiting 90s for 'foo' lustre.testpool1 oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool1 oleg149-server: Pool lustre.testpool1 destroyed PASS 15 (32s) == ost-pools test 16: Inheritance of pool properties ===== 18:23:56 (1736983436) oleg149-server: Pool lustre.testpool created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool total: 10 open/close in 0.05 seconds: 184.13 ops/second Destroy the created pools: testpool lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed Waiting 90s for 'foo' PASS 16 (22s) == ost-pools test 17: Referencing an empty pool ========== 18:24:18 (1736983458) oleg149-server: Pool lustre.testpool created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 10 open/close in 0.07 seconds: 142.08 ops/second lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed total: 10 open/close in 0.06 seconds: 176.93 ops/second PASS 17 (21s) == ost-pools test 18: File create in a directory which references a deleted pool ========================================================== 18:24:40 (1736983480) Create performance, iteration 1, 15 seconds x 3 total: 3285 open/close in 15.00 seconds: 219.00 ops/second iter 1: 3285 creates without pool oleg149-server: Pool lustre.testpool created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 3322 open/close in 15.00 seconds: 221.47 ops/second iter 1: 3322 creates with pool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed total: 3434 open/close in 15.00 seconds: 228.92 ops/second iter 1: 3434 creates with missing pool Create performance, iteration 2, 15 seconds x 3 total: 3134 open/close in 15.00 seconds: 208.90 ops/second iter 2: 3134 creates without pool oleg149-server: Pool lustre.testpool created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 3447 open/close in 15.00 seconds: 229.79 ops/second iter 2: 3447 creates with pool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed total: 3504 open/close in 15.00 seconds: 233.53 ops/second iter 2: 3504 creates with missing pool Create performance, iteration 3, 15 seconds x 3 total: 5212 open/close in 15.00 seconds: 347.40 ops/second iter 3: 5212 creates without pool oleg149-server: Pool lustre.testpool created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 4402 open/close in 15.00 seconds: 293.43 ops/second iter 3: 4402 creates with pool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed total: 4524 open/close in 15.00 seconds: 301.59 ops/second iter 3: 4524 creates with missing pool Avg files created in 15 seconds without pool: 3877 Avg files created in 15 seconds with pool: 3723 Avg files created in 15 seconds missing pool: 3820 No pool / wide pool: 3 %. No pool / missing pool: 1 %. PASS 18 (321s) == ost-pools test 19: Pools should not come into play when not specified ========================================================== 18:30:01 (1736983801) oleg149-server: Pool lustre.testpool created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool total: 12 open/close in 0.03 seconds: 403.67 ops/second total: 12 open/close in 0.04 seconds: 319.39 ops/second Destroy the created pools: testpool lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed PASS 19 (17s) == ost-pools test 20: Different pools in a directory hierarchy. ========================================================== 18:30:18 (1736983818) oleg149-server: Pool lustre.testpool created oleg149-server: Pool lustre.testpool2 created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool2 Destroy the created pools: testpool,testpool2 lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed lustre.testpool2 oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool2 oleg149-server: Pool lustre.testpool2 destroyed PASS 20 (27s) == ost-pools test 21: OST pool with fewer OSTs than stripe count ========================================================== 18:30:45 (1736983845) oleg149-server: Pool lustre.testpool created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool /mnt/lustre/d21.ost-pools/dir/file1 lmm_magic: 0x0BD30BD0 lmm_seq: 0x200000402 lmm_object_id: 0x120 lmm_fid: [0x200000402:0x120:0x0] lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 lmm_pool: testpool obdidx objid objid group 0 145 0x91 0 Destroy the created pools: testpool lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed PASS 21 (11s) == ost-pools test 22: Simultaneous manipulation of a pool ========================================================== 18:30:56 (1736983856) oleg149-server: Pool lustre.testpool created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: Pool lustre.testpool2 created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool2 loop for testpool loop for testpool2 Pool testpool, iteration 1 Pool testpool2, iteration 1 Pool testpool2, iteration 2 Pool testpool2, iteration 3 Pool testpool2, iteration 4 Pool testpool2, iteration 5 Pool testpool2, iteration 6 Pool testpool2, iteration 7 Pool testpool2, iteration 8 Pool testpool2, iteration 9 Pool testpool2, iteration 10 loop for testpool2 complete oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 2 total: 100 open/close in 0.24 seconds: 416.71 ops/second oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 3 oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 4 oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 5 oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 6 oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 7 oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 8 oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 9 oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool Pool testpool, iteration 10 oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool loop for testpool complete Destroy the created pools: testpool,testpool2 lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed lustre.testpool2 oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool2 oleg149-server: Pool lustre.testpool2 destroyed PASS 22 (53s) == ost-pools test 23a: OST pools and quota =============== 18:31:49 (1736983909) running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7460] oleg149-server: Pool lustre.testpool created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool Disk quotas for usr 500 (uid 500): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre/d23a.ost-pools/dir 0 3072 3072 - 0 0 0 - lustre-MDT0000_UUID 0 - 0 - 0 - 0 - lustre-MDT0001_UUID 0 - 0 - 0 - 0 - lustre-OST0000_UUID 0 - 0 - - - - - lustre-OST0001_UUID 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 uid 500 is using default file quota setting -rw-r--r-- 1 sanityusr sanityusr 0 Jan 15 18:32 /mnt/lustre/d23a.ost-pools/dir/f23a.ost-pools-quota first dd failed with EDQUOT. Disk quotas for usr 500 (uid 500): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre/d23a.ost-pools/dir 0 3072 3072 - 1 0 0 - lustre-MDT0000_UUID 0 - 0 - 0 - 0 - lustre-MDT0001_UUID 0 - 0 - 1 - 0 - lustre-OST0000_UUID 0 - 0 - - - - - lustre-OST0001_UUID 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 uid 500 is using default file quota setting Destroy the created pools: testpool lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed PASS 23a (20s) == ost-pools test 23b: OST pools and OOS ================= 18:32:09 (1736983929) running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7460] oleg149-server: Pool lustre.testpool created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool OSTCOUNT=2, OSTSIZE=0, AVAIL=3603584 MAXFREE=31457280, SLOW=yes [1 iteration] dd: error writing '/mnt/lustre/d23b.ost-pools/dir/f23b.ost-pools-quota1': No space left on device 3519+0 records in 3518+0 records out 3689226240 bytes (3.7 GB) copied, 26.4591 s, 139 MB/s total written: 5242880 stime=1736983941, etime=1736983967, elapsed=26 Filesystem Size Used Avail Use% Mounted on devtmpfs 1.9G 0 1.9G 0% /dev tmpfs 1.9G 0 1.9G 0% /dev/shm tmpfs 1.9G 17M 1.9G 1% /run tmpfs 1.9G 0 1.9G 0% /sys/fs/cgroup /dev/nbd0 30G 12G 16G 43% / none 1.9G 32M 1.8G 2% /var/lib/stateless/writable /dev/vda 27M 27M 0 100% /home/green/git/lustre-release 192.168.200.253:/exports/state/oleg149-client.virtnet 98G 85G 8.7G 91% /var/lib/stateless/state 192.168.200.253:/exports/state/oleg149-client.virtnet/boot 98G 85G 8.7G 91% /boot 192.168.200.253:/exports/state/oleg149-client.virtnet/etc/kdump.conf 98G 85G 8.7G 91% /etc/kdump.conf 192.168.200.253:/exports/testreports/48573/testresults/ost-pools-ldiskfs-DNE-centos7_x86_64-centos7_x86_64 51T 22T 30T 43% /tmp/testlogs tmpfs 374M 0 374M 0% /run/user/0 192.168.201.149@tcp:/lustre 7.4G 3.4G 3.6G 49% /mnt/lustre Destroy the created pools: testpool lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed PASS 23b (46s) == ost-pools test 24: Independence of pool from other setstripe parameters ========================================================== 18:32:55 (1736983975) oleg149-server: Pool lustre.testpool created Waiting 90s for '' oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool total: 10 open/close in 0.02 seconds: 526.87 ops/second total: 10 open/close in 0.02 seconds: 431.33 ops/second total: 10 open/close in 0.03 seconds: 371.72 ops/second total: 10 open/close in 0.03 seconds: 356.33 ops/second Destroy the created pools: testpool lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed PASS 24 (24s) == ost-pools test 25: Create new pool and restart MDS ==== 18:33:19 (1736983999) oleg149-server: Pool lustre.testpool1 created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool1 Failing mds1 on oleg149-server Stopping /mnt/lustre-mds1 (opts:) on oleg149-server reboot facets: mds1 Failover mds1 to oleg149-server mount facets: mds1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg149-server: oleg149-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg149-client: oleg149-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg149-server: oleg149-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 40 oleg149-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0000-osc-MDT0001.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0001.old_sync_processed wait 40 secs maximumly for oleg149-server mds-ost sync done. Creating a file in pool1 Destroy the created pools: testpool1 lustre.testpool1 oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool1 oleg149-server: Pool lustre.testpool1 destroyed Waiting 90s for 'foo' PASS 25 (42s) == ost-pools test 26: Choose other OSTs in the pool first in the creation remedy ========================================================== 18:34:01 (1736984041) SKIP: ost-pools test_26 needs >= 3 OSTs SKIP 26 (0s) == ost-pools test 27: Race pool_list and pool_remove ===== 18:34:01 (1736984041) oleg149-server: Pool lustre.testpool created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool fail_loc=0x239 fail_val=10 fail_loc=0 lustre-OST0001_UUID oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool fail_val=0 lustre.testpool oleg149-server: Pool lustre.testpool destroyed PASS 27 (19s) == ost-pools test 28: lfs_migrate with pool name ========= 18:34:20 (1736984060) oleg149-server: Pool lustre.testpool created oleg149-server: Pool lustre.testpool2 created oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool oleg149-server: OST lustre-OST0000_UUID added to pool lustre.testpool2 oleg149-server: OST lustre-OST0001_UUID added to pool lustre.testpool2 debug=-1 debug_mb=150 debug=-1 debug_mb=150 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.046547 s, 22.5 MB/s /mnt/lustre/f28.ost-pools lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_pool: testpool obdidx objid objid group 1 162 0xa2 0 /mnt/lustre/f28.ost-pools: done /mnt/lustre/f28.ost-pools lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 1 lmm_stripe_offset: 1 lmm_pool: testpool2 obdidx objid objid group 1 163 0xa3 0 debug_mb=8 debug_mb=8 debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck Destroy the created pools: testpool,testpool2 lustre.testpool oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool oleg149-server: Pool lustre.testpool destroyed lustre.testpool2 oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.testpool2 oleg149-server: OST lustre-OST0001_UUID removed from pool lustre.testpool2 oleg149-server: Pool lustre.testpool2 destroyed PASS 28 (29s) == ost-pools test 29: check OST pool spilling ============ 18:34:49 (1736984089) SKIP: ost-pools test_29 needs >= 4 OSTs SKIP 29 (0s) == ost-pools test 30: persistent OST pool spilling ======= 18:34:49 (1736984089) SKIP: ost-pools test_30 needs >= 4 OSTs SKIP 30 (1s) == ost-pools test 31: OST pool spilling chained ========== 18:34:50 (1736984090) SKIP: ost-pools test_31 needs >= 4 OSTs SKIP 31 (1s) == ost-pools test 32: force to create a file without pool (no inheritance) ========================================================== 18:34:51 (1736984091) Creating new pool oleg149-server: Pool lustre.test_32 created Adding targets to pool oleg149-server: OST lustre-OST0000_UUID added to pool lustre.test_32 striped dir -i0 -c2 -H all_char /mnt/lustre/d32.ost-pools Destroy the created pools: test_32 lustre.test_32 oleg149-server: OST lustre-OST0000_UUID removed from pool lustre.test_32 oleg149-server: Pool lustre.test_32 destroyed PASS 32 (12s) == ost-pools test complete, duration 1218 sec ============ 18:35:03 (1736984103)