-----============= acceptance-small: sanity ============----- Thu Apr 30 14:09:40 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg153-server: /home/green/git/lustre-release/lustre/tests/except/sanity.56aa.ex oleg153-server: /home/green/git/lustre-release/lustre/tests/except/sanity.ex - see CLIENT_VERSION > v2_15_63-134-gdacc4b6d38 (34681982 > 34553734) for LU-15963, go 312 - see CLIENT_VERSION > v2_15_63-239-gab4ede45b4 (34681982 > 34553839) for LU-17856, go 56wa 56xe - see CLIENT_VERSION > v2_16_54-54-ga2e3a2f5a3 (34681982 > 34616886) for LU-14590, go 0d - see CLIENT_VERSION >= v2_17_50-196-g63ee4af3bb (34681982 >= 34681540) for LU-19620, go 60b - see CLIENT_VERSION >= v2_17_50-71-g2cbe29c282 (34681982 >= 34681415) for LU-19644, go 150ib - see CLIENT_VERSION >= v2_17_51-74 (34681982 >= 34681674) for LU-20010, go 56aa - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34681982 <= 34618625) for LU-18938, skip 360 - see MDS1_VERSION <= CLIENT_VERSION (34681982 <= 34681982) for LU-18562, go 270a - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34681982 < 34486116) for LU-14927, skip 0f excepting tests: 42a 42c 42b 118c 118d 407 119i 817 411a 130b 130c 130d 130e 130f 130g skipping tests SLOW=no: 51c 51e 834 === sanity: start setup 14:09:48 (1777572588) === oleg153-client.virtnet: executing check_config_client /mnt/lustre oleg153-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg153-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88e143936000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88e143936000.idle_timeout=debug disable quota as required oleg153-server: oleg153-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity: finish setup 14:09:58 (1777572598) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7565] preparing for tests involving mounts mke2fs 1.47.3-wc2 (11-Nov-2025) debug=all == sanity test 27m: create file while OST0 was full ====== 14:09:59 (1777572599) SKIP: sanity test_27m 7534592 > 600000 skipping out-of-space test on OST0 SKIP 27m (1s) == sanity test 51b: exceed 64k subdirectory nlink limit on create, verify unlink ========================================================== 14:10:00 (1777572600) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2048 2206592 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 4096 7534592 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 534698 333 534365 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 118184 392 117792 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 118184 392 117792 1% /mnt/lustre[OST:1] filesystem_summary: 235917 333 235584 1% /mnt/lustre - mkdir 4049 (time 1777572612.62 total 10.06 last 402.41) - mkdir 7499 (time 1777572622.62 total 20.06 last 344.98) - mkdir 10000 (time 1777572628.88 total 26.33 last 399.32) - mkdir 13609 (time 1777572638.89 total 36.33 last 360.80) - mkdir 17124 (time 1777572648.90 total 46.34 last 351.09) - mkdir 20000 (time 1777572658.40 total 55.85 last 302.58) - mkdir 22917 (time 1777572668.41 total 65.85 last 291.64) - mkdir 26134 (time 1777572678.41 total 75.85 last 321.66) - mkdir 29393 (time 1777572688.41 total 85.85 last 325.85) - mkdir 30000 (time 1777572690.55 total 87.99 last 283.38) total: 32818 mkdir in 97.40 seconds: 336.96 ops/second - mkdir 3552 (time 1777572612.62 total 10.05 last 353.31) - mkdir 7163 (time 1777572622.62 total 20.05 last 361.10) - mkdir 10000 (time 1777572631.43 total 28.86 last 321.99) - mkdir 13586 (time 1777572641.43 total 38.86 last 358.59) - mkdir 16848 (time 1777572651.43 total 48.87 last 326.17) - mkdir 19897 (time 1777572661.43 total 58.87 last 304.82) - mkdir 23131 (time 1777572671.49 total 68.93 last 321.45) - mkdir 26432 (time 1777572681.49 total 78.93 last 330.00) - mkdir 29439 (time 1777572691.50 total 88.94 last 300.61) - mkdir 32592 (time 1777572701.50 total 98.94 last 315.28) total: 32818 mkdir in 99.68 seconds: 329.24 ops/second UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210176 489472 1718656 23% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 4096 7534592 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 304267 65969 238298 22% /mnt/lustre[MDT:0] lustre-OST0000_UUID 118184 392 117792 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 118183 391 117792 1% /mnt/lustre[OST:1] filesystem_summary: 301553 65969 235584 22% /mnt/lustre nlink before: 65638, created before: 65637 - unlinked 0 (time 1777572860 ; total 0 ; last 0) - unlinked 10000 (time 1777572895 ; total 35 ; last 35) - unlinked 20000 (time 1777572925 ; total 65 ; last 30) - unlinked 30000 (time 1777572955 ; total 95 ; last 30) total: 32768 unlinks in 103 seconds: 318.135925 unlinks/second - unlinked 0 (time 1777572860 ; total 0 ; last 0) - unlinked 10000 (time 1777572894 ; total 34 ; last 34) - unlinked 20000 (time 1777572924 ; total 64 ; last 30) - unlinked 30000 (time 1777572955 ; total 95 ; last 31) total: 32768 unlinks in 103 seconds: 318.135925 unlinks/second nlink between: 102 - unlinked 0 (time 1777572964 ; total 0 ; last 0) total: 50 unlinks in 0 seconds: inf unlinks/second - unlinked 0 (time 1777572964 ; total 0 ; last 0) total: 50 unlinks in 0 seconds: inf unlinks/second nlink after: 2 rmdir(/mnt/lustre/d51b.sanity/d.1.0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second rmdir(/mnt/lustre/d51b.sanity/d.0.0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2208512 6912 2199552 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 4096 7534592 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 433985 492 433493 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 118184 392 117792 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 118183 391 117792 1% /mnt/lustre[OST:1] filesystem_summary: 236076 492 235584 1% /mnt/lustre PASS 51b (368s) == sanity test 64b: check out-of-space detection on client ========================================================== 14:16:08 (1777572968) mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky STRIPECOUNT=2 ORIGFREE=7534592 MAXFREE=800000 SKIP: oos test_64b oos.sh: 7534592kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2208512 2176 2204288 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 4096 7534592 1% /mnt/lustre pass grant check: client:6815744 server:6815744 SKIP 64b (8s) == sanity test 71: Running dbench on lustre (don't segment fault) ============================================================== 14:16:16 (1777572976) looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d71.sanity '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2' in /mnt/lustre/d71.sanity at Thu Apr 30 14:16:19 EDT 2026 waiting for dbench pid 14426 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 600 seconds with load 'client.txt' and minimum warmup 120 secs failed to create barrier semaphore 0 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 118 10.74 MB/sec warmup 1 sec latency 40.416 ms 2 184 7.38 MB/sec warmup 2 sec latency 522.352 ms 2 247 6.27 MB/sec warmup 3 sec latency 981.975 ms 2 379 6.75 MB/sec warmup 4 sec latency 26.395 ms 2 518 7.14 MB/sec warmup 5 sec latency 26.958 ms 2 733 7.10 MB/sec warmup 6 sec latency 49.917 ms 2 921 6.22 MB/sec warmup 7 sec latency 43.875 ms 2 1161 5.75 MB/sec warmup 8 sec latency 32.489 ms 2 1481 5.79 MB/sec warmup 9 sec latency 17.769 ms 2 1708 5.24 MB/sec warmup 10 sec latency 70.192 ms 2 1984 4.81 MB/sec warmup 11 sec latency 40.039 ms 2 2257 4.46 MB/sec warmup 12 sec latency 19.017 ms 2 2473 4.40 MB/sec warmup 13 sec latency 43.946 ms 2 2908 4.71 MB/sec warmup 14 sec latency 56.898 ms 2 3297 4.71 MB/sec warmup 15 sec latency 39.244 ms 2 3696 4.84 MB/sec warmup 16 sec latency 24.940 ms 2 3920 4.71 MB/sec warmup 17 sec latency 23.469 ms 2 4117 4.45 MB/sec warmup 18 sec latency 31.232 ms 2 4293 4.25 MB/sec warmup 19 sec latency 111.444 ms 2 4488 4.09 MB/sec warmup 20 sec latency 36.146 ms 2 4729 4.01 MB/sec warmup 21 sec latency 28.458 ms 2 5034 4.10 MB/sec warmup 22 sec latency 20.040 ms 2 5236 3.94 MB/sec warmup 23 sec latency 54.333 ms 2 5415 3.79 MB/sec warmup 24 sec latency 25.940 ms 2 5709 3.66 MB/sec warmup 25 sec latency 37.560 ms 2 5961 3.62 MB/sec warmup 26 sec latency 40.689 ms 2 6237 3.67 MB/sec warmup 27 sec latency 241.731 ms 2 6667 3.79 MB/sec warmup 28 sec latency 45.430 ms 2 7152 3.97 MB/sec warmup 29 sec latency 24.365 ms 2 7382 3.93 MB/sec warmup 30 sec latency 23.419 ms 2 7600 3.82 MB/sec warmup 31 sec latency 23.704 ms 2 7802 3.71 MB/sec warmup 32 sec latency 92.769 ms 2 7987 3.63 MB/sec warmup 33 sec latency 36.912 ms 2 8211 3.60 MB/sec warmup 34 sec latency 35.441 ms 2 8531 3.67 MB/sec warmup 35 sec latency 19.694 ms 2 8648 3.57 MB/sec warmup 36 sec latency 122.810 ms 2 8861 3.49 MB/sec warmup 37 sec latency 36.419 ms 2 9106 3.41 MB/sec warmup 38 sec latency 30.889 ms 2 9355 3.36 MB/sec warmup 39 sec latency 25.759 ms 2 9554 3.33 MB/sec warmup 40 sec latency 54.583 ms 2 9947 3.46 MB/sec warmup 41 sec latency 40.294 ms 2 10419 3.51 MB/sec warmup 42 sec latency 34.472 ms 2 10783 3.58 MB/sec warmup 43 sec latency 18.980 ms 2 11024 3.56 MB/sec warmup 44 sec latency 18.317 ms 2 11250 3.48 MB/sec warmup 45 sec latency 28.327 ms 2 11442 3.42 MB/sec warmup 46 sec latency 89.557 ms 2 11651 3.38 MB/sec warmup 47 sec latency 44.696 ms 2 11881 3.35 MB/sec warmup 48 sec latency 27.115 ms 2 12189 3.41 MB/sec warmup 49 sec latency 45.916 ms 2 12411 3.35 MB/sec warmup 50 sec latency 28.787 ms 2 12656 3.29 MB/sec warmup 51 sec latency 36.543 ms 2 12931 3.26 MB/sec warmup 52 sec latency 19.155 ms 2 13167 3.25 MB/sec warmup 53 sec latency 35.779 ms 2 13606 3.36 MB/sec warmup 54 sec latency 32.185 ms 2 14083 3.43 MB/sec warmup 55 sec latency 36.955 ms 2 14382 3.45 MB/sec warmup 56 sec latency 18.074 ms 2 14636 3.42 MB/sec warmup 57 sec latency 17.162 ms 2 14840 3.36 MB/sec warmup 58 sec latency 105.507 ms 2 15041 3.32 MB/sec warmup 59 sec latency 48.508 ms 2 15258 3.30 MB/sec warmup 60 sec latency 36.939 ms 2 15546 3.31 MB/sec warmup 61 sec latency 22.350 ms 2 15819 3.31 MB/sec warmup 62 sec latency 41.005 ms 2 16018 3.26 MB/sec warmup 63 sec latency 33.042 ms 2 16249 3.22 MB/sec warmup 64 sec latency 31.464 ms 2 16496 3.19 MB/sec warmup 65 sec latency 48.351 ms 2 16706 3.18 MB/sec warmup 66 sec latency 39.062 ms 2 17119 3.26 MB/sec warmup 67 sec latency 40.397 ms 2 17494 3.28 MB/sec warmup 68 sec latency 42.867 ms 2 17837 3.34 MB/sec warmup 69 sec latency 21.446 ms 2 18055 3.33 MB/sec warmup 70 sec latency 21.201 ms 2 18262 3.28 MB/sec warmup 71 sec latency 23.921 ms 2 18445 3.24 MB/sec warmup 72 sec latency 106.491 ms 2 18611 3.21 MB/sec warmup 73 sec latency 44.230 ms 2 18793 3.19 MB/sec warmup 74 sec latency 46.691 ms 2 19058 3.20 MB/sec warmup 75 sec latency 23.534 ms 2 19292 3.20 MB/sec warmup 76 sec latency 44.969 ms 2 19483 3.16 MB/sec warmup 77 sec latency 37.938 ms 2 19684 3.13 MB/sec warmup 78 sec latency 35.785 ms 2 19926 3.10 MB/sec warmup 79 sec latency 18.139 ms 2 20164 3.09 MB/sec warmup 80 sec latency 40.247 ms 2 20387 3.08 MB/sec warmup 81 sec latency 45.419 ms 2 20787 3.15 MB/sec warmup 82 sec latency 34.419 ms 2 21233 3.19 MB/sec warmup 83 sec latency 29.695 ms 2 21508 3.21 MB/sec warmup 84 sec latency 19.534 ms 2 21719 3.19 MB/sec warmup 85 sec latency 20.158 ms 2 21924 3.16 MB/sec warmup 86 sec latency 28.196 ms 2 22093 3.13 MB/sec warmup 87 sec latency 117.432 ms 2 22271 3.10 MB/sec warmup 88 sec latency 42.072 ms 2 22492 3.10 MB/sec warmup 89 sec latency 33.663 ms 2 22774 3.13 MB/sec warmup 90 sec latency 26.062 ms 2 22968 3.10 MB/sec warmup 91 sec latency 55.430 ms 2 23153 3.07 MB/sec warmup 92 sec latency 27.815 ms 2 23372 3.04 MB/sec warmup 93 sec latency 38.117 ms 2 23627 3.02 MB/sec warmup 94 sec latency 21.472 ms 2 23770 3.01 MB/sec warmup 95 sec latency 63.083 ms 2 24027 3.03 MB/sec warmup 96 sec latency 45.490 ms 2 24476 3.07 MB/sec warmup 97 sec latency 36.092 ms 2 24865 3.13 MB/sec warmup 98 sec latency 43.028 ms 2 25095 3.12 MB/sec warmup 99 sec latency 19.489 ms 2 25307 3.10 MB/sec warmup 100 sec latency 19.955 ms 2 25514 3.07 MB/sec warmup 101 sec latency 29.574 ms 2 25667 3.05 MB/sec warmup 102 sec latency 102.628 ms 2 25836 3.02 MB/sec warmup 103 sec latency 39.216 ms 2 26065 3.02 MB/sec warmup 104 sec latency 37.241 ms 2 26351 3.05 MB/sec warmup 105 sec latency 38.763 ms 2 26527 3.02 MB/sec warmup 106 sec latency 39.055 ms 2 26706 2.99 MB/sec warmup 107 sec latency 41.732 ms 2 26931 2.97 MB/sec warmup 108 sec latency 35.943 ms 2 27184 2.96 MB/sec warmup 109 sec latency 40.032 ms 2 27397 2.96 MB/sec warmup 110 sec latency 39.922 ms 2 27804 3.01 MB/sec warmup 111 sec latency 40.040 ms 2 28192 3.02 MB/sec warmup 112 sec latency 34.247 ms 2 28526 3.05 MB/sec warmup 113 sec latency 20.961 ms 2 28739 3.05 MB/sec warmup 114 sec latency 20.392 ms 2 28947 3.03 MB/sec warmup 115 sec latency 31.520 ms 2 29110 3.00 MB/sec warmup 116 sec latency 135.729 ms 2 29274 2.98 MB/sec warmup 117 sec latency 43.338 ms 2 29459 2.97 MB/sec warmup 118 sec latency 36.411 ms 2 29687 2.96 MB/sec warmup 119 sec latency 21.027 ms