-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:56 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:00 (1734015840) === oleg239-client.virtnet: executing check_config_client /mnt/lustre oleg239-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg239-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b3e94000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b3e94000.idle_timeout=debug disable quota as required oleg239-server: oleg239-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:10 (1734015850) === == sanity-benchmark test dbench: dbench ================== 10:04:11 (1734015851) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6982] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg239-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg239-client.virtnet at Thu Dec 12 10:04:13 EST 2024 waiting for dbench pid 9450 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 16 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 10 33 24.34 MB/sec warmup 1 sec latency 158.275 ms 20 118 54.41 MB/sec warmup 2 sec latency 239.813 ms 20 166 45.65 MB/sec warmup 3 sec latency 244.141 ms 20 225 43.38 MB/sec warmup 4 sec latency 169.025 ms 20 291 43.07 MB/sec warmup 5 sec latency 141.686 ms 20 356 42.53 MB/sec warmup 6 sec latency 117.996 ms 20 427 43.05 MB/sec warmup 7 sec latency 133.036 ms 20 501 43.52 MB/sec warmup 8 sec latency 115.301 ms 20 618 46.33 MB/sec warmup 9 sec latency 329.480 ms 20 670 42.30 MB/sec warmup 10 sec latency 219.223 ms 20 715 38.59 MB/sec warmup 11 sec latency 191.361 ms 20 744 35.53 MB/sec warmup 12 sec latency 286.038 ms 20 790 32.94 MB/sec warmup 13 sec latency 227.830 ms 20 819 30.71 MB/sec warmup 14 sec latency 370.049 ms 20 869 28.80 MB/sec warmup 15 sec latency 247.040 ms 20 908 27.13 MB/sec warmup 16 sec latency 308.910 ms 20 943 25.74 MB/sec warmup 17 sec latency 404.301 ms 20 995 24.49 MB/sec warmup 18 sec latency 219.174 ms 20 1045 23.67 MB/sec warmup 19 sec latency 257.016 ms 20 1111 22.94 MB/sec warmup 20 sec latency 122.156 ms 20 1176 22.04 MB/sec warmup 21 sec latency 104.080 ms 20 1239 21.35 MB/sec warmup 22 sec latency 129.551 ms 20 1287 20.70 MB/sec warmup 23 sec latency 322.996 ms 20 1449 24.15 MB/sec execute 1 sec latency 258.097 ms 20 1501 12.37 MB/sec execute 2 sec latency 262.964 ms 20 1542 8.46 MB/sec execute 3 sec latency 294.128 ms 20 1591 6.59 MB/sec execute 4 sec latency 283.462 ms 20 1639 5.43 MB/sec execute 5 sec latency 264.815 ms 20 1684 4.66 MB/sec execute 6 sec latency 351.813 ms 20 1727 4.08 MB/sec execute 7 sec latency 183.197 ms 20 1775 3.67 MB/sec execute 8 sec latency 283.119 ms 20 1827 3.36 MB/sec execute 9 sec latency 170.425 ms 20 1872 3.11 MB/sec execute 10 sec latency 181.294 ms 20 1915 2.89 MB/sec execute 11 sec latency 183.770 ms 20 1970 2.75 MB/sec execute 12 sec latency 225.242 ms 20 2026 2.63 MB/sec execute 13 sec latency 236.345 ms 20 2064 2.53 MB/sec execute 14 sec latency 156.463 ms 20 2086 2.40 MB/sec execute 15 sec latency 307.457 ms 20 2144 2.46 MB/sec execute 16 sec latency 134.374 ms 20 2180 2.47 MB/sec execute 17 sec latency 519.904 ms 20 2212 2.43 MB/sec execute 18 sec latency 289.558 ms 20 2241 2.39 MB/sec execute 19 sec latency 415.537 ms 20 2265 2.40 MB/sec execute 20 sec latency 904.649 ms 20 2314 2.57 MB/sec execute 21 sec latency 1110.218 ms 20 2367 2.84 MB/sec execute 22 sec latency 442.248 ms 20 2406 2.86 MB/sec execute 23 sec latency 479.287 ms 20 2440 2.86 MB/sec execute 24 sec latency 525.817 ms 20 2478 2.92 MB/sec execute 25 sec latency 509.665 ms 20 2520 3.18 MB/sec execute 26 sec latency 515.187 ms 20 2594 3.55 MB/sec execute 27 sec latency 573.216 ms 20 2647 3.73 MB/sec execute 28 sec latency 447.801 ms 20 2694 3.84 MB/sec execute 29 sec latency 433.957 ms 20 2762 4.32 MB/sec execute 30 sec latency 514.540 ms 20 2854 4.84 MB/sec execute 31 sec latency 666.943 ms 20 2938 5.15 MB/sec execute 32 sec latency 464.376 ms 20 3014 5.39 MB/sec execute 33 sec latency 451.058 ms 20 3079 5.40 MB/sec execute 34 sec latency 422.870 ms 20 3159 5.40 MB/sec execute 35 sec latency 401.862 ms 20 3262 5.59 MB/sec execute 36 sec latency 549.254 ms 20 3323 5.83 MB/sec execute 37 sec latency 557.437 ms 20 3399 6.03 MB/sec execute 38 sec latency 522.118 ms 20 3447 5.94 MB/sec execute 39 sec latency 379.134 ms 20 3506 6.19 MB/sec execute 40 sec latency 318.431 ms 20 3596 6.72 MB/sec execute 41 sec latency 132.043 ms 20 3647 6.66 MB/sec execute 42 sec latency 128.351 ms 20 3701 6.58 MB/sec execute 43 sec latency 114.739 ms 20 3741 6.49 MB/sec execute 44 sec latency 135.620 ms 20 3786 6.50 MB/sec execute 45 sec latency 114.368 ms 20 3832 6.52 MB/sec execute 46 sec latency 122.229 ms 20 3860 6.39 MB/sec execute 47 sec latency 146.427 ms 20 3886 6.25 MB/sec execute 48 sec latency 273.920 ms 20 3917 6.15 MB/sec execute 49 sec latency 133.989 ms 20 3946 6.08 MB/sec execute 50 sec latency 186.159 ms 20 3985 5.97 MB/sec execute 51 sec latency 110.286 ms 20 4018 5.86 MB/sec execute 52 sec latency 145.975 ms 20 4050 5.75 MB/sec execute 53 sec latency 194.715 ms 20 4076 5.65 MB/sec execute 54 sec latency 548.534 ms 20 4105 5.56 MB/sec execute 55 sec latency 818.861 ms 20 4134 5.46 MB/sec execute 56 sec latency 319.564 ms 20 4164 5.38 MB/sec execute 57 sec latency 501.342 ms 20 4208 5.30 MB/sec execute 58 sec latency 430.998 ms 20 4244 5.23 MB/sec execute 59 sec latency 598.105 ms 20 4270 5.17 MB/sec execute 60 sec latency 449.472 ms 20 4297 5.10 MB/sec execute 61 sec latency 339.910 ms 20 4324 5.05 MB/sec execute 62 sec latency 375.626 ms 20 4352 4.98 MB/sec execute 63 sec latency 354.399 ms 20 4383 4.92 MB/sec execute 64 sec latency 416.572 ms 20 4409 4.87 MB/sec execute 65 sec latency 371.480 ms 20 4438 4.82 MB/sec execute 66 sec latency 438.737 ms 20 4477 4.79 MB/sec execute 67 sec latency 318.464 ms 20 4512 4.79 MB/sec execute 68 sec latency 491.786 ms 20 4553 4.76 MB/sec execute 69 sec latency 343.910 ms 20 4589 4.71 MB/sec execute 70 sec latency 284.040 ms 20 4628 4.71 MB/sec execute 71 sec latency 415.380 ms 20 4664 4.70 MB/sec execute 72 sec latency 496.812 ms 20 4721 4.81 MB/sec execute 73 sec latency 146.816 ms 20 4779 4.85 MB/sec execute 74 sec latency 139.741 ms 20 4825 4.85 MB/sec execute 75 sec latency 253.248 ms 20 4862 4.80 MB/sec execute 76 sec latency 317.055 ms 20 4916 4.89 MB/sec execute 77 sec latency 288.687 ms 20 4960 4.85 MB/sec execute 78 sec latency 259.061 ms 20 5044 5.15 MB/sec execute 79 sec latency 250.924 ms 20 5078 5.09 MB/sec execute 80 sec latency 245.226 ms 20 5126 5.03 MB/sec execute 81 sec latency 287.277 ms 20 5165 4.98 MB/sec execute 82 sec latency 296.630 ms 20 5205 4.93 MB/sec execute 83 sec latency 283.677 ms 20 5246 4.88 MB/sec execute 84 sec latency 327.485 ms 20 5291 4.83 MB/sec execute 85 sec latency 310.987 ms 20 5348 4.79 MB/sec execute 86 sec latency 206.516 ms 20 5406 4.74 MB/sec execute 87 sec latency 223.021 ms 20 5472 4.71 MB/sec execute 88 sec latency 194.502 ms 20 5528 4.66 MB/sec execute 89 sec latency 183.882 ms 20 5589 4.64 MB/sec execute 90 sec latency 168.405 ms 20 5674 4.64 MB/sec execute 91 sec latency 211.282 ms 20 5732 4.62 MB/sec execute 92 sec latency 211.324 ms 20 5803 4.61 MB/sec execute 93 sec latency 217.514 ms 20 5855 4.62 MB/sec execute 94 sec latency 217.262 ms 20 5915 4.62 MB/sec execute 95 sec latency 269.619 ms 20 5985 4.70 MB/sec execute 96 sec latency 273.474 ms 20 6042 4.73 MB/sec execute 97 sec latency 309.652 ms 20 6119 4.86 MB/sec execute 98 sec latency 314.872 ms 20 6192 4.91 MB/sec execute 99 sec latency 384.882 ms 20 6260 5.02 MB/sec execute 100 sec latency 479.332 ms 20 6358 5.09 MB/sec execute 101 sec latency 280.074 ms 20 6470 5.27 MB/sec execute 102 sec latency 276.189 ms 20 6581 5.39 MB/sec execute 103 sec latency 355.326 ms 20 6688 5.51 MB/sec execute 104 sec latency 325.650 ms 20 6779 5.59 MB/sec execute 105 sec latency 301.458 ms 20 6891 5.67 MB/sec execute 106 sec latency 386.438 ms 20 6985 5.76 MB/sec execute 107 sec latency 311.719 ms 20 7078 5.87 MB/sec execute 108 sec latency 239.807 ms 20 7133 5.89 MB/sec execute 109 sec latency 185.494 ms 20 7207 6.03 MB/sec execute 110 sec latency 158.366 ms 20 7253 6.00 MB/sec execute 111 sec latency 122.827 ms 20 7295 5.99 MB/sec execute 112 sec latency 190.092 ms 20 7340 5.96 MB/sec execute 113 sec latency 216.636 ms 20 7375 5.94 MB/sec execute 114 sec latency 132.357 ms 20 7412 5.94 MB/sec execute 115 sec latency 195.078 ms 20 7449 5.89 MB/sec execute 116 sec latency 116.114 ms 20 7476 5.85 MB/sec execute 117 sec latency 190.934 ms 20 7504 5.80 MB/sec execute 118 sec latency 139.978 ms 20 7546 5.77 MB/sec execute 119 sec latency 136.217 ms 20 cleanup 120 sec 20 cleanup 121 sec 20 cleanup 122 sec 11 cleanup 123 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 21531 57.248 307.447 Close 15673 16.077 95.505 Rename 840 91.979 225.068 Unlink 4074 21.719 145.243 Qpathinfo 19888 14.568 176.152 Qfileinfo 3531 0.236 52.153 Qfsinfo 3413 0.283 35.800 Sfileinfo 1327 59.904 212.245 Find 7482 4.424 155.234 WriteX 10459 5.090 86.276 ReadX 34745 0.050 16.287 LockX 80 20.024 50.615 UnlockX 80 19.305 39.654 Flush 1243 231.568 1110.205 Throughput 5.7698 MB/sec 20 clients 20 procs max_latency=1110.218 ms stopping dbench on /mnt/lustre/d0.oleg239-client.virtnet at Thu Dec 12 10:06:40 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg239-client.virtnet /mnt/lustre/d0.oleg239-client.virtnet /mnt/lustre/d0.oleg239-client.virtnet removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg239-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (157s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:48 (1734016008) min OST has 3320832kB available, using 4981248kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6982] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4864] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg239-clien 4864M 79614 61 60606 49 129515 31 467.1 97 Latency 31386us 307ms 81335us 586ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg239-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 193 17 7306 33 379 13 311 18 1021 12 472 12 Latency 31404us 14652us 49803us 18974us 7770us 14872us 1.97,1.97,oleg239-client.virtnet,1,1734006064,4864M,,,,79614,61,60606,49,,,129515,31,467.1,97,10,,,,,193,17,7306,33,379,13,311,18,1021,12,472,12,,31386us,307ms,,81335us,586ms,31404us,14652us,49803us,18974us,7770us,14872us debug=0x33f0484 PASS bonnie (354s) == sanity-benchmark test iozone: iozone ================== 10:12:42 (1734016362) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6982] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:05 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 124254 117763 110355 160957 71772 92048 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:19:01 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 27773 26382 107753 109274 103221 34404 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1139s) == sanity-benchmark test fsx: fsx ======================== 10:31:41 (1734017501) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 25785 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 25785 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read truncating to largest ever: 0x2710a truncating to largest ever: 0x516fc4 truncating to largest ever: 0x556599 truncating to largest ever: 0x55b95d 001000 1734017504.689731 trunc from 0x3b6b1e to 0x420e1b (0x6a2fe bytes) 002000 1734017507.415721 mapread 0x026d4d thru 0x029678 (0x292c bytes) 003000 1734017510.213834 write 0x4284de thru 0x42b6ff (0x3222 bytes) truncating to largest ever: 0x55e330 truncating to largest ever: 0x561558 006000 1734017518.598185 read 0x147a3c thru 0x152563 (0xab28 bytes) 008000 1734017524.024147 mapread 0x186088 thru 0x1927be (0xc737 bytes) 010000 1734017528.979624 read 0x0e5ca4 thru 0x0ed333 (0x7690 bytes) truncating to largest ever: 0x56168e 011000 1734017531.525512 write 0x51c83c thru 0x5248e2 (0x80a7 bytes) 013000 1734017536.637505 trunc from 0x522ba3 to 0x504c6f (0x1df33 bytes) skipping zero size write 016000 1734017544.218053 read 0x29941c thru 0x29a716 (0x12fb bytes) 021000 1734017557.227290 trunc from 0x525bbb to 0x188f00 (0x39ccba bytes) 024000 1734017565.812277 mapwrite 0x1309ab thru 0x137e9f (0x74f5 bytes) 025000 1734017568.139768 read 0x15478a thru 0x163bd6 (0xf44d bytes) 027000 1734017573.646528 trunc from 0x3ed1f1 to 0x080430 (0x36cdc0 bytes) 032000 1734017587.641652 mapwrite 0x17dc7c thru 0x18ba83 (0xde08 bytes) 033000 1734017590.483615 trunc from 0x0275fd to 0x0ce066 (0xa6a6a bytes) 037000 1734017601.488400 mapread 0x1b46df thru 0x1b4f05 (0x827 bytes) 038000 1734017604.559349 read 0x06fa88 thru 0x07ca23 (0xcf9c bytes) truncating to largest ever: 0x561b11 048000 1734017631.674084 mapread 0x41388b thru 0x416c0a (0x3380 bytes) 049000 1734017634.257449 read 0x45b9c0 thru 0x46ac38 (0xf279 bytes) 052000 1734017642.735917 write 0x31e8f9 thru 0x325c8a (0x7392 bytes) 056000 1734017653.791899 read 0x1a365e thru 0x1a7458 (0x3dfb bytes) 058000 1734017659.461545 trunc from 0x1cf55c to 0x340332 (0x170dd7 bytes) 060000 1734017664.536609 write 0x00409b thru 0x0095b0 (0x5516 bytes) 061000 1734017667.548027 mapread 0x0e34a0 thru 0x0e9dc9 (0x692a bytes) 063000 1734017673.085039 write 0x53c49c thru 0x5406a2 (0x4207 bytes) 065000 1734017678.020319 mapwrite 0x26f2db thru 0x26f685 (0x3ab bytes) 067000 1734017683.611350 trunc from 0x3c02fe to 0x22297b (0x19d982 bytes) 070000 1734017692.149768 trunc from 0x52cde2 to 0x36e2fc (0x1beae5 bytes) 072000 1734017697.406395 trunc from 0x229d85 to 0x37c6cd (0x152949 bytes) 076000 1734017708.061317 read 0x02c41f thru 0x0337ef (0x73d1 bytes) 077000 1734017710.711990 mapread 0x020d46 thru 0x021872 (0xb2d bytes) 079000 1734017716.230486 mapwrite 0x1cd95e thru 0x1daad0 (0xd173 bytes) 080000 1734017718.787782 write 0x179e9f thru 0x187d81 (0xdee3 bytes) 081000 1734017721.332540 trunc from 0x0dd561 to 0x1d642e (0xf8ece bytes) 082000 1734017724.263563 trunc from 0x44dc3b to 0x02e796 (0x41f4a4 bytes) 085000 1734017732.827131 write 0x1c37b4 thru 0x1d09b9 (0xd206 bytes) 086000 1734017735.899387 mapwrite 0x49f335 thru 0x4aaf20 (0xbbec bytes) 092000 1734017752.061826 mapwrite 0x54bf61 thru 0x55229a (0x633a bytes) 093000 1734017754.564188 write 0x3deb01 thru 0x3ec58f (0xda8f bytes) 095000 1734017760.504523 write 0x01ecdc thru 0x027628 (0x894d bytes) 096000 1734017763.468405 mapwrite 0x374c8e thru 0x37a7f3 (0x5b66 bytes) 099000 1734017772.758496 mapwrite 0x4c47c0 thru 0x4ceb4e (0xa38f bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 5643264 (5632 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (275s) == sanity-benchmark test complete, duration 1940 sec ===== 10:36:16 (1734017776) === sanity-benchmark: start cleanup 10:36:16 (1734017776) === === sanity-benchmark: finish cleanup 10:36:17 (1734017777) ===