-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:56 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:01 (1734015841) === oleg203-client.virtnet: executing check_config_client /mnt/lustre oleg203-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg203-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6ca6800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6ca6800.idle_timeout=debug disable quota as required oleg203-server: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:11 (1734015851) === == sanity-benchmark test dbench: dbench ================== 10:04:12 (1734015852) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6992] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg203-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg203-client.virtnet at Thu Dec 12 10:04:13 EST 2024 waiting for dbench pid 9461 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 9 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 13 37 28.25 MB/sec warmup 1 sec latency 129.648 ms 20 126 56.77 MB/sec warmup 2 sec latency 201.085 ms 20 196 51.96 MB/sec warmup 3 sec latency 116.766 ms 20 273 51.26 MB/sec warmup 4 sec latency 108.822 ms 20 339 48.97 MB/sec warmup 5 sec latency 141.093 ms 20 404 47.68 MB/sec warmup 6 sec latency 126.252 ms 20 472 47.19 MB/sec warmup 7 sec latency 130.186 ms 20 567 48.80 MB/sec warmup 8 sec latency 134.405 ms 20 659 46.91 MB/sec warmup 9 sec latency 442.599 ms 20 694 42.37 MB/sec warmup 10 sec latency 243.982 ms 20 732 38.73 MB/sec warmup 11 sec latency 354.390 ms 20 777 35.61 MB/sec warmup 12 sec latency 192.854 ms 20 807 33.05 MB/sec warmup 13 sec latency 249.313 ms 20 864 30.85 MB/sec warmup 14 sec latency 215.763 ms 20 909 28.94 MB/sec warmup 15 sec latency 254.307 ms 20 954 27.36 MB/sec warmup 16 sec latency 321.557 ms 20 1001 25.94 MB/sec warmup 17 sec latency 352.878 ms 20 1084 25.46 MB/sec warmup 18 sec latency 381.560 ms 20 1154 24.21 MB/sec warmup 19 sec latency 93.249 ms 20 1218 23.33 MB/sec warmup 20 sec latency 127.215 ms 20 1279 22.40 MB/sec warmup 21 sec latency 130.029 ms 20 1406 23.64 MB/sec warmup 22 sec latency 300.134 ms 20 1460 22.63 MB/sec warmup 23 sec latency 222.598 ms 20 1552 0.93 MB/sec execute 1 sec latency 268.336 ms 20 1612 1.06 MB/sec execute 2 sec latency 190.781 ms 20 1657 0.93 MB/sec execute 3 sec latency 186.793 ms 20 1712 0.93 MB/sec execute 4 sec latency 193.285 ms 20 1772 0.95 MB/sec execute 5 sec latency 207.738 ms 20 1831 0.94 MB/sec execute 6 sec latency 101.197 ms 20 1876 0.92 MB/sec execute 7 sec latency 212.630 ms 20 1936 0.95 MB/sec execute 8 sec latency 209.567 ms 20 1997 0.98 MB/sec execute 9 sec latency 215.213 ms 20 2046 1.04 MB/sec execute 10 sec latency 111.351 ms 20 2110 1.09 MB/sec execute 11 sec latency 84.798 ms 20 2163 1.26 MB/sec execute 12 sec latency 228.493 ms 20 2204 1.26 MB/sec execute 13 sec latency 397.598 ms 20 2260 1.64 MB/sec execute 14 sec latency 297.218 ms 20 2292 1.71 MB/sec execute 15 sec latency 778.690 ms 20 2357 2.30 MB/sec execute 16 sec latency 1233.230 ms 20 2396 2.33 MB/sec execute 17 sec latency 400.278 ms 20 2439 2.39 MB/sec execute 18 sec latency 419.720 ms 20 2492 2.82 MB/sec execute 19 sec latency 434.962 ms 20 2535 3.00 MB/sec execute 20 sec latency 671.229 ms 20 2637 3.62 MB/sec execute 21 sec latency 291.385 ms 20 2721 4.34 MB/sec execute 22 sec latency 396.824 ms 20 2834 5.47 MB/sec execute 23 sec latency 347.681 ms 20 2947 5.96 MB/sec execute 24 sec latency 445.441 ms 20 3008 6.04 MB/sec execute 25 sec latency 401.033 ms 20 3088 6.04 MB/sec execute 26 sec latency 497.259 ms 20 3175 6.17 MB/sec execute 27 sec latency 354.628 ms 20 3290 6.58 MB/sec execute 28 sec latency 468.019 ms 20 3369 6.74 MB/sec execute 29 sec latency 479.664 ms 20 3462 7.27 MB/sec execute 30 sec latency 393.675 ms 20 3520 7.34 MB/sec execute 31 sec latency 136.046 ms 20 3607 7.83 MB/sec execute 32 sec latency 129.067 ms 20 3657 7.67 MB/sec execute 33 sec latency 109.200 ms 20 3703 7.64 MB/sec execute 34 sec latency 175.450 ms 20 3748 7.56 MB/sec execute 35 sec latency 130.600 ms 20 3787 7.45 MB/sec execute 36 sec latency 130.356 ms 20 3830 7.41 MB/sec execute 37 sec latency 160.217 ms 20 3867 7.26 MB/sec execute 38 sec latency 128.648 ms 20 3901 7.10 MB/sec execute 39 sec latency 157.274 ms 20 3933 6.95 MB/sec execute 40 sec latency 162.516 ms 20 3971 6.82 MB/sec execute 41 sec latency 127.532 ms 20 4002 6.66 MB/sec execute 42 sec latency 126.093 ms 20 4036 6.51 MB/sec execute 43 sec latency 135.786 ms 20 4072 6.37 MB/sec execute 44 sec latency 209.029 ms 20 4106 6.23 MB/sec execute 45 sec latency 527.971 ms 20 4146 6.11 MB/sec execute 46 sec latency 716.060 ms 20 4182 6.00 MB/sec execute 47 sec latency 481.237 ms 20 4231 5.90 MB/sec execute 48 sec latency 541.850 ms 20 4263 5.82 MB/sec execute 49 sec latency 462.670 ms 20 4289 5.72 MB/sec execute 50 sec latency 316.214 ms 20 4322 5.65 MB/sec execute 51 sec latency 294.534 ms 20 4350 5.56 MB/sec execute 52 sec latency 393.914 ms 20 4390 5.49 MB/sec execute 53 sec latency 341.760 ms 20 4428 5.42 MB/sec execute 54 sec latency 321.338 ms 20 4469 5.36 MB/sec execute 55 sec latency 345.708 ms 20 4508 5.32 MB/sec execute 56 sec latency 368.164 ms 20 4539 5.28 MB/sec execute 57 sec latency 380.517 ms 20 4599 5.32 MB/sec execute 58 sec latency 338.971 ms 20 4646 5.28 MB/sec execute 59 sec latency 337.716 ms 20 4713 5.39 MB/sec execute 60 sec latency 119.565 ms 20 4771 5.37 MB/sec execute 61 sec latency 120.672 ms 20 4829 5.43 MB/sec execute 62 sec latency 124.776 ms 20 4886 5.55 MB/sec execute 63 sec latency 334.062 ms 20 4934 5.55 MB/sec execute 64 sec latency 297.642 ms 20 5008 5.87 MB/sec execute 65 sec latency 391.823 ms 20 5038 5.78 MB/sec execute 66 sec latency 255.872 ms 20 5077 5.70 MB/sec execute 67 sec latency 296.971 ms 20 5115 5.63 MB/sec execute 68 sec latency 318.754 ms 20 5148 5.56 MB/sec execute 69 sec latency 147.100 ms 20 5193 5.49 MB/sec execute 70 sec latency 207.698 ms 20 5229 5.42 MB/sec execute 71 sec latency 163.941 ms 20 5261 5.35 MB/sec execute 72 sec latency 349.819 ms 20 5300 5.29 MB/sec execute 73 sec latency 253.088 ms 20 5337 5.22 MB/sec execute 74 sec latency 173.604 ms 20 5374 5.16 MB/sec execute 75 sec latency 214.046 ms 20 5422 5.11 MB/sec execute 76 sec latency 136.437 ms 20 5472 5.05 MB/sec execute 77 sec latency 210.041 ms 20 5525 5.00 MB/sec execute 78 sec latency 186.171 ms 20 5587 4.96 MB/sec execute 79 sec latency 226.978 ms 20 5640 4.91 MB/sec execute 80 sec latency 148.807 ms 20 5687 4.88 MB/sec execute 81 sec latency 216.606 ms 20 5741 4.86 MB/sec execute 82 sec latency 261.123 ms 20 5796 4.85 MB/sec execute 83 sec latency 265.942 ms 20 5850 4.87 MB/sec execute 84 sec latency 248.363 ms 20 5898 4.87 MB/sec execute 85 sec latency 359.971 ms 20 5965 4.91 MB/sec execute 86 sec latency 385.009 ms 20 6017 4.94 MB/sec execute 87 sec latency 416.522 ms 20 6093 5.02 MB/sec execute 88 sec latency 306.841 ms 20 6177 5.13 MB/sec execute 89 sec latency 329.990 ms 20 6283 5.33 MB/sec execute 90 sec latency 288.522 ms 20 6394 5.51 MB/sec execute 91 sec latency 285.034 ms 20 6512 5.70 MB/sec execute 92 sec latency 314.020 ms 20 6636 5.82 MB/sec execute 93 sec latency 293.963 ms 20 6741 5.87 MB/sec execute 94 sec latency 321.566 ms 20 6855 5.97 MB/sec execute 95 sec latency 339.267 ms 20 6957 6.12 MB/sec execute 96 sec latency 314.409 ms 20 7057 6.26 MB/sec execute 97 sec latency 224.765 ms 20 7151 6.41 MB/sec execute 98 sec latency 83.386 ms 20 7228 6.46 MB/sec execute 99 sec latency 91.091 ms 20 7299 6.47 MB/sec execute 100 sec latency 100.604 ms 20 7347 6.44 MB/sec execute 101 sec latency 125.395 ms 20 7395 6.45 MB/sec execute 102 sec latency 138.505 ms 20 7438 6.40 MB/sec execute 103 sec latency 107.554 ms 20 7482 6.34 MB/sec execute 104 sec latency 97.707 ms 20 7525 6.30 MB/sec execute 105 sec latency 136.256 ms 20 7561 6.25 MB/sec execute 106 sec latency 346.471 ms 20 7610 6.19 MB/sec execute 107 sec latency 164.137 ms 20 7647 6.14 MB/sec execute 108 sec latency 359.287 ms 20 7693 6.09 MB/sec execute 109 sec latency 342.993 ms 20 7737 6.04 MB/sec execute 110 sec latency 399.297 ms 20 7786 6.00 MB/sec execute 111 sec latency 498.267 ms 20 7821 5.96 MB/sec execute 112 sec latency 385.681 ms 20 7859 5.92 MB/sec execute 113 sec latency 271.247 ms 20 7894 5.89 MB/sec execute 114 sec latency 363.609 ms 20 7934 5.85 MB/sec execute 115 sec latency 294.905 ms 20 7977 5.83 MB/sec execute 116 sec latency 334.447 ms 20 8006 5.79 MB/sec execute 117 sec latency 336.998 ms 20 8062 5.78 MB/sec execute 118 sec latency 295.019 ms 20 8113 5.78 MB/sec execute 119 sec latency 264.183 ms 20 cleanup 120 sec 20 cleanup 121 sec 13 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 23171 53.211 245.819 Close 16887 13.417 116.392 Rename 934 77.275 213.920 Unlink 4787 17.843 92.683 Qpathinfo 21179 12.579 181.090 Qfileinfo 3628 0.212 39.609 Qfsinfo 3859 0.200 26.478 Sfileinfo 1716 46.374 192.733 Find 8131 3.816 155.116 WriteX 11437 4.069 73.233 ReadX 35868 0.028 13.801 LockX 80 17.052 38.589 UnlockX 80 16.092 44.628 Flush 1690 210.457 1233.223 Throughput 5.78004 MB/sec 20 clients 20 procs max_latency=1233.230 ms stopping dbench on /mnt/lustre/d0.oleg203-client.virtnet at Thu Dec 12 10:06:40 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg203-client.virtnet /mnt/lustre/d0.oleg203-client.virtnet /mnt/lustre/d0.oleg203-client.virtnet removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg203-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (154s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:46 (1734016006) min OST has 3450880kB available, using 5176320kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6992] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5055] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg203-clien 5055M 82347 61 60731 50 132660 32 518.0 104 Latency 19926us 183ms 78547us 786ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg203-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 197 17 7503 34 385 13 310 18 1014 12 472 13 Latency 47943us 14278us 51079us 19091us 3443us 14047us 1.97,1.97,oleg203-client.virtnet,1,1734006074,5055M,,,,82347,61,60731,50,,,132660,32,518.0,104,10,,,,,197,17,7503,34,385,13,310,18,1014,12,472,13,,19926us,183ms,,78547us,786ms,47943us,14278us,51079us,19091us,3443us,14047us debug=0x33f0484 PASS bonnie (356s) == sanity-benchmark test iozone: iozone ================== 10:12:42 (1734016362) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6992] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:59 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 126181 127749 108760 149332 69055 95265 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:18:58 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 27479 26759 106396 108012 102586 33980 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1139s) == sanity-benchmark test fsx: fsx ======================== 10:31:41 (1734017501) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 21058 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 21058 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x55f700 truncating to largest ever: 0x55fb2e truncating to largest ever: 0x560170 003000 1734017509.647045 trunc from 0x4b665e to 0x47b9f9 (0x3ac64 bytes) 004000 1734017512.463724 mapread 0x430e37 thru 0x433c5f (0x2e29 bytes) 009000 1734017525.321006 write 0x2df8a0 thru 0x2e7e6e (0x85cf bytes) 010000 1734017527.953615 read 0x36c875 thru 0x3765d0 (0x9d5c bytes) 011000 1734017530.960989 write 0x4e4063 thru 0x4f0641 (0xc5df bytes) 016000 1734017543.821705 mapread 0x22684d thru 0x233869 (0xd01d bytes) 017000 1734017546.584781 read 0x1ab382 thru 0x1b3f35 (0x8bb4 bytes) 018000 1734017549.525198 mapread 0x2688b1 thru 0x2724ac (0x9bfc bytes) truncating to largest ever: 0x5603a1 019000 1734017552.081988 mapread 0x2444d5 thru 0x24b342 (0x6e6e bytes) 022000 1734017560.840486 write 0x01f824 thru 0x02dd86 (0xe563 bytes) truncating to largest ever: 0x560985 023000 1734017563.409646 read 0x0618ae thru 0x061ab7 (0x20a bytes) 025000 1734017568.924573 read 0x3373b6 thru 0x33753a (0x185 bytes) 026000 1734017571.676089 mapread 0x37ae89 thru 0x385823 (0xa99b bytes) 029000 1734017579.973295 mapread 0x375cc2 thru 0x378b7f (0x2ebe bytes) 032000 1734017587.922989 write 0x094117 thru 0x0a0d72 (0xcc5c bytes) 033000 1734017590.836381 write 0x0439d3 thru 0x04e860 (0xae8e bytes) 034000 1734017593.666357 read 0x243e97 thru 0x250a8e (0xcbf8 bytes) 035000 1734017596.534582 mapwrite 0x22d109 thru 0x2305ab (0x34a3 bytes) 036000 1734017599.406855 mapwrite 0x033d32 thru 0x034089 (0x358 bytes) 037000 1734017602.036756 mapwrite 0x156c1d thru 0x1666ce (0xfab2 bytes) 040000 1734017610.505143 trunc from 0x4662d8 to 0x1a227c (0x2c405b bytes) 042000 1734017616.067056 mapread 0x2d4124 thru 0x2d5015 (0xef2 bytes) 044000 1734017621.694955 read 0x0bcf8c thru 0x0c673f (0x97b4 bytes) truncating to largest ever: 0x560d5f 047000 1734017629.394553 mapread 0x02fe6a thru 0x03a3c6 (0xa55d bytes) 048000 1734017632.355046 read 0x2e7006 thru 0x2e84cc (0x14c7 bytes) truncating to largest ever: 0x561ba2 051000 1734017640.615263 trunc from 0x5474b9 to 0x22f2fb (0x3181bd bytes) 052000 1734017643.384913 mapread 0x027912 thru 0x0306dd (0x8dcc bytes) 053000 1734017646.387380 read 0x0379be thru 0x04329e (0xb8e1 bytes) 055000 1734017651.767337 mapwrite 0x27df5b thru 0x283926 (0x59cc bytes) 056000 1734017654.671318 mapwrite 0x46731a thru 0x4675fa (0x2e1 bytes) 059000 1734017662.782532 trunc from 0x195e3e to 0x268eca (0xd308d bytes) 061000 1734017668.365807 write 0x14c309 thru 0x155e27 (0x9b1f bytes) 062000 1734017671.492281 mapread 0x0c5eb9 thru 0x0d425f (0xe3a7 bytes) 063000 1734017674.029057 mapwrite 0x07e4d0 thru 0x087fe2 (0x9b13 bytes) 065000 1734017679.698103 write 0x3a674e thru 0x3ac1a4 (0x5a57 bytes) 066000 1734017682.092674 mapread 0x2d5fb0 thru 0x2e068f (0xa6e0 bytes) 067000 1734017684.939673 write 0x4a0f32 thru 0x4aac70 (0x9d3f bytes) 069000 1734017690.513020 mapread 0x287deb thru 0x28c10a (0x4320 bytes) 070000 1734017693.346981 mapwrite 0x0d4149 thru 0x0de181 (0xa039 bytes) 072000 1734017699.020172 mapwrite 0x33e340 thru 0x34b776 (0xd437 bytes) 073000 1734017701.754848 mapread 0x05244e thru 0x057c7e (0x5831 bytes) 076000 1734017710.096433 mapwrite 0x2d5b8c thru 0x2da04d (0x44c2 bytes) 077000 1734017713.136636 mapread 0x0df398 thru 0x0edf0d (0xeb76 bytes) 080000 1734017721.172927 mapwrite 0x277e21 thru 0x27b5fa (0x37da bytes) 082000 1734017726.488110 mapwrite 0x0863ca thru 0x093a03 (0xd63a bytes) 083000 1734017729.396448 mapread 0x2bf7cb thru 0x2c00ce (0x904 bytes) 084000 1734017732.203897 read 0x1c5085 thru 0x1c8fa4 (0x3f20 bytes) 087000 1734017740.990796 mapread 0x371957 thru 0x37c3b4 (0xaa5e bytes) 088000 1734017743.450612 read 0x355b61 thru 0x356473 (0x913 bytes) 089000 1734017745.796738 read 0x446b7c thru 0x455f33 (0xf3b8 bytes) 090000 1734017748.242956 mapread 0x0e86ce thru 0x0ea484 (0x1db7 bytes) 091000 1734017751.163592 write 0x45c741 thru 0x464e96 (0x8756 bytes) 092000 1734017753.554382 trunc from 0x54267b to 0x0df950 (0x462d2a bytes) 095000 1734017761.551755 write 0x535411 thru 0x535543 (0x133 bytes) 097000 1734017766.814765 mapwrite 0x2426c6 thru 0x245de7 (0x3722 bytes) 099000 1734017772.280166 mapread 0x007065 thru 0x00aff6 (0x3f92 bytes) 100000 1734017774.941171 write 0x11a1d2 thru 0x11c368 (0x2197 bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 5500177 (5376 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (274s) == sanity-benchmark test complete, duration 1939 sec ===== 10:36:16 (1734017776) === sanity-benchmark: start cleanup 10:36:16 (1734017776) === === sanity-benchmark: finish cleanup 10:36:17 (1734017777) ===