-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:02 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:08 (1734015848) === oleg224-client.virtnet: executing check_config_client /mnt/lustre oleg224-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg224-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b65a8800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b65a8800.idle_timeout=debug disable quota as required oleg224-server: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:24 (1734015864) === == sanity-benchmark test dbench: dbench ================== 10:04:25 (1734015865) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6887] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg224-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg224-client.virtnet at Thu Dec 12 10:04:27 EST 2024 waiting for dbench pid 9456 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 12 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 15 39 30.20 MB/sec warmup 1 sec latency 110.450 ms 20 134 58.85 MB/sec warmup 2 sec latency 190.143 ms 20 200 52.58 MB/sec warmup 3 sec latency 139.623 ms 20 273 51.11 MB/sec warmup 4 sec latency 123.363 ms 20 330 47.71 MB/sec warmup 5 sec latency 135.147 ms 20 393 46.47 MB/sec warmup 6 sec latency 163.750 ms 20 475 47.42 MB/sec warmup 7 sec latency 94.787 ms 20 574 49.19 MB/sec warmup 8 sec latency 137.817 ms 20 668 46.89 MB/sec warmup 9 sec latency 163.713 ms 20 724 42.49 MB/sec warmup 10 sec latency 109.735 ms 20 777 38.82 MB/sec warmup 11 sec latency 150.553 ms 20 843 35.86 MB/sec warmup 12 sec latency 114.490 ms 20 890 33.31 MB/sec warmup 13 sec latency 133.269 ms 20 931 31.06 MB/sec warmup 14 sec latency 117.381 ms 20 954 29.03 MB/sec warmup 15 sec latency 303.097 ms 20 1003 27.69 MB/sec warmup 16 sec latency 120.399 ms 20 1083 26.93 MB/sec warmup 17 sec latency 90.940 ms 20 1143 25.51 MB/sec warmup 18 sec latency 106.435 ms 20 1196 24.22 MB/sec warmup 19 sec latency 112.585 ms 20 1249 23.06 MB/sec warmup 20 sec latency 102.929 ms 20 1380 24.34 MB/sec warmup 21 sec latency 110.306 ms 20 1439 23.62 MB/sec warmup 22 sec latency 157.651 ms 20 1485 22.62 MB/sec warmup 23 sec latency 110.276 ms 20 1598 1.11 MB/sec execute 1 sec latency 111.135 ms 20 1649 0.96 MB/sec execute 2 sec latency 110.555 ms 20 1700 0.92 MB/sec execute 3 sec latency 130.435 ms 20 1756 0.93 MB/sec execute 4 sec latency 139.745 ms 20 1801 0.88 MB/sec execute 5 sec latency 115.343 ms 20 1841 0.85 MB/sec execute 6 sec latency 151.476 ms 20 1885 0.83 MB/sec execute 7 sec latency 119.134 ms 20 1936 0.86 MB/sec execute 8 sec latency 141.767 ms 20 1988 0.87 MB/sec execute 9 sec latency 118.540 ms 20 2035 0.93 MB/sec execute 10 sec latency 120.466 ms 20 2093 1.00 MB/sec execute 11 sec latency 115.160 ms 20 2142 1.00 MB/sec execute 12 sec latency 141.696 ms 20 2185 1.06 MB/sec execute 13 sec latency 125.833 ms 20 2241 1.47 MB/sec execute 14 sec latency 146.970 ms 20 2298 1.78 MB/sec execute 15 sec latency 151.849 ms 20 2333 1.96 MB/sec execute 16 sec latency 824.181 ms 20 2364 2.15 MB/sec execute 17 sec latency 1828.115 ms 20 2400 2.13 MB/sec execute 18 sec latency 1902.564 ms 20 2435 2.21 MB/sec execute 19 sec latency 160.208 ms 20 2483 2.38 MB/sec execute 20 sec latency 183.599 ms 20 2537 2.61 MB/sec execute 21 sec latency 165.410 ms 20 2616 3.05 MB/sec execute 22 sec latency 150.529 ms 20 2719 4.12 MB/sec execute 23 sec latency 165.765 ms 20 2851 5.41 MB/sec execute 24 sec latency 127.488 ms 20 2953 5.91 MB/sec execute 25 sec latency 135.699 ms 20 3039 5.81 MB/sec execute 26 sec latency 132.919 ms 20 3131 5.89 MB/sec execute 27 sec latency 248.922 ms 20 3258 6.19 MB/sec execute 28 sec latency 179.399 ms 20 3361 6.63 MB/sec execute 29 sec latency 128.424 ms 20 3432 7.02 MB/sec execute 30 sec latency 138.466 ms 20 3536 7.88 MB/sec execute 31 sec latency 111.444 ms 20 3603 7.76 MB/sec execute 32 sec latency 109.519 ms 20 3659 7.62 MB/sec execute 33 sec latency 119.317 ms 20 3701 7.52 MB/sec execute 34 sec latency 170.159 ms 20 3755 7.56 MB/sec execute 35 sec latency 117.388 ms 20 3801 7.58 MB/sec execute 36 sec latency 139.681 ms 20 3833 7.38 MB/sec execute 37 sec latency 145.058 ms 20 3867 7.21 MB/sec execute 38 sec latency 116.603 ms 20 3894 7.07 MB/sec execute 39 sec latency 197.010 ms 20 3935 6.97 MB/sec execute 40 sec latency 121.226 ms 20 3970 6.80 MB/sec execute 41 sec latency 119.875 ms 20 4006 6.64 MB/sec execute 42 sec latency 127.435 ms 20 4039 6.49 MB/sec execute 43 sec latency 111.773 ms 20 4069 6.35 MB/sec execute 44 sec latency 220.133 ms 20 4120 6.21 MB/sec execute 45 sec latency 123.870 ms 20 4163 6.09 MB/sec execute 46 sec latency 180.229 ms 20 4220 6.00 MB/sec execute 47 sec latency 207.179 ms 20 4273 5.93 MB/sec execute 48 sec latency 220.401 ms 20 4322 5.85 MB/sec execute 49 sec latency 132.071 ms 20 4379 5.79 MB/sec execute 50 sec latency 102.202 ms 20 4433 5.73 MB/sec execute 51 sec latency 185.212 ms 20 4481 5.67 MB/sec execute 52 sec latency 121.067 ms 20 4520 5.60 MB/sec execute 53 sec latency 130.997 ms 20 4573 5.65 MB/sec execute 54 sec latency 139.639 ms 20 4624 5.69 MB/sec execute 55 sec latency 167.529 ms 20 4691 5.71 MB/sec execute 56 sec latency 116.454 ms 20 4743 5.62 MB/sec execute 57 sec latency 157.029 ms 20 4801 5.61 MB/sec execute 58 sec latency 125.000 ms 20 4880 5.87 MB/sec execute 59 sec latency 109.510 ms 20 4942 6.08 MB/sec execute 60 sec latency 209.653 ms 20 5008 6.24 MB/sec execute 61 sec latency 128.156 ms 20 5047 6.14 MB/sec execute 62 sec latency 120.095 ms 20 5089 6.06 MB/sec execute 63 sec latency 120.867 ms 20 5122 5.97 MB/sec execute 64 sec latency 125.185 ms 20 5160 5.89 MB/sec execute 65 sec latency 137.011 ms 20 5203 5.81 MB/sec execute 66 sec latency 113.266 ms 20 5250 5.74 MB/sec execute 67 sec latency 127.261 ms 20 5293 5.66 MB/sec execute 68 sec latency 123.018 ms 20 5324 5.59 MB/sec execute 69 sec latency 119.116 ms 20 5360 5.52 MB/sec execute 70 sec latency 135.446 ms 20 5395 5.45 MB/sec execute 71 sec latency 116.095 ms 20 5443 5.39 MB/sec execute 72 sec latency 130.158 ms 20 5506 5.33 MB/sec execute 73 sec latency 98.261 ms 20 5566 5.27 MB/sec execute 74 sec latency 110.513 ms 20 5616 5.22 MB/sec execute 75 sec latency 100.890 ms 20 5675 5.18 MB/sec execute 76 sec latency 107.536 ms 20 5734 5.13 MB/sec execute 77 sec latency 104.937 ms 20 5795 5.13 MB/sec execute 78 sec latency 166.564 ms 20 5884 5.21 MB/sec execute 79 sec latency 91.849 ms 20 5956 5.26 MB/sec execute 80 sec latency 98.777 ms 20 6011 5.25 MB/sec execute 81 sec latency 134.359 ms 20 6090 5.31 MB/sec execute 82 sec latency 123.541 ms 20 6191 5.49 MB/sec execute 83 sec latency 107.217 ms 20 6324 5.82 MB/sec execute 84 sec latency 118.521 ms 20 6447 6.09 MB/sec execute 85 sec latency 122.895 ms 20 6562 6.17 MB/sec execute 86 sec latency 121.600 ms 20 6701 6.25 MB/sec execute 87 sec latency 108.549 ms 20 6849 6.41 MB/sec execute 88 sec latency 108.552 ms 20 6982 6.63 MB/sec execute 89 sec latency 97.130 ms 20 7098 6.93 MB/sec execute 90 sec latency 79.512 ms 20 7171 6.94 MB/sec execute 91 sec latency 84.203 ms 20 7232 6.93 MB/sec execute 92 sec latency 94.141 ms 20 7287 6.93 MB/sec execute 93 sec latency 109.164 ms 20 7337 6.95 MB/sec execute 94 sec latency 147.771 ms 20 7383 6.90 MB/sec execute 95 sec latency 102.216 ms 20 7422 6.84 MB/sec execute 96 sec latency 112.471 ms 20 7466 6.81 MB/sec execute 97 sec latency 104.157 ms 20 7509 6.75 MB/sec execute 98 sec latency 105.673 ms 20 7535 6.68 MB/sec execute 99 sec latency 197.793 ms 20 7568 6.61 MB/sec execute 100 sec latency 104.547 ms 20 7606 6.55 MB/sec execute 101 sec latency 124.741 ms 20 7652 6.49 MB/sec execute 102 sec latency 190.192 ms 20 7704 6.43 MB/sec execute 103 sec latency 191.586 ms 20 7760 6.38 MB/sec execute 104 sec latency 223.488 ms 20 7819 6.35 MB/sec execute 105 sec latency 118.996 ms 20 7869 6.31 MB/sec execute 106 sec latency 136.880 ms 20 7919 6.28 MB/sec execute 107 sec latency 126.862 ms 20 7973 6.24 MB/sec execute 108 sec latency 108.827 ms 20 8026 6.21 MB/sec execute 109 sec latency 108.164 ms 20 8090 6.21 MB/sec execute 110 sec latency 95.538 ms 20 8156 6.25 MB/sec execute 111 sec latency 154.798 ms 20 8235 6.26 MB/sec execute 112 sec latency 96.212 ms 20 8310 6.25 MB/sec execute 113 sec latency 102.007 ms 20 8390 6.30 MB/sec execute 114 sec latency 88.283 ms 20 8499 6.56 MB/sec execute 115 sec latency 111.002 ms 20 8560 6.58 MB/sec execute 116 sec latency 95.748 ms 20 8616 6.53 MB/sec execute 117 sec latency 84.400 ms 20 8668 6.48 MB/sec execute 118 sec latency 93.917 ms 20 8711 6.43 MB/sec execute 119 sec latency 113.748 ms 20 cleanup 120 sec 20 cleanup 121 sec 18 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 25128 55.322 252.669 Close 18365 13.415 151.056 Rename 1045 80.371 266.949 Unlink 4983 18.474 135.609 Qpathinfo 23057 13.092 174.589 Qfileinfo 3978 0.266 49.116 Qfsinfo 4080 0.164 28.679 Sfileinfo 2000 50.741 314.677 Find 8729 3.700 169.959 WriteX 12298 5.348 109.508 ReadX 38820 0.028 7.315 LockX 80 21.497 50.170 UnlockX 80 21.153 52.366 Flush 1742 46.041 1902.552 Throughput 6.43138 MB/sec 20 clients 20 procs max_latency=1902.564 ms stopping dbench on /mnt/lustre/d0.oleg224-client.virtnet at Thu Dec 12 10:06:54 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg224-client.virtnet /mnt/lustre/d0.oleg224-client.virtnet /mnt/lustre/d0.oleg224-client.virtnet removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg224-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:01 (1734016021) min OST has 3569916kB available, using 5354874kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6887] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5229] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg224-clien 5229M 83857 66 54337 48 117866 30 1368 206 Latency 16731us 205ms 138ms 56473us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg224-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 301 19 7495 33 446 15 343 19 1025 12 541 14 Latency 17109us 16044us 31507us 22712us 3185us 14527us 1.97,1.97,oleg224-client.virtnet,1,1734006040,5229M,,,,83857,66,54337,48,,,117866,30,1368,206,10,,,,,301,19,7495,33,446,15,343,19,1025,12,541,14,,16731us,205ms,,138ms,56473us,17109us,16044us,31507us,22712us,3185us,14527us debug=0x33f0484 PASS bonnie (340s) == sanity-benchmark test iozone: iozone ================== 10:12:41 (1734016361) Waiting for MDT destroys to complete oleg224-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg224-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg224-client: oleg224-server: ssh exited with exit code 1 pdsh@oleg224-client: oleg224-server: ssh exited with exit code 1 min OST has 3605620kB available, using 5408430kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6887] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:50 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 335054 139407 96309 100915 51323 257256 iozone test complete. Waiting for MDT destroys to complete oleg224-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg224-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg224-client: oleg224-server: ssh exited with exit code 1 pdsh@oleg224-client: oleg224-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg224-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg224-client: oleg224-server: ssh exited with exit code 1 oleg224-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg224-client: oleg224-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:18:04 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 53602 75420 87628 86424 88991 77187 iozone test complete. Waiting for MDT destroys to complete oleg224-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg224-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg224-client: oleg224-server: ssh exited with exit code 1 pdsh@oleg224-client: oleg224-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (761s) == sanity-benchmark test fsx: fsx ======================== 10:25:22 (1734017122) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 30762 -P /tmp -l 5408430 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 30762 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x425809 fallocating to largest ever: 0x4bc8a2 fallocating to largest ever: 0x4ec67c truncating to largest ever: 0x5271c8 truncating to largest ever: 0x527378 fallocating to largest ever: 0x5286ae 003000 1734017131.013394 read 0x3d489c thru 0x3d6cb3 (0x2418 bytes) 004000 1734017133.723521 mapread 0x143bb8 thru 0x145945 (0x1d8e bytes) 006000 1734017139.748247 fallocate 0x4263fa thru 0x42b541 (0x5148 bytes) 009000 1734017148.505720 read 0x310eac thru 0x3114a2 (0x5f7 bytes) 010000 1734017151.286777 fallocate 0x304ac4 thru 0x314868 (0xfda5 bytes) 011000 1734017153.902581 punch from 0x472361 to 0x478333 (0x5fd3 bytes) 012000 1734017156.940865 fallocate 0x3b6a1c thru 0x3c0a2d (0xa012 bytes) 013000 1734017159.671669 write 0x42b12a thru 0x437a9a (0xc971 bytes) 014000 1734017162.639764 write 0x04b3f2 thru 0x04cb70 (0x177f bytes) 015000 1734017165.528401 read 0x1fa896 thru 0x202d34 (0x849f bytes) 018000 1734017174.590718 mapwrite 0x0460da thru 0x04a223 (0x414a bytes) 021000 1734017183.100139 punch from 0x4871f9 to 0x492ead (0xbcb5 bytes) 023000 1734017188.663264 fallocate 0x4d47d4 thru 0x4da45e (0x5c8b bytes) 025000 1734017194.683205 fallocate 0x3a2ff1 thru 0x3ac43c (0x944c bytes) 027000 1734017200.342555 punch from 0x062ee5 to 0x064c1b (0x1d37 bytes) 028000 1734017203.379979 fallocate 0x313e6b thru 0x31d5ae (0x9744 bytes) 029000 1734017206.357353 trunc from 0x070cc9 to 0x172c11 (0x101f49 bytes) 031000 1734017212.243260 mapwrite 0x12c1b1 thru 0x13c086 (0xfed6 bytes) 032000 1734017215.035339 mapread 0x19fd00 thru 0x1a891a (0x8c1b bytes) 033000 1734017217.802910 write 0x2576a4 thru 0x25d052 (0x59af bytes) 034000 1734017220.687932 trunc from 0x363bb6 to 0x427b0f (0xc3f5a bytes) 036000 1734017226.836017 write 0x1d376e thru 0x1d4f26 (0x17b9 bytes) 038000 1734017232.492984 punch from 0x31aff2 to 0x321f0f (0x6f1e bytes) 039000 1734017235.259220 mapread 0x00547c thru 0x007fb3 (0x2b38 bytes) 040000 1734017238.228803 read 0x14e76e thru 0x15573e (0x6fd1 bytes) 042000 1734017244.477155 fallocate 0x3bc38e thru 0x3bcf5c (0xbcf bytes) 045000 1734017253.071918 read 0x141852 thru 0x14c864 (0xb013 bytes) 046000 1734017255.935347 trunc from 0x229a04 to 0x2e8f84 (0xbf581 bytes) 048000 1734017262.063826 mapread 0x15225d thru 0x15ef03 (0xcca7 bytes) 050000 1734017267.709216 trunc from 0x4f65bd to 0x19d6e3 (0x358ed9 bytes) 051000 1734017270.512374 mapread 0x2766eb thru 0x28608b (0xf9a1 bytes) 052000 1734017273.319188 fallocate 0x2f057d thru 0x2f3497 (0x2f1b bytes) 053000 1734017275.736518 mapwrite 0x3c8e98 thru 0x3d8550 (0xf6b9 bytes) 055000 1734017281.563963 punch from 0x0da8e0 to 0x0e043d (0x5b5e bytes) 056000 1734017284.624718 mapwrite 0x1c8e89 thru 0x1d5ca2 (0xce1a bytes) 057000 1734017287.452737 punch from 0x0b1c45 to 0x0b827b (0x6637 bytes) 058000 1734017290.298337 mapwrite 0x469628 thru 0x46e82a (0x5203 bytes) 060000 1734017296.081598 mapwrite 0x1e6cd6 thru 0x1f5957 (0xec82 bytes) 061000 1734017298.540921 mapwrite 0x01439f thru 0x0224e7 (0xe149 bytes) 064000 1734017307.773288 mapread 0x088de0 thru 0x09553e (0xc75f bytes) 065000 1734017310.753375 write 0x244111 thru 0x25324f (0xf13f bytes) 066000 1734017313.584026 punch from 0x004167 to 0x00a41e (0x62b8 bytes) 067000 1734017316.146435 mapread 0x1f1676 thru 0x1fb8a0 (0xa22b bytes) 069000 1734017321.572555 punch from 0x0e7548 to 0x0eeb9b (0x7654 bytes) 071000 1734017327.194708 fallocate 0x2efdb3 thru 0x2f2a09 (0x2c57 bytes) 072000 1734017329.828052 read 0x134498 thru 0x13e6ec (0xa255 bytes) 073000 1734017332.879736 trunc from 0x116e20 to 0x0b9bda (0x5d245 bytes) 074000 1734017335.539073 punch from 0x1939b1 to 0x19a97f (0x6fcf bytes) 078000 1734017347.452971 punch from 0x172a9a to 0x181e98 (0xf3ff bytes) 080000 1734017353.183453 read 0x323958 thru 0x324ce9 (0x1392 bytes) 081000 1734017355.680243 read 0x447b11 thru 0x44f8b0 (0x7da0 bytes) 082000 1734017358.404764 write 0x3fa662 thru 0x3fcb4c (0x24eb bytes) 083000 1734017361.287043 mapread 0x0360ea thru 0x03a84b (0x4762 bytes) 084000 1734017363.725411 punch from 0x04f1e7 to 0x0584f6 (0x9310 bytes) 085000 1734017366.593856 write 0x521670 thru 0x527524 (0x5eb5 bytes) 086000 1734017369.504360 read 0x053f01 thru 0x061931 (0xda31 bytes) 087000 1734017372.221939 mapwrite 0x0154b7 thru 0x0248e4 (0xf42e bytes) 089000 1734017377.577405 fallocate 0x04f29e thru 0x05e820 (0xf583 bytes) 090000 1734017380.074332 punch from 0x057772 to 0x0638a9 (0xc138 bytes) 091000 1734017382.868489 read 0x335dd2 thru 0x33ea3e (0x8c6d bytes) 092000 1734017385.493265 mapwrite 0x3dbe5e thru 0x3ddbc2 (0x1d65 bytes) 094000 1734017391.355470 mapread 0x337cc4 thru 0x3397e1 (0x1b1e bytes) 095000 1734017394.045860 trunc from 0x023f9f to 0x44b492 (0x4274f4 bytes) 096000 1734017396.860165 punch from 0x007677 to 0x015830 (0xe1ba bytes) 097000 1734017399.491871 mapread 0x0a6a9c thru 0x0a8fb0 (0x2515 bytes) 098000 1734017402.101973 fallocate 0x2a3ba9 thru 0x2a4d50 (0x11a8 bytes) 099000 1734017404.792394 trunc from 0x40fa3c to 0x46e848 (0x5ee0d bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 5266024 (5144 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 4067328.. 4067331: 4: 0000: net 1: 12.. 23: 4067028.. 4067039: 12: 0000: net 2: 76.. 95: 306552.. 306571: 20: 0000: net 3: 152.. 163: 4070612.. 4070623: 12: 0000: net 4: 164.. 171: 4075464.. 4075471: 8: 0000: net 5: 308.. 351: 4075744.. 4075787: 44: 0000: net 6: 376.. 387: 4067332.. 4067343: 12: 0000: unwritten,net 7: 432.. 459: 4066944.. 4066971: 28: 0000: unwritten,net 8: 460.. 463: 4073468.. 4073471: 4: 0000: unwritten,net 9: 464.. 487: 4067120.. 4067143: 24: 0000: unwritten,net 10: 488.. 491: 4067144.. 4067147: 4: 0000: net 11: 492.. 531: 4063344.. 4063383: 40: 0000: net 12: 532.. 587: 4078116.. 4078171: 56: 0000: net 13: 612.. 655: 4067392.. 4067435: 44: 0000: net 14: 656.. 663: 4066984.. 4066991: 8: 0000: net 15: 664.. 699: 4066992.. 4067027: 36: 0000: unwritten,net 16: 748.. 803: 4065736.. 4065791: 56: 0000: net 17: 1096.. 1119: 4078172.. 4078195: 24: 0000: net 18: 1492.. 1527: 4067808.. 4067843: 36: 0000: net 19: 1696.. 1763: 4068012.. 4068079: 68: 0000: net 20: 3564.. 3575: 4066972.. 4066983: 12: 0000: net 21: 3804.. 3819: 4066020.. 4066035: 16: 0000: net 22: 4672.. 4691: 4063296.. 4063315: 20: 0000: net 23: 4692.. 4715: 4063316.. 4063339: 24: 0000: unwritten,net 24: 5132.. 5143: 4080032.. 4080043: 12: 0000: last,net,eof /mnt/lustre/f0.fsxfile: 21 extents found debug=0x33f0484 PASS fsx (286s) == sanity-benchmark test complete, duration 1565 sec ===== 10:30:08 (1734017408) === sanity-benchmark: start cleanup 10:30:08 (1734017408) === === sanity-benchmark: finish cleanup 10:30:09 (1734017409) ===