-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:17 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:27 (1734015867) === oleg232-client.virtnet: executing check_config_client /mnt/lustre oleg232-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg232-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6d24000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6d24000.idle_timeout=debug disable quota as required oleg232-server: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:48 (1734015888) === == sanity-benchmark test dbench: dbench ================== 10:04:50 (1734015890) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7600] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg232-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg232-client.virtnet at Thu Dec 12 10:04:52 EST 2024 waiting for dbench pid 10298 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 3 11 5.20 MB/sec warmup 1 sec latency 856.490 ms 20 80 35.29 MB/sec warmup 2 sec latency 178.962 ms 20 136 39.47 MB/sec warmup 3 sec latency 230.808 ms 20 171 34.81 MB/sec warmup 4 sec latency 216.305 ms 20 214 33.22 MB/sec warmup 5 sec latency 181.629 ms 20 259 32.46 MB/sec warmup 6 sec latency 186.160 ms 20 299 31.44 MB/sec warmup 7 sec latency 194.623 ms 20 336 30.28 MB/sec warmup 8 sec latency 184.366 ms 20 385 30.38 MB/sec warmup 9 sec latency 172.961 ms 20 443 31.05 MB/sec warmup 10 sec latency 148.792 ms 20 490 31.02 MB/sec warmup 11 sec latency 153.811 ms 20 540 31.02 MB/sec warmup 12 sec latency 232.868 ms 20 637 32.27 MB/sec warmup 13 sec latency 199.994 ms 20 684 30.16 MB/sec warmup 14 sec latency 134.827 ms 20 727 28.29 MB/sec warmup 15 sec latency 117.959 ms 20 771 26.64 MB/sec warmup 16 sec latency 139.979 ms 20 801 25.19 MB/sec warmup 17 sec latency 158.843 ms 20 850 23.90 MB/sec warmup 18 sec latency 151.215 ms 20 883 22.74 MB/sec warmup 19 sec latency 147.571 ms 20 899 21.63 MB/sec warmup 20 sec latency 828.826 ms 20 910 20.66 MB/sec warmup 21 sec latency 1718.358 ms 20 952 19.77 MB/sec warmup 22 sec latency 1558.607 ms 20 993 19.09 MB/sec warmup 23 sec latency 109.397 ms 20 1125 1.29 MB/sec execute 1 sec latency 148.245 ms 20 1171 0.97 MB/sec execute 2 sec latency 113.079 ms 20 1219 1.02 MB/sec execute 3 sec latency 95.088 ms 20 1259 1.01 MB/sec execute 4 sec latency 146.511 ms 20 1378 10.66 MB/sec execute 5 sec latency 183.931 ms 20 1436 10.34 MB/sec execute 6 sec latency 111.679 ms 20 1486 8.94 MB/sec execute 7 sec latency 148.216 ms 20 1530 7.93 MB/sec execute 8 sec latency 114.267 ms 20 1588 7.18 MB/sec execute 9 sec latency 102.594 ms 20 1630 6.52 MB/sec execute 10 sec latency 116.022 ms 20 1677 6.00 MB/sec execute 11 sec latency 127.041 ms 20 1724 5.56 MB/sec execute 12 sec latency 170.265 ms 20 1797 5.23 MB/sec execute 13 sec latency 104.146 ms 20 1846 4.91 MB/sec execute 14 sec latency 107.171 ms 20 1892 4.65 MB/sec execute 15 sec latency 175.620 ms 20 1966 4.42 MB/sec execute 16 sec latency 105.987 ms 20 2009 4.24 MB/sec execute 17 sec latency 110.982 ms 20 2059 4.11 MB/sec execute 18 sec latency 119.160 ms 20 2122 3.95 MB/sec execute 19 sec latency 121.857 ms 20 2160 3.80 MB/sec execute 20 sec latency 133.834 ms 20 2174 3.64 MB/sec execute 21 sec latency 430.161 ms 20 2198 3.49 MB/sec execute 22 sec latency 205.751 ms 20 2278 3.90 MB/sec execute 23 sec latency 179.112 ms 20 2357 4.14 MB/sec execute 24 sec latency 117.274 ms 20 2406 4.09 MB/sec execute 25 sec latency 111.181 ms 20 2448 4.05 MB/sec execute 26 sec latency 179.673 ms 20 2536 4.39 MB/sec execute 27 sec latency 128.361 ms 20 2605 4.45 MB/sec execute 28 sec latency 109.148 ms 20 2789 6.26 MB/sec execute 29 sec latency 118.219 ms 20 2914 6.84 MB/sec execute 30 sec latency 146.379 ms 20 2984 6.83 MB/sec execute 31 sec latency 141.052 ms 20 3105 6.84 MB/sec execute 32 sec latency 148.915 ms 20 3230 7.08 MB/sec execute 33 sec latency 158.214 ms 20 3343 7.34 MB/sec execute 34 sec latency 130.832 ms 20 3448 7.99 MB/sec execute 35 sec latency 114.680 ms 20 3561 8.60 MB/sec execute 36 sec latency 96.815 ms 20 3640 8.48 MB/sec execute 37 sec latency 90.926 ms 20 3697 8.33 MB/sec execute 38 sec latency 106.796 ms 20 3769 8.57 MB/sec execute 39 sec latency 138.089 ms 20 3813 8.41 MB/sec execute 40 sec latency 117.920 ms 20 3848 8.21 MB/sec execute 41 sec latency 109.032 ms 20 3897 8.12 MB/sec execute 42 sec latency 106.038 ms 20 3938 7.97 MB/sec execute 43 sec latency 140.746 ms 20 3966 7.79 MB/sec execute 44 sec latency 193.974 ms 20 4007 7.61 MB/sec execute 45 sec latency 102.961 ms 20 4052 7.45 MB/sec execute 46 sec latency 107.227 ms 20 4121 7.30 MB/sec execute 47 sec latency 84.872 ms 20 4196 7.17 MB/sec execute 48 sec latency 125.188 ms 20 4244 7.07 MB/sec execute 49 sec latency 147.226 ms 20 4291 6.98 MB/sec execute 50 sec latency 120.122 ms 20 4344 6.89 MB/sec execute 51 sec latency 123.346 ms 20 4403 6.81 MB/sec execute 52 sec latency 102.600 ms 20 4460 6.74 MB/sec execute 53 sec latency 97.985 ms 20 4510 6.66 MB/sec execute 54 sec latency 110.381 ms 20 4568 6.66 MB/sec execute 55 sec latency 98.948 ms 20 4643 6.79 MB/sec execute 56 sec latency 336.628 ms 20 4711 6.73 MB/sec execute 57 sec latency 114.369 ms 20 4773 6.63 MB/sec execute 58 sec latency 92.993 ms 20 4836 6.63 MB/sec execute 59 sec latency 104.615 ms 20 4945 7.23 MB/sec execute 60 sec latency 104.651 ms 20 5006 7.28 MB/sec execute 61 sec latency 150.088 ms 20 5057 7.17 MB/sec execute 62 sec latency 85.621 ms 20 5116 7.07 MB/sec execute 63 sec latency 97.804 ms 20 5160 6.98 MB/sec execute 64 sec latency 94.569 ms 20 5215 6.88 MB/sec execute 65 sec latency 101.853 ms 20 5263 6.79 MB/sec execute 66 sec latency 129.578 ms 20 5318 6.70 MB/sec execute 67 sec latency 104.994 ms 20 5363 6.62 MB/sec execute 68 sec latency 133.277 ms 20 5412 6.53 MB/sec execute 69 sec latency 96.363 ms 20 5487 6.46 MB/sec execute 70 sec latency 98.814 ms 20 5549 6.38 MB/sec execute 71 sec latency 111.587 ms 20 5601 6.32 MB/sec execute 72 sec latency 104.028 ms 20 5666 6.26 MB/sec execute 73 sec latency 108.007 ms 20 5723 6.19 MB/sec execute 74 sec latency 109.921 ms 20 5775 6.14 MB/sec execute 75 sec latency 105.129 ms 20 5852 6.23 MB/sec execute 76 sec latency 135.930 ms 20 5927 6.26 MB/sec execute 77 sec latency 97.081 ms 20 5974 6.21 MB/sec execute 78 sec latency 112.612 ms 20 6032 6.24 MB/sec execute 79 sec latency 123.739 ms 20 6116 6.27 MB/sec execute 80 sec latency 101.684 ms 20 6220 6.49 MB/sec execute 81 sec latency 113.892 ms 20 6426 7.03 MB/sec execute 82 sec latency 87.709 ms 20 6529 7.14 MB/sec execute 83 sec latency 104.191 ms 20 6700 7.22 MB/sec execute 84 sec latency 108.117 ms 20 6882 7.39 MB/sec execute 85 sec latency 76.575 ms 20 7037 7.83 MB/sec execute 86 sec latency 91.112 ms 20 7146 7.97 MB/sec execute 87 sec latency 90.343 ms 20 7230 7.94 MB/sec execute 88 sec latency 70.397 ms 20 7319 8.04 MB/sec execute 89 sec latency 81.655 ms 20 7375 7.98 MB/sec execute 90 sec latency 117.012 ms 20 7428 7.92 MB/sec execute 91 sec latency 115.046 ms 20 7490 7.88 MB/sec execute 92 sec latency 93.498 ms 20 7545 7.79 MB/sec execute 93 sec latency 83.573 ms 20 7590 7.71 MB/sec execute 94 sec latency 99.741 ms 20 7656 7.63 MB/sec execute 95 sec latency 99.771 ms 20 7723 7.56 MB/sec execute 96 sec latency 119.563 ms 20 7798 7.52 MB/sec execute 97 sec latency 115.138 ms 20 7854 7.47 MB/sec execute 98 sec latency 113.618 ms 20 7925 7.43 MB/sec execute 99 sec latency 81.539 ms 20 7985 7.38 MB/sec execute 100 sec latency 91.752 ms 20 8043 7.34 MB/sec execute 101 sec latency 100.344 ms 20 8102 7.33 MB/sec execute 102 sec latency 93.570 ms 20 8202 7.42 MB/sec execute 103 sec latency 72.445 ms 20 8283 7.37 MB/sec execute 104 sec latency 77.455 ms 20 8349 7.32 MB/sec execute 105 sec latency 83.655 ms 20 8476 7.66 MB/sec execute 106 sec latency 83.760 ms 20 8566 7.72 MB/sec execute 107 sec latency 88.378 ms 20 8632 7.66 MB/sec execute 108 sec latency 96.807 ms 20 8694 7.60 MB/sec execute 109 sec latency 81.209 ms 20 8752 7.54 MB/sec execute 110 sec latency 114.786 ms 20 8820 7.48 MB/sec execute 111 sec latency 87.485 ms 20 8883 7.42 MB/sec execute 112 sec latency 79.841 ms 20 8939 7.37 MB/sec execute 113 sec latency 82.567 ms 20 9034 7.32 MB/sec execute 114 sec latency 72.532 ms 20 9122 7.27 MB/sec execute 115 sec latency 71.722 ms 20 9202 7.23 MB/sec execute 116 sec latency 86.497 ms 20 9274 7.18 MB/sec execute 117 sec latency 85.280 ms 20 9361 7.20 MB/sec execute 118 sec latency 106.443 ms 20 9466 7.26 MB/sec execute 119 sec latency 81.076 ms 20 cleanup 120 sec 20 cleanup 121 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 29649 45.296 430.154 Close 22377 11.584 55.455 Rename 1229 66.516 183.398 Unlink 5422 14.178 88.043 Qpathinfo 28133 10.995 198.852 Qfileinfo 4844 0.251 27.944 Qfsinfo 4422 0.181 33.564 Sfileinfo 2500 46.174 147.207 Find 10180 3.750 162.328 WriteX 14416 6.043 105.252 ReadX 44086 0.037 8.834 LockX 80 12.508 33.086 UnlockX 80 11.738 31.239 Flush 1896 44.135 336.621 Throughput 7.25847 MB/sec 20 clients 20 procs max_latency=430.161 ms stopping dbench on /mnt/lustre/d0.oleg232-client.virtnet at Thu Dec 12 10:07:18 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg232-client.virtnet /mnt/lustre/d0.oleg232-client.virtnet /mnt/lustre/d0.oleg232-client.virtnet removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg232-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (155s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:25 (1734016045) min OST has 3554716kB available, using 5332074kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7600] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5207] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg232-clien 5207M 81677 66 56591 49 174836 37 2226 225 Latency 21414us 393ms 128ms 36946us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg232-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 298 19 7052 32 402 14 353 19 957 12 535 13 Latency 22345us 16835us 58891us 15326us 5257us 50433us 1.97,1.97,oleg232-client.virtnet,1,1734004808,5207M,,,,81677,66,56591,49,,,174836,37,2226,225,10,,,,,298,19,7052,32,402,14,353,19,957,12,535,13,,21414us,393ms,,128ms,36946us,22345us,16835us,58891us,15326us,5257us,50433us debug=0x33f0484 PASS bonnie (321s) == sanity-benchmark test iozone: iozone ================== 10:12:46 (1734016366) Waiting for MDT destroys to complete oleg232-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg232-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg232-client: oleg232-server: ssh exited with exit code 1 pdsh@oleg232-client: oleg232-server: ssh exited with exit code 1 min OST has 3605484kB available, using 5408226kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7600] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:55 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 165332 137932 109542 121229 58888 74335 iozone test complete. Waiting for MDT destroys to complete oleg232-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg232-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg232-client: oleg232-server: ssh exited with exit code 1 pdsh@oleg232-client: oleg232-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg232-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg232-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg232-client: oleg232-server: ssh exited with exit code 1 pdsh@oleg232-client: oleg232-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:18:49 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 82595 76977 88501 87381 88606 79174 iozone test complete. Waiting for MDT destroys to complete oleg232-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg232-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg232-client: oleg232-server: ssh exited with exit code 1 pdsh@oleg232-client: oleg232-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (760s) == sanity-benchmark test fsx: fsx ======================== 10:25:26 (1734017126) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 27978 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 27978 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x1d33e2 fallocating to largest ever: 0x484377 truncating to largest ever: 0x510e63 truncating to largest ever: 0x527ec3 001000 1734017129.813234 write 0x25c4d8 thru 0x2691aa (0xccd3 bytes) fallocating to largest ever: 0x5285e2 004000 1734017138.400375 fallocate 0x252792 thru 0x25dcf6 (0xb565 bytes) 006000 1734017144.563601 write 0x00c568 thru 0x00f736 (0x31cf bytes) 007000 1734017147.517929 read 0x0a96df thru 0x0acc74 (0x3596 bytes) 008000 1734017150.584697 write 0x080919 thru 0x087f33 (0x761b bytes) 009000 1734017153.593084 trunc from 0x2eb93f to 0x0f3f45 (0x1f79f9 bytes) 012000 1734017161.768958 mapread 0x2102f3 thru 0x2129af (0x26bd bytes) 013000 1734017164.569290 read 0x44c511 thru 0x456ee5 (0xa9d5 bytes) 014000 1734017167.529021 fallocate 0x2b4408 thru 0x2c11b8 (0xcdb1 bytes) 015000 1734017170.173228 punch from 0x262b68 to 0x266243 (0x36dc bytes) 016000 1734017173.129754 fallocate 0x106551 thru 0x10f6a2 (0x9152 bytes) 017000 1734017176.374635 read 0x40263f thru 0x403199 (0xb5b bytes) 018000 1734017179.350260 read 0x1d1629 thru 0x1de3cc (0xcda4 bytes) 021000 1734017188.652939 mapread 0x20271d thru 0x20e639 (0xbf1d bytes) 022000 1734017191.570520 mapread 0x0d0889 thru 0x0d8941 (0x80b9 bytes) 023000 1734017194.231714 read 0x21c17c thru 0x2269c0 (0xa845 bytes) skipping zero size read 024000 1734017197.364769 fallocate 0x00cd90 thru 0x017225 (0xa496 bytes) 025000 1734017200.304310 punch from 0x10717e to 0x1161f1 (0xf074 bytes) 026000 1734017203.291999 punch from 0x4e2cf8 to 0x4ecbe6 (0x9eef bytes) 028000 1734017209.297113 write 0x467ed4 thru 0x46c2f8 (0x4425 bytes) 030000 1734017214.934603 write 0x1adcf3 thru 0x1b6c59 (0x8f67 bytes) 031000 1734017217.997627 trunc from 0x2af313 to 0x1a3b4a (0x10b7c8 bytes) 032000 1734017220.798990 fallocate 0x28e0f8 thru 0x29338c (0x5295 bytes) 034000 1734017226.283672 trunc from 0x475706 to 0x21eb68 (0x256b9d bytes) 036000 1734017232.713336 fallocate 0x2a2402 thru 0x2aa33b (0x7f3a bytes) 038000 1734017238.717336 trunc from 0x19d0d2 to 0x09f655 (0xfda7c bytes) 039000 1734017241.895745 write 0x2c7ec8 thru 0x2d36c7 (0xb800 bytes) 040000 1734017245.129485 write 0x438a0c thru 0x447513 (0xeb08 bytes) 041000 1734017248.149515 write 0x3384fa thru 0x33bcb4 (0x37bb bytes) 042000 1734017251.171549 mapread 0x0ee194 thru 0x0fbf7e (0xddeb bytes) 043000 1734017254.113235 mapwrite 0x0263b2 thru 0x027846 (0x1495 bytes) 044000 1734017257.012987 mapwrite 0x080675 thru 0x089c14 (0x95a0 bytes) 045000 1734017260.131068 fallocate 0x50100c thru 0x509f88 (0x8f7d bytes) 046000 1734017262.776042 fallocate 0x0d13be thru 0x0dd3ca (0xc00d bytes) 047000 1734017265.424899 write 0x26cbd8 thru 0x27b639 (0xea62 bytes) 049000 1734017270.792863 trunc from 0x2a2a5c to 0x1da1b0 (0xc88ab bytes) 053000 1734017281.828669 write 0x25326b thru 0x255b57 (0x28ed bytes) 056000 1734017290.699268 mapwrite 0x0458ab thru 0x04609e (0x7f4 bytes) 057000 1734017293.601462 fallocate 0x159acb thru 0x163494 (0x99ca bytes) 058000 1734017296.490886 fallocate 0x2ed152 thru 0x2f9f46 (0xcdf5 bytes) 060000 1734017301.603987 write 0x4ec14c thru 0x4ed4cd (0x1382 bytes) 062000 1734017307.409725 punch from 0x1c74d3 to 0x1c9316 (0x1e44 bytes) 063000 1734017310.237839 trunc from 0x494fa6 to 0x42b97d (0x69628 bytes) 064000 1734017312.830017 write 0x209cfb thru 0x2194b3 (0xf7b9 bytes) 065000 1734017315.574643 write 0x27253b thru 0x275e6c (0x3932 bytes) 066000 1734017318.093389 trunc from 0x3c10a0 to 0x4cb060 (0x109fc1 bytes) skipping zero size read 067000 1734017320.761066 mapread 0x1d5bdb thru 0x1d6222 (0x648 bytes) 068000 1734017323.501264 write 0x0612fd thru 0x067711 (0x6415 bytes) 071000 1734017331.099917 read 0x1d483c thru 0x1e139c (0xcb61 bytes) 072000 1734017333.888533 read 0x1dc4cb thru 0x1dfc1d (0x3753 bytes) 073000 1734017336.865933 mapwrite 0x347f91 thru 0x3481ed (0x25d bytes) 074000 1734017339.548619 mapread 0x3a4e88 thru 0x3b4de0 (0xff59 bytes) 075000 1734017342.324441 read 0x0008da thru 0x00d647 (0xcd6e bytes) 076000 1734017344.886591 read 0x11d4f0 thru 0x11fefb (0x2a0c bytes) 077000 1734017347.523973 write 0x0a1dac thru 0x0af39e (0xd5f3 bytes) 078000 1734017350.325347 punch from 0x1bc7ce to 0x1bfbf4 (0x3427 bytes) 079000 1734017352.829898 mapread 0x18c917 thru 0x18d028 (0x712 bytes) 081000 1734017358.440564 fallocate 0x348d1a thru 0x35499d (0xbc84 bytes) 082000 1734017361.279404 mapread 0x1e387e thru 0x1eaed6 (0x7659 bytes) 083000 1734017364.044895 read 0x11af4d thru 0x120e3d (0x5ef1 bytes) 085000 1734017369.646845 write 0x1c2fba thru 0x1c49ac (0x19f3 bytes) 086000 1734017372.382102 read 0x289ada thru 0x296f1b (0xd442 bytes) 087000 1734017375.076900 trunc from 0x352cce to 0x389ba9 (0x36edc bytes) 088000 1734017377.835705 mapread 0x2d8256 thru 0x2dd097 (0x4e42 bytes) 089000 1734017380.674841 punch from 0x0d8612 to 0x0dbe0b (0x37fa bytes) 090000 1734017383.138073 mapwrite 0x4f63d8 thru 0x500e4f (0xaa78 bytes) 091000 1734017386.327838 mapwrite 0x33edb6 thru 0x348e55 (0xa0a0 bytes) 092000 1734017389.235222 trunc from 0x437b8d to 0x404eb3 (0x32cd9 bytes) 093000 1734017391.891297 trunc from 0x2521b0 to 0x0451dc (0x20cfd3 bytes) 094000 1734017394.520452 mapwrite 0x2d0736 thru 0x2d856e (0x7e39 bytes) 095000 1734017397.002776 fallocate 0x10bb51 thru 0x11914c (0xd5fc bytes) 097000 1734017402.164693 punch from 0x2594df to 0x264f55 (0xba77 bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 3354990 (3280 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 1576960.. 1576963: 4: 0000: net 1: 4.. 7: 1704328.. 1704331: 4: 0000: net 2: 56.. 63: 1712824.. 1712831: 8: 0000: unwritten,net 3: 64.. 71: 1704332.. 1704339: 8: 0000: unwritten,net 4: 72.. 107: 1704340.. 1704375: 36: 0000: net 5: 108.. 111: 1712752.. 1712755: 4: 0000: net 6: 112.. 123: 1712572.. 1712583: 12: 0000: net 7: 124.. 131: 1712756.. 1712763: 8: 0000: net 8: 132.. 151: 1706272.. 1706291: 20: 0000: net 9: 152.. 163: 1715276.. 1715287: 12: 0000: unwritten,net 10: 164.. 167: 1706240.. 1706243: 4: 0000: unwritten,net 11: 168.. 195: 1706244.. 1706271: 28: 0000: net 12: 204.. 215: 1703944.. 1703955: 12: 0000: net 13: 236.. 295: 1707072.. 1707131: 60: 0000: unwritten,net 14: 372.. 395: 1715252.. 1715275: 24: 0000: unwritten,net 15: 408.. 435: 1704404.. 1704431: 28: 0000: unwritten,net 16: 756.. 771: 1707056.. 1707071: 16: 0000: unwritten,net 17: 812.. 839: 1712832.. 1712859: 28: 0000: net 18: 1076.. 1115: 1712956.. 1712995: 40: 0000: net 19: 1164.. 1203: 1715384.. 1715423: 40: 0000: unwritten,net 20: 1204.. 1259: 1715288.. 1715343: 56: 0000: unwritten,net 21: 1560.. 1611: 1712996.. 1713047: 52: 0000: net 22: 1744.. 1775: 1712860.. 1712891: 32: 0000: net 23: 2344.. 2399: 1713048.. 1713103: 56: 0000: net 24: 2592.. 2655: 1712892.. 1712955: 64: 0000: unwritten,net 25: 2968.. 3007: 1715344.. 1715383: 40: 0000: last,unwritten,net /mnt/lustre/f0.fsxfile: 24 extents found debug=0x33f0484 PASS fsx (284s) == sanity-benchmark test complete, duration 1552 sec ===== 10:30:10 (1734017410) === sanity-benchmark: start cleanup 10:30:10 (1734017410) === === sanity-benchmark: finish cleanup 10:30:11 (1734017411) ===