-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:09 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:18 (1734015858) === oleg451-client.virtnet: executing check_config_client /mnt/lustre oleg451-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg451-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b58a5800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b58a5800.idle_timeout=debug disable quota as required oleg451-server: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:42 (1734015882) === == sanity-benchmark test dbench: dbench ================== 10:04:43 (1734015883) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7584] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg451-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg451-client.virtnet at Thu Dec 12 10:04:46 EST 2024 waiting for dbench pid 10284 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 0 6 0.00 MB/sec warmup 1 sec latency 870.977 ms 20 72 31.67 MB/sec warmup 2 sec latency 166.872 ms 20 135 39.54 MB/sec warmup 3 sec latency 283.286 ms 20 179 36.16 MB/sec warmup 4 sec latency 211.116 ms 20 227 34.97 MB/sec warmup 5 sec latency 214.451 ms 20 284 35.22 MB/sec warmup 6 sec latency 172.371 ms 20 328 33.98 MB/sec warmup 7 sec latency 171.515 ms 20 374 33.31 MB/sec warmup 8 sec latency 187.967 ms 20 424 33.16 MB/sec warmup 9 sec latency 184.446 ms 20 482 33.61 MB/sec warmup 10 sec latency 155.776 ms 20 528 33.23 MB/sec warmup 11 sec latency 195.011 ms 20 622 34.36 MB/sec warmup 12 sec latency 279.976 ms 20 675 32.48 MB/sec warmup 13 sec latency 117.473 ms 20 712 30.26 MB/sec warmup 14 sec latency 163.069 ms 20 744 28.37 MB/sec warmup 15 sec latency 137.102 ms 20 783 26.69 MB/sec warmup 16 sec latency 140.934 ms 20 844 25.31 MB/sec warmup 17 sec latency 116.054 ms 20 891 24.03 MB/sec warmup 18 sec latency 117.502 ms 20 915 22.85 MB/sec warmup 19 sec latency 643.447 ms 20 924 21.73 MB/sec warmup 20 sec latency 1631.539 ms 20 948 20.73 MB/sec warmup 21 sec latency 2065.935 ms 20 996 20.03 MB/sec warmup 22 sec latency 141.819 ms 20 1069 19.88 MB/sec warmup 23 sec latency 138.503 ms 20 1180 0.83 MB/sec execute 1 sec latency 133.768 ms 20 1225 0.91 MB/sec execute 2 sec latency 172.608 ms 20 1294 4.74 MB/sec execute 3 sec latency 101.451 ms 20 1413 15.14 MB/sec execute 4 sec latency 152.991 ms 20 1452 12.15 MB/sec execute 5 sec latency 119.066 ms 20 1507 10.25 MB/sec execute 6 sec latency 104.928 ms 20 1562 8.94 MB/sec execute 7 sec latency 100.798 ms 20 1617 7.95 MB/sec execute 8 sec latency 113.546 ms 20 1659 7.15 MB/sec execute 9 sec latency 184.350 ms 20 1704 6.50 MB/sec execute 10 sec latency 151.098 ms 20 1762 6.00 MB/sec execute 11 sec latency 151.758 ms 20 1822 5.59 MB/sec execute 12 sec latency 113.501 ms 20 1875 5.21 MB/sec execute 13 sec latency 107.009 ms 20 1930 4.93 MB/sec execute 14 sec latency 121.132 ms 20 1994 4.68 MB/sec execute 15 sec latency 122.734 ms 20 2039 4.48 MB/sec execute 16 sec latency 104.379 ms 20 2104 4.32 MB/sec execute 17 sec latency 110.345 ms 20 2164 4.14 MB/sec execute 18 sec latency 107.473 ms 20 2219 4.19 MB/sec execute 19 sec latency 155.032 ms 20 2263 4.21 MB/sec execute 20 sec latency 363.058 ms 20 2314 4.30 MB/sec execute 21 sec latency 800.075 ms 20 2382 4.52 MB/sec execute 22 sec latency 102.835 ms 20 2427 4.51 MB/sec execute 23 sec latency 122.584 ms 20 2475 4.56 MB/sec execute 24 sec latency 128.700 ms 20 2542 4.81 MB/sec execute 25 sec latency 170.675 ms 20 2653 5.16 MB/sec execute 26 sec latency 91.099 ms 20 2823 6.82 MB/sec execute 27 sec latency 111.934 ms 20 2952 7.32 MB/sec execute 28 sec latency 102.666 ms 20 3043 7.41 MB/sec execute 29 sec latency 165.413 ms 20 3166 7.49 MB/sec execute 30 sec latency 113.410 ms 20 3331 8.17 MB/sec execute 31 sec latency 117.550 ms 20 3436 8.49 MB/sec execute 32 sec latency 100.351 ms 20 3560 9.36 MB/sec execute 33 sec latency 102.134 ms 20 3632 9.20 MB/sec execute 34 sec latency 103.904 ms 20 3704 9.11 MB/sec execute 35 sec latency 100.394 ms 20 3755 9.09 MB/sec execute 36 sec latency 165.913 ms 20 3812 9.06 MB/sec execute 37 sec latency 104.994 ms 20 3859 8.86 MB/sec execute 38 sec latency 106.843 ms 20 3908 8.70 MB/sec execute 39 sec latency 100.984 ms 20 3952 8.53 MB/sec execute 40 sec latency 120.771 ms 20 3982 8.33 MB/sec execute 41 sec latency 156.621 ms 20 4021 8.13 MB/sec execute 42 sec latency 135.485 ms 20 4067 7.94 MB/sec execute 43 sec latency 115.638 ms 20 4122 7.78 MB/sec execute 44 sec latency 148.945 ms 20 4189 7.63 MB/sec execute 45 sec latency 113.270 ms 20 4247 7.51 MB/sec execute 46 sec latency 126.062 ms 20 4293 7.40 MB/sec execute 47 sec latency 168.604 ms 20 4348 7.30 MB/sec execute 48 sec latency 107.693 ms 20 4397 7.20 MB/sec execute 49 sec latency 105.374 ms 20 4454 7.11 MB/sec execute 50 sec latency 158.844 ms 20 4492 7.02 MB/sec execute 51 sec latency 145.426 ms 20 4546 6.98 MB/sec execute 52 sec latency 109.523 ms 20 4609 7.04 MB/sec execute 53 sec latency 110.035 ms 20 4683 7.07 MB/sec execute 54 sec latency 100.900 ms 20 4737 6.96 MB/sec execute 55 sec latency 126.540 ms 20 4802 6.97 MB/sec execute 56 sec latency 108.784 ms 20 4864 7.02 MB/sec execute 57 sec latency 105.206 ms 20 4960 7.47 MB/sec execute 58 sec latency 118.823 ms 20 5023 7.51 MB/sec execute 59 sec latency 150.190 ms 20 5070 7.39 MB/sec execute 60 sec latency 106.159 ms 20 5128 7.29 MB/sec execute 61 sec latency 86.943 ms 20 5178 7.19 MB/sec execute 62 sec latency 98.908 ms 20 5225 7.09 MB/sec execute 63 sec latency 113.185 ms 20 5273 6.99 MB/sec execute 64 sec latency 124.621 ms 20 5321 6.89 MB/sec execute 65 sec latency 99.755 ms 20 5367 6.80 MB/sec execute 66 sec latency 111.366 ms 20 5421 6.71 MB/sec execute 67 sec latency 84.930 ms 20 5480 6.63 MB/sec execute 68 sec latency 121.346 ms 20 5548 6.55 MB/sec execute 69 sec latency 104.405 ms 20 5604 6.48 MB/sec execute 70 sec latency 117.279 ms 20 5654 6.41 MB/sec execute 71 sec latency 131.567 ms 20 5717 6.34 MB/sec execute 72 sec latency 107.969 ms 20 5772 6.32 MB/sec execute 73 sec latency 126.947 ms 20 5835 6.31 MB/sec execute 74 sec latency 115.570 ms 20 5929 6.41 MB/sec execute 75 sec latency 98.264 ms 20 5979 6.39 MB/sec execute 76 sec latency 121.205 ms 20 6037 6.38 MB/sec execute 77 sec latency 111.559 ms 20 6130 6.55 MB/sec execute 78 sec latency 126.103 ms 20 6238 6.67 MB/sec execute 79 sec latency 120.197 ms 20 6378 7.07 MB/sec execute 80 sec latency 107.012 ms 20 6528 7.25 MB/sec execute 81 sec latency 117.028 ms 20 6624 7.32 MB/sec execute 82 sec latency 125.119 ms 20 6750 7.36 MB/sec execute 83 sec latency 110.022 ms 20 6922 7.63 MB/sec execute 84 sec latency 91.313 ms 20 7039 7.83 MB/sec execute 85 sec latency 97.214 ms 20 7156 8.06 MB/sec execute 86 sec latency 81.878 ms 20 7233 8.05 MB/sec execute 87 sec latency 79.089 ms 20 7296 8.03 MB/sec execute 88 sec latency 107.737 ms 20 7361 8.07 MB/sec execute 89 sec latency 115.079 ms 20 7417 7.99 MB/sec execute 90 sec latency 99.389 ms 20 7480 7.95 MB/sec execute 91 sec latency 85.284 ms 20 7535 7.86 MB/sec execute 92 sec latency 93.231 ms 20 7603 7.78 MB/sec execute 93 sec latency 106.827 ms 20 7665 7.71 MB/sec execute 94 sec latency 103.833 ms 20 7755 7.65 MB/sec execute 95 sec latency 99.935 ms 20 7828 7.60 MB/sec execute 96 sec latency 120.151 ms 20 7906 7.56 MB/sec execute 97 sec latency 79.839 ms 20 7999 7.53 MB/sec execute 98 sec latency 63.933 ms 20 8088 7.53 MB/sec execute 99 sec latency 62.471 ms 20 8189 7.60 MB/sec execute 100 sec latency 69.982 ms 20 8285 7.57 MB/sec execute 101 sec latency 88.812 ms 20 8379 7.64 MB/sec execute 102 sec latency 77.201 ms 20 8476 7.79 MB/sec execute 103 sec latency 127.041 ms 20 8572 7.93 MB/sec execute 104 sec latency 78.061 ms 20 8625 7.87 MB/sec execute 105 sec latency 105.978 ms 20 8690 7.80 MB/sec execute 106 sec latency 86.949 ms 20 8753 7.74 MB/sec execute 107 sec latency 99.976 ms 20 8820 7.68 MB/sec execute 108 sec latency 90.278 ms 20 8871 7.62 MB/sec execute 109 sec latency 114.845 ms 20 8927 7.56 MB/sec execute 110 sec latency 102.131 ms 20 8989 7.50 MB/sec execute 111 sec latency 79.069 ms 20 9075 7.45 MB/sec execute 112 sec latency 88.957 ms 20 9151 7.40 MB/sec execute 113 sec latency 79.743 ms 20 9225 7.35 MB/sec execute 114 sec latency 101.487 ms 20 9305 7.33 MB/sec execute 115 sec latency 94.972 ms 20 9391 7.34 MB/sec execute 116 sec latency 87.534 ms 20 9485 7.40 MB/sec execute 117 sec latency 107.461 ms 20 9564 7.39 MB/sec execute 118 sec latency 91.865 ms 20 9650 7.46 MB/sec execute 119 sec latency 108.556 ms 20 cleanup 120 sec 20 cleanup 121 sec 12 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 30008 44.471 229.223 Close 22610 11.678 100.998 Rename 1268 67.105 184.334 Unlink 5515 13.740 59.944 Qpathinfo 28379 10.952 192.497 Qfileinfo 5000 0.261 31.096 Qfsinfo 4509 0.177 29.649 Sfileinfo 2561 44.873 205.563 Find 10379 3.156 88.670 WriteX 14849 5.922 124.239 ReadX 45981 0.031 12.380 LockX 89 11.840 24.250 UnlockX 89 10.240 21.645 Flush 1929 45.632 800.068 Throughput 7.45578 MB/sec 20 clients 20 procs max_latency=800.075 ms stopping dbench on /mnt/lustre/d0.oleg451-client.virtnet at Thu Dec 12 10:07:12 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg451-client.virtnet /mnt/lustre/d0.oleg451-client.virtnet /mnt/lustre/d0.oleg451-client.virtnet removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg451-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (158s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:21 (1734016041) min OST has 3557312kB available, using 5335968kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7584] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5210] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg451-clien 5210M 66577 56 46287 42 198669 44 3369 240 Latency 57273us 369ms 90129us 7318us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg451-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 250 18 4359 20 346 13 306 18 706 12 257 13 Latency 18229us 49264us 42639us 30135us 7491us 30737us 1.97,1.97,oleg451-client.virtnet,1,1734004814,5210M,,,,66577,56,46287,42,,,198669,44,3369,240,10,,,,,250,18,4359,20,346,13,306,18,706,12,257,13,,57273us,369ms,,90129us,7318us,18229us,49264us,42639us,30135us,7491us,30737us debug=0x33f0484 PASS bonnie (395s) == sanity-benchmark test iozone: iozone ================== 10:13:56 (1734016436) Waiting for MDT destroys to complete oleg451-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg451-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg451-client: oleg451-server: ssh exited with exit code 1 pdsh@oleg451-client: oleg451-server: ssh exited with exit code 1 min OST has 3605484kB available, using 5408226kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7584] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:14:06 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 127251 135316 116300 133096 56717 171210 iozone test complete. Waiting for MDT destroys to complete oleg451-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg451-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg451-client: oleg451-server: ssh exited with exit code 1 pdsh@oleg451-client: oleg451-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg451-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg451-client: oleg451-server: ssh exited with exit code 1 oleg451-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg451-client: oleg451-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:19:26 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 55843 65013 72422 76409 80445 66844 iozone test complete. Waiting for MDT destroys to complete oleg451-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg451-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg451-client: oleg451-server: ssh exited with exit code 1 pdsh@oleg451-client: oleg451-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (814s) == sanity-benchmark test fsx: fsx ======================== 10:27:30 (1734017250) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 18696 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 18696 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x43b10f skipping zero size read skipping zero size read skipping zero size read skipping zero size read skipping zero size read truncating to largest ever: 0x520aea fallocating to largest ever: 0x5285e2 003000 1734017261.908543 mapwrite 0x0e3a3d thru 0x0e6b03 (0x30c7 bytes) 004000 1734017265.498071 punch from 0x3529f8 to 0x35773b (0x4d44 bytes) 005000 1734017268.701592 write 0x107e7c thru 0x117451 (0xf5d6 bytes) 006000 1734017271.948567 write 0x4529b9 thru 0x459f29 (0x7571 bytes) 007000 1734017274.816654 trunc from 0x5285e2 to 0x211ae9 (0x316af8 bytes) 008000 1734017278.655097 punch from 0x08f98f to 0x09124b (0x18bd bytes) 009000 1734017282.144563 fallocate 0x3d3d6a thru 0x3d7337 (0x35ce bytes) 010000 1734017284.958119 read 0x0860cb thru 0x093859 (0xd78f bytes) 011000 1734017288.230590 mapread 0x0a0569 thru 0x0a21f5 (0x1c8d bytes) 015000 1734017301.244725 mapread 0x40504e thru 0x40509b (0x4e bytes) 017000 1734017307.684548 read 0x00ec63 thru 0x0140c7 (0x5465 bytes) 018000 1734017310.813222 punch from 0x0fc5b9 to 0x0fe9c7 (0x240f bytes) 019000 1734017314.342040 write 0x1405ff thru 0x14ed0e (0xe710 bytes) 020000 1734017317.407720 punch from 0x22dd20 to 0x22f6d5 (0x19b6 bytes) 021000 1734017320.658467 mapwrite 0x0bb20d thru 0x0c863d (0xd431 bytes) 023000 1734017327.700491 trunc from 0x44e451 to 0x1ce7a7 (0x27fca9 bytes) 024000 1734017331.534218 mapwrite 0x00be4a thru 0x017f78 (0xc12f bytes) 026000 1734017338.358256 write 0x4dc60a thru 0x4dc9c1 (0x3b8 bytes) 028000 1734017345.564843 mapread 0x102b3f thru 0x10b16a (0x862c bytes) 029000 1734017348.818573 read 0x3ae7c9 thru 0x3b703e (0x8876 bytes) 032000 1734017358.690754 mapread 0x49bc3b thru 0x4a77b6 (0xbb7c bytes) 033000 1734017362.505183 punch from 0x0ac017 to 0x0b6561 (0xa54b bytes) 034000 1734017366.308250 mapread 0x0e5db8 thru 0x0eb60b (0x5854 bytes) 036000 1734017372.692694 punch from 0x020e28 to 0x02981a (0x89f3 bytes) 037000 1734017375.804485 mapread 0x259e34 thru 0x2673bc (0xd589 bytes) 039000 1734017382.077178 mapwrite 0x1bf3c4 thru 0x1bfe6a (0xaa7 bytes) 041000 1734017389.242561 mapwrite 0x37e7a6 thru 0x389004 (0xa85f bytes) 042000 1734017392.645151 trunc from 0x396e79 to 0x42e009 (0x97191 bytes) 043000 1734017396.104563 fallocate 0x0cf396 thru 0x0cfcf8 (0x963 bytes) 044000 1734017399.606992 write 0x255058 thru 0x264cf3 (0xfc9c bytes) 045000 1734017402.843889 read 0x190a18 thru 0x197101 (0x66ea bytes) 047000 1734017409.736710 write 0x30812b thru 0x30cb9c (0x4a72 bytes) 048000 1734017412.649207 write 0x040be1 thru 0x04616e (0x558e bytes) 049000 1734017416.095873 punch from 0x2630ca to 0x268509 (0x5440 bytes) 051000 1734017421.520059 mapwrite 0x168e97 thru 0x16cb55 (0x3cbf bytes) 052000 1734017424.550897 punch from 0x3232cd to 0x327e30 (0x4b64 bytes) 054000 1734017429.935579 fallocate 0x45a467 thru 0x467d13 (0xd8ad bytes) 055000 1734017433.035256 write 0x02642d thru 0x0315cf (0xb1a3 bytes) 056000 1734017436.453745 mapread 0x0dc399 thru 0x0e8e84 (0xcaec bytes) 060000 1734017447.504128 trunc from 0x203176 to 0x4d8acc (0x2d5957 bytes) 062000 1734017453.060597 write 0x00bd2c thru 0x01ad4d (0xf022 bytes) 063000 1734017456.313375 mapread 0x01cba6 thru 0x0273ba (0xa815 bytes) 066000 1734017464.101945 trunc from 0x445411 to 0x4641b1 (0x1eda1 bytes) 069000 1734017472.084518 mapwrite 0x1b0784 thru 0x1bebba (0xe437 bytes) 070000 1734017474.896187 fallocate 0x0a7a99 thru 0x0ac36c (0x48d4 bytes) 071000 1734017477.590708 fallocate 0x406896 thru 0x4126a7 (0xbe12 bytes) 072000 1734017480.491465 write 0x1749f6 thru 0x183456 (0xea61 bytes) 073000 1734017483.661939 trunc from 0x10b80b to 0x4af599 (0x3a3d8f bytes) 075000 1734017489.476697 mapwrite 0x125514 thru 0x13282a (0xd317 bytes) 076000 1734017492.338518 read 0x11979b thru 0x123b00 (0xa366 bytes) 077000 1734017495.221593 mapread 0x024938 thru 0x02b3b7 (0x6a80 bytes) 078000 1734017498.370534 read 0x0554f2 thru 0x062f7e (0xda8d bytes) 079000 1734017501.202936 read 0x17422b thru 0x17ca5a (0x8830 bytes) 081000 1734017506.972010 read 0x27cc78 thru 0x27f41b (0x27a4 bytes) 083000 1734017512.512185 trunc from 0x2d954a to 0x286926 (0x52c23 bytes) 084000 1734017515.734881 punch from 0x27ceda to 0x27eed5 (0x1ffc bytes) 086000 1734017522.595742 mapwrite 0x03f860 thru 0x04a3bf (0xab60 bytes) 087000 1734017525.771361 mapread 0x2bcd4a thru 0x2ccd2a (0xffe1 bytes) 089000 1734017532.080022 read 0x0f92cf thru 0x0ff6ff (0x6431 bytes) 090000 1734017535.194690 punch from 0x17ad7e to 0x1829b7 (0x7c3a bytes) 091000 1734017538.265870 punch from 0x29defc to 0x2a7e48 (0x9f4d bytes) 093000 1734017545.044394 punch from 0x352694 to 0x359fb2 (0x791f bytes) 094000 1734017549.187575 read 0x26fd96 thru 0x277395 (0x7600 bytes) 095000 1734017552.850744 write 0x0b2f8a thru 0x0b835f (0x53d6 bytes) 096000 1734017556.041209 mapwrite 0x207697 thru 0x214836 (0xd1a0 bytes) 098000 1734017561.822452 trunc from 0x3bcc86 to 0x289b76 (0x13310f bytes) 099000 1734017564.614206 read 0x4293be thru 0x42b69e (0x22e1 bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 289623 (284 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 3936256.. 3936259: 4: 0001: net 1: 4.. 7: 3936520.. 3936523: 4: 0001: net 2: 64.. 107: 3936580.. 3936623: 44: 0001: net 3: 192.. 231: 4070376.. 4070415: 40: 0001: last,net /mnt/lustre/f0.fsxfile: 3 extents found debug=0x33f0484 PASS fsx (318s) == sanity-benchmark test complete, duration 1718 sec ===== 10:32:48 (1734017568) === sanity-benchmark: start cleanup 10:32:49 (1734017569) === === sanity-benchmark: finish cleanup 10:32:50 (1734017570) ===