-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:15 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:24 (1734015864) === oleg209-client.virtnet: executing check_config_client /mnt/lustre oleg209-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg209-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6cf5000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6cf5000.idle_timeout=debug disable quota as required oleg209-server: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:45 (1734015885) === == sanity-benchmark test dbench: dbench ================== 10:04:46 (1734015886) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7591] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg209-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg209-client.virtnet at Thu Dec 12 10:04:49 EST 2024 waiting for dbench pid 10288 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 17 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 0 5 0.00 MB/sec warmup 1 sec latency 908.484 ms 20 64 27.91 MB/sec warmup 2 sec latency 213.444 ms 20 139 40.22 MB/sec warmup 3 sec latency 207.426 ms 20 183 36.76 MB/sec warmup 4 sec latency 194.400 ms 20 235 35.85 MB/sec warmup 5 sec latency 159.625 ms 20 279 34.65 MB/sec warmup 6 sec latency 183.353 ms 20 322 33.36 MB/sec warmup 7 sec latency 203.489 ms 20 363 32.34 MB/sec warmup 8 sec latency 191.047 ms 20 407 31.93 MB/sec warmup 9 sec latency 165.127 ms 20 452 31.66 MB/sec warmup 10 sec latency 169.297 ms 20 501 31.62 MB/sec warmup 11 sec latency 163.305 ms 20 577 32.84 MB/sec warmup 12 sec latency 206.910 ms 20 654 32.36 MB/sec warmup 13 sec latency 182.537 ms 20 699 30.21 MB/sec warmup 14 sec latency 105.655 ms 20 735 28.34 MB/sec warmup 15 sec latency 153.114 ms 20 777 26.67 MB/sec warmup 16 sec latency 144.619 ms 20 814 25.23 MB/sec warmup 17 sec latency 141.864 ms 20 857 23.93 MB/sec warmup 18 sec latency 147.566 ms 20 882 22.76 MB/sec warmup 19 sec latency 737.860 ms 20 886 21.65 MB/sec warmup 20 sec latency 1738.009 ms 20 917 20.65 MB/sec warmup 21 sec latency 2063.253 ms 20 953 19.80 MB/sec warmup 22 sec latency 131.528 ms 20 998 19.24 MB/sec warmup 23 sec latency 179.735 ms 20 1104 1.55 MB/sec execute 1 sec latency 138.317 ms 20 1155 1.30 MB/sec execute 2 sec latency 127.920 ms 20 1200 1.10 MB/sec execute 3 sec latency 142.749 ms 20 1254 2.60 MB/sec execute 4 sec latency 114.410 ms 20 1309 4.44 MB/sec execute 5 sec latency 188.005 ms 20 1420 10.46 MB/sec execute 6 sec latency 98.485 ms 20 1470 9.01 MB/sec execute 7 sec latency 103.077 ms 20 1522 7.99 MB/sec execute 8 sec latency 145.799 ms 20 1587 7.24 MB/sec execute 9 sec latency 92.934 ms 20 1641 6.61 MB/sec execute 10 sec latency 113.877 ms 20 1704 6.11 MB/sec execute 11 sec latency 116.122 ms 20 1761 5.68 MB/sec execute 12 sec latency 113.980 ms 20 1819 5.32 MB/sec execute 13 sec latency 107.006 ms 20 1867 5.00 MB/sec execute 14 sec latency 117.659 ms 20 1924 4.72 MB/sec execute 15 sec latency 101.558 ms 20 1985 4.50 MB/sec execute 16 sec latency 116.826 ms 20 2036 4.33 MB/sec execute 17 sec latency 109.822 ms 20 2091 4.19 MB/sec execute 18 sec latency 115.940 ms 20 2145 4.02 MB/sec execute 19 sec latency 114.973 ms 20 2171 3.84 MB/sec execute 20 sec latency 259.079 ms 20 2203 3.84 MB/sec execute 21 sec latency 251.079 ms 20 2266 3.89 MB/sec execute 22 sec latency 99.994 ms 20 2356 4.36 MB/sec execute 23 sec latency 154.880 ms 20 2400 4.27 MB/sec execute 24 sec latency 120.791 ms 20 2436 4.29 MB/sec execute 25 sec latency 194.779 ms 20 2490 4.30 MB/sec execute 26 sec latency 141.007 ms 20 2581 4.87 MB/sec execute 27 sec latency 121.184 ms 20 2684 5.16 MB/sec execute 28 sec latency 112.613 ms 20 2814 6.57 MB/sec execute 29 sec latency 162.644 ms 20 2917 6.69 MB/sec execute 30 sec latency 134.371 ms 20 3014 6.96 MB/sec execute 31 sec latency 158.040 ms 20 3096 6.95 MB/sec execute 32 sec latency 124.845 ms 20 3254 7.12 MB/sec execute 33 sec latency 113.737 ms 20 3384 7.87 MB/sec execute 34 sec latency 120.879 ms 20 3449 7.82 MB/sec execute 35 sec latency 122.334 ms 20 3568 8.65 MB/sec execute 36 sec latency 121.677 ms 20 3632 8.48 MB/sec execute 37 sec latency 90.721 ms 20 3702 8.49 MB/sec execute 38 sec latency 97.922 ms 20 3737 8.31 MB/sec execute 39 sec latency 183.342 ms 20 3801 8.43 MB/sec execute 40 sec latency 127.299 ms 20 3841 8.25 MB/sec execute 41 sec latency 124.561 ms 20 3880 8.08 MB/sec execute 42 sec latency 101.778 ms 20 3921 7.96 MB/sec execute 43 sec latency 133.559 ms 20 3953 7.80 MB/sec execute 44 sec latency 190.400 ms 20 3991 7.63 MB/sec execute 45 sec latency 108.623 ms 20 4034 7.47 MB/sec execute 46 sec latency 91.830 ms 20 4093 7.31 MB/sec execute 47 sec latency 109.945 ms 20 4141 7.19 MB/sec execute 48 sec latency 150.869 ms 20 4207 7.05 MB/sec execute 49 sec latency 135.116 ms 20 4260 6.96 MB/sec execute 50 sec latency 140.370 ms 20 4311 6.88 MB/sec execute 51 sec latency 122.401 ms 20 4369 6.79 MB/sec execute 52 sec latency 91.217 ms 20 4423 6.72 MB/sec execute 53 sec latency 99.075 ms 20 4484 6.65 MB/sec execute 54 sec latency 94.579 ms 20 4540 6.65 MB/sec execute 55 sec latency 200.089 ms 20 4606 6.66 MB/sec execute 56 sec latency 115.937 ms 20 4691 6.73 MB/sec execute 57 sec latency 87.840 ms 20 4757 6.64 MB/sec execute 58 sec latency 100.272 ms 20 4838 6.80 MB/sec execute 59 sec latency 108.512 ms 20 4908 6.90 MB/sec execute 60 sec latency 121.714 ms 20 5002 7.29 MB/sec execute 61 sec latency 133.294 ms 20 5055 7.18 MB/sec execute 62 sec latency 102.388 ms 20 5106 7.08 MB/sec execute 63 sec latency 94.749 ms 20 5167 6.99 MB/sec execute 64 sec latency 94.772 ms 20 5222 6.90 MB/sec execute 65 sec latency 106.228 ms 20 5286 6.81 MB/sec execute 66 sec latency 124.695 ms 20 5333 6.72 MB/sec execute 67 sec latency 108.675 ms 20 5387 6.63 MB/sec execute 68 sec latency 93.489 ms 20 5446 6.55 MB/sec execute 69 sec latency 100.236 ms 20 5507 6.48 MB/sec execute 70 sec latency 101.945 ms 20 5591 6.41 MB/sec execute 71 sec latency 91.255 ms 20 5643 6.34 MB/sec execute 72 sec latency 114.185 ms 20 5713 6.28 MB/sec execute 73 sec latency 94.713 ms 20 5783 6.29 MB/sec execute 74 sec latency 102.683 ms 20 5853 6.30 MB/sec execute 75 sec latency 95.373 ms 20 5921 6.32 MB/sec execute 76 sec latency 101.575 ms 20 5985 6.35 MB/sec execute 77 sec latency 101.464 ms 20 6039 6.33 MB/sec execute 78 sec latency 151.460 ms 20 6119 6.45 MB/sec execute 79 sec latency 120.379 ms 20 6225 6.61 MB/sec execute 80 sec latency 118.213 ms 20 6323 6.79 MB/sec execute 81 sec latency 131.122 ms 20 6440 7.07 MB/sec execute 82 sec latency 122.043 ms 20 6581 7.19 MB/sec execute 83 sec latency 103.588 ms 20 6702 7.25 MB/sec execute 84 sec latency 117.778 ms 20 6861 7.44 MB/sec execute 85 sec latency 237.685 ms 20 6975 7.62 MB/sec execute 86 sec latency 125.311 ms 20 7119 7.92 MB/sec execute 87 sec latency 89.801 ms 20 7220 7.98 MB/sec execute 88 sec latency 78.460 ms 20 7291 7.97 MB/sec execute 89 sec latency 89.469 ms 20 7360 8.00 MB/sec execute 90 sec latency 111.317 ms 20 7409 7.92 MB/sec execute 91 sec latency 115.083 ms 20 7467 7.86 MB/sec execute 92 sec latency 81.810 ms 20 7528 7.80 MB/sec execute 93 sec latency 83.712 ms 20 7592 7.72 MB/sec execute 94 sec latency 87.841 ms 20 7641 7.64 MB/sec execute 95 sec latency 145.203 ms 20 7702 7.57 MB/sec execute 96 sec latency 166.504 ms 20 7777 7.52 MB/sec execute 97 sec latency 110.179 ms 20 7855 7.48 MB/sec execute 98 sec latency 88.157 ms 20 7918 7.43 MB/sec execute 99 sec latency 100.650 ms 20 7989 7.39 MB/sec execute 100 sec latency 75.932 ms 20 8053 7.38 MB/sec execute 101 sec latency 104.731 ms 20 8125 7.36 MB/sec execute 102 sec latency 88.279 ms 20 8200 7.40 MB/sec execute 103 sec latency 121.350 ms 20 8289 7.38 MB/sec execute 104 sec latency 79.877 ms 20 8372 7.45 MB/sec execute 105 sec latency 103.546 ms 20 8468 7.57 MB/sec execute 106 sec latency 84.111 ms 20 8560 7.73 MB/sec execute 107 sec latency 114.672 ms 20 8626 7.67 MB/sec execute 108 sec latency 104.134 ms 20 8692 7.61 MB/sec execute 109 sec latency 102.122 ms 20 8755 7.55 MB/sec execute 110 sec latency 81.547 ms 20 8817 7.49 MB/sec execute 111 sec latency 124.776 ms 20 8879 7.43 MB/sec execute 112 sec latency 88.532 ms 20 8946 7.38 MB/sec execute 113 sec latency 78.862 ms 20 9029 7.32 MB/sec execute 114 sec latency 63.561 ms 20 9115 7.28 MB/sec execute 115 sec latency 193.874 ms 20 9198 7.23 MB/sec execute 116 sec latency 69.475 ms 20 9284 7.22 MB/sec execute 117 sec latency 75.464 ms 20 9380 7.22 MB/sec execute 118 sec latency 73.688 ms 20 9467 7.25 MB/sec execute 119 sec latency 84.985 ms 20 cleanup 120 sec 20 cleanup 121 sec 3 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 29678 44.775 259.064 Close 22448 11.610 88.640 Rename 1225 69.468 194.767 Unlink 5433 14.347 65.193 Qpathinfo 28217 11.109 169.211 Qfileinfo 4868 0.266 33.053 Qfsinfo 4451 0.210 27.202 Sfileinfo 2500 47.170 150.851 Find 10223 3.575 107.016 WriteX 14495 6.036 108.879 ReadX 44273 0.039 12.692 LockX 80 14.729 39.901 UnlockX 80 15.249 39.726 Flush 1896 45.209 237.670 Throughput 7.25048 MB/sec 20 clients 20 procs max_latency=259.079 ms stopping dbench on /mnt/lustre/d0.oleg209-client.virtnet at Thu Dec 12 10:07:15 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg209-client.virtnet /mnt/lustre/d0.oleg209-client.virtnet /mnt/lustre/d0.oleg209-client.virtnet removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg209-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (157s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:23 (1734016043) min OST has 3588848kB available, using 5383272kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7591] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5257] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg209-clien 5257M 77475 63 53149 47 205028 42 2249 220 Latency 34517us 196ms 149ms 11839us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg209-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 243 18 5126 24 404 14 307 17 816 12 139 10 Latency 25537us 30368us 38177us 21847us 6940us 56864us 1.97,1.97,oleg209-client.virtnet,1,1734004803,5257M,,,,77475,63,53149,47,,,205028,42,2249,220,10,,,,,243,18,5126,24,404,14,307,17,816,12,139,10,,34517us,196ms,,149ms,11839us,25537us,30368us,38177us,21847us,6940us,56864us debug=0x33f0484 PASS bonnie (401s) == sanity-benchmark test iozone: iozone ================== 10:14:04 (1734016444) Waiting for MDT destroys to complete oleg209-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg209-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg209-client: oleg209-server: ssh exited with exit code 1 pdsh@oleg209-client: oleg209-server: ssh exited with exit code 1 min OST has 3605484kB available, using 5408226kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7591] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:14:17 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 131275 150639 164739 235657 84975 110767 iozone test complete. Waiting for MDT destroys to complete oleg209-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg209-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg209-client: oleg209-server: ssh exited with exit code 1 pdsh@oleg209-client: oleg209-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg209-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg209-client: oleg209-server: ssh exited with exit code 1 oleg209-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg209-client: oleg209-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:18:45 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 75318 73591 89013 86436 88215 77862 iozone test complete. Waiting for MDT destroys to complete oleg209-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg209-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg209-client: oleg209-server: ssh exited with exit code 1 pdsh@oleg209-client: oleg209-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (692s) == sanity-benchmark test fsx: fsx ======================== 10:25:36 (1734017136) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 15034 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 15034 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0xd582d fallocating to largest ever: 0x48b202 truncating to largest ever: 0x50579b truncating to largest ever: 0x51cd49 truncating to largest ever: 0x525fb6 fallocating to largest ever: 0x5285e2 001000 1734017140.646916 read 0x36bf0f thru 0x371e0a (0x5efc bytes) 003000 1734017147.204791 write 0x24c5c2 thru 0x256ea3 (0xa8e2 bytes) 004000 1734017150.527263 read 0x2e7c77 thru 0x2f6e93 (0xf21d bytes) 006000 1734017157.138393 trunc from 0x1bea01 to 0x351273 (0x192873 bytes) 008000 1734017163.929164 write 0x50ea3a thru 0x5104ab (0x1a72 bytes) 010000 1734017170.289824 fallocate 0x144f8b thru 0x15437c (0xf3f2 bytes) 014000 1734017183.051401 trunc from 0x3df91f to 0x119f3b (0x2c59e3 bytes) 015000 1734017186.148680 mapwrite 0x3d728d thru 0x3e2905 (0xb679 bytes) 017000 1734017192.297189 mapread 0x4b9764 thru 0x4bccc2 (0x355f bytes) 022000 1734017207.063662 read 0x05abd7 thru 0x0682cd (0xd6f7 bytes) 023000 1734017210.107362 write 0x11c488 thru 0x120b8b (0x4704 bytes) 024000 1734017213.546245 write 0x3343fb thru 0x3418b0 (0xd4b6 bytes) 025000 1734017216.228425 mapread 0x0447fe thru 0x044a68 (0x26b bytes) 026000 1734017218.869111 mapwrite 0x302b03 thru 0x30b2c8 (0x87c6 bytes) 027000 1734017221.639289 read 0x21c97c thru 0x21df99 (0x161e bytes) 028000 1734017224.772225 write 0x20e20f thru 0x21db34 (0xf926 bytes) 029000 1734017227.265995 trunc from 0x43403a to 0x004d56 (0x42f2e3 bytes) 031000 1734017233.449018 read 0x474fe3 thru 0x4786f0 (0x370e bytes) 032000 1734017236.454790 write 0x423993 thru 0x433738 (0xfda6 bytes) 033000 1734017239.650469 punch from 0x0a8c23 to 0x0b876c (0xfb4a bytes) 034000 1734017242.332171 trunc from 0x4cab02 to 0x26635f (0x2647a2 bytes) 035000 1734017245.231817 punch from 0x08a957 to 0x094e74 (0xa51e bytes) skipping zero length punch hole 036000 1734017248.505386 trunc from 0x465458 to 0x00f4f1 (0x455f66 bytes) 037000 1734017251.755914 mapread 0x1fd659 thru 0x209a39 (0xc3e1 bytes) 038000 1734017255.095771 write 0x33da57 thru 0x34ce25 (0xf3cf bytes) 039000 1734017258.279194 mapwrite 0x21a56b thru 0x21c96e (0x2404 bytes) 041000 1734017264.181026 trunc from 0x48e6bb to 0x2e482c (0x1a9e8e bytes) 042000 1734017267.078698 trunc from 0x263524 to 0x0cbe69 (0x1976ba bytes) 044000 1734017272.168187 fallocate 0x120883 thru 0x130325 (0xfaa3 bytes) 045000 1734017274.896332 write 0x0dd16c thru 0x0ea611 (0xd4a6 bytes) 048000 1734017282.612540 fallocate 0x2a4041 thru 0x2a59cd (0x198d bytes) 049000 1734017285.163357 write 0x39b6ba thru 0x3a9d96 (0xe6dd bytes) 050000 1734017288.140773 trunc from 0x05bb76 to 0x2c8b75 (0x26d000 bytes) 054000 1734017299.214880 mapread 0x3d5fd5 thru 0x3d7633 (0x165f bytes) 055000 1734017301.851781 punch from 0x03a36d to 0x03b27d (0xf11 bytes) 059000 1734017312.560176 write 0x0c2331 thru 0x0c90f2 (0x6dc2 bytes) 061000 1734017317.606386 fallocate 0x463cd7 thru 0x465a8d (0x1db7 bytes) 065000 1734017328.242360 write 0x107cb1 thru 0x109684 (0x19d4 bytes) 066000 1734017330.757389 write 0x50383b thru 0x506010 (0x27d6 bytes) 067000 1734017333.922003 fallocate 0x4237e7 thru 0x424c3e (0x1458 bytes) 068000 1734017336.393706 trunc from 0x36b31e to 0x13a565 (0x230db8 bytes) 070000 1734017342.304349 mapread 0x0a5fec thru 0x0adadc (0x7af1 bytes) 071000 1734017345.068487 write 0x1c4068 thru 0x1d09d5 (0xc96e bytes) 072000 1734017347.570889 punch from 0x37ba89 to 0x38152b (0x5aa3 bytes) 073000 1734017351.039815 read 0x071abe thru 0x07879b (0x6cde bytes) 075000 1734017356.861254 write 0x00d8e8 thru 0x016fee (0x9707 bytes) 076000 1734017359.539739 punch from 0x0b5d4f to 0x0c4e1f (0xf0d1 bytes) 077000 1734017362.439529 mapwrite 0x2a716a thru 0x2b4c0d (0xdaa4 bytes) 078000 1734017365.409184 punch from 0x2532a8 to 0x25a646 (0x739f bytes) 080000 1734017370.762803 fallocate 0x32bbba thru 0x3370b9 (0xb500 bytes) skipping zero size read 082000 1734017376.499362 trunc from 0x4cc6b4 to 0x409c3c (0xc2a77 bytes) 083000 1734017379.454303 punch from 0x085060 to 0x08d1b3 (0x8154 bytes) 085000 1734017385.058092 fallocate 0x147990 thru 0x153f2a (0xc59b bytes) 086000 1734017387.940974 mapwrite 0x2bd0da thru 0x2c0cc7 (0x3bee bytes) 087000 1734017390.735291 trunc from 0x0b5e6c to 0x06ee1b (0x47050 bytes) 088000 1734017393.245385 mapwrite 0x4fcb26 thru 0x503a52 (0x6f2d bytes) 089000 1734017395.823793 fallocate 0x250026 thru 0x2585e4 (0x85bf bytes) 090000 1734017398.209791 mapwrite 0x4740d6 thru 0x47e7e3 (0xa70e bytes) 091000 1734017400.687210 mapwrite 0x3dcb7d thru 0x3e6428 (0x98ac bytes) 092000 1734017403.084263 write 0x41e235 thru 0x4240c1 (0x5e8d bytes) 094000 1734017408.108180 mapread 0x063b4c thru 0x06e294 (0xa749 bytes) 096000 1734017413.280721 fallocate 0x30dd62 thru 0x31afd1 (0xd270 bytes) 097000 1734017415.504804 punch from 0x18f8a2 to 0x19293c (0x309b bytes) 098000 1734017417.945980 write 0x18afee thru 0x19714d (0xc160 bytes) 099000 1734017420.440782 fallocate 0x139841 thru 0x13e5fb (0x4dbb bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4726051 (4616 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 1314816.. 1314819: 4: 0000: net 1: 4.. 7: 1706828.. 1706831: 4: 0000: net 2: 112.. 131: 1707040.. 1707059: 20: 0000: net 3: 176.. 211: 1707168.. 1707203: 36: 0000: net 4: 264.. 291: 1707308.. 1707335: 28: 0000: net 5: 332.. 347: 1707424.. 1707439: 16: 0000: net 6: 352.. 363: 1709356.. 1709367: 12: 0000: unwritten,net 7: 364.. 411: 1709368.. 1709415: 48: 0000: net 8: 412.. 431: 1709492.. 1709511: 20: 0000: net 9: 516.. 531: 1706832.. 1706847: 16: 0000: unwritten,net 10: 1416.. 1451: 1840252.. 1840287: 36: 0000: unwritten,net 11: 1452.. 1467: 1709688.. 1709703: 16: 0000: last,unwritten,net /mnt/lustre/f0.fsxfile: 11 extents found debug=0x33f0484 PASS fsx (288s) == sanity-benchmark test complete, duration 1568 sec ===== 10:30:24 (1734017424) === sanity-benchmark: start cleanup 10:30:24 (1734017424) === === sanity-benchmark: finish cleanup 10:30:25 (1734017425) ===