-----============= acceptance-small: sanity-benchmark ============----- Fri Aug 9 21:17:23 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 21:17:28 (1723252648) === oleg117-client.virtnet: executing check_config_client /mnt/lustre oleg117-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg117-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5d4d800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5d4d800.idle_timeout=debug disable quota as required oleg117-server: oleg117-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 21:17:34 (1723252654) === == sanity-benchmark test dbench: dbench ================== 21:17:34 (1723252654) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6957] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg117-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg117-client.virtnet at Fri Aug 9 21:17:35 EDT 2024 waiting for dbench pid 8962 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 175 142.80 MB/sec warmup 1 sec latency 87.505 ms 20 355 127.55 MB/sec warmup 2 sec latency 64.264 ms 20 570 131.63 MB/sec warmup 3 sec latency 65.794 ms 20 744 106.63 MB/sec warmup 4 sec latency 208.885 ms 20 907 86.89 MB/sec warmup 5 sec latency 148.835 ms 20 1159 76.69 MB/sec warmup 6 sec latency 81.481 ms 20 1469 74.38 MB/sec warmup 7 sec latency 130.154 ms 20 1675 65.54 MB/sec warmup 8 sec latency 132.871 ms 20 1931 58.75 MB/sec warmup 9 sec latency 87.494 ms 20 2206 53.91 MB/sec warmup 10 sec latency 52.004 ms 20 2452 51.35 MB/sec warmup 11 sec latency 137.971 ms 20 2882 54.53 MB/sec warmup 12 sec latency 152.779 ms 20 3294 54.08 MB/sec warmup 13 sec latency 185.448 ms 20 3706 55.74 MB/sec warmup 14 sec latency 88.766 ms 20 3947 53.37 MB/sec warmup 15 sec latency 24.612 ms 20 4164 50.18 MB/sec warmup 16 sec latency 285.190 ms 20 4296 47.54 MB/sec warmup 17 sec latency 252.572 ms 20 4422 45.23 MB/sec warmup 18 sec latency 111.662 ms 20 4597 43.66 MB/sec warmup 19 sec latency 150.092 ms 20 4873 43.51 MB/sec warmup 20 sec latency 117.076 ms 20 5093 43.05 MB/sec warmup 21 sec latency 87.709 ms 20 5260 41.23 MB/sec warmup 22 sec latency 78.681 ms 20 5412 39.54 MB/sec warmup 23 sec latency 82.151 ms 20 5850 15.97 MB/sec execute 1 sec latency 94.537 ms 20 6052 20.84 MB/sec execute 2 sec latency 169.976 ms 20 6424 41.00 MB/sec execute 3 sec latency 142.638 ms 20 6808 41.74 MB/sec execute 4 sec latency 127.714 ms 20 7165 48.14 MB/sec execute 5 sec latency 103.109 ms 20 7396 44.23 MB/sec execute 6 sec latency 40.267 ms 20 7585 38.60 MB/sec execute 7 sec latency 27.203 ms 20 7742 34.06 MB/sec execute 8 sec latency 261.858 ms 20 7873 30.95 MB/sec execute 9 sec latency 167.861 ms 20 8029 28.64 MB/sec execute 10 sec latency 104.582 ms 20 8195 27.74 MB/sec execute 11 sec latency 284.247 ms 20 8448 28.28 MB/sec execute 12 sec latency 77.354 ms 20 8663 28.70 MB/sec execute 13 sec latency 93.666 ms 20 8843 26.88 MB/sec execute 14 sec latency 88.328 ms 20 9021 25.29 MB/sec execute 15 sec latency 59.706 ms 20 9218 24.08 MB/sec execute 16 sec latency 73.521 ms 20 9459 23.83 MB/sec execute 17 sec latency 97.138 ms 20 9662 24.16 MB/sec execute 18 sec latency 165.040 ms 20 10037 26.91 MB/sec execute 19 sec latency 143.586 ms 20 10418 27.92 MB/sec execute 20 sec latency 140.508 ms 20 10749 29.83 MB/sec execute 21 sec latency 112.493 ms 20 10964 29.48 MB/sec execute 22 sec latency 26.232 ms 20 11117 28.37 MB/sec execute 23 sec latency 226.461 ms 20 11297 27.31 MB/sec execute 24 sec latency 165.517 ms 20 11428 26.45 MB/sec execute 25 sec latency 168.830 ms 20 11582 25.73 MB/sec execute 26 sec latency 138.457 ms 20 11790 25.57 MB/sec execute 27 sec latency 124.471 ms 20 12081 26.32 MB/sec execute 28 sec latency 155.709 ms 20 12298 26.10 MB/sec execute 29 sec latency 93.658 ms 20 12476 25.34 MB/sec execute 30 sec latency 69.284 ms 20 12689 24.70 MB/sec execute 31 sec latency 56.901 ms 20 12933 24.40 MB/sec execute 32 sec latency 75.695 ms 20 13146 24.44 MB/sec execute 33 sec latency 147.374 ms 20 13477 25.56 MB/sec execute 34 sec latency 114.398 ms 20 13862 26.61 MB/sec execute 35 sec latency 153.480 ms 20 14192 27.40 MB/sec execute 36 sec latency 127.069 ms 20 14447 27.68 MB/sec execute 37 sec latency 25.862 ms 20 14634 27.23 MB/sec execute 38 sec latency 246.628 ms 20 14798 26.59 MB/sec execute 39 sec latency 160.755 ms 20 14947 26.06 MB/sec execute 40 sec latency 184.176 ms 20 15078 25.59 MB/sec execute 41 sec latency 163.075 ms 20 15281 25.41 MB/sec execute 42 sec latency 113.064 ms 20 15540 25.63 MB/sec execute 43 sec latency 85.365 ms 20 15791 25.87 MB/sec execute 44 sec latency 77.482 ms 20 15992 25.38 MB/sec execute 45 sec latency 63.438 ms 20 16193 24.94 MB/sec execute 46 sec latency 87.094 ms 20 16482 24.79 MB/sec execute 47 sec latency 86.976 ms 20 16766 25.08 MB/sec execute 48 sec latency 113.918 ms 20 17180 26.25 MB/sec execute 49 sec latency 138.005 ms 20 17587 26.75 MB/sec execute 50 sec latency 129.272 ms 20 17924 27.46 MB/sec execute 51 sec latency 110.326 ms 20 18143 27.22 MB/sec execute 52 sec latency 204.000 ms 20 18341 26.78 MB/sec execute 53 sec latency 248.919 ms 20 18518 26.42 MB/sec execute 54 sec latency 155.261 ms 20 18699 26.16 MB/sec execute 55 sec latency 119.503 ms 20 18944 26.18 MB/sec execute 56 sec latency 118.095 ms 20 19231 26.41 MB/sec execute 57 sec latency 97.896 ms 20 19456 26.26 MB/sec execute 58 sec latency 87.461 ms 20 19691 25.91 MB/sec execute 59 sec latency 68.253 ms 20 19957 25.70 MB/sec execute 60 sec latency 73.291 ms 20 20215 25.68 MB/sec execute 61 sec latency 106.016 ms 20 20472 25.97 MB/sec execute 62 sec latency 137.328 ms 20 20822 26.61 MB/sec execute 63 sec latency 144.544 ms 20 21074 26.69 MB/sec execute 64 sec latency 145.222 ms 20 21288 26.77 MB/sec execute 65 sec latency 140.134 ms 20 21417 26.78 MB/sec execute 66 sec latency 111.634 ms 20 21501 26.58 MB/sec execute 67 sec latency 278.175 ms 20 21556 26.24 MB/sec execute 68 sec latency 144.793 ms 20 21602 25.96 MB/sec execute 69 sec latency 355.031 ms 20 21657 25.66 MB/sec execute 70 sec latency 157.738 ms 20 21707 25.32 MB/sec execute 71 sec latency 254.422 ms 20 21758 25.00 MB/sec execute 72 sec latency 288.159 ms 20 21813 24.68 MB/sec execute 73 sec latency 260.868 ms 20 21881 24.36 MB/sec execute 74 sec latency 204.262 ms 20 21944 24.06 MB/sec execute 75 sec latency 191.301 ms 20 22018 23.76 MB/sec execute 76 sec latency 181.356 ms 20 22078 23.49 MB/sec execute 77 sec latency 312.334 ms 20 22119 23.24 MB/sec execute 78 sec latency 310.664 ms 20 22158 22.98 MB/sec execute 79 sec latency 329.262 ms 20 22214 22.73 MB/sec execute 80 sec latency 271.583 ms 20 22263 22.49 MB/sec execute 81 sec latency 276.762 ms 20 22319 22.25 MB/sec execute 82 sec latency 286.259 ms 20 22381 22.09 MB/sec execute 83 sec latency 279.152 ms 20 22446 21.90 MB/sec execute 84 sec latency 197.758 ms 20 22536 21.78 MB/sec execute 85 sec latency 153.044 ms 20 22681 21.74 MB/sec execute 86 sec latency 101.838 ms 20 22833 21.73 MB/sec execute 87 sec latency 107.167 ms 20 22987 21.66 MB/sec execute 88 sec latency 82.603 ms 20 23126 21.46 MB/sec execute 89 sec latency 78.860 ms 20 23226 21.24 MB/sec execute 90 sec latency 74.452 ms 20 23353 21.10 MB/sec execute 91 sec latency 108.276 ms 20 23492 20.94 MB/sec execute 92 sec latency 134.624 ms 20 23609 20.79 MB/sec execute 93 sec latency 105.442 ms 20 23779 20.81 MB/sec execute 94 sec latency 109.216 ms 20 23914 20.80 MB/sec execute 95 sec latency 205.202 ms 20 24090 20.86 MB/sec execute 96 sec latency 169.075 ms 20 24308 21.09 MB/sec execute 97 sec latency 148.424 ms 20 24522 21.23 MB/sec execute 98 sec latency 147.457 ms 20 24692 21.23 MB/sec execute 99 sec latency 184.737 ms 20 24882 21.35 MB/sec execute 100 sec latency 201.927 ms 20 25047 21.41 MB/sec execute 101 sec latency 151.292 ms 20 25187 21.33 MB/sec execute 102 sec latency 119.086 ms 20 25301 21.18 MB/sec execute 103 sec latency 165.940 ms 20 25404 21.02 MB/sec execute 104 sec latency 128.914 ms 20 25499 20.83 MB/sec execute 105 sec latency 183.111 ms 20 25608 20.69 MB/sec execute 106 sec latency 187.774 ms 20 25704 20.54 MB/sec execute 107 sec latency 177.980 ms 20 25798 20.39 MB/sec execute 108 sec latency 150.731 ms 20 25914 20.31 MB/sec execute 109 sec latency 153.646 ms 20 26040 20.26 MB/sec execute 110 sec latency 119.498 ms 20 26156 20.16 MB/sec execute 111 sec latency 105.022 ms 20 26304 20.17 MB/sec execute 112 sec latency 97.218 ms 20 26441 20.17 MB/sec execute 113 sec latency 133.199 ms 20 26573 20.09 MB/sec execute 114 sec latency 103.591 ms 20 26678 19.96 MB/sec execute 115 sec latency 103.337 ms 20 26782 19.82 MB/sec execute 116 sec latency 104.134 ms 20 26900 19.68 MB/sec execute 117 sec latency 109.654 ms 20 27051 19.58 MB/sec execute 118 sec latency 81.577 ms 20 27223 19.58 MB/sec execute 119 sec latency 129.007 ms 20 cleanup 120 sec 7 cleanup 121 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 75193 16.761 162.134 Close 55543 3.170 54.684 Rename 3177 23.292 121.938 Unlink 15038 5.371 51.726 Qpathinfo 68317 3.922 112.810 Qfileinfo 11955 0.090 27.664 Qfsinfo 12423 0.041 18.064 Sfileinfo 6135 14.048 91.186 Find 26375 0.607 92.388 WriteX 37326 1.119 40.463 ReadX 118031 0.014 3.410 LockX 246 4.065 16.861 UnlockX 246 3.949 13.078 Flush 5212 74.672 354.784 Throughput 19.5776 MB/sec 20 clients 20 procs max_latency=355.031 ms stopping dbench on /mnt/lustre/d0.oleg117-client.virtnet at Fri Aug 9 21:20:00 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg117-client.virtnet /mnt/lustre/d0.oleg117-client.virtnet /mnt/lustre/d0.oleg117-client.virtnet removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg117-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (150s) == sanity-benchmark test bonnie: bonnie++ ================ 21:20:04 (1723252804) min OST has 3206144kB available, using 4809216kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6957] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4696] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg117-clien 4696M 147219 96 135411 92 386849 77 2002 130 Latency 8507us 99148us 26597us 285ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg117-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 396 17 8564 32 572 11 446 16 1107 12 556 12 Latency 12609us 13334us 62443us 13885us 4466us 12221us 1.97,1.97,oleg117-client.virtnet,1,1723262837,4696M,,,,147219,96,135411,92,,,386849,77,2002,130,10,,,,,396,17,8564,32,572,11,446,16,1107,12,556,12,,8507us,99148us,,26597us,285ms,12609us,13334us,62443us,13885us,4466us,12221us debug=0x33f0484 PASS bonnie (187s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 21:23:12 (1723252992) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 27418 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 27418 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x466d25 truncating to largest ever: 0x4d3c15 truncating to largest ever: 0x547274 truncating to largest ever: 0x54b33f truncating to largest ever: 0x54ba08 truncating to largest ever: 0x55a307 truncating to largest ever: 0x55ec86 004000 1723253010.465333 write 0x068cc6 thru 0x06d366 (0x46a1 bytes) truncating to largest ever: 0x560c53 010000 1723253032.032963 read 0x01f805 thru 0x0259b9 (0x61b5 bytes) 011000 1723253035.957521 trunc from 0x0d2236 to 0x38896a (0x2b6735 bytes) truncating to largest ever: 0x560dd4 012000 1723253040.105649 read 0x013df6 thru 0x0168e5 (0x2af0 bytes) truncating to largest ever: 0x561aaa 013000 1723253043.317727 mapwrite 0x1c6e29 thru 0x1c8474 (0x164c bytes) 015000 1723253050.468978 write 0x3b02f7 thru 0x3bcb45 (0xc84f bytes) 016000 1723253053.922244 mapwrite 0x4cbea0 thru 0x4d49bf (0x8b20 bytes) 019000 1723253065.625563 trunc from 0x55ba5a to 0x3809e1 (0x1db078 bytes) 020000 1723253069.299825 trunc from 0x124907 to 0x3fe104 (0x2d97fe bytes) 022000 1723253075.989173 mapwrite 0x54d319 thru 0x5512ff (0x3fe7 bytes) skipping zero size write 023000 1723253079.016893 write 0x55fe1f thru 0x560afa (0xcdc bytes) truncating to largest ever: 0x562873 026000 1723253090.129758 write 0x4b05c7 thru 0x4b4d46 (0x4780 bytes) 028000 1723253098.191049 mapread 0x1a826a thru 0x1af69f (0x7436 bytes) 030000 1723253105.546711 mapwrite 0x53b226 thru 0x53d2bd (0x2098 bytes) 035000 1723253123.634089 trunc from 0x37bbaa to 0x31f688 (0x5c521 bytes) 038000 1723253134.870444 read 0x37d30a thru 0x387b11 (0xa808 bytes) 039000 1723253139.059434 mapwrite 0x21c22e thru 0x223255 (0x7028 bytes) 040000 1723253143.380292 mapwrite 0x32f494 thru 0x33ed84 (0xf8f1 bytes) 044000 1723253161.912401 mapread 0x3f9d82 thru 0x402107 (0x8386 bytes) 047000 1723253173.447704 trunc from 0x103226 to 0x022dba (0xe046b bytes) 048000 1723253177.400890 mapwrite 0x09fd6b thru 0x0a849a (0x8730 bytes) 050000 1723253185.441022 trunc from 0x4e5871 to 0x03e8ee (0x4a6f82 bytes) 053000 1723253196.768127 write 0x47a839 thru 0x483f6f (0x9737 bytes) 054000 1723253200.997719 trunc from 0x3c25ee to 0x236dff (0x18b7ee bytes) 056000 1723253208.727678 mapwrite 0x3885c9 thru 0x390998 (0x83d0 bytes) 058000 1723253217.168595 mapread 0x379f06 thru 0x37ee07 (0x4f02 bytes) 059000 1723253221.088018 trunc from 0x54a1c9 to 0x23c67a (0x30db4e bytes) 061000 1723253230.201545 read 0x200522 thru 0x20ac03 (0xa6e2 bytes) 063000 1723253238.745597 mapwrite 0x2b0f66 thru 0x2b32cf (0x236a bytes) 065000 1723253245.955732 read 0x2c0352 thru 0x2c5709 (0x53b8 bytes) 066000 1723253249.400040 read 0x16f2f0 thru 0x178be4 (0x98f5 bytes) 068000 1723253256.193644 trunc from 0x445ddd to 0x4f44e6 (0xae70a bytes) 070000 1723253262.110485 read 0x14a0f8 thru 0x155237 (0xb140 bytes) 071000 1723253265.208309 mapread 0x25942e thru 0x259d40 (0x913 bytes) 074000 1723253274.533421 mapread 0x3bf163 thru 0x3ce402 (0xf2a0 bytes) 075000 1723253278.250046 mapwrite 0x38ec33 thru 0x39c66a (0xda38 bytes) 076000 1723253281.415641 mapread 0x07bc15 thru 0x080652 (0x4a3e bytes) 078000 1723253288.819441 mapwrite 0x07d8db thru 0x089993 (0xc0b9 bytes) 079000 1723253292.576625 read 0x03d6b6 thru 0x040ae4 (0x342f bytes) 081000 1723253299.298100 mapwrite 0x098564 thru 0x0a73fe (0xee9b bytes) 082000 1723253302.337594 write 0x0ebd09 thru 0x0f2e81 (0x7179 bytes) 083000 1723253305.697009 trunc from 0x4ffc97 to 0x44521f (0xbaa77 bytes) 086000 1723253315.548445 read 0x02f88b thru 0x03b623 (0xbd99 bytes) 090000 1723253327.785194 mapread 0x23a529 thru 0x23c0e2 (0x1bba bytes) 092000 1723253334.727959 read 0x07126b thru 0x07511e (0x3eb4 bytes) 093000 1723253338.168401 mapwrite 0x154346 thru 0x15ae33 (0x6aee bytes) 094000 1723253341.178776 read 0x32dfa7 thru 0x331d8e (0x3de8 bytes) truncating to largest ever: 0x562bd5 097000 1723253350.469175 mapwrite 0x0a4416 thru 0x0af2f2 (0xaedd bytes) 100000 1723253359.612392 trunc from 0x451236 to 0x36337e (0xedeb7 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (368s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 21:29:20 (1723253360) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1723253369.871819 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1723253377.446760 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1723253381.546378 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1723253395.983168 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1723253399.186644 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1723253413.528266 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1723253417.418700 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1723253425.567347 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1723253432.692064 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1723253436.021237 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1723253442.935608 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1723253447.365202 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1723253462.426872 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1723253468.608410 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1723253478.518118 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1723253488.442544 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1723253491.428895 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1723253506.693469 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1723253510.732234 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1723253521.922980 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1723253525.535232 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1723253529.724007 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1723253540.397699 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1723253547.686407 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1723253555.136295 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1723253559.405173 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1723253596.784728 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1723253608.539221 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1723253612.968040 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1723253616.708828 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1723253620.632408 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1723253632.935336 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1723253636.762892 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1723253649.057715 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1723253653.180974 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1723253663.786539 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1723253674.755182 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1723253678.730546 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1723253688.995823 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1723253707.347170 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1723253710.636686 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1723253717.821364 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1723253725.455289 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (370s) == sanity-benchmark test complete, duration 1086 sec ===== 21:35:30 (1723253730) === sanity-benchmark: start cleanup 21:35:30 (1723253730) === === sanity-benchmark: finish cleanup 21:35:30 (1723253730) ===