-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:45 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:50 (1734015830) === oleg359-client.virtnet: executing check_config_client /mnt/lustre oleg359-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg359-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800ab39a800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800ab39a800.idle_timeout=debug disable quota as required oleg359-server: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:00 (1734015840) === == sanity-benchmark test dbench: dbench ================== 10:04:01 (1734015841) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6980] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg359-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg359-client.virtnet at Thu Dec 12 10:04:03 EST 2024 waiting for dbench pid 9449 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 16 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 63 54.71 MB/sec warmup 1 sec latency 129.708 ms 20 154 65.03 MB/sec warmup 2 sec latency 171.990 ms 20 237 60.51 MB/sec warmup 3 sec latency 115.522 ms 20 312 57.15 MB/sec warmup 4 sec latency 146.607 ms 20 383 54.55 MB/sec warmup 5 sec latency 108.053 ms 20 456 53.36 MB/sec warmup 6 sec latency 112.512 ms 20 525 52.08 MB/sec warmup 7 sec latency 141.663 ms 20 652 52.70 MB/sec warmup 8 sec latency 282.845 ms 20 684 47.05 MB/sec warmup 9 sec latency 429.231 ms 20 725 42.58 MB/sec warmup 10 sec latency 297.070 ms 20 770 38.83 MB/sec warmup 11 sec latency 147.830 ms 20 804 35.79 MB/sec warmup 12 sec latency 207.367 ms 20 868 33.24 MB/sec warmup 13 sec latency 159.155 ms 20 908 31.01 MB/sec warmup 14 sec latency 234.879 ms 20 953 29.06 MB/sec warmup 15 sec latency 236.403 ms 20 1001 27.68 MB/sec warmup 16 sec latency 347.214 ms 20 1077 26.95 MB/sec warmup 17 sec latency 219.662 ms 20 1139 25.54 MB/sec warmup 18 sec latency 154.096 ms 20 1190 24.23 MB/sec warmup 19 sec latency 122.133 ms 20 1247 23.36 MB/sec warmup 20 sec latency 107.625 ms 20 1311 22.79 MB/sec warmup 21 sec latency 134.310 ms 20 1420 23.64 MB/sec warmup 22 sec latency 165.641 ms 20 1470 22.63 MB/sec warmup 23 sec latency 240.705 ms 20 1575 1.18 MB/sec execute 1 sec latency 296.570 ms 20 1626 1.05 MB/sec execute 2 sec latency 272.141 ms 20 1668 0.96 MB/sec execute 3 sec latency 267.629 ms 20 1723 0.92 MB/sec execute 4 sec latency 312.209 ms 20 1782 0.95 MB/sec execute 5 sec latency 127.426 ms 20 1829 0.93 MB/sec execute 6 sec latency 273.603 ms 20 1873 0.88 MB/sec execute 7 sec latency 254.292 ms 20 1931 0.90 MB/sec execute 8 sec latency 248.620 ms 20 2000 0.99 MB/sec execute 9 sec latency 251.394 ms 20 2049 1.03 MB/sec execute 10 sec latency 108.650 ms 20 2096 1.06 MB/sec execute 11 sec latency 107.669 ms 20 2152 1.14 MB/sec execute 12 sec latency 95.863 ms 20 2206 1.29 MB/sec execute 13 sec latency 240.436 ms 20 2262 1.70 MB/sec execute 14 sec latency 281.284 ms 20 2302 1.90 MB/sec execute 15 sec latency 741.014 ms 20 2355 2.29 MB/sec execute 16 sec latency 1308.328 ms 20 2395 2.33 MB/sec execute 17 sec latency 448.886 ms 20 2440 2.40 MB/sec execute 18 sec latency 360.336 ms 20 2482 2.60 MB/sec execute 19 sec latency 443.382 ms 20 2553 3.07 MB/sec execute 20 sec latency 476.297 ms 20 2655 3.78 MB/sec execute 21 sec latency 267.014 ms 20 2757 4.75 MB/sec execute 22 sec latency 330.557 ms 20 2874 5.72 MB/sec execute 23 sec latency 378.913 ms 20 2966 6.13 MB/sec execute 24 sec latency 411.413 ms 20 3039 6.14 MB/sec execute 25 sec latency 389.300 ms 20 3139 6.19 MB/sec execute 26 sec latency 465.746 ms 20 3263 6.52 MB/sec execute 27 sec latency 428.405 ms 20 3365 6.97 MB/sec execute 28 sec latency 277.447 ms 20 3457 7.40 MB/sec execute 29 sec latency 271.096 ms 20 3556 8.03 MB/sec execute 30 sec latency 102.200 ms 20 3638 8.14 MB/sec execute 31 sec latency 87.718 ms 20 3698 8.05 MB/sec execute 32 sec latency 94.159 ms 20 3738 7.94 MB/sec execute 33 sec latency 171.458 ms 20 3787 7.94 MB/sec execute 34 sec latency 117.778 ms 20 3835 7.85 MB/sec execute 35 sec latency 115.289 ms 20 3872 7.65 MB/sec execute 36 sec latency 105.925 ms 20 3915 7.50 MB/sec execute 37 sec latency 102.572 ms 20 3945 7.36 MB/sec execute 38 sec latency 207.085 ms 20 3978 7.17 MB/sec execute 39 sec latency 169.906 ms 20 4018 7.00 MB/sec execute 40 sec latency 95.242 ms 20 4063 6.83 MB/sec execute 41 sec latency 89.554 ms 20 4100 6.68 MB/sec execute 42 sec latency 403.648 ms 20 4154 6.54 MB/sec execute 43 sec latency 283.245 ms 20 4215 6.42 MB/sec execute 44 sec latency 310.944 ms 20 4253 6.32 MB/sec execute 45 sec latency 605.181 ms 20 4286 6.21 MB/sec execute 46 sec latency 356.638 ms 20 4322 6.13 MB/sec execute 47 sec latency 286.194 ms 20 4368 6.03 MB/sec execute 48 sec latency 145.168 ms 20 4404 5.96 MB/sec execute 49 sec latency 243.232 ms 20 4448 5.87 MB/sec execute 50 sec latency 213.122 ms 20 4492 5.83 MB/sec execute 51 sec latency 313.317 ms 20 4535 5.82 MB/sec execute 52 sec latency 207.448 ms 20 4583 5.76 MB/sec execute 53 sec latency 333.932 ms 20 4628 5.72 MB/sec execute 54 sec latency 275.951 ms 20 4691 5.82 MB/sec execute 55 sec latency 115.453 ms 20 4762 5.86 MB/sec execute 56 sec latency 105.705 ms 20 4824 5.96 MB/sec execute 57 sec latency 127.233 ms 20 4871 5.91 MB/sec execute 58 sec latency 336.716 ms 20 4924 5.93 MB/sec execute 59 sec latency 244.155 ms 20 5012 6.36 MB/sec execute 60 sec latency 309.868 ms 20 5060 6.26 MB/sec execute 61 sec latency 114.503 ms 20 5093 6.17 MB/sec execute 62 sec latency 274.668 ms 20 5144 6.09 MB/sec execute 63 sec latency 294.877 ms 20 5185 6.00 MB/sec execute 64 sec latency 181.809 ms 20 5218 5.92 MB/sec execute 65 sec latency 243.465 ms 20 5264 5.84 MB/sec execute 66 sec latency 265.615 ms 20 5304 5.76 MB/sec execute 67 sec latency 152.833 ms 20 5344 5.69 MB/sec execute 68 sec latency 160.971 ms 20 5397 5.62 MB/sec execute 69 sec latency 159.374 ms 20 5441 5.55 MB/sec execute 70 sec latency 106.654 ms 20 5488 5.49 MB/sec execute 71 sec latency 198.865 ms 20 5544 5.42 MB/sec execute 72 sec latency 222.990 ms 20 5607 5.37 MB/sec execute 73 sec latency 249.562 ms 20 5664 5.33 MB/sec execute 74 sec latency 104.864 ms 20 5704 5.31 MB/sec execute 75 sec latency 216.705 ms 20 5760 5.30 MB/sec execute 76 sec latency 402.824 ms 20 5814 5.25 MB/sec execute 77 sec latency 242.814 ms 20 5864 5.25 MB/sec execute 78 sec latency 274.076 ms 20 5934 5.30 MB/sec execute 79 sec latency 295.387 ms 20 6007 5.37 MB/sec execute 80 sec latency 295.063 ms 20 6072 5.46 MB/sec execute 81 sec latency 329.254 ms 20 6152 5.55 MB/sec execute 82 sec latency 370.159 ms 20 6222 5.65 MB/sec execute 83 sec latency 400.475 ms 20 6325 5.77 MB/sec execute 84 sec latency 340.181 ms 20 6432 5.96 MB/sec execute 85 sec latency 300.993 ms 20 6575 6.15 MB/sec execute 86 sec latency 321.540 ms 20 6660 6.29 MB/sec execute 87 sec latency 330.902 ms 20 6755 6.32 MB/sec execute 88 sec latency 298.935 ms 20 6889 6.50 MB/sec execute 89 sec latency 300.591 ms 20 6956 6.49 MB/sec execute 90 sec latency 396.397 ms 20 7050 6.64 MB/sec execute 91 sec latency 190.002 ms 20 7111 6.68 MB/sec execute 92 sec latency 250.813 ms 20 7199 6.87 MB/sec execute 93 sec latency 108.903 ms 20 7251 6.82 MB/sec execute 94 sec latency 93.504 ms 20 7288 6.77 MB/sec execute 95 sec latency 172.405 ms 20 7337 6.77 MB/sec execute 96 sec latency 193.291 ms 20 7384 6.77 MB/sec execute 97 sec latency 130.486 ms 20 7423 6.71 MB/sec execute 98 sec latency 117.289 ms 20 7460 6.66 MB/sec execute 99 sec latency 102.845 ms 20 7489 6.60 MB/sec execute 100 sec latency 190.138 ms 20 7528 6.55 MB/sec execute 101 sec latency 200.360 ms 20 7573 6.49 MB/sec execute 102 sec latency 249.460 ms 20 7621 6.43 MB/sec execute 103 sec latency 266.304 ms 20 7653 6.38 MB/sec execute 104 sec latency 371.243 ms 20 7691 6.32 MB/sec execute 105 sec latency 373.971 ms 20 7744 6.27 MB/sec execute 106 sec latency 284.614 ms 20 7796 6.23 MB/sec execute 107 sec latency 411.030 ms 20 7835 6.19 MB/sec execute 108 sec latency 288.255 ms 20 7872 6.15 MB/sec execute 109 sec latency 276.465 ms 20 7913 6.11 MB/sec execute 110 sec latency 293.364 ms 20 7953 6.07 MB/sec execute 111 sec latency 270.925 ms 20 8005 6.05 MB/sec execute 112 sec latency 290.399 ms 20 8058 6.05 MB/sec execute 113 sec latency 209.220 ms 20 8109 6.02 MB/sec execute 114 sec latency 266.831 ms 20 8163 6.00 MB/sec execute 115 sec latency 242.959 ms 20 8234 6.04 MB/sec execute 116 sec latency 227.862 ms 20 8317 6.13 MB/sec execute 117 sec latency 183.194 ms 20 8396 6.14 MB/sec execute 118 sec latency 106.597 ms 20 8470 6.17 MB/sec execute 119 sec latency 179.944 ms 20 cleanup 120 sec 20 cleanup 121 sec 13 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 24198 51.717 243.035 Close 17779 12.478 68.973 Rename 1040 75.512 181.150 Unlink 4932 16.942 63.062 Qpathinfo 22400 12.436 182.274 Qfileinfo 3817 0.253 30.601 Qfsinfo 4071 0.182 24.824 Sfileinfo 2000 44.625 157.916 Find 8515 3.377 129.691 WriteX 12010 3.953 76.148 ReadX 38030 0.036 8.971 LockX 80 17.436 41.969 UnlockX 80 16.237 42.808 Flush 1709 184.097 1308.315 Throughput 6.17148 MB/sec 20 clients 20 procs max_latency=1308.328 ms stopping dbench on /mnt/lustre/d0.oleg359-client.virtnet at Thu Dec 12 10:06:29 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg359-client.virtnet /mnt/lustre/d0.oleg359-client.virtnet /mnt/lustre/d0.oleg359-client.virtnet removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg359-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (155s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:36 (1734015996) min OST has 3497984kB available, using 5246976kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6980] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5124] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg359-clien 5124M 89311 67 61968 49 144208 30 630.0 111 Latency 25047us 132ms 84872us 800ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg359-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 257 18 7062 29 395 13 344 17 858 12 431 13 Latency 20931us 16223us 52568us 14679us 4794us 12877us 1.97,1.97,oleg359-client.virtnet,1,1734005474,5124M,,,,89311,67,61968,49,,,144208,30,630.0,111,10,,,,,257,18,7062,29,395,13,344,17,858,12,431,13,,25047us,132ms,,84872us,800ms,20931us,16223us,52568us,14679us,4794us,12877us debug=0x33f0484 PASS bonnie (334s) == sanity-benchmark test iozone: iozone ================== 10:12:10 (1734016330) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6980] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:27 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 150504 145205 122823 182402 72104 101161 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:17:52 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 24002 24687 109312 105557 88211 32632 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1168s) == sanity-benchmark test fsx: fsx ======================== 10:31:38 (1734017498) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 3935 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 3935 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read truncating to largest ever: 0x168d3d truncating to largest ever: 0x3ac36c truncating to largest ever: 0x42c4a0 truncating to largest ever: 0x4fb14a truncating to largest ever: 0x53aef2 truncating to largest ever: 0x5523de truncating to largest ever: 0x556dd9 002000 1734017505.091520 mapwrite 0x4e714d thru 0x4e9f1d (0x2dd1 bytes) truncating to largest ever: 0x557dfc truncating to largest ever: 0x560e9d truncating to largest ever: 0x5615d4 003000 1734017508.291591 mapwrite 0x1a9685 thru 0x1aa490 (0xe0c bytes) 004000 1734017511.465907 mapread 0x069838 thru 0x074373 (0xab3c bytes) 006000 1734017516.981507 mapwrite 0x143979 thru 0x151d4d (0xe3d5 bytes) 007000 1734017520.044608 trunc from 0x3631bb to 0x3632a7 (0xed bytes) 008000 1734017523.412090 mapwrite 0x21e4f3 thru 0x2264a9 (0x7fb7 bytes) 010000 1734017529.347273 mapread 0x0029a2 thru 0x00c013 (0x9672 bytes) 011000 1734017532.387676 trunc from 0x2efb2b to 0x37202a (0x82500 bytes) 012000 1734017535.195800 read 0x1dd0bf thru 0x1e0731 (0x3673 bytes) 013000 1734017537.775658 mapread 0x0ea867 thru 0x0f80e2 (0xd87c bytes) 020000 1734017559.556845 write 0x548560 thru 0x552b19 (0xa5ba bytes) 021000 1734017562.393690 trunc from 0x2489d0 to 0x38f132 (0x146763 bytes) 022000 1734017565.084918 read 0x0ec477 thru 0x0ecb36 (0x6c0 bytes) 023000 1734017567.796329 mapread 0x0738e0 thru 0x07ddc7 (0xa4e8 bytes) 024000 1734017570.606494 mapread 0x1ce019 thru 0x1d2eab (0x4e93 bytes) truncating to largest ever: 0x5616c1 025000 1734017573.425872 trunc from 0x3fa469 to 0x0a387f (0x356be9 bytes) 026000 1734017576.026492 write 0x38254b thru 0x384133 (0x1be9 bytes) 027000 1734017579.045354 trunc from 0x33f4d6 to 0x29feda (0x9f5fb bytes) 028000 1734017581.702726 read 0x084803 thru 0x093b9f (0xf39d bytes) 029000 1734017584.868795 read 0x3d7404 thru 0x3d8be7 (0x17e4 bytes) 030000 1734017587.521646 mapwrite 0x41c773 thru 0x41e844 (0x20d2 bytes) 031000 1734017590.533375 mapread 0x03ed1c thru 0x0455b6 (0x689b bytes) 032000 1734017593.519085 mapread 0x0da0af thru 0x0e24ae (0x8400 bytes) 033000 1734017596.703377 write 0x4f44fc thru 0x4f4dc4 (0x8c9 bytes) 035000 1734017602.946177 trunc from 0x1a5825 to 0x0e69fb (0xbee29 bytes) 036000 1734017605.938900 mapread 0x0023bb thru 0x00713e (0x4d84 bytes) 037000 1734017608.820027 write 0x039371 thru 0x042cde (0x996e bytes) 039000 1734017614.941752 mapwrite 0x42ffa7 thru 0x433155 (0x31af bytes) 043000 1734017625.605443 trunc from 0x504563 to 0x237080 (0x2cd4e2 bytes) 044000 1734017628.680477 trunc from 0x509f8c to 0x370a77 (0x199514 bytes) 045000 1734017631.622076 write 0x44b629 thru 0x450c48 (0x5620 bytes) 046000 1734017634.498016 mapwrite 0x44c975 thru 0x45198a (0x5016 bytes) truncating to largest ever: 0x56187d 048000 1734017639.899084 trunc from 0x425450 to 0x2d4516 (0x150f39 bytes) 049000 1734017642.546538 mapwrite 0x555543 thru 0x561bff (0xc6bd bytes) 051000 1734017648.311642 mapread 0x2fb594 thru 0x30854c (0xcfb9 bytes) 052000 1734017651.337973 write 0x25c0a4 thru 0x26bb41 (0xfa9e bytes) 054000 1734017656.441616 trunc from 0x35c6df to 0x0d762a (0x2850b4 bytes) 056000 1734017661.852786 trunc from 0x4a4904 to 0x175222 (0x32f6e1 bytes) 057000 1734017664.786377 write 0x401d31 thru 0x40f3ee (0xd6be bytes) 058000 1734017667.460954 trunc from 0x4eda05 to 0x5457d9 (0x57dd5 bytes) 061000 1734017676.061055 mapwrite 0x1ad8b1 thru 0x1b4cc6 (0x7416 bytes) 063000 1734017681.342914 mapread 0x00d533 thru 0x00f5f9 (0x20c7 bytes) 064000 1734017684.327339 read 0x037001 thru 0x03b840 (0x4840 bytes) 065000 1734017686.918075 read 0x483611 thru 0x48c0dc (0x8acc bytes) 066000 1734017690.015912 read 0x209727 thru 0x20cfe2 (0x38bc bytes) 068000 1734017694.903485 mapwrite 0x1da005 thru 0x1e574e (0xb74a bytes) 069000 1734017697.352640 mapread 0x3a1844 thru 0x3a3b7b (0x2338 bytes) 071000 1734017702.289907 mapread 0x046132 thru 0x04a13c (0x400b bytes) 073000 1734017707.295956 read 0x20cebe thru 0x20f7c9 (0x290c bytes) 074000 1734017710.377123 trunc from 0x303790 to 0x2b1cbe (0x51ad1 bytes) 075000 1734017713.217867 mapwrite 0x477650 thru 0x484c21 (0xd5d2 bytes) 076000 1734017715.992034 mapread 0x0484f4 thru 0x056983 (0xe490 bytes) 077000 1734017718.566525 trunc from 0x3cb8ae to 0x23bf43 (0x18f96a bytes) 079000 1734017723.578478 read 0x14c645 thru 0x14cdc8 (0x784 bytes) 082000 1734017731.256272 mapwrite 0x2184f5 thru 0x223bea (0xb6f6 bytes) 083000 1734017733.904549 write 0x138530 thru 0x146537 (0xe008 bytes) 085000 1734017738.949609 write 0x3f9bd0 thru 0x3fa4eb (0x91c bytes) 088000 1734017747.390273 read 0x1c21d5 thru 0x1d0d30 (0xeb5c bytes) 090000 1734017752.684010 trunc from 0x058680 to 0x120e18 (0xc8799 bytes) 091000 1734017755.612600 mapwrite 0x3f0d70 thru 0x3f6b51 (0x5de2 bytes) 093000 1734017763.697882 mapwrite 0x041cbf thru 0x049a2c (0x7d6e bytes) 094000 1734017767.634724 mapread 0x16b913 thru 0x171859 (0x5f47 bytes) 095000 1734017770.529070 trunc from 0x2fa09c to 0x1e3820 (0x11687b bytes) 097000 1734017777.715371 mapwrite 0x539344 thru 0x53fd93 (0x6a50 bytes) 100000 1734017789.459090 read 0x04fd0b thru 0x057d58 (0x804e bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 5517327 (5504 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (292s) == sanity-benchmark test complete, duration 1964 sec ===== 10:36:30 (1734017790) === sanity-benchmark: start cleanup 10:36:30 (1734017790) === === sanity-benchmark: finish cleanup 10:36:31 (1734017791) ===