-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:47 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:52 (1734015832) === oleg309-client.virtnet: executing check_config_client /mnt/lustre oleg309-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg309-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b607f800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b607f800.idle_timeout=debug disable quota as required oleg309-server: oleg309-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:05 (1734015845) === == sanity-benchmark test dbench: dbench ================== 10:04:06 (1734015846) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7727] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg309-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg309-client.virtnet at Thu Dec 12 10:04:08 EST 2024 waiting for dbench pid 10312 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 16 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 1 6 1.05 MB/sec warmup 1 sec latency 943.866 ms 12 61 26.42 MB/sec warmup 2 sec latency 665.101 ms 20 129 38.54 MB/sec warmup 3 sec latency 233.046 ms 20 189 37.87 MB/sec warmup 4 sec latency 158.822 ms 20 261 39.39 MB/sec warmup 5 sec latency 102.857 ms 20 332 40.06 MB/sec warmup 6 sec latency 109.546 ms 20 403 40.84 MB/sec warmup 7 sec latency 120.370 ms 20 472 41.28 MB/sec warmup 8 sec latency 130.223 ms 20 569 43.11 MB/sec warmup 9 sec latency 116.181 ms 20 661 42.22 MB/sec warmup 10 sec latency 418.579 ms 20 696 38.50 MB/sec warmup 11 sec latency 278.878 ms 20 731 35.48 MB/sec warmup 12 sec latency 305.546 ms 20 779 32.88 MB/sec warmup 13 sec latency 188.157 ms 20 806 30.67 MB/sec warmup 14 sec latency 297.111 ms 20 875 28.84 MB/sec warmup 15 sec latency 245.538 ms 20 920 27.18 MB/sec warmup 16 sec latency 239.829 ms 20 970 25.72 MB/sec warmup 17 sec latency 324.119 ms 20 1018 24.71 MB/sec warmup 18 sec latency 449.397 ms 20 1108 24.14 MB/sec warmup 19 sec latency 90.120 ms 20 1171 23.00 MB/sec warmup 20 sec latency 102.464 ms 20 1232 22.09 MB/sec warmup 21 sec latency 107.838 ms 20 1324 22.06 MB/sec warmup 22 sec latency 99.708 ms 20 1432 22.61 MB/sec warmup 23 sec latency 265.165 ms 20 1558 1.30 MB/sec execute 1 sec latency 343.609 ms 20 1632 1.28 MB/sec execute 2 sec latency 260.847 ms 20 1697 1.22 MB/sec execute 3 sec latency 245.807 ms 20 1780 1.26 MB/sec execute 4 sec latency 79.936 ms 20 1844 1.20 MB/sec execute 5 sec latency 246.980 ms 20 1903 1.17 MB/sec execute 6 sec latency 264.717 ms 20 1968 1.22 MB/sec execute 7 sec latency 301.945 ms 20 2038 1.28 MB/sec execute 8 sec latency 85.412 ms 20 2105 1.34 MB/sec execute 9 sec latency 100.672 ms 20 2166 1.43 MB/sec execute 10 sec latency 107.270 ms 20 2230 1.94 MB/sec execute 11 sec latency 294.852 ms 20 2292 2.16 MB/sec execute 12 sec latency 340.443 ms 20 2375 2.91 MB/sec execute 13 sec latency 308.700 ms 20 2410 2.91 MB/sec execute 14 sec latency 343.725 ms 20 2451 3.07 MB/sec execute 15 sec latency 518.146 ms 20 2523 3.45 MB/sec execute 16 sec latency 417.106 ms 20 2617 4.29 MB/sec execute 17 sec latency 321.016 ms 20 2720 5.16 MB/sec execute 18 sec latency 322.550 ms 20 2846 6.82 MB/sec execute 19 sec latency 444.775 ms 20 2912 6.93 MB/sec execute 20 sec latency 1147.495 ms 20 2997 7.18 MB/sec execute 21 sec latency 1070.333 ms 20 3099 7.16 MB/sec execute 22 sec latency 454.004 ms 20 3230 7.48 MB/sec execute 23 sec latency 403.940 ms 20 3327 7.78 MB/sec execute 24 sec latency 319.308 ms 20 3430 8.33 MB/sec execute 25 sec latency 275.435 ms 20 3573 9.46 MB/sec execute 26 sec latency 142.623 ms 20 3663 9.41 MB/sec execute 27 sec latency 81.992 ms 20 3728 9.31 MB/sec execute 28 sec latency 137.642 ms 20 3792 9.35 MB/sec execute 29 sec latency 117.316 ms 20 3839 9.15 MB/sec execute 30 sec latency 156.891 ms 20 3892 8.92 MB/sec execute 31 sec latency 109.190 ms 20 3947 8.74 MB/sec execute 32 sec latency 96.093 ms 20 3987 8.48 MB/sec execute 33 sec latency 128.638 ms 20 4036 8.24 MB/sec execute 34 sec latency 93.697 ms 20 4091 8.01 MB/sec execute 35 sec latency 198.589 ms 20 4158 7.82 MB/sec execute 36 sec latency 409.798 ms 20 4227 7.66 MB/sec execute 37 sec latency 337.083 ms 20 4253 7.50 MB/sec execute 38 sec latency 534.131 ms 20 4289 7.34 MB/sec execute 39 sec latency 328.519 ms 20 4322 7.20 MB/sec execute 40 sec latency 288.923 ms 20 4365 7.07 MB/sec execute 41 sec latency 246.103 ms 20 4400 6.95 MB/sec execute 42 sec latency 322.116 ms 20 4441 6.83 MB/sec execute 43 sec latency 374.355 ms 20 4492 6.75 MB/sec execute 44 sec latency 385.239 ms 20 4535 6.70 MB/sec execute 45 sec latency 373.230 ms 20 4596 6.66 MB/sec execute 46 sec latency 292.552 ms 20 4666 6.80 MB/sec execute 47 sec latency 347.859 ms 20 4747 6.76 MB/sec execute 48 sec latency 91.157 ms 20 4822 6.88 MB/sec execute 49 sec latency 114.180 ms 20 4884 6.87 MB/sec execute 50 sec latency 311.041 ms 20 4997 7.48 MB/sec execute 51 sec latency 354.308 ms 20 5053 7.35 MB/sec execute 52 sec latency 208.324 ms 20 5106 7.22 MB/sec execute 53 sec latency 292.239 ms 20 5166 7.11 MB/sec execute 54 sec latency 233.953 ms 20 5223 7.00 MB/sec execute 55 sec latency 208.858 ms 20 5286 6.89 MB/sec execute 56 sec latency 219.737 ms 20 5334 6.79 MB/sec execute 57 sec latency 151.895 ms 20 5394 6.69 MB/sec execute 58 sec latency 225.092 ms 20 5454 6.59 MB/sec execute 59 sec latency 252.373 ms 20 5511 6.50 MB/sec execute 60 sec latency 280.564 ms 20 5609 6.43 MB/sec execute 61 sec latency 211.531 ms 20 5679 6.38 MB/sec execute 62 sec latency 96.100 ms 20 5779 6.40 MB/sec execute 63 sec latency 236.688 ms 20 5844 6.37 MB/sec execute 64 sec latency 252.690 ms 20 5933 6.47 MB/sec execute 65 sec latency 258.359 ms 20 5984 6.45 MB/sec execute 66 sec latency 323.335 ms 20 6055 6.47 MB/sec execute 67 sec latency 399.017 ms 20 6141 6.67 MB/sec execute 68 sec latency 356.730 ms 20 6253 6.81 MB/sec execute 69 sec latency 414.338 ms 20 6373 7.12 MB/sec execute 70 sec latency 313.257 ms 20 6493 7.34 MB/sec execute 71 sec latency 374.304 ms 20 6613 7.47 MB/sec execute 72 sec latency 359.422 ms 20 6718 7.51 MB/sec execute 73 sec latency 318.156 ms 20 6851 7.60 MB/sec execute 74 sec latency 293.364 ms 20 6980 7.87 MB/sec execute 75 sec latency 247.362 ms 20 7075 8.04 MB/sec execute 76 sec latency 205.570 ms 20 7176 8.22 MB/sec execute 77 sec latency 76.163 ms 20 7251 8.23 MB/sec execute 78 sec latency 107.176 ms 20 7301 8.18 MB/sec execute 79 sec latency 146.773 ms 20 7359 8.19 MB/sec execute 80 sec latency 111.424 ms 20 7409 8.12 MB/sec execute 81 sec latency 154.715 ms 20 7466 8.04 MB/sec execute 82 sec latency 94.417 ms 20 7525 7.98 MB/sec execute 83 sec latency 94.775 ms 20 7563 7.88 MB/sec execute 84 sec latency 135.319 ms 20 7609 7.79 MB/sec execute 85 sec latency 263.900 ms 20 7673 7.72 MB/sec execute 86 sec latency 368.648 ms 20 7722 7.64 MB/sec execute 87 sec latency 398.738 ms 20 7783 7.57 MB/sec execute 88 sec latency 297.991 ms 20 7810 7.50 MB/sec execute 89 sec latency 525.912 ms 20 7847 7.43 MB/sec execute 90 sec latency 357.322 ms 20 7883 7.38 MB/sec execute 91 sec latency 380.300 ms 20 7932 7.32 MB/sec execute 92 sec latency 244.376 ms 20 7975 7.27 MB/sec execute 93 sec latency 231.901 ms 20 8027 7.22 MB/sec execute 94 sec latency 291.310 ms 20 8079 7.20 MB/sec execute 95 sec latency 247.495 ms 20 8149 7.21 MB/sec execute 96 sec latency 299.237 ms 20 8212 7.19 MB/sec execute 97 sec latency 259.567 ms 20 8302 7.21 MB/sec execute 98 sec latency 75.371 ms 20 8387 7.31 MB/sec execute 99 sec latency 100.952 ms 20 8469 7.40 MB/sec execute 100 sec latency 279.278 ms 20 8556 7.51 MB/sec execute 101 sec latency 291.809 ms 20 8616 7.49 MB/sec execute 102 sec latency 273.816 ms 20 8676 7.43 MB/sec execute 103 sec latency 195.024 ms 20 8737 7.37 MB/sec execute 104 sec latency 226.667 ms 20 8794 7.31 MB/sec execute 105 sec latency 195.663 ms 20 8855 7.25 MB/sec execute 106 sec latency 223.062 ms 20 8915 7.19 MB/sec execute 107 sec latency 147.275 ms 20 8985 7.14 MB/sec execute 108 sec latency 189.751 ms 20 9057 7.08 MB/sec execute 109 sec latency 210.391 ms 20 9142 7.04 MB/sec execute 110 sec latency 279.326 ms 20 9222 7.00 MB/sec execute 111 sec latency 76.004 ms 20 9328 7.00 MB/sec execute 112 sec latency 180.218 ms 20 9414 7.02 MB/sec execute 113 sec latency 181.666 ms 20 9519 7.07 MB/sec execute 114 sec latency 248.097 ms 20 9614 7.11 MB/sec execute 115 sec latency 206.012 ms 20 9746 7.33 MB/sec execute 116 sec latency 207.113 ms 20 9884 7.45 MB/sec execute 117 sec latency 288.678 ms 20 10047 7.66 MB/sec execute 118 sec latency 241.388 ms 20 10203 7.77 MB/sec execute 119 sec latency 257.712 ms 20 cleanup 120 sec 20 cleanup 121 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 29883 39.927 178.649 Close 22342 10.024 53.349 Rename 1267 59.467 180.851 Unlink 5542 13.117 70.072 Qpathinfo 28248 9.555 131.305 Qfileinfo 5178 0.161 24.301 Qfsinfo 4716 0.181 27.493 Sfileinfo 2320 39.430 140.466 Find 10676 2.250 89.550 WriteX 15315 4.277 82.861 ReadX 48942 0.026 9.912 LockX 120 11.082 50.436 UnlockX 120 10.690 41.676 Flush 2038 185.947 1147.483 Throughput 7.76754 MB/sec 20 clients 20 procs max_latency=1147.495 ms stopping dbench on /mnt/lustre/d0.oleg309-client.virtnet at Thu Dec 12 10:06:34 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg309-client.virtnet /mnt/lustre/d0.oleg309-client.virtnet /mnt/lustre/d0.oleg309-client.virtnet removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg309-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:42 (1734016002) min OST has 3204096kB available, using 4806144kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7727] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4693] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg309-clien 4693M 90037 68 63233 50 148912 31 653.2 114 Latency 19477us 66787us 85060us 702ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg309-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 218 17 8377 36 399 12 316 18 1004 12 458 12 Latency 28609us 12811us 54479us 19670us 4012us 12994us 1.97,1.97,oleg309-client.virtnet,1,1734004878,4693M,,,,90037,68,63233,50,,,148912,31,653.2,114,10,,,,,218,17,8377,36,399,12,316,18,1004,12,458,12,,19477us,66787us,,85060us,702ms,28609us,12811us,54479us,19670us,4012us,12994us debug=0x33f0484 PASS bonnie (320s) == sanity-benchmark test iozone: iozone ================== 10:12:02 (1734016322) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7727] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:18 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 194840 144695 123437 144785 72476 101729 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:17:43 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 25546 25211 104462 110628 90510 32397 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1149s) == sanity-benchmark test fsx: fsx ======================== 10:31:11 (1734017471) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 16615 -P /tmp -l 5641728 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 16615 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x16b5c truncating to largest ever: 0x502644 truncating to largest ever: 0x527dbd truncating to largest ever: 0x5580c3 truncating to largest ever: 0x55f357 001000 1734017474.239432 mapread 0x2bb928 thru 0x2ca75a (0xee33 bytes) 004000 1734017482.890092 mapwrite 0x144527 thru 0x1455fe (0x10d8 bytes) 005000 1734017485.954046 mapread 0x1fd0a3 thru 0x20865d (0xb5bb bytes) truncating to largest ever: 0x55f659 skipping zero size read 007000 1734017491.096705 mapwrite 0x3dee74 thru 0x3e68d5 (0x7a62 bytes) 009000 1734017496.141185 mapwrite 0x012985 thru 0x016244 (0x38c0 bytes) 010000 1734017498.764775 mapwrite 0x01c99d thru 0x01fb4f (0x31b3 bytes) truncating to largest ever: 0x560f3a 018000 1734017522.266050 read 0x098be9 thru 0x0a076f (0x7b87 bytes) 019000 1734017525.332518 mapwrite 0x23fbe1 thru 0x24747a (0x789a bytes) 020000 1734017528.663366 mapread 0x47b8ba thru 0x47f9c6 (0x410d bytes) 021000 1734017532.125623 mapwrite 0x4a4d4c thru 0x4a8343 (0x35f8 bytes) 024000 1734017540.639990 read 0x31cbfb thru 0x3265ff (0x9a05 bytes) 025000 1734017543.496591 read 0x533764 thru 0x543153 (0xf9f0 bytes) 026000 1734017546.821912 mapwrite 0x147d4d thru 0x14d1e7 (0x549b bytes) 032000 1734017563.427545 trunc from 0x46951d to 0x0ca661 (0x39eebb bytes) 035000 1734017572.548174 trunc from 0x1f1a6a to 0x05820c (0x19985d bytes) 041000 1734017589.399566 read 0x081538 thru 0x083fa5 (0x2a6e bytes) truncating to largest ever: 0x560ff8 043000 1734017595.252687 write 0x385e3d thru 0x38809d (0x2261 bytes) 046000 1734017603.968449 read 0x07154c thru 0x072bc8 (0x167d bytes) 047000 1734017606.827504 mapwrite 0x011e32 thru 0x01cc85 (0xae54 bytes) 048000 1734017609.858181 trunc from 0x461f93 to 0x5108e7 (0xae955 bytes) 050000 1734017615.626005 trunc from 0x43b3cc to 0x2bc4cb (0x17ef00 bytes) 051000 1734017618.293969 mapread 0x053eab thru 0x05c938 (0x8a8e bytes) 054000 1734017626.747680 mapread 0x0637a4 thru 0x06e130 (0xa98d bytes) 055000 1734017629.616373 mapwrite 0x3877dd thru 0x393a23 (0xc247 bytes) 056000 1734017631.956152 mapread 0x0be2ea thru 0x0c869d (0xa3b4 bytes) 063000 1734017650.691692 mapread 0x08c38b thru 0x099194 (0xce0a bytes) 067000 1734017662.037103 trunc from 0x0fe1c1 to 0x556467 (0x4582a7 bytes) 070000 1734017670.734489 mapwrite 0x4dfea5 thru 0x4e4368 (0x44c4 bytes) 073000 1734017679.595362 write 0x154475 thru 0x15569e (0x122a bytes) skipping zero size write 077000 1734017691.490107 read 0x257f0e thru 0x2665f5 (0xe6e8 bytes) 078000 1734017694.234912 trunc from 0x36e953 to 0x48c51e (0x11dbcc bytes) 079000 1734017696.759440 mapwrite 0x2f1be3 thru 0x2f1df4 (0x212 bytes) 081000 1734017701.955062 mapread 0x0ad1bf thru 0x0b1fd5 (0x4e17 bytes) 084000 1734017710.689508 read 0x3eaebd thru 0x3f3b12 (0x8c56 bytes) 086000 1734017716.064700 read 0x4140f6 thru 0x418a0a (0x4915 bytes) 088000 1734017721.200525 trunc from 0x06dc95 to 0x2c0826 (0x252b92 bytes) 091000 1734017728.668679 mapread 0x1fd212 thru 0x2026cd (0x54bc bytes) 092000 1734017731.220944 mapread 0x0643dd thru 0x064509 (0x12d bytes) 093000 1734017733.652321 mapread 0x0bb4f5 thru 0x0c57f7 (0xa303 bytes) 100000 1734017753.158938 write 0x3c602f thru 0x3cb73e (0x5710 bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 5219734 (5120 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (283s) == sanity-benchmark test complete, duration 1927 sec ===== 10:35:54 (1734017754) === sanity-benchmark: start cleanup 10:35:54 (1734017754) === === sanity-benchmark: finish cleanup 10:35:55 (1734017755) ===