-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:41 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:45 (1734015825) === oleg333-client.virtnet: executing check_config_client /mnt/lustre oleg333-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg333-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6ca3000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6ca3000.idle_timeout=debug disable quota as required oleg333-server: oleg333-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:03:53 (1734015833) === == sanity-benchmark test dbench: dbench ================== 10:03:54 (1734015834) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6969] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg333-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg333-client.virtnet at Thu Dec 12 10:03:55 EST 2024 waiting for dbench pid 9436 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 14 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 92 84.11 MB/sec warmup 1 sec latency 128.843 ms 20 178 72.30 MB/sec warmup 2 sec latency 150.145 ms 20 284 70.57 MB/sec warmup 3 sec latency 92.483 ms 20 369 65.80 MB/sec warmup 4 sec latency 101.168 ms 20 464 64.92 MB/sec warmup 5 sec latency 146.281 ms 20 594 67.55 MB/sec warmup 6 sec latency 126.174 ms 20 674 60.43 MB/sec warmup 7 sec latency 318.895 ms 20 724 53.20 MB/sec warmup 8 sec latency 246.411 ms 20 782 47.50 MB/sec warmup 9 sec latency 172.841 ms 20 822 42.98 MB/sec warmup 10 sec latency 231.916 ms 20 885 39.38 MB/sec warmup 11 sec latency 223.718 ms 20 931 36.28 MB/sec warmup 12 sec latency 223.232 ms 20 982 33.74 MB/sec warmup 13 sec latency 252.080 ms 20 1045 32.36 MB/sec warmup 14 sec latency 304.337 ms 20 1117 30.60 MB/sec warmup 15 sec latency 103.386 ms 20 1179 28.76 MB/sec warmup 16 sec latency 116.912 ms 20 1249 27.48 MB/sec warmup 17 sec latency 96.573 ms 20 1334 27.02 MB/sec warmup 18 sec latency 95.310 ms 20 1434 27.37 MB/sec warmup 19 sec latency 265.084 ms 20 1494 26.04 MB/sec warmup 20 sec latency 185.544 ms 20 1544 24.84 MB/sec warmup 21 sec latency 205.749 ms 20 1606 23.77 MB/sec warmup 22 sec latency 202.191 ms 20 1647 22.76 MB/sec warmup 23 sec latency 209.256 ms 20 1762 0.92 MB/sec execute 1 sec latency 224.678 ms 20 1821 0.96 MB/sec execute 2 sec latency 205.080 ms 20 1876 0.96 MB/sec execute 3 sec latency 203.260 ms 20 1935 0.98 MB/sec execute 4 sec latency 194.560 ms 20 2005 1.14 MB/sec execute 5 sec latency 188.224 ms 20 2062 1.20 MB/sec execute 6 sec latency 102.784 ms 20 2118 1.24 MB/sec execute 7 sec latency 99.045 ms 20 2174 1.34 MB/sec execute 8 sec latency 118.550 ms 20 2240 1.89 MB/sec execute 9 sec latency 234.659 ms 20 2311 2.57 MB/sec execute 10 sec latency 375.553 ms 20 2386 3.22 MB/sec execute 11 sec latency 415.189 ms 20 2435 3.33 MB/sec execute 12 sec latency 326.184 ms 20 2493 3.65 MB/sec execute 13 sec latency 335.509 ms 20 2573 4.21 MB/sec execute 14 sec latency 373.116 ms 20 2643 5.13 MB/sec execute 15 sec latency 425.968 ms 20 2736 6.07 MB/sec execute 16 sec latency 962.173 ms 20 2865 7.74 MB/sec execute 17 sec latency 322.585 ms 20 2962 7.81 MB/sec execute 18 sec latency 321.695 ms 20 3039 7.90 MB/sec execute 19 sec latency 408.602 ms 20 3146 7.93 MB/sec execute 20 sec latency 383.011 ms 20 3254 8.36 MB/sec execute 21 sec latency 497.767 ms 20 3357 8.70 MB/sec execute 22 sec latency 281.903 ms 20 3456 9.21 MB/sec execute 23 sec latency 246.947 ms 20 3559 9.89 MB/sec execute 24 sec latency 83.177 ms 20 3641 9.95 MB/sec execute 25 sec latency 96.739 ms 20 3707 9.82 MB/sec execute 26 sec latency 99.179 ms 20 3759 9.76 MB/sec execute 27 sec latency 165.095 ms 20 3807 9.64 MB/sec execute 28 sec latency 113.956 ms 20 3848 9.36 MB/sec execute 29 sec latency 100.049 ms 20 3890 9.08 MB/sec execute 30 sec latency 92.248 ms 20 3933 8.87 MB/sec execute 31 sec latency 92.374 ms 20 3963 8.63 MB/sec execute 32 sec latency 184.975 ms 20 3996 8.37 MB/sec execute 33 sec latency 161.009 ms 20 4034 8.13 MB/sec execute 34 sec latency 131.263 ms 20 4079 7.90 MB/sec execute 35 sec latency 318.698 ms 20 4128 7.70 MB/sec execute 36 sec latency 369.181 ms 20 4188 7.52 MB/sec execute 37 sec latency 311.816 ms 20 4238 7.38 MB/sec execute 38 sec latency 439.333 ms 20 4267 7.22 MB/sec execute 39 sec latency 351.716 ms 20 4302 7.08 MB/sec execute 40 sec latency 383.738 ms 20 4333 6.95 MB/sec execute 41 sec latency 354.498 ms 20 4378 6.83 MB/sec execute 42 sec latency 239.369 ms 20 4410 6.71 MB/sec execute 43 sec latency 264.013 ms 20 4466 6.64 MB/sec execute 44 sec latency 329.511 ms 20 4495 6.52 MB/sec execute 45 sec latency 643.057 ms 20 4543 6.48 MB/sec execute 46 sec latency 643.502 ms 20 4600 6.46 MB/sec execute 47 sec latency 279.662 ms 20 4672 6.60 MB/sec execute 48 sec latency 317.320 ms 20 4745 6.54 MB/sec execute 49 sec latency 102.131 ms 20 4814 6.60 MB/sec execute 50 sec latency 188.451 ms 20 4876 6.63 MB/sec execute 51 sec latency 106.416 ms 20 4955 6.95 MB/sec execute 52 sec latency 233.185 ms 20 5025 7.13 MB/sec execute 53 sec latency 215.916 ms 20 5073 7.01 MB/sec execute 54 sec latency 214.702 ms 20 5114 6.90 MB/sec execute 55 sec latency 244.390 ms 20 5163 6.79 MB/sec execute 56 sec latency 188.515 ms 20 5199 6.68 MB/sec execute 57 sec latency 180.618 ms 20 5239 6.58 MB/sec execute 58 sec latency 283.008 ms 20 5285 6.48 MB/sec execute 59 sec latency 208.213 ms 20 5329 6.38 MB/sec execute 60 sec latency 177.615 ms 20 5379 6.29 MB/sec execute 61 sec latency 85.870 ms 20 5420 6.20 MB/sec execute 62 sec latency 196.913 ms 20 5470 6.12 MB/sec execute 63 sec latency 179.976 ms 20 5517 6.04 MB/sec execute 64 sec latency 230.425 ms 20 5587 5.97 MB/sec execute 65 sec latency 195.629 ms 20 5647 5.92 MB/sec execute 66 sec latency 94.929 ms 20 5699 5.85 MB/sec execute 67 sec latency 196.346 ms 20 5781 5.86 MB/sec execute 68 sec latency 181.804 ms 20 5839 5.85 MB/sec execute 69 sec latency 229.756 ms 20 5912 5.90 MB/sec execute 70 sec latency 316.342 ms 20 5967 5.92 MB/sec execute 71 sec latency 391.559 ms 20 6029 5.94 MB/sec execute 72 sec latency 347.477 ms 20 6101 5.98 MB/sec execute 73 sec latency 315.005 ms 20 6190 6.19 MB/sec execute 74 sec latency 355.623 ms 20 6299 6.37 MB/sec execute 75 sec latency 389.726 ms 20 6398 6.57 MB/sec execute 76 sec latency 310.751 ms 20 6521 6.76 MB/sec execute 77 sec latency 405.093 ms 20 6639 6.90 MB/sec execute 78 sec latency 321.114 ms 20 6743 6.95 MB/sec execute 79 sec latency 320.666 ms 20 6871 7.03 MB/sec execute 80 sec latency 380.311 ms 20 6972 7.26 MB/sec execute 81 sec latency 293.463 ms 20 7071 7.42 MB/sec execute 82 sec latency 235.644 ms 20 7167 7.59 MB/sec execute 83 sec latency 86.676 ms 20 7226 7.55 MB/sec execute 84 sec latency 116.174 ms 20 7284 7.55 MB/sec execute 85 sec latency 105.113 ms 20 7327 7.51 MB/sec execute 86 sec latency 174.464 ms 20 7375 7.50 MB/sec execute 87 sec latency 126.180 ms 20 7417 7.44 MB/sec execute 88 sec latency 103.723 ms 20 7460 7.37 MB/sec execute 89 sec latency 101.508 ms 20 7502 7.31 MB/sec execute 90 sec latency 124.735 ms 20 7535 7.24 MB/sec execute 91 sec latency 161.700 ms 20 7576 7.16 MB/sec execute 92 sec latency 349.347 ms 20 7624 7.09 MB/sec execute 93 sec latency 116.340 ms 20 7678 7.02 MB/sec execute 94 sec latency 296.959 ms 20 7726 6.96 MB/sec execute 95 sec latency 391.092 ms 20 7785 6.90 MB/sec execute 96 sec latency 336.138 ms 20 7818 6.85 MB/sec execute 97 sec latency 441.474 ms 20 7853 6.79 MB/sec execute 98 sec latency 278.421 ms 20 7891 6.74 MB/sec execute 99 sec latency 312.567 ms 20 7932 6.70 MB/sec execute 100 sec latency 251.887 ms 20 7985 6.66 MB/sec execute 101 sec latency 286.264 ms 20 8028 6.62 MB/sec execute 102 sec latency 244.830 ms 20 8068 6.58 MB/sec execute 103 sec latency 291.946 ms 20 8119 6.58 MB/sec execute 104 sec latency 290.694 ms 20 8181 6.62 MB/sec execute 105 sec latency 268.322 ms 20 8239 6.59 MB/sec execute 106 sec latency 311.384 ms 20 8309 6.60 MB/sec execute 107 sec latency 112.838 ms 20 8372 6.58 MB/sec execute 108 sec latency 93.747 ms 20 8448 6.71 MB/sec execute 109 sec latency 230.372 ms 20 8519 6.80 MB/sec execute 110 sec latency 173.629 ms 20 8580 6.85 MB/sec execute 111 sec latency 274.650 ms 20 8622 6.79 MB/sec execute 112 sec latency 284.596 ms 20 8672 6.74 MB/sec execute 113 sec latency 175.278 ms 20 8711 6.69 MB/sec execute 114 sec latency 232.848 ms 20 8758 6.64 MB/sec execute 115 sec latency 310.695 ms 20 8805 6.59 MB/sec execute 116 sec latency 186.286 ms 20 8851 6.54 MB/sec execute 117 sec latency 171.098 ms 20 8906 6.49 MB/sec execute 118 sec latency 165.257 ms 20 8950 6.44 MB/sec execute 119 sec latency 166.998 ms 20 cleanup 120 sec 20 cleanup 121 sec 19 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 25561 49.730 184.961 Close 18768 11.558 71.506 Rename 1049 71.124 187.336 Unlink 5019 15.791 63.658 Qpathinfo 23458 11.552 121.078 Qfileinfo 4023 0.265 31.167 Qfsinfo 4080 0.170 16.075 Sfileinfo 2000 41.511 157.669 Find 8788 2.704 126.296 WriteX 12293 3.721 63.129 ReadX 39165 0.025 6.569 LockX 80 17.512 45.217 UnlockX 80 16.649 42.953 Flush 1735 190.402 962.167 Throughput 6.44079 MB/sec 20 clients 20 procs max_latency=962.173 ms stopping dbench on /mnt/lustre/d0.oleg333-client.virtnet at Thu Dec 12 10:06:22 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg333-client.virtnet /mnt/lustre/d0.oleg333-client.virtnet /mnt/lustre/d0.oleg333-client.virtnet removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg333-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (154s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:29 (1734015989) min OST has 3512320kB available, using 5268480kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6969] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5145] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg333-clien 5145M 91182 67 65901 51 147234 31 623.0 111 Latency 24947us 139ms 95549us 394ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg333-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 224 18 7565 31 419 13 319 18 1030 12 493 13 Latency 26046us 13252us 50362us 13502us 3386us 11097us 1.97,1.97,oleg333-client.virtnet,1,1734005490,5145M,,,,91182,67,65901,51,,,147234,31,623.0,111,10,,,,,224,18,7565,31,419,13,319,18,1030,12,493,13,,24947us,139ms,,95549us,394ms,26046us,13252us,50362us,13502us,3386us,11097us debug=0x33f0484 PASS bonnie (328s) == sanity-benchmark test iozone: iozone ================== 10:11:57 (1734016317) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6969] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:17 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 191757 143940 126825 142821 74323 102910 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:17:42 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 25458 25039 104422 109820 89908 32687 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1152s) == sanity-benchmark test fsx: fsx ======================== 10:31:09 (1734017469) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 9419 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 9419 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x3f02f6 truncating to largest ever: 0x495546 truncating to largest ever: 0x4e8b53 truncating to largest ever: 0x55b187 004000 1734017481.004598 trunc from 0x3e2ad9 to 0x02ff26 (0x3b2bb2 bytes) truncating to largest ever: 0x55fab3 006000 1734017486.548153 mapwrite 0x162e38 thru 0x16d66d (0xa836 bytes) truncating to largest ever: 0x55ff90 007000 1734017489.308742 write 0x2388d8 thru 0x2445e3 (0xbd0c bytes) 010000 1734017497.189495 mapread 0x031548 thru 0x0315e1 (0x9a bytes) 011000 1734017499.958190 write 0x4247ad thru 0x42c50d (0x7d61 bytes) 014000 1734017507.829053 mapread 0x04991b thru 0x053b3b (0xa221 bytes) 015000 1734017510.859737 mapread 0x357064 thru 0x3650d4 (0xe071 bytes) truncating to largest ever: 0x5611ae truncating to largest ever: 0x5616d7 017000 1734017516.640312 read 0x0db48f thru 0x0ea503 (0xf075 bytes) 019000 1734017523.204067 mapread 0x1639a2 thru 0x171eee (0xe54d bytes) 020000 1734017526.218155 mapread 0x2ce626 thru 0x2dd5ac (0xef87 bytes) 024000 1734017537.442726 mapwrite 0x09b85c thru 0x0a6d47 (0xb4ec bytes) 025000 1734017540.481674 mapwrite 0x4c65c7 thru 0x4ca7ce (0x4208 bytes) 028000 1734017549.423024 trunc from 0x2aa22a to 0x50de1b (0x263bf2 bytes) 029000 1734017552.327769 write 0x5120fb thru 0x51b298 (0x919e bytes) 031000 1734017558.165349 trunc from 0x11e213 to 0x3ba3ed (0x29c1db bytes) 034000 1734017566.114465 write 0x252bc8 thru 0x25b364 (0x879d bytes) 035000 1734017569.034156 mapread 0x2f325a thru 0x2f65c5 (0x336c bytes) 041000 1734017586.034477 write 0x0e504e thru 0x0e8699 (0x364c bytes) 044000 1734017594.197426 read 0x28c09d thru 0x28ee12 (0x2d76 bytes) 047000 1734017602.829121 read 0x143100 thru 0x147b73 (0x4a74 bytes) 048000 1734017605.870653 read 0x03b921 thru 0x03c10b (0x7eb bytes) 052000 1734017617.627558 read 0x1084d3 thru 0x10e049 (0x5b77 bytes) 054000 1734017623.255861 read 0x559751 thru 0x561bff (0x84af bytes) 055000 1734017625.920720 read 0x0e3d11 thru 0x0f222d (0xe51d bytes) 057000 1734017631.656469 write 0x309163 thru 0x313c92 (0xab30 bytes) 058000 1734017634.518626 read 0x405e97 thru 0x40dae3 (0x7c4d bytes) 061000 1734017642.748024 read 0x1fe30c thru 0x20da01 (0xf6f6 bytes) 063000 1734017648.362431 read 0x2d5281 thru 0x2d9eb2 (0x4c32 bytes) 064000 1734017651.341217 read 0x03e7e6 thru 0x04c2ef (0xdb0a bytes) 065000 1734017654.280064 read 0x1a2206 thru 0x1a810c (0x5f07 bytes) 066000 1734017657.218860 read 0x363a36 thru 0x36e9f0 (0xafbb bytes) 067000 1734017660.208757 mapread 0x41a858 thru 0x42a26f (0xfa18 bytes) 068000 1734017663.706583 mapread 0x19acf1 thru 0x1a4abe (0x9dce bytes) 069000 1734017666.713428 mapwrite 0x366599 thru 0x3683e3 (0x1e4b bytes) 070000 1734017669.579063 mapwrite 0x1f53d5 thru 0x203143 (0xdd6f bytes) 073000 1734017677.859405 trunc from 0x5086a1 to 0x17150d (0x397193 bytes) 075000 1734017683.786297 write 0x4e5602 thru 0x4f5393 (0xfd92 bytes) 079000 1734017694.878940 mapread 0x0b9818 thru 0x0bf76c (0x5f55 bytes) 080000 1734017697.920858 read 0x238f72 thru 0x23e3b6 (0x5445 bytes) 081000 1734017700.905417 mapwrite 0x516308 thru 0x51cc9d (0x6996 bytes) 082000 1734017704.050118 mapread 0x350dbe thru 0x35d966 (0xcba9 bytes) 085000 1734017712.610969 mapwrite 0x1be23f thru 0x1bfd10 (0x1ad2 bytes) 086000 1734017715.885081 trunc from 0x47efb4 to 0x3d476b (0xaa848 bytes) 087000 1734017718.653175 write 0x286af4 thru 0x28d05b (0x6568 bytes) 088000 1734017720.942291 read 0x1447bc thru 0x145140 (0x985 bytes) 089000 1734017723.447421 mapread 0x00217a thru 0x00b777 (0x95fe bytes) 090000 1734017726.033481 trunc from 0x314f8c to 0x13131b (0x1e3c70 bytes) 091000 1734017728.962020 write 0x16158f thru 0x16978f (0x8201 bytes) 092000 1734017731.740170 mapwrite 0x0c3bdf thru 0x0c3e47 (0x269 bytes) 096000 1734017742.309893 read 0x20cd15 thru 0x215de2 (0x90ce bytes) 097000 1734017744.947119 mapread 0x0ed94c thru 0x0fa891 (0xcf46 bytes) 098000 1734017747.643175 write 0x265560 thru 0x26f4d7 (0x9f78 bytes) 099000 1734017750.290108 mapread 0x025655 thru 0x02b4a9 (0x5e55 bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 3826402 (3840 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (285s) == sanity-benchmark test complete, duration 1933 sec ===== 10:35:54 (1734017754) === sanity-benchmark: start cleanup 10:35:54 (1734017754) === === sanity-benchmark: finish cleanup 10:35:55 (1734017755) ===