-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:58 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:03 (1734015843) === oleg258-client.virtnet: executing check_config_client /mnt/lustre oleg258-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg258-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b63ce000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b63ce000.idle_timeout=debug disable quota as required oleg258-server: oleg258-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:15 (1734015855) === == sanity-benchmark test dbench: dbench ================== 10:04:16 (1734015856) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6874] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg258-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg258-client.virtnet at Thu Dec 12 10:04:18 EST 2024 waiting for dbench pid 9438 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 3 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 18 56 48.16 MB/sec warmup 1 sec latency 125.671 ms 20 147 63.04 MB/sec warmup 2 sec latency 166.306 ms 20 218 56.42 MB/sec warmup 3 sec latency 128.936 ms 20 302 55.70 MB/sec warmup 4 sec latency 121.386 ms 20 375 53.45 MB/sec warmup 5 sec latency 140.053 ms 20 461 53.95 MB/sec warmup 6 sec latency 114.113 ms 20 537 53.24 MB/sec warmup 7 sec latency 139.704 ms 20 659 52.77 MB/sec warmup 8 sec latency 126.825 ms 20 718 47.20 MB/sec warmup 9 sec latency 102.483 ms 20 776 42.75 MB/sec warmup 10 sec latency 151.269 ms 20 840 39.15 MB/sec warmup 11 sec latency 86.728 ms 20 893 36.13 MB/sec warmup 12 sec latency 100.312 ms 20 940 33.50 MB/sec warmup 13 sec latency 121.179 ms 20 968 31.17 MB/sec warmup 14 sec latency 480.610 ms 20 1054 30.51 MB/sec warmup 15 sec latency 559.135 ms 20 1130 28.72 MB/sec warmup 16 sec latency 78.829 ms 20 1185 27.08 MB/sec warmup 17 sec latency 102.844 ms 20 1245 25.64 MB/sec warmup 18 sec latency 100.446 ms 20 1394 27.36 MB/sec warmup 19 sec latency 104.422 ms 20 1443 26.01 MB/sec warmup 20 sec latency 129.964 ms 20 1497 24.80 MB/sec warmup 21 sec latency 99.602 ms 20 1555 23.73 MB/sec warmup 22 sec latency 97.040 ms 20 1610 22.74 MB/sec warmup 23 sec latency 101.270 ms 20 1716 0.66 MB/sec execute 1 sec latency 138.501 ms 20 1782 0.88 MB/sec execute 2 sec latency 110.876 ms 20 1828 0.87 MB/sec execute 3 sec latency 108.274 ms 20 1883 0.89 MB/sec execute 4 sec latency 120.322 ms 20 1960 1.00 MB/sec execute 5 sec latency 87.993 ms 20 2007 1.00 MB/sec execute 6 sec latency 115.539 ms 20 2058 1.11 MB/sec execute 7 sec latency 121.539 ms 20 2123 1.16 MB/sec execute 8 sec latency 110.038 ms 20 2167 1.13 MB/sec execute 9 sec latency 117.650 ms 20 2216 1.41 MB/sec execute 10 sec latency 116.071 ms 20 2301 2.30 MB/sec execute 11 sec latency 117.329 ms 20 2379 2.91 MB/sec execute 12 sec latency 110.045 ms 20 2425 2.96 MB/sec execute 13 sec latency 118.912 ms 20 2474 3.21 MB/sec execute 14 sec latency 147.210 ms 20 2503 3.22 MB/sec execute 15 sec latency 668.588 ms 20 2530 3.27 MB/sec execute 16 sec latency 1572.160 ms 20 2641 4.47 MB/sec execute 17 sec latency 892.412 ms 20 2728 4.99 MB/sec execute 18 sec latency 147.224 ms 20 2853 6.74 MB/sec execute 19 sec latency 155.611 ms 20 2944 6.86 MB/sec execute 20 sec latency 316.492 ms 20 3046 7.17 MB/sec execute 21 sec latency 154.911 ms 20 3129 7.27 MB/sec execute 22 sec latency 160.052 ms 20 3273 7.44 MB/sec execute 23 sec latency 149.394 ms 20 3382 8.43 MB/sec execute 24 sec latency 180.416 ms 20 3472 8.52 MB/sec execute 25 sec latency 130.698 ms 20 3576 9.43 MB/sec execute 26 sec latency 112.479 ms 20 3627 9.15 MB/sec execute 27 sec latency 96.024 ms 20 3681 9.04 MB/sec execute 28 sec latency 135.919 ms 20 3718 8.87 MB/sec execute 29 sec latency 263.896 ms 20 3753 8.67 MB/sec execute 30 sec latency 140.380 ms 20 3795 8.67 MB/sec execute 31 sec latency 138.759 ms 20 3830 8.47 MB/sec execute 32 sec latency 123.868 ms 20 3867 8.27 MB/sec execute 33 sec latency 119.463 ms 20 3893 8.04 MB/sec execute 34 sec latency 221.029 ms 20 3926 7.87 MB/sec execute 35 sec latency 152.442 ms 20 3963 7.69 MB/sec execute 36 sec latency 119.602 ms 20 4000 7.48 MB/sec execute 37 sec latency 113.799 ms 20 4037 7.29 MB/sec execute 38 sec latency 119.372 ms 20 4080 7.10 MB/sec execute 39 sec latency 169.009 ms 20 4130 6.94 MB/sec execute 40 sec latency 146.492 ms 20 4185 6.81 MB/sec execute 41 sec latency 169.007 ms 20 4236 6.67 MB/sec execute 42 sec latency 155.214 ms 20 4291 6.58 MB/sec execute 43 sec latency 174.265 ms 20 4326 6.47 MB/sec execute 44 sec latency 157.173 ms 20 4368 6.37 MB/sec execute 45 sec latency 167.572 ms 20 4408 6.28 MB/sec execute 46 sec latency 141.415 ms 20 4461 6.20 MB/sec execute 47 sec latency 117.886 ms 20 4503 6.12 MB/sec execute 48 sec latency 133.613 ms 20 4542 6.13 MB/sec execute 49 sec latency 193.256 ms 20 4588 6.07 MB/sec execute 50 sec latency 203.928 ms 20 4639 6.09 MB/sec execute 51 sec latency 142.945 ms 20 4697 6.10 MB/sec execute 52 sec latency 139.367 ms 20 4751 6.01 MB/sec execute 53 sec latency 120.280 ms 20 4807 6.09 MB/sec execute 54 sec latency 153.171 ms 20 4869 6.23 MB/sec execute 55 sec latency 114.938 ms 20 4912 6.23 MB/sec execute 56 sec latency 218.016 ms 20 4996 6.63 MB/sec execute 57 sec latency 112.588 ms 20 5039 6.53 MB/sec execute 58 sec latency 121.213 ms 20 5080 6.43 MB/sec execute 59 sec latency 134.712 ms 20 5130 6.34 MB/sec execute 60 sec latency 92.943 ms 20 5176 6.25 MB/sec execute 61 sec latency 110.987 ms 20 5210 6.15 MB/sec execute 62 sec latency 149.915 ms 20 5254 6.07 MB/sec execute 63 sec latency 144.819 ms 20 5302 5.98 MB/sec execute 64 sec latency 116.955 ms 20 5333 5.90 MB/sec execute 65 sec latency 131.399 ms 20 5379 5.82 MB/sec execute 66 sec latency 119.330 ms 20 5419 5.75 MB/sec execute 67 sec latency 117.087 ms 20 5473 5.68 MB/sec execute 68 sec latency 111.082 ms 20 5516 5.61 MB/sec execute 69 sec latency 147.451 ms 20 5569 5.55 MB/sec execute 70 sec latency 152.891 ms 20 5619 5.48 MB/sec execute 71 sec latency 101.281 ms 20 5660 5.42 MB/sec execute 72 sec latency 132.504 ms 20 5720 5.37 MB/sec execute 73 sec latency 114.146 ms 20 5789 5.38 MB/sec execute 74 sec latency 99.694 ms 20 5841 5.39 MB/sec execute 75 sec latency 114.193 ms 20 5903 5.40 MB/sec execute 76 sec latency 123.673 ms 20 5969 5.46 MB/sec execute 77 sec latency 124.709 ms 20 6032 5.47 MB/sec execute 78 sec latency 126.402 ms 20 6117 5.60 MB/sec execute 79 sec latency 159.901 ms 20 6230 5.85 MB/sec execute 80 sec latency 140.181 ms 20 6328 5.95 MB/sec execute 81 sec latency 169.279 ms 20 6441 6.26 MB/sec execute 82 sec latency 121.381 ms 20 6565 6.32 MB/sec execute 83 sec latency 106.584 ms 20 6682 6.44 MB/sec execute 84 sec latency 140.542 ms 20 6808 6.59 MB/sec execute 85 sec latency 129.188 ms 20 6916 6.69 MB/sec execute 86 sec latency 140.513 ms 20 7038 6.90 MB/sec execute 87 sec latency 100.181 ms 20 7148 7.14 MB/sec execute 88 sec latency 79.310 ms 20 7217 7.13 MB/sec execute 89 sec latency 92.936 ms 20 7281 7.14 MB/sec execute 90 sec latency 106.030 ms 20 7338 7.13 MB/sec execute 91 sec latency 85.905 ms 20 7383 7.11 MB/sec execute 92 sec latency 138.042 ms 20 7429 7.05 MB/sec execute 93 sec latency 95.173 ms 20 7474 6.99 MB/sec execute 94 sec latency 92.374 ms 20 7519 6.93 MB/sec execute 95 sec latency 99.672 ms 20 7563 6.86 MB/sec execute 96 sec latency 86.814 ms 20 7599 6.79 MB/sec execute 97 sec latency 150.751 ms 20 7656 6.73 MB/sec execute 98 sec latency 96.710 ms 20 7713 6.67 MB/sec execute 99 sec latency 130.812 ms 20 7783 6.63 MB/sec execute 100 sec latency 143.442 ms 20 7840 6.59 MB/sec execute 101 sec latency 132.786 ms 20 7897 6.55 MB/sec execute 102 sec latency 99.744 ms 20 7946 6.51 MB/sec execute 103 sec latency 120.760 ms 20 7995 6.47 MB/sec execute 104 sec latency 119.706 ms 20 8043 6.44 MB/sec execute 105 sec latency 129.809 ms 20 8092 6.43 MB/sec execute 106 sec latency 129.793 ms 20 8151 6.43 MB/sec execute 107 sec latency 121.991 ms 20 8212 6.44 MB/sec execute 108 sec latency 118.743 ms 20 8272 6.42 MB/sec execute 109 sec latency 164.049 ms 20 8340 6.48 MB/sec execute 110 sec latency 131.826 ms 20 8411 6.54 MB/sec execute 111 sec latency 117.595 ms 20 8484 6.63 MB/sec execute 112 sec latency 121.311 ms 20 8534 6.66 MB/sec execute 113 sec latency 171.128 ms 20 8589 6.67 MB/sec execute 114 sec latency 115.222 ms 20 8636 6.62 MB/sec execute 115 sec latency 109.221 ms 20 8684 6.57 MB/sec execute 116 sec latency 95.733 ms 20 8732 6.52 MB/sec execute 117 sec latency 113.510 ms 20 8778 6.47 MB/sec execute 118 sec latency 134.011 ms 20 8833 6.43 MB/sec execute 119 sec latency 101.055 ms 20 cleanup 120 sec 20 cleanup 121 sec 12 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 25054 55.715 274.937 Close 18523 13.077 83.691 Rename 1056 87.160 343.018 Unlink 4997 17.586 74.809 Qpathinfo 22981 13.237 267.273 Qfileinfo 3939 0.288 58.313 Qfsinfo 4080 0.184 27.311 Sfileinfo 2000 52.833 266.647 Find 8660 2.969 106.921 WriteX 12194 5.446 106.654 ReadX 38856 0.031 11.273 LockX 80 22.626 60.012 UnlockX 80 20.862 56.396 Flush 1720 43.278 1572.147 Throughput 6.42794 MB/sec 20 clients 20 procs max_latency=1572.160 ms stopping dbench on /mnt/lustre/d0.oleg258-client.virtnet at Thu Dec 12 10:06:44 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg258-client.virtnet /mnt/lustre/d0.oleg258-client.virtnet /mnt/lustre/d0.oleg258-client.virtnet removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg258-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (155s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:52 (1734016012) min OST has 3575100kB available, using 5362650kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6874] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5236] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg258-clien 5236M 87293 65 55180 49 113071 29 850.3 168 Latency 28274us 133ms 185ms 112ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg258-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 264 19 8307 37 442 15 337 19 1028 13 550 14 Latency 20599us 11734us 39357us 13169us 3704us 11341us 1.97,1.97,oleg258-client.virtnet,1,1734006041,5236M,,,,87293,65,55180,49,,,113071,29,850.3,168,10,,,,,264,19,8307,37,442,15,337,19,1028,13,550,14,,28274us,133ms,,185ms,112ms,20599us,11734us,39357us,13169us,3704us,11341us debug=0x33f0484 PASS bonnie (346s) == sanity-benchmark test iozone: iozone ================== 10:12:38 (1734016358) Waiting for MDT destroys to complete oleg258-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg258-client: oleg258-server: ssh exited with exit code 1 oleg258-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg258-client: oleg258-server: ssh exited with exit code 1 min OST has 3605620kB available, using 5408430kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6874] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:51 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 308102 130523 95965 103442 52867 115268 iozone test complete. Waiting for MDT destroys to complete oleg258-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg258-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg258-client: oleg258-server: ssh exited with exit code 1 pdsh@oleg258-client: oleg258-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg258-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg258-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg258-client: oleg258-server: ssh exited with exit code 1 pdsh@oleg258-client: oleg258-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:18:33 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 68812 77516 84232 82967 85306 80571 iozone test complete. Waiting for MDT destroys to complete oleg258-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg258-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg258-client: oleg258-server: ssh exited with exit code 1 pdsh@oleg258-client: oleg258-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (774s) == sanity-benchmark test fsx: fsx ======================== 10:25:32 (1734017132) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7577 -P /tmp -l 5408430 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7577 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x3d24b3 fallocating to largest ever: 0x5028d7 fallocating to largest ever: 0x503729 truncating to largest ever: 0x506723 fallocating to largest ever: 0x514f2b truncating to largest ever: 0x520d63 fallocating to largest ever: 0x5286ae 001000 1734017136.587874 fallocate 0x2edeee thru 0x2ee5a4 (0x6b7 bytes) 002000 1734017139.579133 write 0x2c979d thru 0x2d7866 (0xe0ca bytes) 003000 1734017142.900215 mapwrite 0x50afa2 thru 0x50e109 (0x3168 bytes) 004000 1734017145.880506 read 0x031313 thru 0x040087 (0xed75 bytes) 005000 1734017148.727367 punch from 0x1c7513 to 0x1cf712 (0x8200 bytes) 006000 1734017151.411614 trunc from 0x35db39 to 0x210a20 (0x14d118 bytes) 008000 1734017157.457461 read 0x0ac2f3 thru 0x0acdd6 (0xae4 bytes) 009000 1734017160.485331 mapread 0x204182 thru 0x20ae0d (0x6c8c bytes) 010000 1734017163.520589 write 0x357060 thru 0x362248 (0xb1e9 bytes) 011000 1734017166.462680 write 0x07549f thru 0x07dc73 (0x87d5 bytes) 012000 1734017169.436069 mapread 0x00e4c7 thru 0x01d1b9 (0xecf3 bytes) 013000 1734017172.777876 punch from 0x03e1ce to 0x042747 (0x457a bytes) 014000 1734017175.498004 trunc from 0x266e81 to 0x46083a (0x1f99ba bytes) 015000 1734017178.946441 mapread 0x27fb81 thru 0x288d4a (0x91ca bytes) 016000 1734017182.000073 read 0x361632 thru 0x36eca3 (0xd672 bytes) 017000 1734017184.993375 fallocate 0x244a10 thru 0x24b337 (0x6928 bytes) 020000 1734017194.714296 fallocate 0x283e55 thru 0x29012b (0xc2d7 bytes) 021000 1734017197.364477 fallocate 0x515eba thru 0x51697b (0xac2 bytes) 022000 1734017200.222486 read 0x07a318 thru 0x07f449 (0x5132 bytes) 025000 1734017208.682974 mapread 0x055f7a thru 0x06367d (0xd704 bytes) 026000 1734017211.206904 write 0x02159a thru 0x02d358 (0xbdbf bytes) 027000 1734017214.046972 write 0x162840 thru 0x16eee6 (0xc6a7 bytes) 029000 1734017220.307314 mapread 0x0cb175 thru 0x0d4fbb (0x9e47 bytes) 032000 1734017228.500339 trunc from 0x461e87 to 0x4a11ad (0x3f327 bytes) 033000 1734017231.254292 punch from 0x397b4c to 0x39aab0 (0x2f65 bytes) 034000 1734017233.809655 trunc from 0x37896a to 0x4342c4 (0xbb95b bytes) 035000 1734017236.596324 trunc from 0x3881a3 to 0x331653 (0x56b4f bytes) 036000 1734017239.598077 trunc from 0x2c1a62 to 0x4d9142 (0x2176e1 bytes) 037000 1734017242.877316 mapread 0x3af552 thru 0x3bb0b1 (0xbb60 bytes) 038000 1734017245.520925 mapread 0x05b363 thru 0x06563f (0xa2dd bytes) 039000 1734017248.653324 mapread 0x302b0d thru 0x30f2b1 (0xc7a5 bytes) 040000 1734017251.584944 mapwrite 0x01b292 thru 0x02978f (0xe4fe bytes) 041000 1734017254.731557 mapwrite 0x0a1a0a thru 0x0a7f51 (0x6548 bytes) 042000 1734017257.384850 write 0x25784e thru 0x2586c0 (0xe73 bytes) 043000 1734017260.124296 write 0x521e98 thru 0x5286ad (0x6816 bytes) 044000 1734017263.030908 mapwrite 0x377431 thru 0x383420 (0xbff0 bytes) 046000 1734017268.864263 trunc from 0x4e13fb to 0x0080ca (0x4d9330 bytes) 047000 1734017271.545486 fallocate 0x0ab72a thru 0x0acc6a (0x1541 bytes) 048000 1734017274.310982 punch from 0x0396b1 to 0x03e6be (0x500e bytes) 049000 1734017277.283826 punch from 0x01af06 to 0x02319c (0x8297 bytes) 050000 1734017280.169399 fallocate 0x3a5e83 thru 0x3a67de (0x95c bytes) 051000 1734017283.282944 mapwrite 0x1f8a6e thru 0x1f8b6f (0x102 bytes) 053000 1734017288.691435 fallocate 0x42e20b thru 0x437053 (0x8e49 bytes) 054000 1734017291.886660 fallocate 0x21d798 thru 0x22c689 (0xeef2 bytes) 056000 1734017297.037619 fallocate 0x1a4dca thru 0x1b1e91 (0xd0c8 bytes) 059000 1734017306.262669 mapwrite 0x33f96d thru 0x34337e (0x3a12 bytes) 061000 1734017311.974334 punch from 0x289ef8 to 0x28e9f0 (0x4af9 bytes) 062000 1734017314.611188 trunc from 0x5286ae to 0x45b61a (0xcd093 bytes) 063000 1734017317.261042 trunc from 0x3e29d1 to 0x2093a1 (0x1d962f bytes) 065000 1734017323.016597 fallocate 0x16b695 thru 0x172b2b (0x7497 bytes) 067000 1734017328.699783 trunc from 0x497f40 to 0x42787d (0x706c2 bytes) 068000 1734017331.561019 write 0x3fe833 thru 0x4000fe (0x18cc bytes) 070000 1734017337.431271 read 0x35da0f thru 0x362b83 (0x5175 bytes) 073000 1734017346.293999 mapwrite 0x0b8c6b thru 0x0bca93 (0x3e29 bytes) 075000 1734017351.648868 fallocate 0x4f1320 thru 0x4f2036 (0xd17 bytes) 076000 1734017354.457994 mapread 0x11bd8d thru 0x12097b (0x4bef bytes) 079000 1734017362.985695 punch from 0x03c604 to 0x0459ed (0x93ea bytes) 080000 1734017365.533042 read 0x07bf16 thru 0x08b3f0 (0xf4db bytes) 081000 1734017368.293592 mapwrite 0x1b304a thru 0x1c2272 (0xf229 bytes) 082000 1734017370.833562 trunc from 0x527b29 to 0x00971a (0x51e40e bytes) 085000 1734017379.265837 write 0x0cca50 thru 0x0daad5 (0xe086 bytes) 086000 1734017381.748515 read 0x363a83 thru 0x3654c8 (0x1a46 bytes) 087000 1734017384.559219 read 0x1c1018 thru 0x1c4a2a (0x3a13 bytes) 088000 1734017387.620650 fallocate 0x1fb112 thru 0x2044c3 (0x93b2 bytes) 090000 1734017393.200780 mapwrite 0x498c60 thru 0x49a19b (0x153c bytes) 091000 1734017396.177068 mapread 0x1f57c1 thru 0x20184d (0xc08d bytes) 093000 1734017402.398620 write 0x455d8c thru 0x45625e (0x4d3 bytes) 095000 1734017407.313392 fallocate 0x50edf2 thru 0x50f976 (0xb85 bytes) 096000 1734017409.625011 trunc from 0x508572 to 0x4e5bd3 (0x2299e bytes) 097000 1734017412.258081 mapwrite 0x12643c thru 0x129649 (0x320e bytes) 098000 1734017414.856869 fallocate 0x16ef5c thru 0x17153c (0x25e1 bytes) 099000 1734017417.195080 write 0x5277f6 thru 0x5286ad (0xeb8 bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4964278 (4848 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 11: 3936256.. 3936267: 12: 0001: net 1: 12.. 27: 3932168.. 3932183: 16: 0001: net 2: 28.. 31: 3942392.. 3942395: 4: 0001: net 3: 32.. 39: 4064576.. 4064583: 8: 0001: net 4: 44.. 67: 4064584.. 4064607: 24: 0001: unwritten,net 5: 128.. 151: 4066220.. 4066243: 24: 0001: unwritten,net 6: 320.. 339: 4071704.. 4071723: 20: 0001: net 7: 824.. 851: 4066288.. 4066315: 28: 0001: unwritten,net 8: 852.. 855: 4065244.. 4065247: 4: 0001: net 9: 856.. 871: 4066316.. 4066331: 16: 0001: unwritten,net 10: 932.. 951: 4076140.. 4076159: 20: 0001: net 11: 1224.. 1267: 4066244.. 4066287: 44: 0001: unwritten,net 12: 1520.. 1535: 4077820.. 4077835: 16: 0001: net 13: 1824.. 1835: 4078124.. 4078135: 12: 0001: net 14: 2424.. 2451: 4076160.. 4076187: 28: 0001: net 15: 2788.. 2823: 4073908.. 4073943: 36: 0001: unwritten,net 16: 4204.. 4215: 4080104.. 4080115: 12: 0001: unwritten,net 17: 4788.. 4847: 4080688.. 4080747: 60: 0001: last,net,eof /mnt/lustre/f0.fsxfile: 15 extents found debug=0x33f0484 PASS fsx (288s) == sanity-benchmark test complete, duration 1582 sec ===== 10:30:20 (1734017420) === sanity-benchmark: start cleanup 10:30:21 (1734017421) === === sanity-benchmark: finish cleanup 10:30:22 (1734017422) ===