-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:01 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:07 (1734015847) === oleg213-client.virtnet: executing check_config_client /mnt/lustre oleg213-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg213-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b34f6800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b34f6800.idle_timeout=debug disable quota as required oleg213-server: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:21 (1734015861) === == sanity-benchmark test dbench: dbench ================== 10:04:22 (1734015862) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6887] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg213-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg213-client.virtnet at Thu Dec 12 10:04:24 EST 2024 waiting for dbench pid 9455 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 17 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 14 40 30.71 MB/sec warmup 1 sec latency 120.052 ms 20 132 58.32 MB/sec warmup 2 sec latency 184.381 ms 20 184 49.32 MB/sec warmup 3 sec latency 162.060 ms 20 254 48.09 MB/sec warmup 4 sec latency 130.575 ms 20 309 45.29 MB/sec warmup 5 sec latency 148.948 ms 20 377 44.72 MB/sec warmup 6 sec latency 127.468 ms 20 451 45.20 MB/sec warmup 7 sec latency 120.786 ms 20 532 45.97 MB/sec warmup 8 sec latency 132.748 ms 20 645 46.77 MB/sec warmup 9 sec latency 144.983 ms 20 696 42.35 MB/sec warmup 10 sec latency 115.914 ms 20 750 38.74 MB/sec warmup 11 sec latency 98.947 ms 20 801 35.73 MB/sec warmup 12 sec latency 142.681 ms 20 864 33.21 MB/sec warmup 13 sec latency 94.864 ms 20 908 30.99 MB/sec warmup 14 sec latency 132.404 ms 20 941 29.02 MB/sec warmup 15 sec latency 314.974 ms 20 985 27.44 MB/sec warmup 16 sec latency 144.108 ms 20 1058 26.92 MB/sec warmup 17 sec latency 122.507 ms 20 1112 25.49 MB/sec warmup 18 sec latency 117.493 ms 20 1166 24.20 MB/sec warmup 19 sec latency 150.493 ms 20 1211 23.04 MB/sec warmup 20 sec latency 116.152 ms 20 1270 22.26 MB/sec warmup 21 sec latency 119.169 ms 20 1395 23.62 MB/sec warmup 22 sec latency 153.544 ms 20 1441 22.61 MB/sec warmup 23 sec latency 141.593 ms 20 1524 0.68 MB/sec execute 1 sec latency 118.031 ms 20 1575 0.84 MB/sec execute 2 sec latency 122.846 ms 20 1622 0.86 MB/sec execute 3 sec latency 107.532 ms 20 1668 0.85 MB/sec execute 4 sec latency 128.239 ms 20 1718 0.82 MB/sec execute 5 sec latency 150.673 ms 20 1762 0.82 MB/sec execute 6 sec latency 145.541 ms 20 1804 0.78 MB/sec execute 7 sec latency 145.073 ms 20 1837 0.76 MB/sec execute 8 sec latency 160.819 ms 20 1876 0.75 MB/sec execute 9 sec latency 153.321 ms 20 1919 0.75 MB/sec execute 10 sec latency 144.434 ms 20 1972 0.78 MB/sec execute 11 sec latency 140.657 ms 20 2010 0.79 MB/sec execute 12 sec latency 140.884 ms 20 2040 0.82 MB/sec execute 13 sec latency 171.242 ms 20 2079 0.84 MB/sec execute 14 sec latency 145.437 ms 20 2126 0.85 MB/sec execute 15 sec latency 121.203 ms 20 2145 0.82 MB/sec execute 16 sec latency 499.932 ms 20 2160 0.79 MB/sec execute 17 sec latency 381.017 ms 20 2172 0.76 MB/sec execute 18 sec latency 339.745 ms 20 2185 0.79 MB/sec execute 19 sec latency 367.623 ms 20 2217 0.91 MB/sec execute 20 sec latency 331.193 ms 20 2267 1.07 MB/sec execute 21 sec latency 173.787 ms 20 2329 1.47 MB/sec execute 22 sec latency 146.514 ms 20 2374 1.64 MB/sec execute 23 sec latency 202.389 ms 20 2409 1.67 MB/sec execute 24 sec latency 126.916 ms 20 2451 1.81 MB/sec execute 25 sec latency 150.074 ms 20 2509 2.02 MB/sec execute 26 sec latency 128.859 ms 20 2576 2.28 MB/sec execute 27 sec latency 154.703 ms 20 2665 2.88 MB/sec execute 28 sec latency 146.821 ms 20 2785 3.93 MB/sec execute 29 sec latency 180.411 ms 20 2887 4.47 MB/sec execute 30 sec latency 152.972 ms 20 2953 4.72 MB/sec execute 31 sec latency 168.835 ms 20 3031 4.77 MB/sec execute 32 sec latency 156.716 ms 20 3129 4.86 MB/sec execute 33 sec latency 150.938 ms 20 3270 5.18 MB/sec execute 34 sec latency 118.411 ms 20 3360 5.56 MB/sec execute 35 sec latency 157.725 ms 20 3452 5.96 MB/sec execute 36 sec latency 116.674 ms 20 3552 6.63 MB/sec execute 37 sec latency 120.538 ms 20 3614 6.58 MB/sec execute 38 sec latency 94.827 ms 20 3668 6.51 MB/sec execute 39 sec latency 124.988 ms 20 3716 6.52 MB/sec execute 40 sec latency 152.274 ms 20 3765 6.51 MB/sec execute 41 sec latency 113.623 ms 20 3808 6.53 MB/sec execute 42 sec latency 114.368 ms 20 3844 6.39 MB/sec execute 43 sec latency 112.214 ms 20 3880 6.28 MB/sec execute 44 sec latency 114.785 ms 20 3911 6.18 MB/sec execute 45 sec latency 204.926 ms 20 3942 6.09 MB/sec execute 46 sec latency 202.511 ms 20 3970 5.96 MB/sec execute 47 sec latency 165.960 ms 20 3994 5.84 MB/sec execute 48 sec latency 185.499 ms 20 4018 5.72 MB/sec execute 49 sec latency 173.488 ms 20 4041 5.60 MB/sec execute 50 sec latency 228.833 ms 20 4076 5.50 MB/sec execute 51 sec latency 166.927 ms 20 4120 5.40 MB/sec execute 52 sec latency 138.074 ms 20 4167 5.32 MB/sec execute 53 sec latency 167.119 ms 20 4215 5.24 MB/sec execute 54 sec latency 156.069 ms 20 4264 5.18 MB/sec execute 55 sec latency 194.845 ms 20 4298 5.12 MB/sec execute 56 sec latency 188.718 ms 20 4342 5.07 MB/sec execute 57 sec latency 138.424 ms 20 4383 5.02 MB/sec execute 58 sec latency 167.128 ms 20 4422 4.96 MB/sec execute 59 sec latency 140.242 ms 20 4462 4.91 MB/sec execute 60 sec latency 144.274 ms 20 4493 4.86 MB/sec execute 61 sec latency 181.389 ms 20 4528 4.84 MB/sec execute 62 sec latency 183.309 ms 20 4571 4.85 MB/sec execute 63 sec latency 167.279 ms 20 4610 4.85 MB/sec execute 64 sec latency 162.346 ms 20 4660 4.91 MB/sec execute 65 sec latency 185.615 ms 20 4713 4.87 MB/sec execute 66 sec latency 154.669 ms 20 4761 4.81 MB/sec execute 67 sec latency 133.184 ms 20 4821 4.89 MB/sec execute 68 sec latency 131.912 ms 20 4869 4.98 MB/sec execute 69 sec latency 151.496 ms 20 4922 5.10 MB/sec execute 70 sec latency 214.158 ms 20 4992 5.37 MB/sec execute 71 sec latency 135.028 ms 20 5023 5.30 MB/sec execute 72 sec latency 152.272 ms 20 5056 5.24 MB/sec execute 73 sec latency 151.118 ms 20 5091 5.17 MB/sec execute 74 sec latency 122.125 ms 20 5128 5.11 MB/sec execute 75 sec latency 149.529 ms 20 5161 5.05 MB/sec execute 76 sec latency 138.458 ms 20 5198 5.00 MB/sec execute 77 sec latency 141.354 ms 20 5238 4.94 MB/sec execute 78 sec latency 143.084 ms 20 5283 4.89 MB/sec execute 79 sec latency 133.275 ms 20 5320 4.83 MB/sec execute 80 sec latency 118.823 ms 20 5366 4.78 MB/sec execute 81 sec latency 120.611 ms 20 5401 4.73 MB/sec execute 82 sec latency 122.327 ms 20 5461 4.69 MB/sec execute 83 sec latency 93.303 ms 20 5518 4.65 MB/sec execute 84 sec latency 117.792 ms 20 5568 4.60 MB/sec execute 85 sec latency 135.741 ms 20 5612 4.57 MB/sec execute 86 sec latency 143.254 ms 20 5657 4.53 MB/sec execute 87 sec latency 120.231 ms 20 5710 4.49 MB/sec execute 88 sec latency 106.058 ms 20 5770 4.48 MB/sec execute 89 sec latency 101.416 ms 20 5830 4.53 MB/sec execute 90 sec latency 131.632 ms 20 5898 4.55 MB/sec execute 91 sec latency 94.279 ms 20 5961 4.59 MB/sec execute 92 sec latency 115.860 ms 20 6015 4.61 MB/sec execute 93 sec latency 110.075 ms 20 6076 4.62 MB/sec execute 94 sec latency 127.692 ms 20 6151 4.72 MB/sec execute 95 sec latency 142.712 ms 20 6270 4.98 MB/sec execute 96 sec latency 138.678 ms 20 6388 5.20 MB/sec execute 97 sec latency 131.337 ms 20 6504 5.35 MB/sec execute 98 sec latency 134.959 ms 20 6598 5.42 MB/sec execute 99 sec latency 168.972 ms 20 6709 5.46 MB/sec execute 100 sec latency 134.052 ms 20 6832 5.58 MB/sec execute 101 sec latency 138.563 ms 20 6940 5.73 MB/sec execute 102 sec latency 140.631 ms 20 7043 5.88 MB/sec execute 103 sec latency 136.323 ms 20 7134 6.07 MB/sec execute 104 sec latency 104.518 ms 20 7186 6.05 MB/sec execute 105 sec latency 132.292 ms 20 7243 6.04 MB/sec execute 106 sec latency 142.036 ms 20 7293 6.06 MB/sec execute 107 sec latency 216.875 ms 20 7338 6.05 MB/sec execute 108 sec latency 230.255 ms 20 7379 6.02 MB/sec execute 109 sec latency 136.834 ms 20 7418 5.98 MB/sec execute 110 sec latency 106.944 ms 20 7463 5.94 MB/sec execute 111 sec latency 115.935 ms 20 7503 5.91 MB/sec execute 112 sec latency 119.498 ms 20 7547 5.86 MB/sec execute 113 sec latency 141.455 ms 20 7601 5.81 MB/sec execute 114 sec latency 77.591 ms 20 7656 5.76 MB/sec execute 115 sec latency 170.767 ms 20 7724 5.73 MB/sec execute 116 sec latency 152.121 ms 20 7809 5.70 MB/sec execute 117 sec latency 128.010 ms 20 7872 5.68 MB/sec execute 118 sec latency 115.183 ms 20 7935 5.66 MB/sec execute 119 sec latency 115.294 ms 20 cleanup 120 sec 20 cleanup 121 sec 5 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 22675 61.835 499.921 Close 16395 15.647 212.292 Rename 889 92.195 202.361 Unlink 4702 19.720 95.366 Qpathinfo 20821 14.328 293.881 Qfileinfo 3586 0.232 72.325 Qfsinfo 3716 0.226 23.796 Sfileinfo 1561 58.301 159.014 Find 7917 4.608 133.704 WriteX 11034 6.144 156.698 ReadX 35112 0.040 11.089 LockX 80 23.147 70.190 UnlockX 80 23.370 48.972 Flush 1623 41.266 137.826 Throughput 5.65566 MB/sec 20 clients 20 procs max_latency=499.932 ms stopping dbench on /mnt/lustre/d0.oleg213-client.virtnet at Thu Dec 12 10:06:51 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg213-client.virtnet /mnt/lustre/d0.oleg213-client.virtnet /mnt/lustre/d0.oleg213-client.virtnet removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg213-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (156s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:58 (1734016018) min OST has 3575348kB available, using 5363022kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6887] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5237] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg213-clien 5237M 85619 66 56406 49 133072 32 1138 179 Latency 19243us 133ms 157ms 22460us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg213-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 241 18 8340 38 416 14 320 18 1005 12 547 13 Latency 27409us 12284us 26542us 16324us 3916us 14133us 1.97,1.97,oleg213-client.virtnet,1,1734006079,5237M,,,,85619,66,56406,49,,,133072,32,1138,179,10,,,,,241,18,8340,38,416,14,320,18,1005,12,547,13,,19243us,133ms,,157ms,22460us,27409us,12284us,26542us,16324us,3916us,14133us debug=0x33f0484 PASS bonnie (343s) == sanity-benchmark test iozone: iozone ================== 10:12:41 (1734016361) Waiting for MDT destroys to complete oleg213-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg213-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 min OST has 3605620kB available, using 5408430kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6887] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:50 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 230142 131139 111939 117189 53917 76483 iozone test complete. Waiting for MDT destroys to complete oleg213-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg213-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg213-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg213-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:18:44 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 80381 75316 89158 87425 88706 78033 iozone test complete. Waiting for MDT destroys to complete oleg213-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg213-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 pdsh@oleg213-client: oleg213-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (765s) == sanity-benchmark test fsx: fsx ======================== 10:25:26 (1734017126) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 883 -P /tmp -l 5408430 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 883 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0xfc847 truncating to largest ever: 0x179612 truncating to largest ever: 0x2e6fe5 fallocating to largest ever: 0x4e42c5 fallocating to largest ever: 0x5008fa truncating to largest ever: 0x516c30 fallocating to largest ever: 0x5286ae 001000 1734017129.989942 read 0x254e37 thru 0x25a2dc (0x54a6 bytes) 002000 1734017132.828006 trunc from 0x27a005 to 0x4128ae (0x1988aa bytes) 003000 1734017135.991973 trunc from 0x46be4f to 0x1aec27 (0x2bd227 bytes) 007000 1734017147.357153 trunc from 0x126637 to 0x3f290a (0x2cc2d4 bytes) 008000 1734017150.378425 fallocate 0x0016a9 thru 0x010b80 (0xf4d8 bytes) 009000 1734017152.876034 mapread 0x056e29 thru 0x057b2e (0xd06 bytes) 011000 1734017158.926015 write 0x0975e9 thru 0x0a2c2f (0xb647 bytes) 013000 1734017165.140573 trunc from 0x001509 to 0x320174 (0x31ec6c bytes) 014000 1734017168.199781 punch from 0x20f46d to 0x2154fb (0x608f bytes) 015000 1734017171.381658 write 0x118a74 thru 0x1229b2 (0x9f3f bytes) 016000 1734017174.447036 punch from 0x2c8c0f to 0x2d2760 (0x9b52 bytes) 017000 1734017177.432687 trunc from 0x35e9b4 to 0x06eb4c (0x2efe67 bytes) 018000 1734017180.915925 fallocate 0x47a6b2 thru 0x4828fe (0x824d bytes) 019000 1734017184.265810 mapread 0x36f028 thru 0x36f617 (0x5f0 bytes) 021000 1734017189.757612 write 0x31c8a4 thru 0x321d98 (0x54f5 bytes) 022000 1734017192.619540 mapread 0x01379d thru 0x0139cc (0x230 bytes) 023000 1734017195.404341 trunc from 0x449676 to 0x33283a (0x116e3b bytes) 024000 1734017198.178105 punch from 0x1d97a1 to 0x1e2a11 (0x9271 bytes) 025000 1734017200.809774 write 0x3ecdfe thru 0x3f6971 (0x9b74 bytes) 026000 1734017203.440047 fallocate 0x36d025 thru 0x370e48 (0x3e24 bytes) 027000 1734017206.521406 fallocate 0x3623db thru 0x368d4b (0x6971 bytes) 028000 1734017209.322406 write 0x13bffa thru 0x140e52 (0x4e59 bytes) 031000 1734017217.747571 read 0x28ebf4 thru 0x290cae (0x20bb bytes) 033000 1734017222.990535 mapwrite 0x0602d4 thru 0x06db34 (0xd861 bytes) 034000 1734017225.580406 write 0x4aa6f7 thru 0x4b43f0 (0x9cfa bytes) 037000 1734017233.683335 mapread 0x24e284 thru 0x2540fa (0x5e77 bytes) skipping zero size write 038000 1734017236.534624 fallocate 0x3a7b69 thru 0x3b1a92 (0x9f2a bytes) skipping zero length fallocate 039000 1734017238.924643 trunc from 0x508554 to 0x318c3f (0x1ef914 bytes) 040000 1734017241.987187 punch from 0x14d5e1 to 0x15b0a3 (0xdac3 bytes) 041000 1734017245.028055 read 0x302fee thru 0x305921 (0x2934 bytes) 042000 1734017247.779916 fallocate 0x291c74 thru 0x297194 (0x5521 bytes) 045000 1734017256.864543 mapread 0x2b84f0 thru 0x2c1944 (0x9455 bytes) 046000 1734017260.128802 read 0x36daa0 thru 0x37d04a (0xf5ab bytes) 047000 1734017263.034448 trunc from 0x517af5 to 0x3517ef (0x1c6305 bytes) 048000 1734017265.385105 write 0x17529b thru 0x18487a (0xf5e0 bytes) 049000 1734017268.059840 punch from 0x0a4673 to 0x0a59f5 (0x1383 bytes) 051000 1734017273.185841 read 0x07cbec thru 0x088742 (0xbb57 bytes) 053000 1734017278.365402 punch from 0x18cf0a to 0x19ba28 (0xeb1f bytes) 055000 1734017284.028409 mapread 0x19606d thru 0x1a26ea (0xc67e bytes) 058000 1734017292.271372 trunc from 0x40d882 to 0x076bb8 (0x396cc9 bytes) 059000 1734017294.805589 read 0x3711d7 thru 0x37cbd2 (0xb9fc bytes) 061000 1734017300.184589 mapread 0x21e883 thru 0x2211a0 (0x291e bytes) 062000 1734017302.769394 trunc from 0x0f0cd4 to 0x15aafd (0x69e2a bytes) 063000 1734017305.566719 read 0x2300d9 thru 0x231476 (0x139e bytes) 064000 1734017307.926591 mapwrite 0x37de15 thru 0x38686e (0x8a5a bytes) 067000 1734017315.074240 write 0x0a76c0 thru 0x0b420a (0xcb4b bytes) 069000 1734017320.002149 fallocate 0x1b6929 thru 0x1c4a2b (0xe103 bytes) 070000 1734017322.634234 read 0x3711bf thru 0x37e4aa (0xd2ec bytes) 072000 1734017328.143269 trunc from 0x2234c2 to 0x381f86 (0x15eac5 bytes) 075000 1734017335.663875 read 0x1200ec thru 0x12847c (0x8391 bytes) 076000 1734017338.114651 fallocate 0x1783b8 thru 0x17a92e (0x2577 bytes) 077000 1734017340.631339 mapread 0x1513e2 thru 0x157cfa (0x6919 bytes) skipping zero length punch hole 079000 1734017346.273850 write 0x108368 thru 0x1171b9 (0xee52 bytes) 080000 1734017348.963394 mapread 0x1194e7 thru 0x125efb (0xca15 bytes) 082000 1734017354.764816 write 0x1cef25 thru 0x1db998 (0xca74 bytes) 084000 1734017360.173154 mapwrite 0x498056 thru 0x4a0496 (0x8441 bytes) 085000 1734017362.847116 mapwrite 0x198f4f thru 0x1a0dd1 (0x7e83 bytes) 086000 1734017365.420324 trunc from 0x1d7266 to 0x268c8f (0x91a2a bytes) 087000 1734017368.118724 mapwrite 0x34a570 thru 0x35533e (0xadcf bytes) 088000 1734017371.268616 write 0x26c2c6 thru 0x279e8b (0xdbc6 bytes) 090000 1734017376.205712 trunc from 0x45331c to 0x0f4da8 (0x35e573 bytes) 091000 1734017379.506215 mapwrite 0x0a476d thru 0x0b0628 (0xbebc bytes) 094000 1734017387.230039 mapread 0x3b5b86 thru 0x3c3f49 (0xe3c4 bytes) 095000 1734017389.863649 mapread 0x2c0d5b thru 0x2c888d (0x7b33 bytes) 096000 1734017392.472068 fallocate 0x33cff2 thru 0x3459dc (0x89eb bytes) 099000 1734017400.225573 trunc from 0x429d07 to 0x02a0b7 (0x3ffc4f bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4057041 (3964 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 663552.. 663555: 4: 0001: net 1: 16.. 19: 798400.. 798403: 4: 0001: unwritten,net 2: 24.. 31: 798412.. 798419: 8: 0001: net 3: 76.. 79: 663652.. 663655: 4: 0001: net 4: 80.. 103: 791936.. 791959: 24: 0001: net 5: 104.. 107: 798500.. 798503: 4: 0001: net 6: 212.. 243: 923572.. 923603: 32: 0001: net 7: 252.. 279: 793088.. 793115: 28: 0001: unwritten,net 8: 280.. 331: 792956.. 793007: 52: 0001: net 9: 332.. 351: 794764.. 794783: 20: 0001: net 10: 452.. 459: 794712.. 794719: 8: 0001: unwritten,net 11: 460.. 475: 794680.. 794695: 16: 0001: net 12: 476.. 495: 794720.. 794739: 20: 0001: unwritten,net 13: 628.. 651: 923268.. 923291: 24: 0001: net 14: 712.. 723: 798676.. 798687: 12: 0001: net 15: 1028.. 1071: 799820.. 799863: 44: 0001: unwritten,net 16: 1660.. 1719: 799864.. 799923: 60: 0001: unwritten,net 17: 1820.. 1883: 799976.. 800039: 64: 0001: unwritten,net 18: 2052.. 2103: 799924.. 799975: 52: 0001: unwritten,net 19: 2624.. 2667: 792896.. 792939: 44: 0001: last,net /mnt/lustre/f0.fsxfile: 19 extents found debug=0x33f0484 PASS fsx (277s) == sanity-benchmark test complete, duration 1561 sec ===== 10:30:03 (1734017403) === sanity-benchmark: start cleanup 10:30:04 (1734017404) === === sanity-benchmark: finish cleanup 10:30:04 (1734017404) ===