-----============= acceptance-small: sanity-benchmark ============----- Tue Aug 27 11:42:40 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 11:42:46 (1724773366) === oleg419-client.virtnet: executing check_config_client /mnt/lustre oleg419-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg419-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6330800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6330800.idle_timeout=debug disable quota as required oleg419-server: oleg419-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 11:42:54 (1724773374) === == sanity-benchmark test dbench: dbench ================== 11:42:54 (1724773374) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7597] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg419-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg419-client.virtnet at Tue Aug 27 11:42:55 EDT 2024 waiting for dbench pid 9818 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 186 149.28 MB/sec warmup 1 sec latency 58.613 ms 20 397 140.83 MB/sec warmup 2 sec latency 50.411 ms 20 664 140.75 MB/sec warmup 3 sec latency 50.952 ms 20 824 107.49 MB/sec warmup 4 sec latency 36.257 ms 20 991 88.08 MB/sec warmup 5 sec latency 39.578 ms 20 1246 77.40 MB/sec warmup 6 sec latency 29.890 ms 20 1525 74.48 MB/sec warmup 7 sec latency 45.098 ms 20 1833 65.84 MB/sec warmup 8 sec latency 26.365 ms 20 2023 58.99 MB/sec warmup 9 sec latency 472.076 ms 20 2348 55.50 MB/sec warmup 10 sec latency 28.876 ms 20 2696 55.79 MB/sec warmup 11 sec latency 29.154 ms 20 3238 57.82 MB/sec warmup 12 sec latency 35.143 ms 20 3646 59.51 MB/sec warmup 13 sec latency 34.024 ms 20 3897 57.02 MB/sec warmup 14 sec latency 23.711 ms 20 4122 53.46 MB/sec warmup 15 sec latency 38.424 ms 20 4307 50.51 MB/sec warmup 16 sec latency 53.152 ms 20 4496 48.09 MB/sec warmup 17 sec latency 36.566 ms 20 4745 46.82 MB/sec warmup 18 sec latency 37.161 ms 20 5024 47.52 MB/sec warmup 19 sec latency 38.370 ms 20 5263 45.34 MB/sec warmup 20 sec latency 29.499 ms 20 5509 43.39 MB/sec warmup 21 sec latency 27.288 ms 20 5847 42.22 MB/sec warmup 22 sec latency 23.354 ms 20 6231 43.07 MB/sec warmup 23 sec latency 27.380 ms 20 7190 81.85 MB/sec execute 1 sec latency 36.398 ms 20 7436 53.54 MB/sec execute 2 sec latency 27.310 ms 20 7632 36.79 MB/sec execute 3 sec latency 36.762 ms 20 7846 29.23 MB/sec execute 4 sec latency 60.058 ms 20 8015 25.19 MB/sec execute 5 sec latency 39.555 ms 20 8235 24.82 MB/sec execute 6 sec latency 33.521 ms 20 8527 29.01 MB/sec execute 7 sec latency 43.940 ms 20 8755 26.85 MB/sec execute 8 sec latency 33.568 ms 20 9002 24.33 MB/sec execute 9 sec latency 37.189 ms 20 9213 22.39 MB/sec execute 10 sec latency 105.976 ms 20 9486 22.64 MB/sec execute 11 sec latency 31.709 ms 20 9851 26.41 MB/sec execute 12 sec latency 32.171 ms 20 10367 30.23 MB/sec execute 13 sec latency 39.037 ms 20 10735 33.01 MB/sec execute 14 sec latency 34.791 ms 20 10962 32.47 MB/sec execute 15 sec latency 37.079 ms 20 11126 30.77 MB/sec execute 16 sec latency 41.470 ms 20 11270 29.08 MB/sec execute 17 sec latency 57.290 ms 20 11451 27.88 MB/sec execute 18 sec latency 44.782 ms 20 11709 27.65 MB/sec execute 19 sec latency 30.437 ms 20 12008 28.61 MB/sec execute 20 sec latency 29.036 ms 20 12271 28.41 MB/sec execute 21 sec latency 29.180 ms 20 12489 27.29 MB/sec execute 22 sec latency 28.822 ms 20 12741 26.38 MB/sec execute 23 sec latency 29.916 ms 20 12998 26.21 MB/sec execute 24 sec latency 33.675 ms 20 13296 26.82 MB/sec execute 25 sec latency 31.875 ms 20 13710 28.77 MB/sec execute 26 sec latency 37.457 ms 20 14133 30.47 MB/sec execute 27 sec latency 35.177 ms 20 14354 30.54 MB/sec execute 28 sec latency 37.000 ms 20 14496 29.95 MB/sec execute 29 sec latency 49.005 ms 20 14648 29.15 MB/sec execute 30 sec latency 39.533 ms 20 14838 28.31 MB/sec execute 31 sec latency 65.906 ms 20 15053 27.73 MB/sec execute 32 sec latency 49.060 ms 20 15290 27.59 MB/sec execute 33 sec latency 28.936 ms 20 15573 28.11 MB/sec execute 34 sec latency 37.567 ms 20 15771 27.95 MB/sec execute 35 sec latency 49.820 ms 20 15947 27.25 MB/sec execute 36 sec latency 43.712 ms 20 16122 26.60 MB/sec execute 37 sec latency 40.367 ms 20 16297 26.04 MB/sec execute 38 sec latency 39.443 ms 20 16504 25.82 MB/sec execute 39 sec latency 41.940 ms 20 16684 25.70 MB/sec execute 40 sec latency 68.139 ms 20 16952 26.42 MB/sec execute 41 sec latency 55.598 ms 20 17341 27.18 MB/sec execute 42 sec latency 51.159 ms 20 17672 27.96 MB/sec execute 43 sec latency 42.511 ms 20 17917 28.22 MB/sec execute 44 sec latency 39.635 ms 20 18085 27.86 MB/sec execute 45 sec latency 46.557 ms 20 18241 27.33 MB/sec execute 46 sec latency 43.683 ms 20 18418 26.83 MB/sec execute 47 sec latency 63.267 ms 20 18561 26.41 MB/sec execute 48 sec latency 56.320 ms 20 18715 26.08 MB/sec execute 49 sec latency 46.051 ms 20 18889 25.98 MB/sec execute 50 sec latency 44.457 ms 20 19090 26.19 MB/sec execute 51 sec latency 45.424 ms 20 19285 26.10 MB/sec execute 52 sec latency 40.199 ms 20 19481 25.72 MB/sec execute 53 sec latency 34.037 ms 20 19705 25.32 MB/sec execute 54 sec latency 35.740 ms 20 19967 25.03 MB/sec execute 55 sec latency 25.951 ms 20 20238 25.13 MB/sec execute 56 sec latency 28.357 ms 20 20638 26.01 MB/sec execute 57 sec latency 28.403 ms 20 21155 26.95 MB/sec execute 58 sec latency 30.123 ms 20 21449 27.35 MB/sec execute 59 sec latency 32.797 ms 20 21661 27.27 MB/sec execute 60 sec latency 27.340 ms 20 21841 26.90 MB/sec execute 61 sec latency 56.028 ms 20 22055 26.56 MB/sec execute 62 sec latency 55.184 ms 20 22248 26.30 MB/sec execute 63 sec latency 35.488 ms 20 22473 26.28 MB/sec execute 64 sec latency 33.906 ms 20 22721 26.57 MB/sec execute 65 sec latency 38.116 ms 20 22946 26.43 MB/sec execute 66 sec latency 34.419 ms 20 23160 26.10 MB/sec execute 67 sec latency 31.990 ms 20 23428 25.81 MB/sec execute 68 sec latency 24.145 ms 20 23732 25.87 MB/sec execute 69 sec latency 31.444 ms 20 24156 26.59 MB/sec execute 70 sec latency 31.882 ms 20 24654 27.27 MB/sec execute 71 sec latency 33.133 ms 20 24996 27.73 MB/sec execute 72 sec latency 31.670 ms 20 25253 27.69 MB/sec execute 73 sec latency 26.635 ms 20 25491 27.37 MB/sec execute 74 sec latency 49.848 ms 20 25703 27.13 MB/sec execute 75 sec latency 58.061 ms 20 25959 27.10 MB/sec execute 76 sec latency 31.887 ms 20 26297 27.44 MB/sec execute 77 sec latency 25.727 ms 20 26579 27.29 MB/sec execute 78 sec latency 33.415 ms 20 26841 27.00 MB/sec execute 79 sec latency 25.570 ms 20 27139 26.89 MB/sec execute 80 sec latency 25.911 ms 20 27451 27.04 MB/sec execute 81 sec latency 28.518 ms 20 27936 27.80 MB/sec execute 82 sec latency 29.941 ms 20 28380 28.40 MB/sec execute 83 sec latency 30.705 ms 20 28645 28.50 MB/sec execute 84 sec latency 27.763 ms 20 28827 28.28 MB/sec execute 85 sec latency 35.796 ms 20 28975 27.98 MB/sec execute 86 sec latency 66.591 ms 20 29165 27.73 MB/sec execute 87 sec latency 54.078 ms 20 29341 27.53 MB/sec execute 88 sec latency 41.477 ms 20 29563 27.48 MB/sec execute 89 sec latency 33.017 ms 20 29830 27.72 MB/sec execute 90 sec latency 32.835 ms 20 30014 27.57 MB/sec execute 91 sec latency 37.124 ms 20 30180 27.30 MB/sec execute 92 sec latency 48.175 ms 20 30376 27.05 MB/sec execute 93 sec latency 39.449 ms 20 30581 26.84 MB/sec execute 94 sec latency 36.249 ms 20 30806 26.79 MB/sec execute 95 sec latency 43.233 ms 20 31166 27.22 MB/sec execute 96 sec latency 36.149 ms 20 31673 27.72 MB/sec execute 97 sec latency 30.861 ms 20 32084 28.19 MB/sec execute 98 sec latency 25.253 ms 20 32310 28.14 MB/sec execute 99 sec latency 31.551 ms 20 32500 27.88 MB/sec execute 100 sec latency 66.834 ms 20 32688 27.66 MB/sec execute 101 sec latency 54.826 ms 20 32897 27.51 MB/sec execute 102 sec latency 37.039 ms 20 33160 27.50 MB/sec execute 103 sec latency 29.163 ms 20 33466 27.71 MB/sec execute 104 sec latency 30.925 ms 20 33715 27.56 MB/sec execute 105 sec latency 28.964 ms 20 33979 27.35 MB/sec execute 106 sec latency 24.921 ms 20 34311 27.32 MB/sec execute 107 sec latency 23.064 ms 20 34636 27.53 MB/sec execute 108 sec latency 36.329 ms 20 35194 28.14 MB/sec execute 109 sec latency 31.546 ms 20 35610 28.56 MB/sec execute 110 sec latency 24.760 ms 20 35875 28.54 MB/sec execute 111 sec latency 27.702 ms 20 36101 28.32 MB/sec execute 112 sec latency 58.155 ms 20 36342 28.15 MB/sec execute 113 sec latency 42.402 ms 20 36581 28.11 MB/sec execute 114 sec latency 31.095 ms 20 36883 28.30 MB/sec execute 115 sec latency 28.997 ms 20 37122 28.22 MB/sec execute 116 sec latency 28.093 ms 20 37273 28.00 MB/sec execute 117 sec latency 41.726 ms 20 37456 27.80 MB/sec execute 118 sec latency 42.027 ms 20 37684 27.63 MB/sec execute 119 sec latency 30.061 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 109150 12.762 70.915 Close 80213 2.854 33.105 Rename 4520 18.328 58.335 Unlink 22026 4.049 47.712 Qpathinfo 98495 3.018 54.415 Qfileinfo 16893 0.087 8.982 Qfsinfo 17920 0.037 7.381 Sfileinfo 8840 12.823 54.247 Find 37950 0.556 56.421 WriteX 53218 1.386 24.887 ReadX 166091 0.016 5.219 LockX 320 3.019 12.839 UnlockX 320 2.906 9.196 Flush 7604 11.667 105.969 Throughput 27.6273 MB/sec 20 clients 20 procs max_latency=105.976 ms stopping dbench on /mnt/lustre/d0.oleg419-client.virtnet at Tue Aug 27 11:45:20 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg419-client.virtnet /mnt/lustre/d0.oleg419-client.virtnet /mnt/lustre/d0.oleg419-client.virtnet removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg419-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (149s) == sanity-benchmark test bonnie: bonnie++ ================ 11:45:23 (1724773523) min OST has 3346068kB available, using 5019102kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7597] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4901] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg419-clien 4901M 145278 98 120007 90 343049 73 2667 214 Latency 4371us 54632us 44849us 33994us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg419-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 190 17 4234 22 414 13 286 19 909 13 475 14 Latency 26161us 34076us 40421us 14634us 6520us 21130us 1.97,1.97,oleg419-client.virtnet,1,1724767750,4901M,,,,145278,98,120007,90,,,343049,73,2667,214,10,,,,,190,17,4234,22,414,13,286,19,909,13,475,14,,4371us,54632us,,44849us,33994us,26161us,34076us,40421us,14634us,6520us,21130us debug=0x33f0484 PASS bonnie (250s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 11:49:33 (1724773773) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 8800 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 8800 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x68460 truncating to largest ever: 0xef426 truncating to largest ever: 0x2fdb73 fallocating to largest ever: 0x3ff376 truncating to largest ever: 0x50b9b0 fallocating to largest ever: 0x50de62 fallocating to largest ever: 0x50fc54 truncating to largest ever: 0x5281f2 001000 1724773777.532093 fallocate 0x217455 thru 0x21a03e (0x2bea bytes) fallocating to largest ever: 0x5285e2 003000 1724773784.119748 trunc from 0x4594be to 0x48cc86 (0x337c9 bytes) 004000 1724773787.652270 mapread 0x40cf36 thru 0x418081 (0xb14c bytes) 005000 1724773791.326385 trunc from 0x21c12c to 0x0c6070 (0x1560bb bytes) 008000 1724773802.502819 write 0x3ada78 thru 0x3bd0e2 (0xf66b bytes) 009000 1724773805.872948 mapread 0x1700a5 thru 0x174db4 (0x4d10 bytes) 011000 1724773812.980213 trunc from 0x4c899e to 0x2221c6 (0x2a67d7 bytes) 012000 1724773815.650258 mapread 0x21542b thru 0x21f424 (0x9ffa bytes) 013000 1724773818.415581 trunc from 0x1a60b0 to 0x1cf59e (0x294ef bytes) 014000 1724773821.038677 punch from 0x2a41a8 to 0x2accab (0x8b04 bytes) 015000 1724773823.732014 punch from 0x3c287c to 0x3d1534 (0xecb9 bytes) 016000 1724773826.861993 read 0x0025e3 thru 0x0065d9 (0x3ff7 bytes) 017000 1724773830.096102 punch from 0x23fba8 to 0x246ec1 (0x731a bytes) 019000 1724773835.879753 mapwrite 0x4aad3d thru 0x4ba926 (0xfbea bytes) 021000 1724773841.188428 trunc from 0x504a1c to 0x4d8c0a (0x2be11 bytes) 026000 1724773857.111890 read 0x301bea thru 0x303f54 (0x236b bytes) 027000 1724773860.000554 mapread 0x3de23a thru 0x3e88bf (0xa686 bytes) 029000 1724773865.441028 mapread 0x1fea9e thru 0x20ab15 (0xc078 bytes) 030000 1724773867.849365 trunc from 0x0bd33c to 0x0fb30c (0x3dfd1 bytes) 031000 1724773871.204726 fallocate 0x2e7cce thru 0x2e88ca (0xbfd bytes) 034000 1724773879.518980 mapread 0x128eda thru 0x12e1a8 (0x52cf bytes) 035000 1724773882.140904 read 0x126538 thru 0x126b38 (0x601 bytes) 038000 1724773889.739865 fallocate 0x0a7f75 thru 0x0b20d5 (0xa161 bytes) 039000 1724773892.318513 trunc from 0x4d87c7 to 0x4b3c76 (0x24b50 bytes) 040000 1724773895.144645 fallocate 0x24c0f5 thru 0x257fdd (0xbee9 bytes) 041000 1724773897.947008 fallocate 0x0e851b thru 0x0f3f21 (0xba07 bytes) 042000 1724773900.853195 mapread 0x206f58 thru 0x216eb1 (0xff5a bytes) 043000 1724773903.349478 mapwrite 0x27ab23 thru 0x289a01 (0xeedf bytes) 045000 1724773908.008194 mapread 0x01836d thru 0x01c067 (0x3cfb bytes) 046000 1724773910.537507 fallocate 0x460bb2 thru 0x46e312 (0xd761 bytes) 049000 1724773918.506705 mapread 0x20c1f8 thru 0x217de7 (0xbbf0 bytes) 050000 1724773921.311743 mapread 0x0b96cd thru 0x0c201f (0x8953 bytes) 051000 1724773924.171524 write 0x3b5613 thru 0x3bf40b (0x9df9 bytes) 052000 1724773927.129881 fallocate 0x0edc76 thru 0x0fd956 (0xfce1 bytes) 053000 1724773930.334443 mapwrite 0x0a49c9 thru 0x0ae797 (0x9dcf bytes) 057000 1724773940.279780 mapwrite 0x001f5e thru 0x00eb06 (0xcba9 bytes) 059000 1724773945.427909 write 0x1c45dc thru 0x1c8c6a (0x468f bytes) 061000 1724773952.180468 trunc from 0x49a1d1 to 0x3c8460 (0xd1d70 bytes) 062000 1724773955.578402 read 0x3014aa thru 0x30b334 (0x9e8b bytes) 063000 1724773958.782265 mapwrite 0x082531 thru 0x0898d4 (0x73a4 bytes) 065000 1724773965.310166 mapwrite 0x26d14f thru 0x26e46d (0x131f bytes) 066000 1724773968.208781 mapread 0x0eef72 thru 0x0fc3d2 (0xd461 bytes) 068000 1724773973.544637 read 0x471906 thru 0x47ba14 (0xa10f bytes) 069000 1724773976.515903 write 0x01b8ff thru 0x029911 (0xe013 bytes) 070000 1724773979.193916 mapread 0x1e362e thru 0x1eef92 (0xb965 bytes) 071000 1724773981.659906 read 0x0bbe20 thru 0x0c4a76 (0x8c57 bytes) 075000 1724773991.406278 mapread 0x4e2114 thru 0x4e912f (0x701c bytes) 076000 1724773994.087387 write 0x1e208d thru 0x1ef38b (0xd2ff bytes) 078000 1724773998.997088 trunc from 0x25eac6 to 0x1d3dcf (0x8acf6 bytes) 079000 1724774001.028501 mapwrite 0x306920 thru 0x315a82 (0xf163 bytes) 081000 1724774006.047784 trunc from 0x303ce6 to 0x4fbd13 (0x1f802e bytes) 082000 1724774008.398343 trunc from 0x497598 to 0x3145e3 (0x182fb4 bytes) skipping zero length punch hole 085000 1724774015.952757 mapwrite 0x2ff0c8 thru 0x305877 (0x67b0 bytes) 086000 1724774018.099824 fallocate 0x02a31d thru 0x03999d (0xf681 bytes) 087000 1724774020.053635 trunc from 0x341144 to 0x211f1c (0x12f227 bytes) 088000 1724774022.156869 mapwrite 0x071a39 thru 0x07fd84 (0xe34c bytes) 089000 1724774024.413969 mapwrite 0x3710bf thru 0x37672a (0x566c bytes) 090000 1724774026.935100 read 0x1d609b thru 0x1e428d (0xe1f3 bytes) 091000 1724774029.122749 mapwrite 0x219d67 thru 0x227567 (0xd801 bytes) skipping zero length fallocate 094000 1724774035.936039 trunc from 0x02e840 to 0x437bbb (0x40937c bytes) 095000 1724774038.004313 fallocate 0x5053a3 thru 0x50ac9c (0x58fa bytes) 096000 1724774040.358889 read 0x071e71 thru 0x0735bf (0x174f bytes) 097000 1724774042.814206 mapread 0x151bc3 thru 0x161981 (0xfdbf bytes) 098000 1724774045.547808 fallocate 0x1854c2 thru 0x188ec9 (0x3a08 bytes) 099000 1724774048.012203 mapread 0x2ba9c3 thru 0x2c8b8b (0xe1c9 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (278s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 11:54:11 (1724774051) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1724774055.450896 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1724774058.186725 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1724774060.808583 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1724774063.903544 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1724774070.506348 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1724774073.353628 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1724774076.947021 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1724774080.834233 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1724774084.168564 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1724774087.429835 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1724774090.722936 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1724774094.347061 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1724774097.651193 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1724774101.754301 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1724774105.405731 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1724774108.360871 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1724774111.834574 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1724774114.839641 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1724774118.591867 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1724774130.103404 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1724774133.461087 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1724774136.436162 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1724774139.324128 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1724774146.867688 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1724774154.359959 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1724774157.775857 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1724774160.712825 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1724774166.783959 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1724774170.341681 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1724774175.643119 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1724774178.409432 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1724774180.814464 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1724774184.056373 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1724774187.909453 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1724774195.359571 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1724774202.940218 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1724774212.286603 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1724774217.714100 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1724774220.504573 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1724774223.356571 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1724774232.296758 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1724774235.307307 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1724774238.675019 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1724774242.035121 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1724774245.379136 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1724774248.519135 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1724774251.952237 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1724774255.391122 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1724774258.814067 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1724774264.718542 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1724774268.674427 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1724774272.147564 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1724774275.571751 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1724774279.240117 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1724774285.762441 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1724774297.091291 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1724774303.358972 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1724774306.677131 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1724774309.780668 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1724774316.382918 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1724774319.874203 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1724774325.652065 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1724774328.759809 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1724774334.813248 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1724774340.702574 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1724774348.373177 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1724774352.046509 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1724774355.037238 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1724774357.888729 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1724774364.148827 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1724774367.428926 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1724774374.207442 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1724774377.620926 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (327s) == sanity-benchmark test complete, duration 1017 sec ===== 11:59:38 (1724774378) === sanity-benchmark: start cleanup 11:59:39 (1724774379) === === sanity-benchmark: finish cleanup 11:59:39 (1724774379) ===