-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:06 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:15 (1734015855) === oleg313-client.virtnet: executing check_config_client /mnt/lustre oleg313-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg313-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012bdf7800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012bdf7800.idle_timeout=debug disable quota as required oleg313-server: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:34 (1734015874) === == sanity-benchmark test dbench: dbench ================== 10:04:35 (1734015875) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7591] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg313-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg313-client.virtnet at Thu Dec 12 10:04:37 EST 2024 waiting for dbench pid 10286 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 4 11 4.36 MB/sec warmup 1 sec latency 889.408 ms 20 99 45.03 MB/sec warmup 2 sec latency 268.455 ms 20 164 45.22 MB/sec warmup 3 sec latency 157.126 ms 20 216 41.93 MB/sec warmup 4 sec latency 166.306 ms 20 282 41.88 MB/sec warmup 5 sec latency 116.454 ms 20 336 40.41 MB/sec warmup 6 sec latency 150.719 ms 20 397 40.19 MB/sec warmup 7 sec latency 121.731 ms 20 467 40.86 MB/sec warmup 8 sec latency 124.103 ms 20 548 41.89 MB/sec warmup 9 sec latency 151.908 ms 20 653 42.07 MB/sec warmup 10 sec latency 139.211 ms 20 704 38.48 MB/sec warmup 11 sec latency 129.751 ms 20 765 35.51 MB/sec warmup 12 sec latency 83.747 ms 20 826 33.03 MB/sec warmup 13 sec latency 97.579 ms 20 890 30.91 MB/sec warmup 14 sec latency 96.035 ms 20 940 29.00 MB/sec warmup 15 sec latency 98.070 ms 20 981 27.41 MB/sec warmup 16 sec latency 575.862 ms 20 994 25.84 MB/sec warmup 17 sec latency 1507.451 ms 20 1062 25.40 MB/sec warmup 18 sec latency 1833.489 ms 20 1139 24.16 MB/sec warmup 19 sec latency 79.286 ms 20 1208 23.16 MB/sec warmup 20 sec latency 94.975 ms 20 1274 22.24 MB/sec warmup 21 sec latency 86.413 ms 20 1414 23.61 MB/sec warmup 22 sec latency 131.853 ms 20 1484 22.61 MB/sec warmup 23 sec latency 80.530 ms 20 1624 1.25 MB/sec execute 1 sec latency 89.733 ms 20 1686 1.20 MB/sec execute 2 sec latency 101.179 ms 20 1765 1.21 MB/sec execute 3 sec latency 103.511 ms 20 1842 1.25 MB/sec execute 4 sec latency 77.976 ms 20 1909 1.24 MB/sec execute 5 sec latency 94.628 ms 20 2003 1.31 MB/sec execute 6 sec latency 74.260 ms 20 2074 1.51 MB/sec execute 7 sec latency 95.935 ms 20 2162 1.61 MB/sec execute 8 sec latency 67.462 ms 20 2220 1.72 MB/sec execute 9 sec latency 87.936 ms 20 2346 3.53 MB/sec execute 10 sec latency 73.516 ms 20 2410 3.59 MB/sec execute 11 sec latency 101.955 ms 20 2469 3.85 MB/sec execute 12 sec latency 106.179 ms 20 2566 4.74 MB/sec execute 13 sec latency 122.143 ms 20 2692 6.26 MB/sec execute 14 sec latency 97.062 ms 20 2876 8.69 MB/sec execute 15 sec latency 103.882 ms 20 3000 9.41 MB/sec execute 16 sec latency 102.007 ms 20 3081 9.14 MB/sec execute 17 sec latency 581.564 ms 20 3158 9.07 MB/sec execute 18 sec latency 1121.190 ms 20 3335 9.99 MB/sec execute 19 sec latency 95.424 ms 20 3470 10.83 MB/sec execute 20 sec latency 72.145 ms 20 3612 11.88 MB/sec execute 21 sec latency 75.277 ms 20 3688 11.54 MB/sec execute 22 sec latency 86.603 ms 20 3757 11.46 MB/sec execute 23 sec latency 122.221 ms 20 3825 11.38 MB/sec execute 24 sec latency 106.904 ms 20 3879 11.00 MB/sec execute 25 sec latency 123.210 ms 20 3945 10.73 MB/sec execute 26 sec latency 78.376 ms 20 4005 10.33 MB/sec execute 27 sec latency 79.313 ms 20 4060 9.98 MB/sec execute 28 sec latency 116.898 ms 20 4132 9.65 MB/sec execute 29 sec latency 128.580 ms 20 4200 9.38 MB/sec execute 30 sec latency 142.980 ms 20 4266 9.17 MB/sec execute 31 sec latency 124.844 ms 20 4333 8.99 MB/sec execute 32 sec latency 84.856 ms 20 4397 8.80 MB/sec execute 33 sec latency 103.924 ms 20 4470 8.66 MB/sec execute 34 sec latency 89.768 ms 20 4533 8.51 MB/sec execute 35 sec latency 97.237 ms 20 4613 8.63 MB/sec execute 36 sec latency 103.481 ms 20 4712 8.65 MB/sec execute 37 sec latency 92.131 ms 20 4790 8.53 MB/sec execute 38 sec latency 77.895 ms 20 4892 8.93 MB/sec execute 39 sec latency 84.983 ms 20 4996 9.51 MB/sec execute 40 sec latency 110.956 ms 20 5051 9.29 MB/sec execute 41 sec latency 89.610 ms 20 5110 9.09 MB/sec execute 42 sec latency 118.883 ms 20 5172 8.91 MB/sec execute 43 sec latency 80.380 ms 20 5232 8.73 MB/sec execute 44 sec latency 92.512 ms 20 5292 8.56 MB/sec execute 45 sec latency 103.389 ms 20 5349 8.39 MB/sec execute 46 sec latency 84.717 ms 20 5401 8.23 MB/sec execute 47 sec latency 122.278 ms 20 5475 8.09 MB/sec execute 48 sec latency 98.490 ms 20 5552 7.96 MB/sec execute 49 sec latency 93.917 ms 20 5625 7.84 MB/sec execute 50 sec latency 105.889 ms 20 5694 7.74 MB/sec execute 51 sec latency 117.475 ms 20 5775 7.66 MB/sec execute 52 sec latency 100.380 ms 20 5860 7.68 MB/sec execute 53 sec latency 81.724 ms 20 5954 7.79 MB/sec execute 54 sec latency 113.888 ms 20 6021 7.79 MB/sec execute 55 sec latency 82.977 ms 20 6098 7.79 MB/sec execute 56 sec latency 162.722 ms 20 6234 8.25 MB/sec execute 57 sec latency 108.318 ms 20 6384 8.68 MB/sec execute 58 sec latency 91.059 ms 20 6523 8.89 MB/sec execute 59 sec latency 93.615 ms 20 6664 9.02 MB/sec execute 60 sec latency 99.442 ms 20 6827 9.15 MB/sec execute 61 sec latency 81.659 ms 20 6996 9.64 MB/sec execute 62 sec latency 83.509 ms 20 7124 9.93 MB/sec execute 63 sec latency 78.068 ms 20 7201 9.90 MB/sec execute 64 sec latency 86.344 ms 20 7282 9.92 MB/sec execute 65 sec latency 79.566 ms 20 7345 9.87 MB/sec execute 66 sec latency 119.019 ms 20 7402 9.80 MB/sec execute 67 sec latency 123.657 ms 20 7458 9.68 MB/sec execute 68 sec latency 105.282 ms 20 7520 9.58 MB/sec execute 69 sec latency 79.257 ms 20 7577 9.45 MB/sec execute 70 sec latency 95.340 ms 20 7627 9.32 MB/sec execute 71 sec latency 114.511 ms 20 7685 9.20 MB/sec execute 72 sec latency 142.865 ms 20 7754 9.10 MB/sec execute 73 sec latency 164.384 ms 20 7824 9.01 MB/sec execute 74 sec latency 118.996 ms 20 7882 8.93 MB/sec execute 75 sec latency 91.748 ms 20 7951 8.86 MB/sec execute 76 sec latency 116.713 ms 20 8012 8.79 MB/sec execute 77 sec latency 148.916 ms 20 8079 8.76 MB/sec execute 78 sec latency 75.059 ms 20 8164 8.75 MB/sec execute 79 sec latency 86.918 ms 20 8260 8.81 MB/sec execute 80 sec latency 82.785 ms 20 8335 8.72 MB/sec execute 81 sec latency 90.464 ms 20 8438 8.94 MB/sec execute 82 sec latency 114.231 ms 20 8544 9.12 MB/sec execute 83 sec latency 73.447 ms 20 8630 9.09 MB/sec execute 84 sec latency 82.233 ms 20 8706 9.00 MB/sec execute 85 sec latency 88.429 ms 20 8780 8.91 MB/sec execute 86 sec latency 72.342 ms 20 8859 8.82 MB/sec execute 87 sec latency 85.024 ms 20 8929 8.74 MB/sec execute 88 sec latency 70.196 ms 20 9017 8.66 MB/sec execute 89 sec latency 73.239 ms 20 9101 8.58 MB/sec execute 90 sec latency 87.718 ms 20 9204 8.52 MB/sec execute 91 sec latency 61.095 ms 20 9305 8.47 MB/sec execute 92 sec latency 58.979 ms 20 9425 8.53 MB/sec execute 93 sec latency 71.299 ms 20 9528 8.57 MB/sec execute 94 sec latency 70.359 ms 20 9638 8.63 MB/sec execute 95 sec latency 88.320 ms 20 9833 8.95 MB/sec execute 96 sec latency 74.327 ms 20 10033 9.31 MB/sec execute 97 sec latency 72.040 ms 20 10240 9.45 MB/sec execute 98 sec latency 74.567 ms 20 10494 9.80 MB/sec execute 99 sec latency 74.589 ms 20 10654 10.08 MB/sec execute 100 sec latency 64.249 ms 20 10748 10.06 MB/sec execute 101 sec latency 78.455 ms 20 10844 10.07 MB/sec execute 102 sec latency 68.555 ms 20 10926 10.08 MB/sec execute 103 sec latency 116.231 ms 20 11000 10.01 MB/sec execute 104 sec latency 127.571 ms 20 11068 9.94 MB/sec execute 105 sec latency 108.905 ms 20 11129 9.84 MB/sec execute 106 sec latency 76.264 ms 20 11205 9.76 MB/sec execute 107 sec latency 102.202 ms 20 11294 9.69 MB/sec execute 108 sec latency 92.283 ms 20 11367 9.62 MB/sec execute 109 sec latency 132.704 ms 20 11445 9.57 MB/sec execute 110 sec latency 82.895 ms 20 11530 9.52 MB/sec execute 111 sec latency 74.617 ms 20 11599 9.48 MB/sec execute 112 sec latency 106.384 ms 20 11693 9.49 MB/sec execute 113 sec latency 83.326 ms 20 11786 9.51 MB/sec execute 114 sec latency 76.557 ms 20 11889 9.50 MB/sec execute 115 sec latency 69.519 ms 20 12003 9.62 MB/sec execute 116 sec latency 79.319 ms 20 12142 9.79 MB/sec execute 117 sec latency 116.555 ms 20 12217 9.72 MB/sec execute 118 sec latency 115.287 ms 20 12293 9.65 MB/sec execute 119 sec latency 90.370 ms 20 cleanup 120 sec 20 cleanup 121 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 37686 36.024 223.749 Close 27767 9.043 100.324 Rename 1575 53.078 199.966 Unlink 7485 11.188 99.584 Qpathinfo 34460 8.582 185.959 Qfileinfo 5972 0.183 22.021 Qfsinfo 6120 0.120 19.128 Sfileinfo 3000 36.657 123.129 Find 13062 2.129 89.120 WriteX 18447 4.460 102.542 ReadX 58250 0.025 6.482 LockX 120 10.006 24.286 UnlockX 120 9.918 28.135 Flush 2617 38.751 1121.183 Throughput 9.6472 MB/sec 20 clients 20 procs max_latency=1121.190 ms stopping dbench on /mnt/lustre/d0.oleg313-client.virtnet at Thu Dec 12 10:07:03 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg313-client.virtnet /mnt/lustre/d0.oleg313-client.virtnet /mnt/lustre/d0.oleg313-client.virtnet removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg313-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (154s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:09 (1734016029) min OST has 3526824kB available, using 5290236kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7591] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5166] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg313-clien 5166M 80696 63 62954 52 243625 45 3241 246 Latency 26669us 239ms 67216us 7720us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg313-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 301 18 6183 28 426 13 373 18 848 13 486 13 Latency 16587us 24351us 36612us 17362us 17597us 15823us 1.97,1.97,oleg313-client.virtnet,1,1734004848,5166M,,,,80696,63,62954,52,,,243625,45,3241,246,10,,,,,301,18,6183,28,426,13,373,18,848,13,486,13,,26669us,239ms,,67216us,7720us,16587us,24351us,36612us,17362us,17597us,15823us debug=0x33f0484 PASS bonnie (301s) == sanity-benchmark test iozone: iozone ================== 10:12:11 (1734016331) Waiting for MDT destroys to complete oleg313-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg313-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 min OST has 3605484kB available, using 5408226kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7591] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:18 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 228177 167305 131709 129047 69888 91472 iozone test complete. Waiting for MDT destroys to complete oleg313-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg313-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg313-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg313-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:17:18 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 99785 75981 87822 87572 84515 78195 iozone test complete. Waiting for MDT destroys to complete oleg313-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg313-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 pdsh@oleg313-client: oleg313-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (699s) == sanity-benchmark test fsx: fsx ======================== 10:23:50 (1734017030) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 4884 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 4884 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x228e8f truncating to largest ever: 0x4a213c fallocating to largest ever: 0x4fefa4 fallocating to largest ever: 0x51ab8b fallocating to largest ever: 0x520099 truncating to largest ever: 0x526260 fallocating to largest ever: 0x526854 001000 1734017033.796234 punch from 0x2d6da4 to 0x2d6dfc (0x59 bytes) 003000 1734017039.639889 read 0x118e53 thru 0x123efe (0xb0ac bytes) 004000 1734017042.573602 write 0x2d9b67 thru 0x2e8346 (0xe7e0 bytes) fallocating to largest ever: 0x5285e2 005000 1734017045.359826 trunc from 0x4d75e3 to 0x4eb3bb (0x13dd9 bytes) 006000 1734017048.291220 read 0x07c5cd thru 0x088abf (0xc4f3 bytes) 007000 1734017050.814479 read 0x03896b thru 0x047190 (0xe826 bytes) 008000 1734017053.472082 trunc from 0x3b501b to 0x22d5d1 (0x187a49 bytes) 009000 1734017056.600084 mapwrite 0x38b843 thru 0x3910e3 (0x58a1 bytes) 011000 1734017062.277426 read 0x0848b7 thru 0x08a238 (0x5982 bytes) 012000 1734017065.130304 mapwrite 0x215c9e thru 0x216abf (0xe22 bytes) 015000 1734017073.643084 punch from 0x00b0a0 to 0x00e817 (0x3778 bytes) 016000 1734017076.762915 trunc from 0x40c023 to 0x505868 (0xf9846 bytes) 018000 1734017082.670213 punch from 0x1a2c44 to 0x1acb1c (0x9ed9 bytes) 019000 1734017085.738143 read 0x4e1c88 thru 0x4f02b0 (0xe629 bytes) 020000 1734017088.697904 trunc from 0x3a79f5 to 0x0cbcfb (0x2dbcf9 bytes) 021000 1734017092.083443 mapwrite 0x0fc082 thru 0x102ba3 (0x6b22 bytes) 023000 1734017097.763818 trunc from 0x44b9fb to 0x501c58 (0xb625e bytes) 024000 1734017101.226304 read 0x0c02bd thru 0x0ce27a (0xdfbe bytes) 026000 1734017107.156228 mapread 0x26b8e3 thru 0x27346d (0x7b8b bytes) 027000 1734017110.388279 mapread 0x37e912 thru 0x380ef9 (0x25e8 bytes) 030000 1734017120.593885 mapwrite 0x133f1f thru 0x13a531 (0x6613 bytes) 032000 1734017127.503212 write 0x07856c thru 0x07b895 (0x332a bytes) 033000 1734017130.763611 punch from 0x20fabd to 0x2156b0 (0x5bf4 bytes) 034000 1734017134.082745 mapread 0x0249b8 thru 0x02cd1d (0x8366 bytes) 035000 1734017136.973660 read 0x0a1adb thru 0x0b0923 (0xee49 bytes) 036000 1734017140.261791 read 0x065485 thru 0x07409a (0xec16 bytes) 038000 1734017145.871512 punch from 0x0ae02d to 0x0aeedc (0xeb0 bytes) 040000 1734017151.535345 mapwrite 0x0e013d thru 0x0e367a (0x353e bytes) 041000 1734017154.424720 write 0x271bea thru 0x2728fc (0xd13 bytes) 042000 1734017157.482038 mapwrite 0x180d84 thru 0x1895a0 (0x881d bytes) 043000 1734017159.930683 fallocate 0x097762 thru 0x0a3d18 (0xc5b7 bytes) 044000 1734017162.966698 trunc from 0x11ece2 to 0x38e51a (0x26f839 bytes) 045000 1734017165.544063 mapread 0x08d827 thru 0x091eba (0x4694 bytes) 047000 1734017171.889414 punch from 0x0d4b51 to 0x0e27be (0xdc6e bytes) 048000 1734017174.850908 read 0x0fd0d1 thru 0x101eda (0x4e0a bytes) 050000 1734017180.352171 mapread 0x1a365c thru 0x1a49b4 (0x1359 bytes) 052000 1734017186.017292 fallocate 0x0be15b thru 0x0c6e54 (0x8cfa bytes) 053000 1734017188.941716 punch from 0x239086 to 0x244b44 (0xbabf bytes) 054000 1734017192.023439 read 0x18e152 thru 0x196043 (0x7ef2 bytes) 055000 1734017194.933595 mapread 0x08aea0 thru 0x091312 (0x6473 bytes) 057000 1734017200.872365 mapread 0x239cfc thru 0x24501c (0xb321 bytes) 059000 1734017206.164497 read 0x0a2c5b thru 0x0af373 (0xc719 bytes) 060000 1734017209.009088 punch from 0x01e428 to 0x0298b2 (0xb48b bytes) 061000 1734017212.031645 punch from 0x1b1076 to 0x1b9bf7 (0x8b82 bytes) 062000 1734017215.171667 punch from 0x018a22 to 0x01dbb7 (0x5196 bytes) 063000 1734017218.187043 mapread 0x09c98b thru 0x0a7395 (0xaa0b bytes) 064000 1734017221.404019 fallocate 0x1b6618 thru 0x1bf665 (0x904e bytes) 065000 1734017224.547893 mapwrite 0x31ef12 thru 0x325c72 (0x6d61 bytes) 069000 1734017236.735827 fallocate 0x085e91 thru 0x09594d (0xfabd bytes) 070000 1734017239.829465 write 0x0cecd6 thru 0x0dd45d (0xe788 bytes) 072000 1734017245.795714 mapread 0x4ae966 thru 0x4be50c (0xfba7 bytes) 073000 1734017248.579294 punch from 0x0fe411 to 0x0ff8df (0x14cf bytes) 075000 1734017254.646646 write 0x05ee38 thru 0x064ad6 (0x5c9f bytes) 076000 1734017257.773738 mapread 0x24e5cb thru 0x259631 (0xb067 bytes) 077000 1734017260.879089 read 0x36a32f thru 0x36cc76 (0x2948 bytes) 078000 1734017263.918222 punch from 0x0f788c to 0x101333 (0x9aa8 bytes) 079000 1734017267.181244 mapwrite 0x5185bf thru 0x521c4e (0x9690 bytes) 080000 1734017269.958465 write 0x30083a thru 0x3031e6 (0x29ad bytes) 081000 1734017273.127200 mapwrite 0x155b90 thru 0x15d185 (0x75f6 bytes) 082000 1734017276.335438 punch from 0x144b1c to 0x14c8b6 (0x7d9b bytes) 083000 1734017279.695313 mapwrite 0x4bdcf5 thru 0x4cc248 (0xe554 bytes) 085000 1734017286.182225 write 0x06b449 thru 0x06b653 (0x20b bytes) 086000 1734017289.426998 read 0x3d07d2 thru 0x3d6d72 (0x65a1 bytes) 087000 1734017292.740751 punch from 0x01aa4f to 0x0287f3 (0xdda5 bytes) 088000 1734017295.412438 fallocate 0x27e644 thru 0x285ec2 (0x787f bytes) 089000 1734017298.431688 mapwrite 0x4860e1 thru 0x488a93 (0x29b3 bytes) 092000 1734017307.211931 mapwrite 0x48b6bc thru 0x4997d7 (0xe11c bytes) 093000 1734017310.359458 trunc from 0x4e4ee3 to 0x1d54a9 (0x30fa39 bytes) 095000 1734017316.048171 write 0x480452 thru 0x481625 (0x11d4 bytes) 096000 1734017318.863620 mapread 0x014700 thru 0x01d281 (0x8b82 bytes) 097000 1734017322.076714 fallocate 0x228ccf thru 0x22b0e0 (0x2412 bytes) 098000 1734017324.837669 fallocate 0x30232b thru 0x311e6d (0xfb43 bytes) 099000 1734017327.729646 punch from 0x1501d4 to 0x15518f (0x4fbc bytes) 100000 1734017330.300675 punch from 0x087c10 to 0x093cd8 (0xc0c9 bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4641048 (4536 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 1839104.. 1839107: 4: 0001: net 1: 4.. 15: 1835520.. 1835531: 12: 0001: net 2: 16.. 19: 1837040.. 1837043: 4: 0001: net 3: 20.. 23: 2097532.. 2097535: 4: 0001: net 4: 24.. 55: 2097472.. 2097503: 32: 0001: net 5: 56.. 71: 2098112.. 2098127: 16: 0001: net 6: 72.. 75: 2097528.. 2097531: 4: 0001: net 7: 76.. 87: 2099732.. 2099743: 12: 0001: net 8: 1972.. 2039: 1845600.. 1845667: 68: 0001: unwritten,net 9: 4252.. 4315: 1836928.. 1836991: 64: 0001: last,net /mnt/lustre/f0.fsxfile: 10 extents found debug=0x33f0484 PASS fsx (301s) == sanity-benchmark test complete, duration 1485 sec ===== 10:28:51 (1734017331) === sanity-benchmark: start cleanup 10:28:51 (1734017331) === === sanity-benchmark: finish cleanup 10:28:52 (1734017332) ===