-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:59 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:08 (1734015848) === oleg360-client.virtnet: executing check_config_client /mnt/lustre oleg360-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg360-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012e5a6800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012e5a6800.idle_timeout=debug disable quota as required oleg360-server: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:27 (1734015867) === == sanity-benchmark test dbench: dbench ================== 10:04:28 (1734015868) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7582] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg360-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg360-client.virtnet at Thu Dec 12 10:04:30 EST 2024 waiting for dbench pid 10277 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 16 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 3 17 10.40 MB/sec warmup 1 sec latency 912.658 ms 20 115 52.94 MB/sec warmup 2 sec latency 191.992 ms 20 172 46.79 MB/sec warmup 3 sec latency 141.812 ms 20 235 45.03 MB/sec warmup 4 sec latency 118.300 ms 20 299 44.13 MB/sec warmup 5 sec latency 135.473 ms 20 357 42.59 MB/sec warmup 6 sec latency 125.174 ms 20 420 42.41 MB/sec warmup 7 sec latency 132.792 ms 20 481 42.02 MB/sec warmup 8 sec latency 126.792 ms 20 569 43.40 MB/sec warmup 9 sec latency 125.470 ms 20 668 42.26 MB/sec warmup 10 sec latency 146.285 ms 20 717 38.60 MB/sec warmup 11 sec latency 111.887 ms 20 777 35.62 MB/sec warmup 12 sec latency 94.897 ms 20 825 33.07 MB/sec warmup 13 sec latency 116.915 ms 20 886 30.94 MB/sec warmup 14 sec latency 104.750 ms 20 920 29.00 MB/sec warmup 15 sec latency 181.307 ms 20 938 27.23 MB/sec warmup 16 sec latency 1131.784 ms 20 950 25.67 MB/sec warmup 17 sec latency 2064.228 ms 20 989 24.72 MB/sec warmup 18 sec latency 2581.157 ms 20 1059 23.82 MB/sec warmup 19 sec latency 113.018 ms 20 1135 22.96 MB/sec warmup 20 sec latency 98.839 ms 20 1201 21.93 MB/sec warmup 21 sec latency 88.110 ms 20 1310 22.29 MB/sec warmup 22 sec latency 98.726 ms 20 1397 22.02 MB/sec warmup 23 sec latency 92.126 ms 20 1544 1.35 MB/sec execute 1 sec latency 145.846 ms 20 1619 1.34 MB/sec execute 2 sec latency 79.828 ms 20 1685 1.24 MB/sec execute 3 sec latency 101.189 ms 20 1767 1.27 MB/sec execute 4 sec latency 101.718 ms 20 1843 1.26 MB/sec execute 5 sec latency 82.284 ms 20 1927 1.29 MB/sec execute 6 sec latency 86.474 ms 20 2007 1.40 MB/sec execute 7 sec latency 77.906 ms 20 2086 1.47 MB/sec execute 8 sec latency 77.723 ms 20 2143 1.48 MB/sec execute 9 sec latency 118.176 ms 20 2227 1.95 MB/sec execute 10 sec latency 80.981 ms 20 2321 2.81 MB/sec execute 11 sec latency 90.230 ms 20 2399 3.30 MB/sec execute 12 sec latency 90.587 ms 20 2460 3.68 MB/sec execute 13 sec latency 102.139 ms 20 2534 3.92 MB/sec execute 14 sec latency 125.577 ms 20 2664 5.69 MB/sec execute 15 sec latency 117.549 ms 20 2771 6.57 MB/sec execute 16 sec latency 209.781 ms 20 2915 8.12 MB/sec execute 17 sec latency 203.842 ms 20 3044 8.51 MB/sec execute 18 sec latency 102.475 ms 20 3208 9.01 MB/sec execute 19 sec latency 107.867 ms 20 3350 9.43 MB/sec execute 20 sec latency 105.185 ms 20 3491 10.79 MB/sec execute 21 sec latency 89.075 ms 20 3614 11.37 MB/sec execute 22 sec latency 70.844 ms 20 3701 11.21 MB/sec execute 23 sec latency 69.138 ms 20 3772 11.22 MB/sec execute 24 sec latency 93.882 ms 20 3823 10.97 MB/sec execute 25 sec latency 127.146 ms 20 3875 10.65 MB/sec execute 26 sec latency 129.490 ms 20 3933 10.36 MB/sec execute 27 sec latency 101.853 ms 20 3991 10.01 MB/sec execute 28 sec latency 83.980 ms 20 4044 9.67 MB/sec execute 29 sec latency 71.907 ms 20 4109 9.35 MB/sec execute 30 sec latency 117.912 ms 20 4179 9.10 MB/sec execute 31 sec latency 149.087 ms 20 4251 8.90 MB/sec execute 32 sec latency 116.919 ms 20 4316 8.72 MB/sec execute 33 sec latency 91.593 ms 20 4374 8.55 MB/sec execute 34 sec latency 93.406 ms 20 4441 8.39 MB/sec execute 35 sec latency 99.927 ms 20 4502 8.24 MB/sec execute 36 sec latency 90.123 ms 20 4566 8.25 MB/sec execute 37 sec latency 101.442 ms 20 4641 8.30 MB/sec execute 38 sec latency 101.711 ms 20 4725 8.24 MB/sec execute 39 sec latency 86.978 ms 20 4801 8.08 MB/sec execute 40 sec latency 74.728 ms 20 4918 8.80 MB/sec execute 41 sec latency 93.045 ms 20 5009 9.09 MB/sec execute 42 sec latency 101.224 ms 20 5071 8.90 MB/sec execute 43 sec latency 111.883 ms 20 5129 8.72 MB/sec execute 44 sec latency 76.770 ms 20 5191 8.55 MB/sec execute 45 sec latency 89.438 ms 20 5245 8.38 MB/sec execute 46 sec latency 138.376 ms 20 5299 8.22 MB/sec execute 47 sec latency 117.066 ms 20 5343 8.07 MB/sec execute 48 sec latency 111.482 ms 20 5392 7.92 MB/sec execute 49 sec latency 108.175 ms 20 5472 7.79 MB/sec execute 50 sec latency 80.751 ms 20 5551 7.67 MB/sec execute 51 sec latency 88.470 ms 20 5618 7.56 MB/sec execute 52 sec latency 100.347 ms 20 5690 7.45 MB/sec execute 53 sec latency 84.375 ms 20 5765 7.34 MB/sec execute 54 sec latency 76.903 ms 20 5862 7.49 MB/sec execute 55 sec latency 106.538 ms 20 5943 7.51 MB/sec execute 56 sec latency 88.881 ms 20 5998 7.47 MB/sec execute 57 sec latency 118.303 ms 20 6081 7.51 MB/sec execute 58 sec latency 105.477 ms 20 6206 7.89 MB/sec execute 59 sec latency 112.800 ms 20 6365 8.31 MB/sec execute 60 sec latency 102.030 ms 20 6499 8.62 MB/sec execute 61 sec latency 106.061 ms 20 6639 8.68 MB/sec execute 62 sec latency 93.129 ms 20 6815 8.87 MB/sec execute 63 sec latency 92.374 ms 20 6975 9.33 MB/sec execute 64 sec latency 90.395 ms 20 7102 9.60 MB/sec execute 65 sec latency 65.317 ms 20 7192 9.60 MB/sec execute 66 sec latency 73.569 ms 20 7266 9.62 MB/sec execute 67 sec latency 95.904 ms 20 7334 9.61 MB/sec execute 68 sec latency 89.969 ms 20 7379 9.51 MB/sec execute 69 sec latency 158.231 ms 20 7430 9.42 MB/sec execute 70 sec latency 163.758 ms 20 7479 9.32 MB/sec execute 71 sec latency 119.532 ms 20 7533 9.20 MB/sec execute 72 sec latency 85.453 ms 20 7589 9.08 MB/sec execute 73 sec latency 79.886 ms 20 7642 8.96 MB/sec execute 74 sec latency 151.438 ms 20 7722 8.85 MB/sec execute 75 sec latency 120.076 ms 20 7787 8.77 MB/sec execute 76 sec latency 158.283 ms 20 7852 8.69 MB/sec execute 77 sec latency 92.159 ms 20 7917 8.62 MB/sec execute 78 sec latency 82.773 ms 20 7990 8.56 MB/sec execute 79 sec latency 81.117 ms 20 8050 8.49 MB/sec execute 80 sec latency 87.718 ms 20 8117 8.51 MB/sec execute 81 sec latency 123.195 ms 20 8200 8.54 MB/sec execute 82 sec latency 139.265 ms 20 8277 8.48 MB/sec execute 83 sec latency 80.858 ms 20 8353 8.43 MB/sec execute 84 sec latency 81.506 ms 20 8476 8.78 MB/sec execute 85 sec latency 73.955 ms 20 8563 8.88 MB/sec execute 86 sec latency 100.551 ms 20 8636 8.79 MB/sec execute 87 sec latency 122.241 ms 20 8707 8.71 MB/sec execute 88 sec latency 63.437 ms 20 8783 8.63 MB/sec execute 89 sec latency 76.755 ms 20 8864 8.54 MB/sec execute 90 sec latency 67.279 ms 20 8932 8.46 MB/sec execute 91 sec latency 66.390 ms 20 9053 8.39 MB/sec execute 92 sec latency 62.440 ms 20 9143 8.33 MB/sec execute 93 sec latency 63.418 ms 20 9246 8.27 MB/sec execute 94 sec latency 67.160 ms 20 9348 8.24 MB/sec execute 95 sec latency 63.198 ms 20 9472 8.35 MB/sec execute 96 sec latency 71.294 ms 20 9545 8.32 MB/sec execute 97 sec latency 88.409 ms 20 9665 8.41 MB/sec execute 98 sec latency 76.673 ms 20 9870 8.79 MB/sec execute 99 sec latency 64.220 ms 20 10081 9.14 MB/sec execute 100 sec latency 74.051 ms 20 10351 9.32 MB/sec execute 101 sec latency 64.441 ms 20 10560 9.71 MB/sec execute 102 sec latency 70.115 ms 20 10708 9.85 MB/sec execute 103 sec latency 51.355 ms 20 10812 9.85 MB/sec execute 104 sec latency 55.649 ms 20 10915 9.89 MB/sec execute 105 sec latency 64.526 ms 20 11011 9.84 MB/sec execute 106 sec latency 79.827 ms 20 11076 9.76 MB/sec execute 107 sec latency 125.328 ms 20 11162 9.67 MB/sec execute 108 sec latency 61.750 ms 20 11277 9.60 MB/sec execute 109 sec latency 83.137 ms 20 11371 9.55 MB/sec execute 110 sec latency 105.136 ms 20 11451 9.50 MB/sec execute 111 sec latency 106.417 ms 20 11534 9.45 MB/sec execute 112 sec latency 104.757 ms 20 11613 9.41 MB/sec execute 113 sec latency 74.561 ms 20 11711 9.45 MB/sec execute 114 sec latency 83.551 ms 20 11834 9.44 MB/sec execute 115 sec latency 58.180 ms 20 11943 9.51 MB/sec execute 116 sec latency 72.446 ms 20 12081 9.76 MB/sec execute 117 sec latency 81.833 ms 20 12168 9.72 MB/sec execute 118 sec latency 81.167 ms 20 12259 9.65 MB/sec execute 119 sec latency 63.474 ms 20 cleanup 120 sec 20 cleanup 121 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 37884 35.773 209.772 Close 27813 8.989 89.433 Rename 1571 53.215 187.470 Unlink 7509 11.448 70.901 Qpathinfo 34673 8.701 179.430 Qfileinfo 6011 0.177 16.793 Qfsinfo 6120 0.145 26.648 Sfileinfo 3000 36.701 117.270 Find 13127 2.283 124.072 WriteX 18614 4.496 96.878 ReadX 58312 0.029 10.215 LockX 120 10.030 28.293 UnlockX 120 9.192 20.229 Flush 2629 35.313 139.257 Throughput 9.65246 MB/sec 20 clients 20 procs max_latency=209.781 ms stopping dbench on /mnt/lustre/d0.oleg360-client.virtnet at Thu Dec 12 10:06:56 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg360-client.virtnet /mnt/lustre/d0.oleg360-client.virtnet /mnt/lustre/d0.oleg360-client.virtnet removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg360-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (154s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:02 (1734016022) min OST has 3590860kB available, using 5386290kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7582] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5260] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg360-clien 5260M 83623 62 58957 50 225680 48 2910 229 Latency 25232us 155ms 82615us 9509us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg360-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 274 17 6038 26 439 13 353 17 782 12 532 13 Latency 18388us 23937us 60537us 21705us 6523us 20135us 1.97,1.97,oleg360-client.virtnet,1,1734004822,5260M,,,,83623,62,58957,50,,,225680,48,2910,229,10,,,,,274,17,6038,26,439,13,353,17,782,12,532,13,,25232us,155ms,,82615us,9509us,18388us,23937us,60537us,21705us,6523us,20135us debug=0x33f0484 PASS bonnie (314s) == sanity-benchmark test iozone: iozone ================== 10:12:16 (1734016336) Waiting for MDT destroys to complete oleg360-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg360-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg360-client: oleg360-server: ssh exited with exit code 1 pdsh@oleg360-client: oleg360-server: ssh exited with exit code 1 min OST has 3605484kB available, using 5408226kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7582] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:25 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 192827 182966 144267 167644 66550 150543 iozone test complete. Waiting for MDT destroys to complete oleg360-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg360-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg360-client: oleg360-server: ssh exited with exit code 1 pdsh@oleg360-client: oleg360-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg360-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg360-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg360-client: oleg360-server: ssh exited with exit code 1 pdsh@oleg360-client: oleg360-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408226] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:16:50 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408226 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408226 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408226 512 81740 77926 84108 85468 89971 73426 iozone test complete. Waiting for MDT destroys to complete oleg360-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg360-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg360-client: oleg360-server: ssh exited with exit code 1 pdsh@oleg360-client: oleg360-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (680s) == sanity-benchmark test fsx: fsx ======================== 10:23:36 (1734017016) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 12875 -P /tmp -l 5408226 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 12875 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read skipping zero size read skipping zero length punch hole fallocating to largest ever: 0x5221f8 001000 1734017020.869009 mapwrite 0x45595e thru 0x460d49 (0xb3ec bytes) truncating to largest ever: 0x526669 002000 1734017023.521809 punch from 0x200ce4 to 0x209593 (0x88b0 bytes) fallocating to largest ever: 0x5285e2 004000 1734017030.012580 trunc from 0x38b460 to 0x1e984d (0x1a1c12 bytes) 005000 1734017033.177977 fallocate 0x300300 thru 0x30aa6d (0xa76e bytes) 007000 1734017039.060097 mapread 0x1d5d5b thru 0x1dab5d (0x4e03 bytes) 008000 1734017042.058278 mapwrite 0x45ee0e thru 0x462950 (0x3b43 bytes) 009000 1734017045.129521 punch from 0x07d276 to 0x08070c (0x3497 bytes) 010000 1734017048.343592 trunc from 0x527939 to 0x01274d (0x5151eb bytes) 012000 1734017054.330724 mapread 0x051c20 thru 0x0553d7 (0x37b8 bytes) 013000 1734017057.118200 punch from 0x351201 to 0x352592 (0x1392 bytes) 015000 1734017063.615011 trunc from 0x51bd8d to 0x14b602 (0x3d078a bytes) 016000 1734017067.002074 write 0x41a4c7 thru 0x427575 (0xd0af bytes) 017000 1734017070.235271 mapwrite 0x2e0ae4 thru 0x2eb475 (0xa992 bytes) 020000 1734017080.719617 punch from 0x132084 to 0x134aef (0x2a6c bytes) 022000 1734017086.982192 write 0x3a01e7 thru 0x3a1c29 (0x1a43 bytes) 025000 1734017095.623420 punch from 0x1eb4dc to 0x1ed30a (0x1e2f bytes) 026000 1734017098.927064 punch from 0x01d187 to 0x021c8a (0x4b04 bytes) 028000 1734017104.982314 mapread 0x2e624a thru 0x2ed2b2 (0x7069 bytes) 029000 1734017107.909365 punch from 0x486160 to 0x4888ff (0x27a0 bytes) 030000 1734017110.849083 mapread 0x3ffac2 thru 0x4082cd (0x880c bytes) 032000 1734017116.323390 read 0x0384e2 thru 0x03c5ec (0x410b bytes) 033000 1734017119.121016 write 0x21a403 thru 0x22343c (0x903a bytes) 034000 1734017121.845602 write 0x118585 thru 0x126657 (0xe0d3 bytes) 035000 1734017124.772296 read 0x08346d thru 0x08de8b (0xaa1f bytes) 037000 1734017130.509482 read 0x4092e3 thru 0x41269e (0x93bc bytes) 038000 1734017133.386100 write 0x141a0e thru 0x14abaa (0x919d bytes) 039000 1734017136.126977 read 0x182381 thru 0x188f1a (0x6b9a bytes) 041000 1734017141.413292 read 0x324e38 thru 0x32ed31 (0x9efa bytes) 043000 1734017146.836076 write 0x017bfe thru 0x021b70 (0x9f73 bytes) 045000 1734017152.713243 punch from 0x30cd91 to 0x31aad5 (0xdd45 bytes) 047000 1734017158.332629 trunc from 0x2d6538 to 0x125d70 (0x1b07c7 bytes) 048000 1734017161.065428 mapwrite 0x3858f9 thru 0x38dc81 (0x8389 bytes) 049000 1734017163.783268 read 0x3f2d8a thru 0x3fd1c8 (0xa43f bytes) 050000 1734017166.470852 mapread 0x1b0927 thru 0x1ba212 (0x98ec bytes) 051000 1734017169.139150 write 0x161ef8 thru 0x16f869 (0xd972 bytes) 052000 1734017172.029895 fallocate 0x413493 thru 0x41bbd9 (0x8747 bytes) 053000 1734017174.734455 mapwrite 0x1cb7dc thru 0x1d1f1c (0x6741 bytes) 054000 1734017177.254482 read 0x0b53a0 thru 0x0b8d21 (0x3982 bytes) 055000 1734017180.599421 punch from 0x1c076f to 0x1cf6aa (0xef3c bytes) 056000 1734017183.410745 fallocate 0x345caa thru 0x350b76 (0xaecd bytes) 058000 1734017189.135914 trunc from 0x4d34c7 to 0x018cb7 (0x4ba80f bytes) 059000 1734017191.948433 write 0x3df4be thru 0x3e38e8 (0x442b bytes) 060000 1734017194.912999 mapwrite 0x46e9b1 thru 0x47c5ef (0xdc3f bytes) 062000 1734017200.392668 mapwrite 0x1ffbe6 thru 0x2064ca (0x68e5 bytes) 063000 1734017202.821109 read 0x1519cc thru 0x154a4a (0x307f bytes) 065000 1734017208.551476 mapwrite 0x1340dd thru 0x1415b6 (0xd4da bytes) 067000 1734017214.268297 read 0x41adf9 thru 0x41d5a0 (0x27a8 bytes) 069000 1734017219.945146 mapread 0x026813 thru 0x02b8e3 (0x50d1 bytes) 070000 1734017222.626601 fallocate 0x3ced51 thru 0x3dadb3 (0xc063 bytes) 071000 1734017225.012455 fallocate 0x49ba96 thru 0x49f3ed (0x3958 bytes) 072000 1734017228.157744 punch from 0x11c1f1 to 0x1249f5 (0x8805 bytes) 073000 1734017231.141490 trunc from 0x524fca to 0x275ae0 (0x2af4e9 bytes) 077000 1734017242.948065 trunc from 0x4c0a1a to 0x123001 (0x39da18 bytes) 080000 1734017251.412512 mapread 0x0dcb80 thru 0x0de99a (0x1e1b bytes) 081000 1734017254.158255 write 0x377672 thru 0x3778ab (0x23a bytes) 082000 1734017256.849885 write 0x2a0e5b thru 0x2aef12 (0xe0b8 bytes) 085000 1734017265.478133 read 0x3f65d9 thru 0x3f8e01 (0x2829 bytes) 087000 1734017271.139430 write 0x3465e1 thru 0x349416 (0x2e36 bytes) 089000 1734017277.009483 mapwrite 0x39bf44 thru 0x3aba12 (0xfacf bytes) 090000 1734017280.506542 punch from 0x1ef2f9 to 0x1fd7a5 (0xe4ad bytes) 091000 1734017283.294520 mapread 0x239336 thru 0x243d06 (0xa9d1 bytes) 093000 1734017289.012759 punch from 0x231dee to 0x23d02f (0xb242 bytes) 094000 1734017291.649546 mapread 0x0f71a2 thru 0x0f782e (0x68d bytes) 096000 1734017297.463456 write 0x3cde0d thru 0x3d267d (0x4871 bytes) 098000 1734017303.550431 read 0x2ff20a thru 0x304d8d (0x5b84 bytes) 100000 1734017309.782301 fallocate 0x203e31 thru 0x20560a (0x17da bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 2707665 (2648 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 3149824.. 3149827: 4: 0000: net 1: 4.. 7: 3154888.. 3154891: 4: 0000: net 2: 8.. 11: 3153856.. 3153859: 4: 0000: unwritten,net 3: 76.. 87: 3147900.. 3147911: 12: 0000: unwritten,net 4: 88.. 127: 3165892.. 3165931: 40: 0000: unwritten,net 5: 128.. 151: 3287988.. 3288011: 24: 0000: unwritten,net 6: 152.. 159: 3154140.. 3154147: 8: 0000: net 7: 164.. 187: 3287676.. 3287699: 24: 0000: net 8: 192.. 239: 3147820.. 3147867: 48: 0000: unwritten,net 9: 240.. 275: 3165704.. 3165739: 36: 0000: net 10: 332.. 367: 3147712.. 3147747: 36: 0000: unwritten,net 11: 396.. 423: 3287720.. 3287747: 28: 0000: net 12: 424.. 451: 3147776.. 3147803: 28: 0000: net 13: 2060.. 2071: 3148020.. 3148031: 12: 0000: last,unwritten,net /mnt/lustre/f0.fsxfile: 14 extents found debug=0x33f0484 PASS fsx (294s) == sanity-benchmark test complete, duration 1471 sec ===== 10:28:31 (1734017311) === sanity-benchmark: start cleanup 10:28:31 (1734017311) === === sanity-benchmark: finish cleanup 10:28:32 (1734017312) ===