-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:51 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:55 (1734015835) === oleg422-client.virtnet: executing check_config_client /mnt/lustre oleg422-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg422-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6cdb000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6cdb000.idle_timeout=debug disable quota as required oleg422-server: oleg422-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:06 (1734015846) === == sanity-benchmark test dbench: dbench ================== 10:04:07 (1734015847) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6868] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg422-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg422-client.virtnet at Thu Dec 12 10:04:09 EST 2024 waiting for dbench pid 9430 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 17 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 106 97.61 MB/sec warmup 1 sec latency 116.018 ms 20 205 80.80 MB/sec warmup 2 sec latency 85.868 ms 20 304 74.48 MB/sec warmup 3 sec latency 89.376 ms 20 381 67.83 MB/sec warmup 4 sec latency 139.847 ms 20 478 66.74 MB/sec warmup 5 sec latency 97.821 ms 20 604 68.20 MB/sec warmup 6 sec latency 124.407 ms 20 688 60.47 MB/sec warmup 7 sec latency 95.178 ms 20 743 53.25 MB/sec warmup 8 sec latency 104.873 ms 20 791 47.56 MB/sec warmup 9 sec latency 158.541 ms 20 852 43.11 MB/sec warmup 10 sec latency 116.692 ms 20 894 39.41 MB/sec warmup 11 sec latency 136.548 ms 20 928 36.27 MB/sec warmup 12 sec latency 286.535 ms 20 950 33.53 MB/sec warmup 13 sec latency 1171.346 ms 20 1000 31.74 MB/sec warmup 14 sec latency 121.299 ms 20 1074 30.49 MB/sec warmup 15 sec latency 105.366 ms 20 1132 28.70 MB/sec warmup 16 sec latency 112.151 ms 20 1194 27.08 MB/sec warmup 17 sec latency 104.949 ms 20 1245 25.79 MB/sec warmup 18 sec latency 114.885 ms 20 1348 26.14 MB/sec warmup 19 sec latency 111.742 ms 20 1425 26.00 MB/sec warmup 20 sec latency 158.265 ms 20 1474 24.78 MB/sec warmup 21 sec latency 104.458 ms 20 1530 23.69 MB/sec warmup 22 sec latency 84.005 ms 20 1581 22.71 MB/sec warmup 23 sec latency 109.475 ms 20 1669 0.55 MB/sec execute 1 sec latency 149.950 ms 20 1727 0.78 MB/sec execute 2 sec latency 140.427 ms 20 1777 0.81 MB/sec execute 3 sec latency 140.298 ms 20 1828 0.80 MB/sec execute 4 sec latency 92.436 ms 20 1881 0.84 MB/sec execute 5 sec latency 109.001 ms 20 1944 0.86 MB/sec execute 6 sec latency 109.902 ms 20 1995 0.92 MB/sec execute 7 sec latency 138.956 ms 20 2030 0.94 MB/sec execute 8 sec latency 146.162 ms 20 2078 0.98 MB/sec execute 9 sec latency 125.641 ms 20 2125 0.99 MB/sec execute 10 sec latency 135.721 ms 20 2165 0.98 MB/sec execute 11 sec latency 113.432 ms 20 2211 1.13 MB/sec execute 12 sec latency 144.850 ms 20 2272 1.73 MB/sec execute 13 sec latency 218.465 ms 20 2313 2.02 MB/sec execute 14 sec latency 1187.059 ms 20 2357 2.28 MB/sec execute 15 sec latency 1612.255 ms 20 2399 2.27 MB/sec execute 16 sec latency 142.370 ms 20 2446 2.43 MB/sec execute 17 sec latency 119.138 ms 20 2513 2.86 MB/sec execute 18 sec latency 179.173 ms 20 2597 3.25 MB/sec execute 19 sec latency 224.907 ms 20 2713 4.57 MB/sec execute 20 sec latency 130.951 ms 20 2857 5.98 MB/sec execute 21 sec latency 114.429 ms 20 2950 6.61 MB/sec execute 22 sec latency 127.001 ms 20 3021 6.46 MB/sec execute 23 sec latency 172.613 ms 20 3188 6.77 MB/sec execute 24 sec latency 111.738 ms 20 3298 7.17 MB/sec execute 25 sec latency 141.431 ms 20 3395 7.48 MB/sec execute 26 sec latency 92.026 ms 20 3506 8.67 MB/sec execute 27 sec latency 125.962 ms 20 3576 8.75 MB/sec execute 28 sec latency 105.441 ms 20 3643 8.58 MB/sec execute 29 sec latency 101.481 ms 20 3704 8.47 MB/sec execute 30 sec latency 94.342 ms 20 3745 8.45 MB/sec execute 31 sec latency 176.419 ms 20 3798 8.48 MB/sec execute 32 sec latency 138.071 ms 20 3836 8.22 MB/sec execute 33 sec latency 127.449 ms 20 3870 8.00 MB/sec execute 34 sec latency 110.779 ms 20 3911 7.90 MB/sec execute 35 sec latency 113.592 ms 20 3942 7.70 MB/sec execute 36 sec latency 176.082 ms 20 3976 7.49 MB/sec execute 37 sec latency 115.810 ms 20 4008 7.30 MB/sec execute 38 sec latency 125.030 ms 20 4043 7.11 MB/sec execute 39 sec latency 107.896 ms 20 4089 6.94 MB/sec execute 40 sec latency 99.103 ms 20 4134 6.78 MB/sec execute 41 sec latency 188.421 ms 20 4197 6.65 MB/sec execute 42 sec latency 140.467 ms 20 4245 6.54 MB/sec execute 43 sec latency 165.987 ms 20 4293 6.44 MB/sec execute 44 sec latency 123.299 ms 20 4343 6.36 MB/sec execute 45 sec latency 112.787 ms 20 4396 6.28 MB/sec execute 46 sec latency 115.481 ms 20 4451 6.20 MB/sec execute 47 sec latency 108.755 ms 20 4488 6.11 MB/sec execute 48 sec latency 176.808 ms 20 4528 6.03 MB/sec execute 49 sec latency 181.432 ms 20 4569 6.03 MB/sec execute 50 sec latency 165.989 ms 20 4630 6.18 MB/sec execute 51 sec latency 118.862 ms 20 4687 6.11 MB/sec execute 52 sec latency 135.666 ms 20 4736 6.01 MB/sec execute 53 sec latency 149.748 ms 20 4786 5.92 MB/sec execute 54 sec latency 138.438 ms 20 4847 6.05 MB/sec execute 55 sec latency 135.965 ms 20 4938 6.53 MB/sec execute 56 sec latency 160.645 ms 20 4991 6.64 MB/sec execute 57 sec latency 144.163 ms 20 5030 6.53 MB/sec execute 58 sec latency 154.903 ms 20 5064 6.43 MB/sec execute 59 sec latency 127.418 ms 20 5100 6.33 MB/sec execute 60 sec latency 143.028 ms 20 5147 6.25 MB/sec execute 61 sec latency 109.317 ms 20 5176 6.16 MB/sec execute 62 sec latency 145.245 ms 20 5231 6.07 MB/sec execute 63 sec latency 116.389 ms 20 5275 5.99 MB/sec execute 64 sec latency 130.758 ms 20 5312 5.90 MB/sec execute 65 sec latency 139.998 ms 20 5349 5.82 MB/sec execute 66 sec latency 109.548 ms 20 5382 5.75 MB/sec execute 67 sec latency 130.310 ms 20 5420 5.67 MB/sec execute 68 sec latency 143.108 ms 20 5482 5.60 MB/sec execute 69 sec latency 98.721 ms 20 5546 5.54 MB/sec execute 70 sec latency 110.361 ms 20 5597 5.49 MB/sec execute 71 sec latency 95.855 ms 20 5639 5.43 MB/sec execute 72 sec latency 172.956 ms 20 5684 5.37 MB/sec execute 73 sec latency 170.560 ms 20 5733 5.31 MB/sec execute 74 sec latency 121.862 ms 20 5779 5.30 MB/sec execute 75 sec latency 165.972 ms 20 5847 5.33 MB/sec execute 76 sec latency 126.306 ms 20 5921 5.41 MB/sec execute 77 sec latency 107.321 ms 20 5966 5.37 MB/sec execute 78 sec latency 152.016 ms 20 6017 5.39 MB/sec execute 79 sec latency 216.014 ms 20 6088 5.42 MB/sec execute 80 sec latency 128.598 ms 20 6172 5.56 MB/sec execute 81 sec latency 128.520 ms 20 6280 5.81 MB/sec execute 82 sec latency 119.358 ms 20 6427 6.18 MB/sec execute 83 sec latency 108.735 ms 20 6519 6.25 MB/sec execute 84 sec latency 119.083 ms 20 6642 6.30 MB/sec execute 85 sec latency 133.235 ms 20 6774 6.40 MB/sec execute 86 sec latency 132.837 ms 20 6912 6.60 MB/sec execute 87 sec latency 140.261 ms 20 7010 6.77 MB/sec execute 88 sec latency 98.653 ms 20 7109 7.00 MB/sec execute 89 sec latency 120.984 ms 20 7173 7.00 MB/sec execute 90 sec latency 102.743 ms 20 7231 6.98 MB/sec execute 91 sec latency 106.122 ms 20 7277 6.97 MB/sec execute 92 sec latency 157.291 ms 20 7326 6.98 MB/sec execute 93 sec latency 185.590 ms 20 7371 6.95 MB/sec execute 94 sec latency 108.297 ms 20 7416 6.89 MB/sec execute 95 sec latency 100.587 ms 20 7453 6.84 MB/sec execute 96 sec latency 122.589 ms 20 7491 6.80 MB/sec execute 97 sec latency 138.147 ms 20 7520 6.73 MB/sec execute 98 sec latency 169.526 ms 20 7557 6.66 MB/sec execute 99 sec latency 95.622 ms 20 7597 6.59 MB/sec execute 100 sec latency 97.717 ms 20 7649 6.53 MB/sec execute 101 sec latency 124.050 ms 20 7702 6.48 MB/sec execute 102 sec latency 152.762 ms 20 7756 6.43 MB/sec execute 103 sec latency 157.543 ms 20 7812 6.39 MB/sec execute 104 sec latency 166.797 ms 20 7854 6.35 MB/sec execute 105 sec latency 148.853 ms 20 7909 6.31 MB/sec execute 106 sec latency 115.383 ms 20 7965 6.28 MB/sec execute 107 sec latency 95.000 ms 20 8010 6.24 MB/sec execute 108 sec latency 142.508 ms 20 8051 6.20 MB/sec execute 109 sec latency 159.050 ms 20 8096 6.20 MB/sec execute 110 sec latency 144.898 ms 20 8148 6.22 MB/sec execute 111 sec latency 138.747 ms 20 8219 6.24 MB/sec execute 112 sec latency 119.186 ms 20 8281 6.20 MB/sec execute 113 sec latency 109.112 ms 20 8329 6.16 MB/sec execute 114 sec latency 133.412 ms 20 8410 6.28 MB/sec execute 115 sec latency 115.917 ms 20 8505 6.49 MB/sec execute 116 sec latency 115.547 ms 20 8554 6.50 MB/sec execute 117 sec latency 167.609 ms 20 8604 6.45 MB/sec execute 118 sec latency 110.843 ms 20 8648 6.40 MB/sec execute 119 sec latency 120.044 ms 20 cleanup 120 sec 20 cleanup 121 sec 20 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 24271 57.168 243.217 Close 17899 13.695 110.558 Rename 1040 83.553 181.420 Unlink 4958 18.518 75.044 Qpathinfo 22442 13.571 154.399 Qfileinfo 3835 0.287 33.884 Qfsinfo 4080 0.193 26.847 Sfileinfo 2000 53.285 175.673 Find 8547 3.507 127.345 WriteX 12029 5.476 109.539 ReadX 38346 0.027 7.463 LockX 80 20.275 33.597 UnlockX 80 20.791 40.673 Flush 1702 45.124 1612.248 Throughput 6.40472 MB/sec 20 clients 20 procs max_latency=1612.255 ms stopping dbench on /mnt/lustre/d0.oleg422-client.virtnet at Thu Dec 12 10:06:35 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg422-client.virtnet /mnt/lustre/d0.oleg422-client.virtnet /mnt/lustre/d0.oleg422-client.virtnet removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg422-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (155s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:42 (1734016002) min OST has 3555188kB available, using 5332782kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6868] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5207] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg422-clien 5207M 80440 62 49236 44 97312 24 914.9 165 Latency 25304us 224ms 239ms 34096us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg422-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 231 19 6795 31 392 15 257 19 909 13 490 15 Latency 40338us 17366us 25658us 26530us 19510us 19689us 1.97,1.97,oleg422-client.virtnet,1,1734006028,5207M,,,,80440,62,49236,44,,,97312,24,914.9,165,10,,,,,231,19,6795,31,392,15,257,19,909,13,490,15,,25304us,224ms,,239ms,34096us,40338us,17366us,25658us,26530us,19510us,19689us debug=0x33f0484 PASS bonnie (392s) == sanity-benchmark test iozone: iozone ================== 10:13:14 (1734016394) Waiting for MDT destroys to complete oleg422-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg422-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg422-client: oleg422-server: ssh exited with exit code 1 pdsh@oleg422-client: oleg422-server: ssh exited with exit code 1 min OST has 3605620kB available, using 5408430kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6868] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:20 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 318075 223146 87364 93241 37846 109429 iozone test complete. Waiting for MDT destroys to complete oleg422-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg422-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg422-client: oleg422-server: ssh exited with exit code 1 pdsh@oleg422-client: oleg422-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg422-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg422-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg422-client: oleg422-server: ssh exited with exit code 1 pdsh@oleg422-client: oleg422-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:19:37 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 56968 65059 66519 70749 70845 68662 iozone test complete. Waiting for MDT destroys to complete oleg422-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg422-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg422-client: oleg422-server: ssh exited with exit code 1 pdsh@oleg422-client: oleg422-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (883s) == sanity-benchmark test fsx: fsx ======================== 10:27:57 (1734017277) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 28674 -P /tmp -l 5408430 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 28674 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1454 fallocating to largest ever: 0x29a9e5 fallocating to largest ever: 0x4432a6 fallocating to largest ever: 0x497b45 fallocating to largest ever: 0x521042 fallocating to largest ever: 0x5211b6 truncating to largest ever: 0x524133 001000 1734017282.390404 fallocate 0x40b375 thru 0x4156ee (0xa37a bytes) 002000 1734017285.313207 mapwrite 0x245b55 thru 0x254b86 (0xf032 bytes) fallocating to largest ever: 0x5286ae 004000 1734017292.251867 mapwrite 0x3edce9 thru 0x3ef05c (0x1374 bytes) 005000 1734017295.795415 mapread 0x045d0e thru 0x053e44 (0xe137 bytes) 006000 1734017298.946443 fallocate 0x27cb5e thru 0x27db54 (0xff7 bytes) 007000 1734017302.443466 fallocate 0x0f7814 thru 0x1019e9 (0xa1d6 bytes) 008000 1734017305.660224 trunc from 0x4a9ffa to 0x0361d5 (0x473e24 bytes) 009000 1734017309.063672 fallocate 0x38a8ba thru 0x39848c (0xdbd3 bytes) 010000 1734017313.078948 write 0x32a567 thru 0x3350ab (0xab45 bytes) 011000 1734017316.281982 trunc from 0x3c212f to 0x144e57 (0x27d2d7 bytes) 012000 1734017319.838128 read 0x08bb5e thru 0x08c676 (0xb19 bytes) 013000 1734017323.377078 mapwrite 0x044ee5 thru 0x046330 (0x144c bytes) 014000 1734017327.366974 fallocate 0x2a7e1a thru 0x2b65ee (0xe7d5 bytes) 015000 1734017331.404510 read 0x3c080d thru 0x3d05ed (0xfde1 bytes) 016000 1734017335.699421 read 0x117259 thru 0x125083 (0xde2b bytes) 017000 1734017340.013538 read 0x43b3ef thru 0x444097 (0x8ca9 bytes) 018000 1734017343.854148 trunc from 0x4169cc to 0x44eda4 (0x383d9 bytes) 020000 1734017351.450202 write 0x4f0613 thru 0x4fac51 (0xa63f bytes) 021000 1734017354.831447 read 0x01fd47 thru 0x0218a4 (0x1b5e bytes) 022000 1734017358.513122 read 0x07c450 thru 0x085bff (0x97b0 bytes) 023000 1734017362.023283 mapwrite 0x4b955f thru 0x4c4864 (0xb306 bytes) 025000 1734017369.754354 trunc from 0x3281ad to 0x120bbc (0x2075f0 bytes) 027000 1734017376.710614 fallocate 0x321c02 thru 0x32565e (0x3a5d bytes) 028000 1734017380.978322 mapwrite 0x1f4b47 thru 0x1fd6c4 (0x8b7e bytes) 029000 1734017385.425928 punch from 0x149273 to 0x150858 (0x75e6 bytes) 031000 1734017393.113619 read 0x4489d2 thru 0x452992 (0x9fc1 bytes) 032000 1734017397.143365 mapread 0x105d10 thru 0x10b4f2 (0x57e3 bytes) 033000 1734017400.901662 write 0x403216 thru 0x40a456 (0x7241 bytes) 034000 1734017405.341384 read 0x1e8474 thru 0x1ece97 (0x4a24 bytes) 035000 1734017409.035263 trunc from 0x5286ae to 0x2b8dc3 (0x26f8ea bytes) 036000 1734017413.011438 punch from 0x477b8f to 0x484ded (0xd25f bytes) 038000 1734017420.074802 write 0x05a084 thru 0x067dbb (0xdd38 bytes) 039000 1734017423.777165 mapwrite 0x381c34 thru 0x38f1ca (0xd597 bytes) 040000 1734017427.290776 mapread 0x0f14b9 thru 0x0f3745 (0x228d bytes) 043000 1734017438.150964 trunc from 0x4782e9 to 0x2232e5 (0x255003 bytes) 044000 1734017441.811518 trunc from 0x3d90bd to 0x030942 (0x3a877a bytes) 045000 1734017444.894580 write 0x1cabb1 thru 0x1d42d9 (0x9729 bytes) 046000 1734017448.126297 punch from 0x1d803e to 0x1e1154 (0x9117 bytes) 047000 1734017451.620579 read 0x11c54f thru 0x12c1ea (0xfc9c bytes) 049000 1734017458.256412 mapwrite 0x37a067 thru 0x389bee (0xfb88 bytes) 051000 1734017464.300901 write 0x43aa98 thru 0x4404ba (0x5a23 bytes) 055000 1734017476.635400 mapread 0x09b2cd thru 0x0a7b2c (0xc860 bytes) 056000 1734017479.726961 fallocate 0x015873 thru 0x022784 (0xcf12 bytes) 057000 1734017482.838424 fallocate 0x15497c thru 0x1605f5 (0xbc7a bytes) 058000 1734017486.725759 mapread 0x03f6b2 thru 0x0468dd (0x722c bytes) 059000 1734017490.211654 mapwrite 0x4cb2c9 thru 0x4daf90 (0xfcc8 bytes) 062000 1734017500.097215 mapwrite 0x0b4915 thru 0x0bfb00 (0xb1ec bytes) 063000 1734017503.365110 read 0x019bbb thru 0x01cb46 (0x2f8c bytes) 066000 1734017514.088827 punch from 0x0fdef4 to 0x107435 (0x9542 bytes) 067000 1734017517.714113 write 0x2ac692 thru 0x2bbc09 (0xf578 bytes) 068000 1734017521.239773 read 0x0cf29b thru 0x0dca33 (0xd799 bytes) 069000 1734017525.238999 punch from 0x443b28 to 0x4456ba (0x1b93 bytes) 071000 1734017531.909969 mapread 0x01c9a2 thru 0x029d3d (0xd39c bytes) 072000 1734017535.261535 write 0x41e026 thru 0x41f860 (0x183b bytes) 073000 1734017538.563079 punch from 0x2e0841 to 0x2e8c1f (0x83df bytes) 074000 1734017541.689391 trunc from 0x4a4bd2 to 0x4f76fb (0x52b2a bytes) 075000 1734017545.996551 read 0x275598 thru 0x27d106 (0x7b6f bytes) 076000 1734017549.722887 punch from 0x2d5dd5 to 0x2e5c52 (0xfe7e bytes) 078000 1734017556.989126 write 0x46ad75 thru 0x47781e (0xcaaa bytes) 080000 1734017563.097152 write 0x4f5527 thru 0x5050db (0xfbb5 bytes) 081000 1734017566.162753 read 0x3a1ca9 thru 0x3a895d (0x6cb5 bytes) 082000 1734017569.437423 read 0x10791e thru 0x10a282 (0x2965 bytes) 084000 1734017574.975740 fallocate 0x18f5af thru 0x198272 (0x8cc4 bytes) 085000 1734017577.396818 write 0x18a117 thru 0x19390f (0x97f9 bytes) 086000 1734017580.076186 trunc from 0x1e7f0a to 0x050a05 (0x197504 bytes) 087000 1734017582.472878 punch from 0x43b51a to 0x449fd8 (0xeabf bytes) 088000 1734017585.010488 fallocate 0x42eb13 thru 0x43a92d (0xbe1b bytes) 089000 1734017588.138262 mapwrite 0x05e004 thru 0x0665d8 (0x85d5 bytes) 090000 1734017590.649602 fallocate 0x0d2362 thru 0x0dd316 (0xafb5 bytes) skipping zero length fallocate 091000 1734017593.032387 read 0x0f3c07 thru 0x102b43 (0xef3d bytes) 092000 1734017595.467755 mapwrite 0x39dda7 thru 0x3a5939 (0x7b93 bytes) 094000 1734017600.895654 mapwrite 0x34961c thru 0x35443c (0xae21 bytes) 096000 1734017606.206966 fallocate 0x0531fa thru 0x059a89 (0x6890 bytes) 097000 1734017608.707401 write 0x49bf3d thru 0x4a30b0 (0x7174 bytes) 098000 1734017611.370479 read 0x183fda thru 0x18ee6a (0xae91 bytes) 099000 1734017613.857320 fallocate 0x0f83cf thru 0x100c6a (0x889c bytes) 100000 1734017616.465346 mapwrite 0x16d74b thru 0x17b08a (0xd940 bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 4526679 (4424 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 3805184.. 3805187: 4: 0001: net 1: 4.. 7: 3802944.. 3802947: 4: 0001: net 2: 44.. 51: 3817888.. 3817895: 8: 0001: net 3: 76.. 83: 4065516.. 4065523: 8: 0001: unwritten,net 4: 108.. 127: 3808484.. 3808503: 20: 0001: net 5: 132.. 183: 3818160.. 3818211: 52: 0001: net 6: 184.. 239: 3801144.. 3801199: 56: 0001: net 7: 240.. 271: 3809280.. 3809311: 32: 0001: net 8: 1460.. 1519: 3810500.. 3810559: 60: 0001: net 9: 3952.. 3971: 3812992.. 3813011: 20: 0001: net 10: 4028.. 4079: 3813068.. 3813119: 52: 0001: net 11: 4180.. 4207: 3801300.. 3801327: 28: 0001: net 12: 4208.. 4227: 3813248.. 3813267: 20: 0001: last,net /mnt/lustre/f0.fsxfile: 10 extents found debug=0x33f0484 PASS fsx (340s) == sanity-benchmark test complete, duration 1786 sec ===== 10:33:37 (1734017617) === sanity-benchmark: start cleanup 10:33:38 (1734017618) === === sanity-benchmark: finish cleanup 10:33:38 (1734017618) ===