-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:55 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:00 (1734015840) === oleg429-client.virtnet: executing check_config_client /mnt/lustre oleg429-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg429-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6fe1000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6fe1000.idle_timeout=debug disable quota as required oleg429-server: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:12 (1734015852) === == sanity-benchmark test dbench: dbench ================== 10:04:13 (1734015853) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6895] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg429-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg429-client.virtnet at Thu Dec 12 10:04:15 EST 2024 waiting for dbench pid 9459 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 5 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 16 42 32.20 MB/sec warmup 1 sec latency 107.321 ms 20 146 62.61 MB/sec warmup 2 sec latency 161.765 ms 20 207 53.98 MB/sec warmup 3 sec latency 146.782 ms 20 274 51.35 MB/sec warmup 4 sec latency 122.778 ms 20 338 48.92 MB/sec warmup 5 sec latency 149.748 ms 20 407 47.91 MB/sec warmup 6 sec latency 112.016 ms 20 481 47.99 MB/sec warmup 7 sec latency 122.196 ms 20 556 47.91 MB/sec warmup 8 sec latency 164.699 ms 20 657 46.82 MB/sec warmup 9 sec latency 152.547 ms 20 702 42.37 MB/sec warmup 10 sec latency 134.147 ms 20 740 38.73 MB/sec warmup 11 sec latency 152.056 ms 20 788 35.63 MB/sec warmup 12 sec latency 112.765 ms 20 840 33.10 MB/sec warmup 13 sec latency 119.027 ms 20 893 30.93 MB/sec warmup 14 sec latency 111.244 ms 20 931 29.00 MB/sec warmup 15 sec latency 112.435 ms 20 972 27.37 MB/sec warmup 16 sec latency 185.135 ms 20 1043 26.82 MB/sec warmup 17 sec latency 116.249 ms 20 1101 25.47 MB/sec warmup 18 sec latency 127.789 ms 20 1162 24.19 MB/sec warmup 19 sec latency 136.775 ms 20 1211 23.02 MB/sec warmup 20 sec latency 143.602 ms 20 1264 22.23 MB/sec warmup 21 sec latency 124.391 ms 20 1381 23.34 MB/sec warmup 22 sec latency 131.956 ms 20 1438 22.59 MB/sec warmup 23 sec latency 111.687 ms 20 1531 0.93 MB/sec execute 1 sec latency 103.694 ms 20 1601 1.15 MB/sec execute 2 sec latency 83.833 ms 20 1646 0.96 MB/sec execute 3 sec latency 135.974 ms 20 1694 0.92 MB/sec execute 4 sec latency 122.687 ms 20 1746 0.93 MB/sec execute 5 sec latency 118.153 ms 20 1800 0.89 MB/sec execute 6 sec latency 121.677 ms 20 1851 0.90 MB/sec execute 7 sec latency 138.795 ms 20 1902 0.89 MB/sec execute 8 sec latency 137.439 ms 20 1963 0.95 MB/sec execute 9 sec latency 108.127 ms 20 2017 0.97 MB/sec execute 10 sec latency 117.255 ms 20 2059 1.01 MB/sec execute 11 sec latency 120.134 ms 20 2125 1.05 MB/sec execute 12 sec latency 90.553 ms 20 2180 1.19 MB/sec execute 13 sec latency 92.462 ms 20 2223 1.46 MB/sec execute 14 sec latency 179.783 ms 20 2285 1.71 MB/sec execute 15 sec latency 116.535 ms 20 2355 2.31 MB/sec execute 16 sec latency 114.411 ms 20 2399 2.39 MB/sec execute 17 sec latency 254.696 ms 20 2421 2.42 MB/sec execute 18 sec latency 1173.977 ms 20 2431 2.31 MB/sec execute 19 sec latency 2174.442 ms 20 2481 2.48 MB/sec execute 20 sec latency 2289.077 ms 20 2539 2.83 MB/sec execute 21 sec latency 149.875 ms 20 2629 3.50 MB/sec execute 22 sec latency 147.422 ms 20 2709 3.95 MB/sec execute 23 sec latency 151.410 ms 20 2808 4.86 MB/sec execute 24 sec latency 195.766 ms 20 2909 5.48 MB/sec execute 25 sec latency 137.708 ms 20 3022 5.83 MB/sec execute 26 sec latency 139.390 ms 20 3091 5.87 MB/sec execute 27 sec latency 175.181 ms 20 3186 6.02 MB/sec execute 28 sec latency 138.616 ms 20 3339 6.63 MB/sec execute 29 sec latency 113.891 ms 20 3424 6.88 MB/sec execute 30 sec latency 146.919 ms 20 3518 7.39 MB/sec execute 31 sec latency 108.712 ms 20 3606 7.83 MB/sec execute 32 sec latency 98.501 ms 20 3664 7.72 MB/sec execute 33 sec latency 107.768 ms 20 3713 7.63 MB/sec execute 34 sec latency 127.349 ms 20 3756 7.58 MB/sec execute 35 sec latency 200.470 ms 20 3811 7.62 MB/sec execute 36 sec latency 134.656 ms 20 3851 7.44 MB/sec execute 37 sec latency 120.173 ms 20 3891 7.27 MB/sec execute 38 sec latency 101.491 ms 20 3936 7.16 MB/sec execute 39 sec latency 104.084 ms 20 3959 7.00 MB/sec execute 40 sec latency 186.621 ms 20 3994 6.83 MB/sec execute 41 sec latency 117.261 ms 20 4027 6.67 MB/sec execute 42 sec latency 100.750 ms 20 4064 6.52 MB/sec execute 43 sec latency 121.800 ms 20 4101 6.38 MB/sec execute 44 sec latency 186.468 ms 20 4148 6.26 MB/sec execute 45 sec latency 161.710 ms 20 4206 6.15 MB/sec execute 46 sec latency 178.610 ms 20 4256 6.06 MB/sec execute 47 sec latency 238.530 ms 20 4310 5.98 MB/sec execute 48 sec latency 302.209 ms 20 4359 5.91 MB/sec execute 49 sec latency 131.856 ms 20 4406 5.84 MB/sec execute 50 sec latency 128.630 ms 20 4451 5.77 MB/sec execute 51 sec latency 127.655 ms 20 4499 5.73 MB/sec execute 52 sec latency 193.580 ms 20 4544 5.69 MB/sec execute 53 sec latency 145.019 ms 20 4589 5.68 MB/sec execute 54 sec latency 133.866 ms 20 4644 5.74 MB/sec execute 55 sec latency 122.889 ms 20 4703 5.73 MB/sec execute 56 sec latency 149.220 ms 20 4759 5.70 MB/sec execute 57 sec latency 129.648 ms 20 4820 5.76 MB/sec execute 58 sec latency 124.222 ms 20 4875 5.80 MB/sec execute 59 sec latency 140.104 ms 20 4956 6.14 MB/sec execute 60 sec latency 124.747 ms 20 5009 6.26 MB/sec execute 61 sec latency 162.648 ms 20 5055 6.16 MB/sec execute 62 sec latency 121.349 ms 20 5101 6.08 MB/sec execute 63 sec latency 115.329 ms 20 5147 6.00 MB/sec execute 64 sec latency 130.653 ms 20 5182 5.92 MB/sec execute 65 sec latency 149.201 ms 20 5224 5.84 MB/sec execute 66 sec latency 145.734 ms 20 5272 5.76 MB/sec execute 67 sec latency 134.502 ms 20 5313 5.69 MB/sec execute 68 sec latency 127.194 ms 20 5358 5.62 MB/sec execute 69 sec latency 118.365 ms 20 5399 5.54 MB/sec execute 70 sec latency 98.301 ms 20 5439 5.48 MB/sec execute 71 sec latency 126.820 ms 20 5482 5.41 MB/sec execute 72 sec latency 129.967 ms 20 5534 5.35 MB/sec execute 73 sec latency 114.252 ms 20 5590 5.30 MB/sec execute 74 sec latency 126.996 ms 20 5636 5.25 MB/sec execute 75 sec latency 125.402 ms 20 5688 5.21 MB/sec execute 76 sec latency 120.241 ms 20 5746 5.17 MB/sec execute 77 sec latency 124.140 ms 20 5796 5.16 MB/sec execute 78 sec latency 141.873 ms 20 5862 5.18 MB/sec execute 79 sec latency 116.724 ms 20 5929 5.24 MB/sec execute 80 sec latency 128.163 ms 20 5985 5.25 MB/sec execute 81 sec latency 147.948 ms 20 6046 5.28 MB/sec execute 82 sec latency 136.911 ms 20 6115 5.35 MB/sec execute 83 sec latency 126.480 ms 20 6194 5.47 MB/sec execute 84 sec latency 154.469 ms 20 6304 5.70 MB/sec execute 85 sec latency 137.638 ms 20 6429 5.97 MB/sec execute 86 sec latency 118.396 ms 20 6544 6.07 MB/sec execute 87 sec latency 142.569 ms 20 6639 6.15 MB/sec execute 88 sec latency 164.252 ms 20 6750 6.20 MB/sec execute 89 sec latency 167.518 ms 20 6887 6.38 MB/sec execute 90 sec latency 126.065 ms 20 6995 6.56 MB/sec execute 91 sec latency 109.488 ms 20 7080 6.68 MB/sec execute 92 sec latency 130.460 ms 20 7164 6.81 MB/sec execute 93 sec latency 91.052 ms 20 7222 6.79 MB/sec execute 94 sec latency 125.330 ms 20 7276 6.78 MB/sec execute 95 sec latency 107.997 ms 20 7317 6.77 MB/sec execute 96 sec latency 158.803 ms 20 7370 6.77 MB/sec execute 97 sec latency 98.909 ms 20 7408 6.71 MB/sec execute 98 sec latency 104.078 ms 20 7447 6.66 MB/sec execute 99 sec latency 104.586 ms 20 7491 6.61 MB/sec execute 100 sec latency 92.799 ms 20 7523 6.56 MB/sec execute 101 sec latency 129.785 ms 20 7562 6.49 MB/sec execute 102 sec latency 116.381 ms 20 7601 6.43 MB/sec execute 103 sec latency 111.755 ms 20 7638 6.37 MB/sec execute 104 sec latency 165.023 ms 20 7676 6.32 MB/sec execute 105 sec latency 202.187 ms 20 7724 6.27 MB/sec execute 106 sec latency 212.408 ms 20 7780 6.23 MB/sec execute 107 sec latency 124.957 ms 20 7838 6.19 MB/sec execute 108 sec latency 162.006 ms 20 7893 6.16 MB/sec execute 109 sec latency 119.961 ms 20 7945 6.13 MB/sec execute 110 sec latency 102.622 ms 20 7995 6.09 MB/sec execute 111 sec latency 121.924 ms 20 8046 6.08 MB/sec execute 112 sec latency 134.601 ms 20 8094 6.07 MB/sec execute 113 sec latency 186.568 ms 20 8151 6.07 MB/sec execute 114 sec latency 110.630 ms 20 8222 6.08 MB/sec execute 115 sec latency 104.178 ms 20 8288 6.09 MB/sec execute 116 sec latency 107.707 ms 20 8362 6.14 MB/sec execute 117 sec latency 111.091 ms 20 8431 6.18 MB/sec execute 118 sec latency 125.057 ms 20 8514 6.33 MB/sec execute 119 sec latency 123.196 ms 20 cleanup 120 sec 20 cleanup 121 sec 17 cleanup 122 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 24450 55.990 226.518 Close 17932 13.482 85.451 Rename 1040 86.617 195.741 Unlink 4949 18.315 76.692 Qpathinfo 22565 13.425 228.355 Qfileinfo 3867 0.272 27.598 Qfsinfo 4080 0.188 30.177 Sfileinfo 2000 53.239 254.685 Find 8587 3.706 129.764 WriteX 12115 5.524 88.748 ReadX 38450 0.029 14.570 LockX 80 21.809 40.704 UnlockX 80 23.048 41.195 Flush 1718 54.872 2289.060 Throughput 6.32947 MB/sec 20 clients 20 procs max_latency=2289.077 ms stopping dbench on /mnt/lustre/d0.oleg429-client.virtnet at Thu Dec 12 10:06:41 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg429-client.virtnet /mnt/lustre/d0.oleg429-client.virtnet /mnt/lustre/d0.oleg429-client.virtnet removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg429-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (155s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:48 (1734016008) min OST has 3516672kB available, using 5275008kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6895] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5151] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg429-clien 5151M 78373 59 46942 42 104536 27 936.4 169 Latency 29992us 375ms 157ms 26560us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg429-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 239 18 7672 33 367 14 264 18 877 12 461 14 Latency 24863us 13795us 34006us 19927us 5915us 14827us 1.97,1.97,oleg429-client.virtnet,1,1734006049,5151M,,,,78373,59,46942,42,,,104536,27,936.4,169,10,,,,,239,18,7672,33,367,14,264,18,877,12,461,14,,29992us,375ms,,157ms,26560us,24863us,13795us,34006us,19927us,5915us,14827us debug=0x33f0484 PASS bonnie (392s) == sanity-benchmark test iozone: iozone ================== 10:13:20 (1734016400) Waiting for MDT destroys to complete oleg429-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg429-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg429-client: oleg429-server: ssh exited with exit code 1 pdsh@oleg429-client: oleg429-server: ssh exited with exit code 1 min OST has 3605620kB available, using 5408430kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6895] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:34 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 271497 159938 100344 114424 43109 108022 iozone test complete. Waiting for MDT destroys to complete oleg429-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg429-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg429-client: oleg429-server: ssh exited with exit code 1 pdsh@oleg429-client: oleg429-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg429-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg429-client: oleg429-server: ssh exited with exit code 1 oleg429-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg429-client: oleg429-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:19:27 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 57996 68326 72622 76341 81134 69706 iozone test complete. Waiting for MDT destroys to complete oleg429-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg429-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg429-client: oleg429-server: ssh exited with exit code 1 pdsh@oleg429-client: oleg429-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (839s) == sanity-benchmark test fsx: fsx ======================== 10:27:19 (1734017239) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 8280 -P /tmp -l 5408430 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 8280 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x1c5758 fallocating to largest ever: 0x2758fc truncating to largest ever: 0x404fe6 fallocating to largest ever: 0x40ee9a truncating to largest ever: 0x4ebdd4 fallocating to largest ever: 0x4fb12d truncating to largest ever: 0x4fea62 fallocating to largest ever: 0x5286ae 001000 1734017243.180634 punch from 0x0885c6 to 0x08b1f4 (0x2c2f bytes) 002000 1734017246.399687 mapread 0x27ee1c thru 0x2859f0 (0x6bd5 bytes) 003000 1734017249.245068 punch from 0x0d8a54 to 0x0dd096 (0x4643 bytes) 004000 1734017252.605036 mapwrite 0x0cd79d thru 0x0ced6d (0x15d1 bytes) 006000 1734017258.768746 fallocate 0x03eacb thru 0x04932c (0xa862 bytes) 007000 1734017262.196742 trunc from 0x4cc33c to 0x07ec78 (0x44d6c3 bytes) 008000 1734017265.019870 trunc from 0x52688f to 0x3281f7 (0x1fe697 bytes) 009000 1734017268.375297 write 0x33e03c thru 0x34446b (0x6430 bytes) 010000 1734017271.618468 mapwrite 0x42f1f8 thru 0x43d339 (0xe142 bytes) 014000 1734017284.816278 write 0x51d5c6 thru 0x520a2d (0x3468 bytes) 018000 1734017297.734163 punch from 0x3f9013 to 0x405971 (0xc95f bytes) 019000 1734017301.027316 mapread 0x02c797 thru 0x033b43 (0x73ad bytes) 020000 1734017304.350924 write 0x19bd59 thru 0x1aad01 (0xefa9 bytes) 021000 1734017307.402197 mapwrite 0x37f181 thru 0x382e4b (0x3ccb bytes) 022000 1734017310.480371 trunc from 0x445354 to 0x2383ef (0x20cf64 bytes) 023000 1734017313.439973 trunc from 0x4fe4b4 to 0x2e20f1 (0x21c3c2 bytes) 029000 1734017334.104641 write 0x19d608 thru 0x19e559 (0xf52 bytes) 031000 1734017340.901514 fallocate 0x47d7e1 thru 0x48a017 (0xc837 bytes) 032000 1734017344.335438 mapwrite 0x1f09df thru 0x1f4cef (0x4311 bytes) 033000 1734017347.619231 punch from 0x0fac33 to 0x0fca60 (0x1e2e bytes) 034000 1734017350.926363 punch from 0x028f86 to 0x0345bc (0xb637 bytes) 035000 1734017354.583829 trunc from 0x5286ae to 0x2d8155 (0x250558 bytes) 036000 1734017357.887301 mapread 0x141910 thru 0x14aebf (0x95b0 bytes) 037000 1734017361.591104 write 0x429ba6 thru 0x433139 (0x9594 bytes) 042000 1734017378.589311 read 0x28b683 thru 0x295b18 (0xa496 bytes) 044000 1734017385.748180 punch from 0x3d858c to 0x3e1c83 (0x96f8 bytes) 045000 1734017389.269832 mapread 0x33581f thru 0x335bae (0x390 bytes) 046000 1734017392.515980 trunc from 0x418e2b to 0x4cabe0 (0xb1db6 bytes) 050000 1734017405.872001 write 0x144c97 thru 0x14bcdc (0x7046 bytes) 051000 1734017409.415609 mapread 0x2d87d7 thru 0x2db4bb (0x2ce5 bytes) 053000 1734017415.677191 trunc from 0x4645ba to 0x3b719e (0xad41b bytes) 054000 1734017418.481837 mapread 0x09f463 thru 0x0a4dc0 (0x595e bytes) 055000 1734017421.095087 mapread 0x1e0091 thru 0x1eb428 (0xb398 bytes) 056000 1734017423.477632 write 0x18cc0f thru 0x19accf (0xe0c1 bytes) 057000 1734017426.705091 fallocate 0x36b395 thru 0x371a25 (0x6691 bytes) 058000 1734017429.447271 trunc from 0x519feb to 0x18ad92 (0x38f258 bytes) 059000 1734017432.841523 fallocate 0x19d0c3 thru 0x1a1d5e (0x4c9c bytes) 064000 1734017447.177914 fallocate 0x2acfb6 thru 0x2ba18a (0xd1d5 bytes) 067000 1734017455.647990 mapread 0x054641 thru 0x05a83f (0x61ff bytes) 069000 1734017460.971839 mapwrite 0x1e026e thru 0x1e9f84 (0x9d17 bytes) 070000 1734017463.541535 mapread 0x136b40 thru 0x140e0d (0xa2ce bytes) 071000 1734017466.130232 trunc from 0x1c9bdf to 0x16cad7 (0x5d107 bytes) 072000 1734017469.088731 write 0x443de7 thru 0x444647 (0x861 bytes) 073000 1734017471.762352 mapread 0x27a841 thru 0x27b83f (0xfff bytes) 074000 1734017474.256020 trunc from 0x46728f to 0x4a99ff (0x42771 bytes) 075000 1734017476.976727 read 0x0a3618 thru 0x0ad10f (0x9af8 bytes) 076000 1734017480.282444 write 0x299534 thru 0x2a08b9 (0x7386 bytes) 078000 1734017485.799146 punch from 0x2d1235 to 0x2d1fca (0xd96 bytes) 079000 1734017488.456100 mapread 0x372f15 thru 0x37849d (0x5589 bytes) 080000 1734017491.084344 trunc from 0x17706c to 0x4ccb55 (0x355aea bytes) 081000 1734017493.586734 trunc from 0x310642 to 0x1ba042 (0x1565ff bytes) 083000 1734017499.303812 read 0x39a424 thru 0x39c949 (0x2526 bytes) 085000 1734017505.162222 punch from 0x3c3b76 to 0x3d31c1 (0xf64c bytes) 086000 1734017508.028368 mapwrite 0x51cfad thru 0x5286ad (0xb701 bytes) 087000 1734017511.075649 punch from 0x232b61 to 0x2360c8 (0x3568 bytes) 088000 1734017513.950993 write 0x048f91 thru 0x0525d4 (0x9644 bytes) 090000 1734017520.269022 fallocate 0x4b963c thru 0x4bbe0a (0x27cf bytes) 092000 1734017526.366041 punch from 0x2cb76c to 0x2ccd41 (0x15d6 bytes) 093000 1734017529.832368 punch from 0x01dcdc to 0x01fd2e (0x2053 bytes) 094000 1734017533.108159 mapread 0x0497b8 thru 0x054542 (0xad8b bytes) 095000 1734017536.037073 write 0x124b6d thru 0x132b53 (0xdfe7 bytes) 098000 1734017545.047407 punch from 0x1796a7 to 0x1835d4 (0x9f2e bytes) 099000 1734017549.140281 punch from 0x077e17 to 0x080020 (0x820a bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 426838 (420 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 3936256.. 3936259: 4: 0001: net 1: 8.. 39: 3936268.. 3936299: 32: 0001: net 2: 40.. 55: 3936344.. 3936359: 16: 0001: net 3: 56.. 59: 3936364.. 3936367: 4: 0001: net 4: 60.. 63: 3936312.. 3936315: 4: 0001: net 5: 64.. 71: 3409164.. 3409171: 8: 0001: last,net /mnt/lustre/f0.fsxfile: 6 extents found debug=0x33f0484 PASS fsx (315s) == sanity-benchmark test complete, duration 1719 sec ===== 10:32:34 (1734017554) === sanity-benchmark: start cleanup 10:32:34 (1734017554) === === sanity-benchmark: finish cleanup 10:32:35 (1734017555) ===