-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:56 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:02 (1734015842) === oleg407-client.virtnet: executing check_config_client /mnt/lustre oleg407-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg407-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b3b15800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b3b15800.idle_timeout=debug disable quota as required oleg407-server: oleg407-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:04:16 (1734015856) === == sanity-benchmark test dbench: dbench ================== 10:04:17 (1734015857) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6885] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg407-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg407-client.virtnet at Thu Dec 12 10:04:19 EST 2024 waiting for dbench pid 9452 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 7 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 7 24 15.56 MB/sec warmup 1 sec latency 221.948 ms 20 120 54.69 MB/sec warmup 2 sec latency 204.153 ms 20 169 46.18 MB/sec warmup 3 sec latency 199.146 ms 20 223 43.08 MB/sec warmup 4 sec latency 149.373 ms 20 280 41.78 MB/sec warmup 5 sec latency 153.026 ms 20 325 39.36 MB/sec warmup 6 sec latency 171.588 ms 20 377 38.37 MB/sec warmup 7 sec latency 133.169 ms 20 442 38.84 MB/sec warmup 8 sec latency 142.430 ms 20 501 38.73 MB/sec warmup 9 sec latency 159.125 ms 20 578 39.65 MB/sec warmup 10 sec latency 183.482 ms 20 646 38.27 MB/sec warmup 11 sec latency 195.830 ms 20 699 35.31 MB/sec warmup 12 sec latency 140.211 ms 20 742 32.78 MB/sec warmup 13 sec latency 138.844 ms 20 777 30.52 MB/sec warmup 14 sec latency 174.746 ms 20 815 28.64 MB/sec warmup 15 sec latency 145.516 ms 20 861 26.98 MB/sec warmup 16 sec latency 134.134 ms 20 878 25.47 MB/sec warmup 17 sec latency 916.356 ms 20 880 24.06 MB/sec warmup 18 sec latency 1925.276 ms 20 886 22.80 MB/sec warmup 19 sec latency 2737.939 ms 20 915 21.70 MB/sec warmup 20 sec latency 1887.481 ms 20 957 20.75 MB/sec warmup 21 sec latency 122.115 ms 20 997 20.06 MB/sec warmup 22 sec latency 155.120 ms 20 1061 19.89 MB/sec warmup 23 sec latency 113.255 ms 20 1152 0.86 MB/sec execute 1 sec latency 164.332 ms 20 1197 0.80 MB/sec execute 2 sec latency 160.702 ms 20 1243 1.80 MB/sec execute 3 sec latency 126.151 ms 20 1301 4.52 MB/sec execute 4 sec latency 142.650 ms 20 1409 12.21 MB/sec execute 5 sec latency 152.091 ms 20 1445 10.20 MB/sec execute 6 sec latency 131.665 ms 20 1490 8.83 MB/sec execute 7 sec latency 117.214 ms 20 1523 7.79 MB/sec execute 8 sec latency 133.677 ms 20 1567 7.02 MB/sec execute 9 sec latency 122.207 ms 20 1608 6.40 MB/sec execute 10 sec latency 150.744 ms 20 1641 5.86 MB/sec execute 11 sec latency 176.893 ms 20 1681 5.44 MB/sec execute 12 sec latency 162.229 ms 20 1723 5.06 MB/sec execute 13 sec latency 146.904 ms 20 1768 4.76 MB/sec execute 14 sec latency 125.151 ms 20 1809 4.48 MB/sec execute 15 sec latency 119.374 ms 20 1845 4.25 MB/sec execute 16 sec latency 132.731 ms 20 1881 4.03 MB/sec execute 17 sec latency 144.961 ms 20 1907 3.82 MB/sec execute 18 sec latency 354.559 ms 20 1955 3.69 MB/sec execute 19 sec latency 134.482 ms 20 1996 3.54 MB/sec execute 20 sec latency 184.195 ms 20 2029 3.42 MB/sec execute 21 sec latency 201.253 ms 20 2063 3.31 MB/sec execute 22 sec latency 139.202 ms 20 2098 3.21 MB/sec execute 23 sec latency 204.761 ms 20 2130 3.10 MB/sec execute 24 sec latency 192.855 ms 20 2170 3.01 MB/sec execute 25 sec latency 141.211 ms 20 2212 3.07 MB/sec execute 26 sec latency 160.067 ms 20 2257 3.14 MB/sec execute 27 sec latency 144.640 ms 20 2318 3.25 MB/sec execute 28 sec latency 120.289 ms 20 2380 3.44 MB/sec execute 29 sec latency 154.037 ms 20 2420 3.46 MB/sec execute 30 sec latency 155.028 ms 20 2470 3.51 MB/sec execute 31 sec latency 147.509 ms 20 2521 3.55 MB/sec execute 32 sec latency 147.444 ms 20 2613 4.18 MB/sec execute 33 sec latency 156.920 ms 20 2711 4.57 MB/sec execute 34 sec latency 149.909 ms 20 2806 5.06 MB/sec execute 35 sec latency 146.200 ms 20 2903 5.51 MB/sec execute 36 sec latency 136.747 ms 20 2999 5.65 MB/sec execute 37 sec latency 192.601 ms 20 3088 5.79 MB/sec execute 38 sec latency 166.569 ms 20 3189 5.90 MB/sec execute 39 sec latency 174.628 ms 20 3288 6.03 MB/sec execute 40 sec latency 141.040 ms 20 3380 6.39 MB/sec execute 41 sec latency 146.115 ms 20 3484 6.82 MB/sec execute 42 sec latency 114.050 ms 20 3541 6.88 MB/sec execute 43 sec latency 140.044 ms 20 3622 7.09 MB/sec execute 44 sec latency 109.155 ms 20 3684 7.07 MB/sec execute 45 sec latency 108.303 ms 20 3728 7.05 MB/sec execute 46 sec latency 174.922 ms 20 3768 7.01 MB/sec execute 47 sec latency 171.993 ms 20 3801 6.95 MB/sec execute 48 sec latency 196.209 ms 20 3835 6.86 MB/sec execute 49 sec latency 144.139 ms 20 3870 6.75 MB/sec execute 50 sec latency 151.734 ms 20 3900 6.65 MB/sec execute 51 sec latency 184.578 ms 20 3926 6.54 MB/sec execute 52 sec latency 225.325 ms 20 3955 6.45 MB/sec execute 53 sec latency 192.720 ms 20 3994 6.33 MB/sec execute 54 sec latency 106.946 ms 20 4027 6.21 MB/sec execute 55 sec latency 94.548 ms 20 4054 6.10 MB/sec execute 56 sec latency 173.819 ms 20 4091 6.00 MB/sec execute 57 sec latency 172.516 ms 20 4135 5.91 MB/sec execute 58 sec latency 155.227 ms 20 4184 5.83 MB/sec execute 59 sec latency 165.258 ms 20 4225 5.76 MB/sec execute 60 sec latency 257.306 ms 20 4272 5.69 MB/sec execute 61 sec latency 183.473 ms 20 4313 5.63 MB/sec execute 62 sec latency 167.734 ms 20 4356 5.57 MB/sec execute 63 sec latency 157.986 ms 20 4394 5.52 MB/sec execute 64 sec latency 151.294 ms 20 4432 5.46 MB/sec execute 65 sec latency 172.848 ms 20 4467 5.40 MB/sec execute 66 sec latency 151.437 ms 20 4504 5.35 MB/sec execute 67 sec latency 150.276 ms 20 4549 5.36 MB/sec execute 68 sec latency 137.058 ms 20 4598 5.37 MB/sec execute 69 sec latency 168.766 ms 20 4646 5.38 MB/sec execute 70 sec latency 150.856 ms 20 4708 5.39 MB/sec execute 71 sec latency 155.753 ms 20 4757 5.33 MB/sec execute 72 sec latency 130.269 ms 20 4821 5.42 MB/sec execute 73 sec latency 123.499 ms 20 4878 5.52 MB/sec execute 74 sec latency 146.079 ms 20 4940 5.68 MB/sec execute 75 sec latency 141.803 ms 20 4994 5.77 MB/sec execute 76 sec latency 163.936 ms 20 5034 5.76 MB/sec execute 77 sec latency 125.036 ms 20 5069 5.69 MB/sec execute 78 sec latency 155.635 ms 20 5098 5.63 MB/sec execute 79 sec latency 137.118 ms 20 5135 5.57 MB/sec execute 80 sec latency 110.737 ms 20 5180 5.51 MB/sec execute 81 sec latency 127.362 ms 20 5219 5.45 MB/sec execute 82 sec latency 152.929 ms 20 5248 5.39 MB/sec execute 83 sec latency 173.758 ms 20 5290 5.33 MB/sec execute 84 sec latency 161.874 ms 20 5317 5.27 MB/sec execute 85 sec latency 185.648 ms 20 5349 5.22 MB/sec execute 86 sec latency 125.761 ms 20 5376 5.16 MB/sec execute 87 sec latency 143.519 ms 20 5404 5.11 MB/sec execute 88 sec latency 154.870 ms 20 5444 5.06 MB/sec execute 89 sec latency 161.976 ms 20 5494 5.01 MB/sec execute 90 sec latency 116.430 ms 20 5539 4.97 MB/sec execute 91 sec latency 125.119 ms 20 5591 4.93 MB/sec execute 92 sec latency 114.835 ms 20 5639 4.89 MB/sec execute 93 sec latency 118.739 ms 20 5685 4.85 MB/sec execute 94 sec latency 117.435 ms 20 5737 4.82 MB/sec execute 95 sec latency 116.064 ms 20 5798 4.83 MB/sec execute 96 sec latency 108.925 ms 20 5860 4.87 MB/sec execute 97 sec latency 127.693 ms 20 5929 4.89 MB/sec execute 98 sec latency 103.750 ms 20 5977 4.90 MB/sec execute 99 sec latency 144.810 ms 20 6025 4.91 MB/sec execute 100 sec latency 138.788 ms 20 6082 4.92 MB/sec execute 101 sec latency 179.237 ms 20 6152 5.03 MB/sec execute 102 sec latency 150.974 ms 20 6268 5.23 MB/sec execute 103 sec latency 128.585 ms 20 6369 5.37 MB/sec execute 104 sec latency 133.714 ms 20 6477 5.55 MB/sec execute 105 sec latency 139.737 ms 20 6581 5.63 MB/sec execute 106 sec latency 116.433 ms 20 6702 5.67 MB/sec execute 107 sec latency 158.352 ms 20 6784 5.71 MB/sec execute 108 sec latency 218.121 ms 20 6906 5.85 MB/sec execute 109 sec latency 140.684 ms 20 7015 6.04 MB/sec execute 110 sec latency 127.709 ms 20 7098 6.14 MB/sec execute 111 sec latency 88.940 ms 20 7172 6.20 MB/sec execute 112 sec latency 88.201 ms 20 7229 6.20 MB/sec execute 113 sec latency 131.001 ms 20 7288 6.22 MB/sec execute 114 sec latency 118.057 ms 20 7335 6.21 MB/sec execute 115 sec latency 162.686 ms 20 7384 6.19 MB/sec execute 116 sec latency 117.623 ms 20 7423 6.15 MB/sec execute 117 sec latency 108.041 ms 20 7469 6.12 MB/sec execute 118 sec latency 94.857 ms 20 7510 6.08 MB/sec execute 119 sec latency 100.692 ms 20 cleanup 120 sec 20 cleanup 121 sec 20 cleanup 122 sec 1 cleanup 123 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 22140 62.639 354.551 Close 16260 15.756 91.962 Rename 937 93.675 257.282 Unlink 4069 19.966 88.296 Qpathinfo 20585 15.452 235.092 Qfileinfo 3653 0.328 34.858 Qfsinfo 3540 0.231 35.247 Sfileinfo 1583 58.375 138.651 Find 7668 5.106 133.092 WriteX 10762 6.732 154.766 ReadX 36197 0.045 8.739 LockX 80 22.140 45.845 UnlockX 80 23.453 47.998 Flush 1240 47.829 218.108 Throughput 6.08141 MB/sec 20 clients 20 procs max_latency=354.559 ms stopping dbench on /mnt/lustre/d0.oleg407-client.virtnet at Thu Dec 12 10:06:46 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg407-client.virtnet /mnt/lustre/d0.oleg407-client.virtnet /mnt/lustre/d0.oleg407-client.virtnet removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg407-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (157s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:54 (1734016014) min OST has 3541596kB available, using 5312394kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6885] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5187] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg407-clien 5187M 71425 58 44173 40 118763 30 2125 221 Latency 38676us 342ms 183ms 14158us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg407-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 246 18 5576 24 340 14 297 18 771 12 373 14 Latency 21694us 24271us 47794us 26156us 8792us 14738us 1.97,1.97,oleg407-client.virtnet,1,1734006098,5187M,,,,71425,58,44173,40,,,118763,30,2125,221,10,,,,,246,18,5576,24,340,14,297,18,771,12,373,14,,38676us,342ms,,183ms,14158us,21694us,24271us,47794us,26156us,8792us,14738us debug=0x33f0484 PASS bonnie (401s) == sanity-benchmark test iozone: iozone ================== 10:13:35 (1734016415) Waiting for MDT destroys to complete oleg407-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg407-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg407-client: oleg407-server: ssh exited with exit code 1 pdsh@oleg407-client: oleg407-server: ssh exited with exit code 1 min OST has 3605620kB available, using 5408430kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6885] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:47 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 189731 121200 108002 121740 49767 128379 iozone test complete. Waiting for MDT destroys to complete oleg407-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg407-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg407-client: oleg407-server: ssh exited with exit code 1 pdsh@oleg407-client: oleg407-server: ssh exited with exit code 1 debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS Waiting for MDT destroys to complete oleg407-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg407-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg407-client: oleg407-server: ssh exited with exit code 1 pdsh@oleg407-client: oleg407-server: ssh exited with exit code 1 debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5408430] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:19:29 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5408430 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5408430 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5408430 512 57176 66490 74519 78350 82978 68022 iozone test complete. Waiting for MDT destroys to complete oleg407-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg407-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg407-client: oleg407-server: ssh exited with exit code 1 pdsh@oleg407-client: oleg407-server: ssh exited with exit code 1 debug=0x33f0484 PASS iozone (829s) == sanity-benchmark test fsx: fsx ======================== 10:27:24 (1734017244) keep default fallocate mode: 0 debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 2404 -P /tmp -l 5408430 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 2404 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x2f0bf2 fallocating to largest ever: 0x3c36c1 fallocating to largest ever: 0x421188 fallocating to largest ever: 0x460c84 truncating to largest ever: 0x4dd432 truncating to largest ever: 0x4fd1c3 fallocating to largest ever: 0x4ff760 fallocating to largest ever: 0x52432a 001000 1734017247.657134 fallocate 0x501f53 thru 0x504489 (0x2537 bytes) truncating to largest ever: 0x527686 002000 1734017250.959475 punch from 0x0ecfc8 to 0x0f4636 (0x766f bytes) 003000 1734017254.184535 fallocate 0x0ff7fb thru 0x1021f0 (0x29f6 bytes) fallocating to largest ever: 0x5286ae 004000 1734017257.493288 mapwrite 0x1d2294 thru 0x1d7f45 (0x5cb2 bytes) 006000 1734017264.426050 fallocate 0x4705a8 thru 0x47f8b3 (0xf30c bytes) 007000 1734017267.778580 trunc from 0x1efeea to 0x06badc (0x18440d bytes) 011000 1734017280.875538 mapwrite 0x062ee4 thru 0x0645bb (0x16d8 bytes) 012000 1734017284.480279 read 0x127e59 thru 0x128e28 (0xfd0 bytes) 013000 1734017287.485087 punch from 0x170e56 to 0x174a5c (0x3c07 bytes) 014000 1734017290.382186 read 0x23d327 thru 0x249596 (0xc270 bytes) 017000 1734017299.900025 mapwrite 0x0aeb82 thru 0x0b89a7 (0x9e26 bytes) 018000 1734017302.930089 trunc from 0x2a3856 to 0x112e24 (0x190a31 bytes) 019000 1734017305.863502 punch from 0x306c5e to 0x30e7ed (0x7b90 bytes) 020000 1734017309.086930 read 0x228a42 thru 0x22dbe8 (0x51a7 bytes) 024000 1734017321.783548 trunc from 0x4ae79b to 0x393c32 (0x11ab68 bytes) 025000 1734017325.006764 mapread 0x18f6e0 thru 0x192ce8 (0x3609 bytes) 026000 1734017328.454892 trunc from 0x4ae01a to 0x0c8418 (0x3e5c01 bytes) 028000 1734017335.387713 read 0x096aba thru 0x09984b (0x2d92 bytes) 029000 1734017339.294857 trunc from 0x2500ed to 0x16ff11 (0xe01db bytes) 030000 1734017342.571070 read 0x25c23c thru 0x25f2e5 (0x30aa bytes) 031000 1734017345.588531 fallocate 0x51b0b7 thru 0x521a00 (0x694a bytes) 032000 1734017348.586956 write 0x510cfe thru 0x51c97a (0xbc7d bytes) 033000 1734017352.004158 read 0x236a2b thru 0x241dca (0xb3a0 bytes) 034000 1734017355.110706 write 0x394a8d thru 0x3a0907 (0xbe7b bytes) 035000 1734017358.090878 mapread 0x3714b9 thru 0x37725b (0x5da3 bytes) 037000 1734017364.307684 fallocate 0x4fa81b thru 0x5036d0 (0x8eb6 bytes) 038000 1734017367.757483 mapwrite 0x343892 thru 0x352f1b (0xf68a bytes) 039000 1734017371.275801 read 0x153b84 thru 0x1609a1 (0xce1e bytes) 040000 1734017374.418910 write 0x3af326 thru 0x3b834d (0x9028 bytes) 042000 1734017381.098012 trunc from 0x441de7 to 0x38e607 (0xb37df bytes) 044000 1734017388.525558 punch from 0x066eb2 to 0x070fe7 (0xa136 bytes) 045000 1734017391.684505 write 0x041c1e thru 0x050c94 (0xf077 bytes) 046000 1734017395.238752 fallocate 0x38594c thru 0x393f8b (0xe640 bytes) 047000 1734017398.738176 mapwrite 0x409931 thru 0x4119c7 (0x8097 bytes) 052000 1734017415.049100 write 0x02f7a5 thru 0x03b132 (0xb98e bytes) 054000 1734017420.529504 mapread 0x19c509 thru 0x1a83a5 (0xbe9d bytes) 055000 1734017423.266367 trunc from 0x452e97 to 0x005940 (0x44d556 bytes) 056000 1734017426.100394 mapread 0x26a325 thru 0x26eda4 (0x4a80 bytes) 057000 1734017429.214091 mapread 0x1db9d9 thru 0x1e7493 (0xbabb bytes) 058000 1734017432.388472 read 0x136742 thru 0x14435a (0xdc19 bytes) 059000 1734017435.193255 write 0x34a0b5 thru 0x3575ba (0xd506 bytes) 060000 1734017438.079845 write 0x1f1a3d thru 0x1f7256 (0x581a bytes) 062000 1734017443.688606 trunc from 0x472043 to 0x06432e (0x40dd14 bytes) 063000 1734017446.072660 mapwrite 0x3962aa thru 0x39e61d (0x8374 bytes) 064000 1734017448.467100 mapread 0x286ec2 thru 0x28de7b (0x6fba bytes) 065000 1734017450.962211 fallocate 0x05c66a thru 0x063b54 (0x74eb bytes) 066000 1734017453.517579 read 0x0c5124 thru 0x0c9c0c (0x4ae9 bytes) 067000 1734017456.521221 read 0x0204bd thru 0x02a856 (0xa39a bytes) 069000 1734017461.669413 read 0x196a39 thru 0x19b770 (0x4d38 bytes) 070000 1734017463.922639 write 0x37d031 thru 0x3834a9 (0x6479 bytes) 071000 1734017466.462302 read 0x273154 thru 0x27bbc3 (0x8a70 bytes) 072000 1734017469.207297 mapwrite 0x313c57 thru 0x319fab (0x6355 bytes) 073000 1734017472.066059 punch from 0x0e7ed6 to 0x0e8c98 (0xdc3 bytes) 074000 1734017474.602541 fallocate 0x4ec60b thru 0x4f83af (0xbda5 bytes) skipping zero size write 075000 1734017477.405803 trunc from 0x33c06a to 0x166dff (0x1d526a bytes) 076000 1734017480.234164 write 0x4d9507 thru 0x4e4c21 (0xb71b bytes) 077000 1734017482.779356 mapread 0x2199c0 thru 0x22768d (0xdcce bytes) 078000 1734017485.760743 trunc from 0x51086a to 0x4a5b27 (0x6ad42 bytes) 080000 1734017491.346354 mapwrite 0x432a2e thru 0x433b99 (0x116c bytes) 081000 1734017494.095138 fallocate 0x202207 thru 0x210985 (0xe77f bytes) 085000 1734017505.726725 read 0x1e1288 thru 0x1e3080 (0x1df9 bytes) skipping zero length punch hole 086000 1734017508.661796 mapwrite 0x34f970 thru 0x352aa3 (0x3134 bytes) 088000 1734017515.043609 write 0x1bcabf thru 0x1c1fd4 (0x5516 bytes) 089000 1734017518.097523 write 0x4d73b9 thru 0x4db0e4 (0x3d2c bytes) 090000 1734017521.345416 write 0x12c34c thru 0x12d31f (0xfd4 bytes) 091000 1734017524.387966 punch from 0x138ac0 to 0x13df15 (0x5456 bytes) 092000 1734017527.877701 mapwrite 0x387492 thru 0x38ce5d (0x59cc bytes) 093000 1734017531.110791 mapwrite 0x1b776f thru 0x1c28cf (0xb161 bytes) 094000 1734017534.251465 fallocate 0x44726c thru 0x44c555 (0x52ea bytes) 095000 1734017537.248533 trunc from 0x3f4c9f to 0x3fe52d (0x988f bytes) 096000 1734017540.697807 read 0x09e6ae thru 0x0aa33c (0xbc8f bytes) 097000 1734017543.896514 punch from 0x1abb4e to 0x1af762 (0x3c15 bytes) 098000 1734017547.555350 mapwrite 0x0d7bd7 thru 0x0d998c (0x1db6 bytes) 099000 1734017550.861854 write 0x40c45e thru 0x41ae5c (0xe9ff bytes) 100000 1734017554.604614 trunc from 0x0dfc17 to 0x16b4a3 (0x8b88d bytes) All operations completed A-OK! Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 1488036 (1456 blocks of 1024 bytes) ext: device_logical: physical_offset: length: dev: flags: 0: 0.. 3: 4067328.. 4067331: 4: 0000: net 1: 4.. 7: 4063400.. 4063403: 4: 0000: net 2: 8.. 11: 4071732.. 4071735: 4: 0000: net 3: 12.. 15: 4069700.. 4069703: 4: 0000: net 4: 16.. 23: 4071736.. 4071743: 8: 0000: net 5: 96.. 115: 4066336.. 4066355: 20: 0000: net 6: 128.. 147: 4066276.. 4066295: 20: 0000: net 7: 280.. 307: 527012.. 527039: 28: 0000: net 8: 884.. 895: 533380.. 533391: 12: 0000: last,net /mnt/lustre/f0.fsxfile: 9 extents found debug=0x33f0484 PASS fsx (311s) == sanity-benchmark test complete, duration 1718 sec ===== 10:32:35 (1734017555) === sanity-benchmark: start cleanup 10:32:36 (1734017556) === === sanity-benchmark: finish cleanup 10:32:37 (1734017557) ===