-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:39 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:43 (1734015823) === oleg325-client.virtnet: executing check_config_client /mnt/lustre oleg325-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg325-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b38ec800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b38ec800.idle_timeout=debug disable quota as required oleg325-server: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:03:51 (1734015831) === == sanity-benchmark test dbench: dbench ================== 10:03:51 (1734015831) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6955] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg325-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg325-client.virtnet at Thu Dec 12 10:03:52 EST 2024 waiting for dbench pid 9425 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 167 137.49 MB/sec warmup 1 sec latency 89.113 ms 20 334 120.86 MB/sec warmup 2 sec latency 59.272 ms 20 485 112.84 MB/sec warmup 3 sec latency 56.127 ms 20 651 105.37 MB/sec warmup 4 sec latency 179.571 ms 20 711 84.82 MB/sec warmup 5 sec latency 382.359 ms 20 767 71.16 MB/sec warmup 6 sec latency 209.617 ms 20 812 61.35 MB/sec warmup 7 sec latency 188.656 ms 20 899 54.20 MB/sec warmup 8 sec latency 218.201 ms 20 962 48.47 MB/sec warmup 9 sec latency 201.496 ms 20 1064 45.79 MB/sec warmup 10 sec latency 166.050 ms 20 1157 41.81 MB/sec warmup 11 sec latency 74.708 ms 20 1236 38.45 MB/sec warmup 12 sec latency 89.312 ms 20 1404 40.01 MB/sec warmup 13 sec latency 78.301 ms 20 1471 37.18 MB/sec warmup 14 sec latency 281.073 ms 20 1538 34.79 MB/sec warmup 15 sec latency 150.906 ms 20 1612 32.69 MB/sec warmup 16 sec latency 241.276 ms 20 1672 30.83 MB/sec warmup 17 sec latency 268.250 ms 20 1737 29.17 MB/sec warmup 18 sec latency 105.753 ms 20 1803 27.70 MB/sec warmup 19 sec latency 79.996 ms 20 1854 26.35 MB/sec warmup 20 sec latency 188.671 ms 20 1930 25.16 MB/sec warmup 21 sec latency 192.939 ms 20 2003 24.09 MB/sec warmup 22 sec latency 168.588 ms 20 2066 23.13 MB/sec warmup 23 sec latency 82.513 ms 20 2191 1.58 MB/sec execute 1 sec latency 94.783 ms 20 2285 7.22 MB/sec execute 2 sec latency 233.554 ms 20 2372 8.32 MB/sec execute 3 sec latency 298.645 ms 20 2419 6.97 MB/sec execute 4 sec latency 294.480 ms 20 2477 7.45 MB/sec execute 5 sec latency 307.393 ms 20 2560 7.83 MB/sec execute 6 sec latency 275.634 ms 20 2705 12.24 MB/sec execute 7 sec latency 289.254 ms 20 2855 14.45 MB/sec execute 8 sec latency 301.892 ms 20 2953 14.82 MB/sec execute 9 sec latency 363.682 ms 20 3029 13.87 MB/sec execute 10 sec latency 395.370 ms 20 3145 13.47 MB/sec execute 11 sec latency 679.099 ms 20 3284 13.95 MB/sec execute 12 sec latency 311.026 ms 20 3387 14.11 MB/sec execute 13 sec latency 228.293 ms 20 3526 15.93 MB/sec execute 14 sec latency 168.044 ms 20 3621 15.83 MB/sec execute 15 sec latency 75.680 ms 20 3693 15.22 MB/sec execute 16 sec latency 95.207 ms 20 3766 15.03 MB/sec execute 17 sec latency 84.656 ms 20 3814 14.51 MB/sec execute 18 sec latency 140.893 ms 20 3855 13.78 MB/sec execute 19 sec latency 94.001 ms 20 3903 13.25 MB/sec execute 20 sec latency 87.577 ms 20 3942 12.71 MB/sec execute 21 sec latency 115.215 ms 20 3984 12.15 MB/sec execute 22 sec latency 99.944 ms 20 4011 11.62 MB/sec execute 23 sec latency 145.487 ms 20 4050 11.14 MB/sec execute 24 sec latency 128.518 ms 20 4096 10.71 MB/sec execute 25 sec latency 126.837 ms 20 4143 10.32 MB/sec execute 26 sec latency 371.490 ms 20 4203 9.98 MB/sec execute 27 sec latency 395.324 ms 20 4245 9.71 MB/sec execute 28 sec latency 451.698 ms 20 4281 9.42 MB/sec execute 29 sec latency 269.403 ms 20 4314 9.17 MB/sec execute 30 sec latency 357.340 ms 20 4351 8.92 MB/sec execute 31 sec latency 322.814 ms 20 4388 8.71 MB/sec execute 32 sec latency 268.669 ms 20 4427 8.49 MB/sec execute 33 sec latency 235.771 ms 20 4476 8.34 MB/sec execute 34 sec latency 291.649 ms 20 4514 8.17 MB/sec execute 35 sec latency 284.525 ms 20 4559 8.07 MB/sec execute 36 sec latency 363.872 ms 20 4613 8.01 MB/sec execute 37 sec latency 327.450 ms 20 4678 8.09 MB/sec execute 38 sec latency 309.633 ms 20 4749 8.00 MB/sec execute 39 sec latency 110.992 ms 20 4816 8.03 MB/sec execute 40 sec latency 114.056 ms 20 4870 8.09 MB/sec execute 41 sec latency 354.738 ms 20 4938 8.20 MB/sec execute 42 sec latency 420.407 ms 20 5014 8.58 MB/sec execute 43 sec latency 204.014 ms 20 5060 8.40 MB/sec execute 44 sec latency 238.362 ms 20 5104 8.23 MB/sec execute 45 sec latency 215.742 ms 20 5148 8.07 MB/sec execute 46 sec latency 215.863 ms 20 5188 7.91 MB/sec execute 47 sec latency 264.648 ms 20 5233 7.76 MB/sec execute 48 sec latency 180.391 ms 20 5279 7.62 MB/sec execute 49 sec latency 278.524 ms 20 5329 7.48 MB/sec execute 50 sec latency 104.453 ms 20 5376 7.35 MB/sec execute 51 sec latency 153.338 ms 20 5418 7.22 MB/sec execute 52 sec latency 199.584 ms 20 5469 7.11 MB/sec execute 53 sec latency 207.664 ms 20 5533 7.00 MB/sec execute 54 sec latency 178.160 ms 20 5598 6.90 MB/sec execute 55 sec latency 189.769 ms 20 5660 6.82 MB/sec execute 56 sec latency 100.318 ms 20 5716 6.74 MB/sec execute 57 sec latency 231.101 ms 20 5775 6.68 MB/sec execute 58 sec latency 201.113 ms 20 5840 6.71 MB/sec execute 59 sec latency 240.305 ms 20 5905 6.71 MB/sec execute 60 sec latency 276.394 ms 20 5966 6.73 MB/sec execute 61 sec latency 368.912 ms 20 6020 6.73 MB/sec execute 62 sec latency 380.211 ms 20 6089 6.78 MB/sec execute 63 sec latency 362.967 ms 20 6171 6.92 MB/sec execute 64 sec latency 334.491 ms 20 6293 7.22 MB/sec execute 65 sec latency 332.586 ms 20 6415 7.54 MB/sec execute 66 sec latency 279.490 ms 20 6520 7.65 MB/sec execute 67 sec latency 284.067 ms 20 6619 7.72 MB/sec execute 68 sec latency 316.959 ms 20 6732 7.80 MB/sec execute 69 sec latency 362.366 ms 20 6873 7.95 MB/sec execute 70 sec latency 341.058 ms 20 6979 8.14 MB/sec execute 71 sec latency 338.037 ms 20 7074 8.28 MB/sec execute 72 sec latency 210.192 ms 20 7174 8.51 MB/sec execute 73 sec latency 105.297 ms 20 7233 8.46 MB/sec execute 74 sec latency 85.175 ms 20 7295 8.46 MB/sec execute 75 sec latency 101.494 ms 20 7339 8.40 MB/sec execute 76 sec latency 153.251 ms 20 7393 8.37 MB/sec execute 77 sec latency 111.132 ms 20 7443 8.29 MB/sec execute 78 sec latency 80.991 ms 20 7490 8.21 MB/sec execute 79 sec latency 93.272 ms 20 7535 8.12 MB/sec execute 80 sec latency 99.601 ms 20 7567 8.02 MB/sec execute 81 sec latency 296.643 ms 20 7618 7.93 MB/sec execute 82 sec latency 317.131 ms 20 7668 7.84 MB/sec execute 83 sec latency 268.587 ms 20 7716 7.76 MB/sec execute 84 sec latency 227.062 ms 20 7773 7.68 MB/sec execute 85 sec latency 364.161 ms 20 7813 7.62 MB/sec execute 86 sec latency 355.358 ms 20 7857 7.55 MB/sec execute 87 sec latency 252.436 ms 20 7892 7.49 MB/sec execute 88 sec latency 320.117 ms 20 7934 7.42 MB/sec execute 89 sec latency 251.702 ms 20 7977 7.38 MB/sec execute 90 sec latency 350.744 ms 20 8024 7.32 MB/sec execute 91 sec latency 235.687 ms 20 8073 7.28 MB/sec execute 92 sec latency 297.850 ms 20 8119 7.26 MB/sec execute 93 sec latency 296.205 ms 20 8189 7.28 MB/sec execute 94 sec latency 191.245 ms 20 8244 7.26 MB/sec execute 95 sec latency 385.725 ms 20 8318 7.29 MB/sec execute 96 sec latency 194.434 ms 20 8392 7.34 MB/sec execute 97 sec latency 108.731 ms 20 8465 7.42 MB/sec execute 98 sec latency 248.764 ms 20 8519 7.38 MB/sec execute 99 sec latency 268.764 ms 20 8591 7.52 MB/sec execute 100 sec latency 271.771 ms 20 8634 7.45 MB/sec execute 101 sec latency 198.883 ms 20 8678 7.38 MB/sec execute 102 sec latency 205.526 ms 20 8722 7.32 MB/sec execute 103 sec latency 238.121 ms 20 8766 7.25 MB/sec execute 104 sec latency 187.389 ms 20 8810 7.19 MB/sec execute 105 sec latency 152.096 ms 20 8853 7.13 MB/sec execute 106 sec latency 197.149 ms 20 8898 7.07 MB/sec execute 107 sec latency 198.316 ms 20 8948 7.01 MB/sec execute 108 sec latency 169.135 ms 20 9004 6.96 MB/sec execute 109 sec latency 195.065 ms 20 9064 6.91 MB/sec execute 110 sec latency 212.898 ms 20 9118 6.87 MB/sec execute 111 sec latency 227.684 ms 20 9192 6.82 MB/sec execute 112 sec latency 201.835 ms 20 9247 6.79 MB/sec execute 113 sec latency 173.479 ms 20 9310 6.77 MB/sec execute 114 sec latency 186.173 ms 20 9384 6.78 MB/sec execute 115 sec latency 224.185 ms 20 9432 6.75 MB/sec execute 116 sec latency 219.810 ms 20 9503 6.77 MB/sec execute 117 sec latency 356.472 ms 20 9563 6.79 MB/sec execute 118 sec latency 317.856 ms 20 9626 6.82 MB/sec execute 119 sec latency 358.768 ms 20 cleanup 120 sec 20 cleanup 121 sec 20 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 25774 49.207 168.213 Close 19166 10.909 86.902 Rename 1135 68.834 165.893 Unlink 5167 15.214 72.149 Qpathinfo 24054 11.575 122.236 Qfileinfo 4274 0.239 33.450 Qfsinfo 4321 0.145 20.698 Sfileinfo 2263 42.098 133.213 Find 9189 1.857 103.050 WriteX 13217 3.543 64.307 ReadX 40915 0.024 4.836 LockX 86 15.203 37.394 UnlockX 86 14.619 35.689 Flush 1801 179.661 679.093 Throughput 6.8182 MB/sec 20 clients 20 procs max_latency=679.099 ms stopping dbench on /mnt/lustre/d0.oleg325-client.virtnet at Thu Dec 12 10:06:19 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg325-client.virtnet /mnt/lustre/d0.oleg325-client.virtnet /mnt/lustre/d0.oleg325-client.virtnet removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg325-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (154s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:25 (1734015985) min OST has 3193856kB available, using 4790784kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6955] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4678] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg325-clien 4678M 90990 68 69438 53 147498 31 476.1 97 Latency 17575us 78377us 100ms 503ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg325-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 175 17 7660 33 440 13 301 18 1001 12 515 13 Latency 31713us 13746us 58850us 22937us 3439us 12221us 1.97,1.97,oleg325-client.virtnet,1,1734005496,4678M,,,,90990,68,69438,53,,,147498,31,476.1,97,10,,,,,175,17,7660,33,440,13,301,18,1001,12,515,13,,17575us,78377us,,100ms,503ms,31713us,13746us,58850us,22937us,3439us,12221us debug=0x33f0484 PASS bonnie (326s) == sanity-benchmark test iozone: iozone ================== 10:11:51 (1734016311) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6955] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:10 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 310276 151669 124689 124538 66180 109730 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:17:30 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 27378 25425 103087 110236 93902 31455 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1130s) == sanity-benchmark test fsx: fsx ======================== 10:30:41 (1734017441) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 30700 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 30700 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0xee843 truncating to largest ever: 0x4e311e truncating to largest ever: 0x55223d truncating to largest ever: 0x55a63e 001000 1734017444.746190 write 0x0bcefa thru 0x0bd34f (0x456 bytes) truncating to largest ever: 0x561631 002000 1734017447.357942 trunc from 0x4df988 to 0x10c644 (0x3d3343 bytes) 003000 1734017450.080364 trunc from 0x50af05 to 0x4c132c (0x49bd8 bytes) 004000 1734017452.813839 read 0x1fc308 thru 0x1fca4f (0x748 bytes) 005000 1734017455.380959 mapwrite 0x425994 thru 0x42af52 (0x55bf bytes) 006000 1734017457.933454 mapwrite 0x2225fe thru 0x229dc4 (0x77c7 bytes) 010000 1734017467.343026 mapread 0x3b0c1b thru 0x3b5174 (0x455a bytes) 013000 1734017474.811744 read 0x05511b thru 0x0610d7 (0xbfbd bytes) 014000 1734017477.655749 trunc from 0x312da5 to 0x3c9784 (0xb69e0 bytes) 016000 1734017482.805473 read 0x110578 thru 0x117744 (0x71cd bytes) truncating to largest ever: 0x5618e2 018000 1734017488.516601 trunc from 0x4b0090 to 0x148ba8 (0x3674e7 bytes) 020000 1734017494.060852 trunc from 0x37593a to 0x3ab52b (0x35bf2 bytes) truncating to largest ever: 0x561a35 025000 1734017507.627395 trunc from 0x43496c to 0x45de22 (0x294b7 bytes) 027000 1734017513.713194 trunc from 0x4f480b to 0x3ef34f (0x1054bb bytes) 029000 1734017519.796816 read 0x25d050 thru 0x267ccc (0xac7d bytes) 030000 1734017522.837339 mapread 0x48ee10 thru 0x495986 (0x6b77 bytes) 031000 1734017525.688791 write 0x180f1e thru 0x188063 (0x7146 bytes) 033000 1734017531.478077 mapread 0x195ccc thru 0x1a525d (0xf592 bytes) 034000 1734017533.996682 trunc from 0x288197 to 0x1bf6f1 (0xc8aa5 bytes) 036000 1734017539.600805 trunc from 0x4d6708 to 0x4d085d (0x5eaa bytes) 038000 1734017545.565084 write 0x458d7f thru 0x45b08a (0x230c bytes) 039000 1734017548.544519 mapread 0x1f4e3e thru 0x202336 (0xd4f9 bytes) 040000 1734017551.590511 write 0x3035b5 thru 0x305d47 (0x2793 bytes) 044000 1734017562.710882 mapread 0x31c28a thru 0x32538a (0x9101 bytes) 046000 1734017568.491457 mapwrite 0x347385 thru 0x34a61e (0x329a bytes) 051000 1734017582.283508 mapread 0x11dbb7 thru 0x11dd32 (0x17c bytes) 055000 1734017593.767015 write 0x1db35a thru 0x1dbce7 (0x98e bytes) 056000 1734017596.371821 mapread 0x1d9b24 thru 0x1e4f94 (0xb471 bytes) 059000 1734017604.762994 mapread 0x20f8f6 thru 0x210291 (0x99c bytes) 060000 1734017607.632911 read 0x095892 thru 0x097dc7 (0x2536 bytes) 061000 1734017610.556845 mapwrite 0x13bf64 thru 0x14aea6 (0xef43 bytes) 064000 1734017619.663122 trunc from 0x4aadb9 to 0x3f3bb3 (0xb7205 bytes) 065000 1734017622.369244 mapread 0x087b44 thru 0x096f81 (0xf43e bytes) 068000 1734017630.690775 trunc from 0x0a5f55 to 0x215905 (0x16f9b1 bytes) truncating to largest ever: 0x561bcb 071000 1734017638.557086 write 0x2fcc90 thru 0x301694 (0x4a05 bytes) 072000 1734017641.067060 mapread 0x033bea thru 0x040da9 (0xd1c0 bytes) 075000 1734017649.575093 write 0x208931 thru 0x20d8fc (0x4fcc bytes) 078000 1734017657.207172 read 0x22b3b2 thru 0x237978 (0xc5c7 bytes) 079000 1734017660.168649 write 0x25b02e thru 0x2666d0 (0xb6a3 bytes) 080000 1734017663.292693 read 0x3b0845 thru 0x3b402b (0x37e7 bytes) 081000 1734017666.099249 mapwrite 0x17fa7d thru 0x181092 (0x1616 bytes) 084000 1734017673.924489 mapread 0x243686 thru 0x247b35 (0x44b0 bytes) 085000 1734017676.399593 write 0x1afeca thru 0x1b1baf (0x1ce6 bytes) 087000 1734017681.260651 mapread 0x065a10 thru 0x06f926 (0x9f17 bytes) 088000 1734017683.954495 write 0x0cdefb thru 0x0cfc02 (0x1d08 bytes) 090000 1734017689.827078 read 0x2a4888 thru 0x2a6a4f (0x21c8 bytes) 091000 1734017692.442374 mapread 0x33c78d thru 0x3486f8 (0xbf6c bytes) 094000 1734017700.474642 mapread 0x3c3c05 thru 0x3ccf0c (0x9308 bytes) 095000 1734017703.095741 mapwrite 0x1a70ab thru 0x1a93d3 (0x2329 bytes) 096000 1734017705.439478 trunc from 0x3f0702 to 0x360166 (0x9059b bytes) 097000 1734017707.991409 mapread 0x01aa32 thru 0x01faac (0x507b bytes) 100000 1734017716.889828 trunc from 0x459339 to 0x20e983 (0x24a9b5 bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 2156932 (2176 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (276s) == sanity-benchmark test complete, duration 1898 sec ===== 10:35:17 (1734017717) === sanity-benchmark: start cleanup 10:35:18 (1734017718) === === sanity-benchmark: finish cleanup 10:35:18 (1734017718) ===