-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:03:36 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:03:41 (1734015821) === oleg338-client.virtnet: executing check_config_client /mnt/lustre oleg338-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg338-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800af029000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800af029000.idle_timeout=debug disable quota as required oleg338-server: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:03:48 (1734015828) === == sanity-benchmark test dbench: dbench ================== 10:03:49 (1734015829) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6961] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg338-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg338-client.virtnet at Thu Dec 12 10:03:50 EST 2024 waiting for dbench pid 9427 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 18 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 186 149.25 MB/sec warmup 1 sec latency 102.962 ms 20 408 144.02 MB/sec warmup 2 sec latency 58.750 ms 20 651 140.54 MB/sec warmup 3 sec latency 138.792 ms 20 733 106.50 MB/sec warmup 4 sec latency 174.948 ms 20 808 85.91 MB/sec warmup 5 sec latency 132.136 ms 20 890 72.26 MB/sec warmup 6 sec latency 143.331 ms 20 956 62.32 MB/sec warmup 7 sec latency 146.047 ms 20 1061 57.23 MB/sec warmup 8 sec latency 165.444 ms 20 1152 51.09 MB/sec warmup 9 sec latency 76.455 ms 20 1234 46.13 MB/sec warmup 10 sec latency 72.205 ms 20 1362 45.49 MB/sec warmup 11 sec latency 87.713 ms 20 1463 43.35 MB/sec warmup 12 sec latency 248.072 ms 20 1536 40.11 MB/sec warmup 13 sec latency 198.872 ms 20 1618 37.37 MB/sec warmup 14 sec latency 159.214 ms 20 1686 34.95 MB/sec warmup 15 sec latency 167.811 ms 20 1768 32.85 MB/sec warmup 16 sec latency 83.557 ms 20 1834 30.98 MB/sec warmup 17 sec latency 140.806 ms 20 1899 29.32 MB/sec warmup 18 sec latency 215.128 ms 20 1962 27.85 MB/sec warmup 19 sec latency 203.199 ms 20 2025 26.53 MB/sec warmup 20 sec latency 99.010 ms 20 2081 25.34 MB/sec warmup 21 sec latency 106.550 ms 20 2142 24.26 MB/sec warmup 22 sec latency 92.739 ms 20 2204 23.37 MB/sec warmup 23 sec latency 94.872 ms 20 2367 12.17 MB/sec execute 1 sec latency 275.977 ms 20 2413 7.75 MB/sec execute 2 sec latency 235.778 ms 20 2470 7.60 MB/sec execute 3 sec latency 294.082 ms 20 2548 8.49 MB/sec execute 4 sec latency 246.796 ms 20 2682 12.76 MB/sec execute 5 sec latency 260.753 ms 20 2817 16.33 MB/sec execute 6 sec latency 256.582 ms 20 2937 16.34 MB/sec execute 7 sec latency 293.701 ms 20 3028 15.86 MB/sec execute 8 sec latency 298.164 ms 20 3140 15.24 MB/sec execute 9 sec latency 337.617 ms 20 3273 15.23 MB/sec execute 10 sec latency 321.702 ms 20 3351 15.13 MB/sec execute 11 sec latency 623.565 ms 20 3461 16.00 MB/sec execute 12 sec latency 241.835 ms 20 3572 16.95 MB/sec execute 13 sec latency 107.124 ms 20 3642 16.18 MB/sec execute 14 sec latency 98.257 ms 20 3710 15.60 MB/sec execute 15 sec latency 111.039 ms 20 3769 15.19 MB/sec execute 16 sec latency 141.410 ms 20 3817 14.64 MB/sec execute 17 sec latency 127.562 ms 20 3857 13.89 MB/sec execute 18 sec latency 137.434 ms 20 3896 13.23 MB/sec execute 19 sec latency 99.655 ms 20 3940 12.70 MB/sec execute 20 sec latency 92.778 ms 20 3969 12.13 MB/sec execute 21 sec latency 172.900 ms 20 4003 11.58 MB/sec execute 22 sec latency 120.320 ms 20 4042 11.08 MB/sec execute 23 sec latency 116.854 ms 20 4093 10.63 MB/sec execute 24 sec latency 90.706 ms 20 4131 10.23 MB/sec execute 25 sec latency 334.959 ms 20 4178 9.86 MB/sec execute 26 sec latency 533.602 ms 20 4224 9.55 MB/sec execute 27 sec latency 323.933 ms 20 4256 9.27 MB/sec execute 28 sec latency 359.647 ms 20 4285 9.00 MB/sec execute 29 sec latency 336.438 ms 20 4317 8.75 MB/sec execute 30 sec latency 400.045 ms 20 4346 8.51 MB/sec execute 31 sec latency 347.335 ms 20 4383 8.30 MB/sec execute 32 sec latency 475.656 ms 20 4420 8.10 MB/sec execute 33 sec latency 335.704 ms 20 4464 7.93 MB/sec execute 34 sec latency 234.899 ms 20 4500 7.77 MB/sec execute 35 sec latency 362.083 ms 20 4537 7.63 MB/sec execute 36 sec latency 329.269 ms 20 4584 7.61 MB/sec execute 37 sec latency 371.018 ms 20 4636 7.60 MB/sec execute 38 sec latency 260.742 ms 20 4698 7.60 MB/sec execute 39 sec latency 204.549 ms 20 4751 7.48 MB/sec execute 40 sec latency 127.491 ms 20 4805 7.45 MB/sec execute 41 sec latency 165.009 ms 20 4860 7.51 MB/sec execute 42 sec latency 280.706 ms 20 4931 7.84 MB/sec execute 43 sec latency 124.796 ms 20 4984 7.91 MB/sec execute 44 sec latency 279.009 ms 20 5035 7.92 MB/sec execute 45 sec latency 268.811 ms 20 5071 7.76 MB/sec execute 46 sec latency 315.483 ms 20 5110 7.61 MB/sec execute 47 sec latency 221.740 ms 20 5142 7.46 MB/sec execute 48 sec latency 279.967 ms 20 5178 7.32 MB/sec execute 49 sec latency 215.632 ms 20 5218 7.19 MB/sec execute 50 sec latency 216.574 ms 20 5264 7.07 MB/sec execute 51 sec latency 185.309 ms 20 5302 6.94 MB/sec execute 52 sec latency 216.380 ms 20 5340 6.82 MB/sec execute 53 sec latency 226.369 ms 20 5379 6.71 MB/sec execute 54 sec latency 136.120 ms 20 5417 6.60 MB/sec execute 55 sec latency 216.382 ms 20 5462 6.50 MB/sec execute 56 sec latency 169.715 ms 20 5517 6.40 MB/sec execute 57 sec latency 164.929 ms 20 5571 6.31 MB/sec execute 58 sec latency 189.268 ms 20 5619 6.23 MB/sec execute 59 sec latency 107.824 ms 20 5674 6.16 MB/sec execute 60 sec latency 107.810 ms 20 5727 6.10 MB/sec execute 61 sec latency 285.304 ms 20 5776 6.05 MB/sec execute 62 sec latency 242.049 ms 20 5838 6.05 MB/sec execute 63 sec latency 233.802 ms 20 5902 6.10 MB/sec execute 64 sec latency 268.099 ms 20 5953 6.10 MB/sec execute 65 sec latency 491.110 ms 20 5997 6.08 MB/sec execute 66 sec latency 386.233 ms 20 6055 6.09 MB/sec execute 67 sec latency 351.308 ms 20 6126 6.21 MB/sec execute 68 sec latency 291.299 ms 20 6219 6.34 MB/sec execute 69 sec latency 288.480 ms 20 6313 6.58 MB/sec execute 70 sec latency 276.272 ms 20 6428 6.90 MB/sec execute 71 sec latency 492.312 ms 20 6531 7.02 MB/sec execute 72 sec latency 341.141 ms 20 6620 7.02 MB/sec execute 73 sec latency 421.956 ms 20 6712 7.08 MB/sec execute 74 sec latency 367.994 ms 20 6859 7.21 MB/sec execute 75 sec latency 424.558 ms 20 6957 7.39 MB/sec execute 76 sec latency 310.286 ms 20 7033 7.48 MB/sec execute 77 sec latency 224.268 ms 20 7123 7.72 MB/sec execute 78 sec latency 113.652 ms 20 7185 7.71 MB/sec execute 79 sec latency 106.963 ms 20 7247 7.69 MB/sec execute 80 sec latency 115.281 ms 20 7294 7.65 MB/sec execute 81 sec latency 148.333 ms 20 7352 7.68 MB/sec execute 82 sec latency 101.195 ms 20 7396 7.61 MB/sec execute 83 sec latency 100.050 ms 20 7436 7.54 MB/sec execute 84 sec latency 97.066 ms 20 7476 7.48 MB/sec execute 85 sec latency 108.752 ms 20 7507 7.40 MB/sec execute 86 sec latency 163.986 ms 20 7548 7.32 MB/sec execute 87 sec latency 122.801 ms 20 7586 7.24 MB/sec execute 88 sec latency 288.717 ms 20 7632 7.16 MB/sec execute 89 sec latency 240.964 ms 20 7684 7.09 MB/sec execute 90 sec latency 236.449 ms 20 7738 7.02 MB/sec execute 91 sec latency 247.608 ms 20 7792 6.97 MB/sec execute 92 sec latency 390.912 ms 20 7828 6.91 MB/sec execute 93 sec latency 326.144 ms 20 7865 6.86 MB/sec execute 94 sec latency 352.459 ms 20 7896 6.80 MB/sec execute 95 sec latency 317.621 ms 20 7938 6.75 MB/sec execute 96 sec latency 327.796 ms 20 7974 6.71 MB/sec execute 97 sec latency 337.191 ms 20 8023 6.67 MB/sec execute 98 sec latency 275.462 ms 20 8070 6.63 MB/sec execute 99 sec latency 267.643 ms 20 8118 6.62 MB/sec execute 100 sec latency 293.528 ms 20 8170 6.62 MB/sec execute 101 sec latency 379.949 ms 20 8227 6.65 MB/sec execute 102 sec latency 337.296 ms 20 8300 6.67 MB/sec execute 103 sec latency 278.401 ms 20 8350 6.61 MB/sec execute 104 sec latency 122.027 ms 20 8419 6.70 MB/sec execute 105 sec latency 246.948 ms 20 8466 6.67 MB/sec execute 106 sec latency 150.743 ms 20 8543 6.85 MB/sec execute 107 sec latency 255.159 ms 20 8590 6.84 MB/sec execute 108 sec latency 187.323 ms 20 8639 6.78 MB/sec execute 109 sec latency 216.868 ms 20 8682 6.73 MB/sec execute 110 sec latency 189.055 ms 20 8725 6.68 MB/sec execute 111 sec latency 278.683 ms 20 8766 6.62 MB/sec execute 112 sec latency 147.778 ms 20 8805 6.57 MB/sec execute 113 sec latency 220.774 ms 20 8856 6.52 MB/sec execute 114 sec latency 144.720 ms 20 8890 6.47 MB/sec execute 115 sec latency 172.892 ms 20 8939 6.42 MB/sec execute 116 sec latency 131.373 ms 20 8975 6.37 MB/sec execute 117 sec latency 173.139 ms 20 9025 6.32 MB/sec execute 118 sec latency 191.792 ms 20 9075 6.28 MB/sec execute 119 sec latency 180.145 ms 20 cleanup 120 sec 20 cleanup 121 sec 20 cleanup 122 sec 0 cleanup 123 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 23621 54.062 192.149 Close 17089 12.238 62.618 Rename 1039 76.450 176.272 Unlink 4899 17.071 70.621 Qpathinfo 21504 12.775 125.617 Qfileinfo 3726 0.312 49.912 Qfsinfo 4043 0.187 24.580 Sfileinfo 1979 46.614 141.367 Find 8286 2.068 102.776 WriteX 11663 4.063 70.394 ReadX 37535 0.038 8.838 LockX 80 15.429 32.612 UnlockX 80 16.738 36.601 Flush 1717 183.034 623.549 Throughput 6.27913 MB/sec 20 clients 20 procs max_latency=623.565 ms stopping dbench on /mnt/lustre/d0.oleg338-client.virtnet at Thu Dec 12 10:06:17 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg338-client.virtnet /mnt/lustre/d0.oleg338-client.virtnet /mnt/lustre/d0.oleg338-client.virtnet removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg338-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (155s) == sanity-benchmark test bonnie: bonnie++ ================ 10:06:24 (1734015984) min OST has 3529728kB available, using 5294592kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6961] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5170] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg338-clien 5170M 84493 63 60902 50 133469 32 603.9 128 Latency 33018us 177ms 107ms 747ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg338-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 226 19 6568 30 362 14 316 19 713 12 395 13 Latency 17164us 29399us 61074us 15496us 6428us 23375us 1.97,1.97,oleg338-client.virtnet,1,1734005494,5170M,,,,84493,63,60902,50,,,133469,32,603.9,128,10,,,,,226,19,6568,30,362,14,316,19,713,12,395,13,,33018us,177ms,,107ms,747ms,17164us,29399us,61074us,15496us,6428us,23375us debug=0x33f0484 PASS bonnie (360s) == sanity-benchmark test iozone: iozone ================== 10:12:24 (1734016344) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6961] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:12:44 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 147065 142365 133613 211263 53096 176789 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:18:03 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 23842 24864 92716 87948 79987 36189 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1175s) == sanity-benchmark test fsx: fsx ======================== 10:31:59 (1734017519) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 32349 -P /tmp -l 5643264 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 32349 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x46503d truncating to largest ever: 0x532a63 truncating to largest ever: 0x532e00 truncating to largest ever: 0x56066d 003000 1734017530.237574 write 0x0e6b02 thru 0x0e8ac2 (0x1fc1 bytes) 004000 1734017533.245086 mapwrite 0x274d41 thru 0x2848a4 (0xfb64 bytes) 005000 1734017536.219366 write 0x05d607 thru 0x06d2b0 (0xfcaa bytes) 009000 1734017549.034986 write 0x0343c1 thru 0x040098 (0xbcd8 bytes) 010000 1734017551.883673 trunc from 0x3cd0ba to 0x406d32 (0x39c79 bytes) 017000 1734017572.149762 write 0x439351 thru 0x440c3a (0x78ea bytes) 018000 1734017575.057084 trunc from 0x52d980 to 0x3c1adc (0x16bea3 bytes) 020000 1734017580.757453 mapread 0x096103 thru 0x09d283 (0x7181 bytes) 023000 1734017589.470043 read 0x041e39 thru 0x04de57 (0xc01f bytes) 024000 1734017592.362502 mapread 0x1f5889 thru 0x1f7266 (0x19de bytes) 025000 1734017595.042234 mapwrite 0x4266b2 thru 0x426890 (0x1df bytes) 027000 1734017601.397620 mapwrite 0x4dd89f thru 0x4e8e11 (0xb573 bytes) 033000 1734017618.340420 read 0x0b6fef thru 0x0b9ce3 (0x2cf5 bytes) 034000 1734017620.916909 trunc from 0x4e509f to 0x32c688 (0x1b8a16 bytes) 035000 1734017623.978308 mapwrite 0x0eeb87 thru 0x0f959a (0xaa14 bytes) 036000 1734017626.512104 mapwrite 0x4cf17c thru 0x4d86fb (0x9580 bytes) 037000 1734017629.354792 mapwrite 0x3ea81a thru 0x3f15ec (0x6dd3 bytes) 041000 1734017639.960641 read 0x002c7f thru 0x005774 (0x2af6 bytes) 042000 1734017642.653741 mapread 0x03230f thru 0x03b131 (0x8e23 bytes) 048000 1734017659.188564 mapread 0x30876d thru 0x316c6a (0xe4fe bytes) 049000 1734017662.007332 mapwrite 0x2e9469 thru 0x2ec87d (0x3415 bytes) 050000 1734017664.911887 read 0x2fc69d thru 0x3032ad (0x6c11 bytes) truncating to largest ever: 0x560ec4 058000 1734017687.417863 read 0x24ad9d thru 0x2582b4 (0xd518 bytes) 059000 1734017690.206137 trunc from 0x2c668d to 0x391988 (0xcb2fc bytes) 064000 1734017702.891216 read 0x2281e0 thru 0x23439e (0xc1bf bytes) 066000 1734017708.491116 mapwrite 0x2264c4 thru 0x22d785 (0x72c2 bytes) truncating to largest ever: 0x560edb 068000 1734017713.941517 mapwrite 0x41fb96 thru 0x4239cf (0x3e3a bytes) 070000 1734017719.219245 mapread 0x3ff325 thru 0x400518 (0x11f4 bytes) 072000 1734017724.538657 trunc from 0x5137c8 to 0x3695aa (0x1aa21d bytes) 074000 1734017729.612290 mapwrite 0x2c926b thru 0x2cf14c (0x5ee2 bytes) 076000 1734017735.057928 write 0x4a2533 thru 0x4afd69 (0xd837 bytes) 077000 1734017737.531910 trunc from 0x4a71f8 to 0x02ea39 (0x4787be bytes) 082000 1734017750.854994 trunc from 0x23bc76 to 0x238ca8 (0x2fcd bytes) 086000 1734017760.845261 write 0x280383 thru 0x288fd5 (0x8c53 bytes) 087000 1734017763.713296 trunc from 0x1799f2 to 0x1c2d2d (0x4933c bytes) 088000 1734017767.007505 write 0x215aba thru 0x21d24d (0x7794 bytes) truncating to largest ever: 0x5611b7 092000 1734017780.071777 mapread 0x172247 thru 0x17336a (0x1124 bytes) 093000 1734017784.628437 trunc from 0x458a1b to 0x494095 (0x3b67b bytes) 094000 1734017788.719102 mapread 0x0df5c0 thru 0x0e5bf6 (0x6637 bytes) 096000 1734017797.570194 write 0x1dcfb9 thru 0x1de346 (0x138e bytes) 097000 1734017802.464013 read 0x2e2250 thru 0x2f0ec9 (0xec7a bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 2831596 (2816 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (293s) == sanity-benchmark test complete, duration 1995 sec ===== 10:36:52 (1734017812) === sanity-benchmark: start cleanup 10:36:52 (1734017812) === === sanity-benchmark: finish cleanup 10:36:53 (1734017813) ===