-----============= acceptance-small: sanity-benchmark ============----- Thu Dec 12 10:04:09 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:04:19 (1734015859) === oleg221-client.virtnet: executing check_config_client /mnt/lustre oleg221-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg221-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6315800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6315800.idle_timeout=debug disable quota as required oleg221-server: oleg221-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:04:37 (1734015877) === == sanity-benchmark test dbench: dbench ================== 10:04:38 (1734015878) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7714] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg221-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg221-client.virtnet at Thu Dec 12 10:04:41 EST 2024 waiting for dbench pid 10308 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 0 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 0 4 0.00 MB/sec warmup 1 sec latency 954.735 ms 11 40 15.67 MB/sec warmup 2 sec latency 1848.083 ms 20 108 32.85 MB/sec warmup 3 sec latency 297.934 ms 20 158 33.04 MB/sec warmup 4 sec latency 347.388 ms 20 206 32.20 MB/sec warmup 5 sec latency 175.468 ms 20 249 31.44 MB/sec warmup 6 sec latency 183.620 ms 20 298 31.35 MB/sec warmup 7 sec latency 177.611 ms 20 341 30.71 MB/sec warmup 8 sec latency 173.308 ms 20 390 30.71 MB/sec warmup 9 sec latency 163.858 ms 20 450 31.54 MB/sec warmup 10 sec latency 125.196 ms 20 503 31.76 MB/sec warmup 11 sec latency 179.819 ms 20 584 33.23 MB/sec warmup 12 sec latency 172.440 ms 20 656 32.40 MB/sec warmup 13 sec latency 623.955 ms 20 677 30.19 MB/sec warmup 14 sec latency 257.731 ms 20 709 28.26 MB/sec warmup 15 sec latency 368.718 ms 20 729 26.58 MB/sec warmup 16 sec latency 498.998 ms 20 762 25.07 MB/sec warmup 17 sec latency 324.760 ms 20 788 23.78 MB/sec warmup 18 sec latency 514.774 ms 20 804 22.57 MB/sec warmup 19 sec latency 552.180 ms 20 850 21.53 MB/sec warmup 20 sec latency 303.778 ms 20 881 20.60 MB/sec warmup 21 sec latency 339.501 ms 20 904 19.72 MB/sec warmup 22 sec latency 510.600 ms 20 927 18.91 MB/sec warmup 23 sec latency 601.011 ms 20 995 4.34 MB/sec execute 1 sec latency 630.046 ms 20 1066 10.72 MB/sec execute 2 sec latency 352.067 ms 20 1124 7.61 MB/sec execute 3 sec latency 120.139 ms 20 1164 5.88 MB/sec execute 4 sec latency 128.173 ms 20 1217 4.91 MB/sec execute 5 sec latency 133.992 ms 20 1261 5.15 MB/sec execute 6 sec latency 150.364 ms 20 1301 5.79 MB/sec execute 7 sec latency 387.818 ms 20 1411 10.44 MB/sec execute 8 sec latency 142.721 ms 20 1450 9.31 MB/sec execute 9 sec latency 441.714 ms 20 1485 8.42 MB/sec execute 10 sec latency 540.046 ms 20 1516 7.70 MB/sec execute 11 sec latency 525.247 ms 20 1572 7.15 MB/sec execute 12 sec latency 125.734 ms 20 1626 6.66 MB/sec execute 13 sec latency 335.530 ms 20 1653 6.23 MB/sec execute 14 sec latency 439.902 ms 20 1697 5.86 MB/sec execute 15 sec latency 545.847 ms 20 1762 5.56 MB/sec execute 16 sec latency 149.176 ms 20 1832 5.30 MB/sec execute 17 sec latency 89.500 ms 20 1867 5.03 MB/sec execute 18 sec latency 325.012 ms 20 1891 4.78 MB/sec execute 19 sec latency 740.059 ms 20 1924 4.59 MB/sec execute 20 sec latency 1165.653 ms 20 2002 4.44 MB/sec execute 21 sec latency 249.894 ms 20 2048 4.31 MB/sec execute 22 sec latency 122.158 ms 20 2102 4.19 MB/sec execute 23 sec latency 131.780 ms 20 2155 4.05 MB/sec execute 24 sec latency 117.742 ms 20 2193 4.04 MB/sec execute 25 sec latency 156.795 ms 20 2245 3.99 MB/sec execute 26 sec latency 347.562 ms 20 2343 4.46 MB/sec execute 27 sec latency 436.064 ms 20 2376 4.37 MB/sec execute 28 sec latency 554.053 ms 20 2411 4.30 MB/sec execute 29 sec latency 699.156 ms 20 2453 4.27 MB/sec execute 30 sec latency 459.869 ms 20 2498 4.46 MB/sec execute 31 sec latency 351.066 ms 20 2595 4.71 MB/sec execute 32 sec latency 496.821 ms 20 2665 4.93 MB/sec execute 33 sec latency 369.316 ms 20 2800 6.11 MB/sec execute 34 sec latency 381.724 ms 20 2891 6.14 MB/sec execute 35 sec latency 572.107 ms 20 2948 6.47 MB/sec execute 36 sec latency 442.254 ms 20 3022 6.37 MB/sec execute 37 sec latency 433.369 ms 20 3150 6.48 MB/sec execute 38 sec latency 340.398 ms 20 3252 6.57 MB/sec execute 39 sec latency 423.406 ms 20 3361 6.92 MB/sec execute 40 sec latency 311.613 ms 20 3446 7.22 MB/sec execute 41 sec latency 263.953 ms 20 3568 7.91 MB/sec execute 42 sec latency 106.332 ms 20 3641 7.81 MB/sec execute 43 sec latency 107.794 ms 20 3699 7.78 MB/sec execute 44 sec latency 136.544 ms 20 3754 7.77 MB/sec execute 45 sec latency 112.186 ms 20 3810 7.79 MB/sec execute 46 sec latency 119.894 ms 20 3853 7.64 MB/sec execute 47 sec latency 114.064 ms 20 3894 7.51 MB/sec execute 48 sec latency 99.653 ms 20 3930 7.43 MB/sec execute 49 sec latency 146.906 ms 20 3971 7.28 MB/sec execute 50 sec latency 172.344 ms 20 4013 7.14 MB/sec execute 51 sec latency 129.337 ms 20 4069 7.01 MB/sec execute 52 sec latency 86.362 ms 20 4123 6.89 MB/sec execute 53 sec latency 437.197 ms 20 4167 6.77 MB/sec execute 54 sec latency 425.064 ms 20 4219 6.67 MB/sec execute 55 sec latency 573.180 ms 20 4250 6.59 MB/sec execute 56 sec latency 452.180 ms 20 4279 6.49 MB/sec execute 57 sec latency 270.273 ms 20 4309 6.41 MB/sec execute 58 sec latency 357.080 ms 20 4342 6.32 MB/sec execute 59 sec latency 248.240 ms 20 4383 6.25 MB/sec execute 60 sec latency 366.711 ms 20 4423 6.18 MB/sec execute 61 sec latency 263.548 ms 20 4475 6.12 MB/sec execute 62 sec latency 270.347 ms 20 4517 6.08 MB/sec execute 63 sec latency 296.944 ms 20 4583 6.09 MB/sec execute 64 sec latency 275.726 ms 20 4649 6.16 MB/sec execute 65 sec latency 357.482 ms 20 4741 6.15 MB/sec execute 66 sec latency 76.170 ms 20 4825 6.28 MB/sec execute 67 sec latency 89.509 ms 20 4899 6.37 MB/sec execute 68 sec latency 155.702 ms 20 4999 6.75 MB/sec execute 69 sec latency 252.971 ms 20 5060 6.66 MB/sec execute 70 sec latency 222.762 ms 20 5111 6.58 MB/sec execute 71 sec latency 255.982 ms 20 5165 6.50 MB/sec execute 72 sec latency 238.836 ms 20 5211 6.42 MB/sec execute 73 sec latency 262.235 ms 20 5270 6.35 MB/sec execute 74 sec latency 253.844 ms 20 5324 6.28 MB/sec execute 75 sec latency 199.660 ms 20 5378 6.20 MB/sec execute 76 sec latency 226.559 ms 20 5435 6.14 MB/sec execute 77 sec latency 323.258 ms 20 5498 6.07 MB/sec execute 78 sec latency 230.511 ms 20 5567 6.02 MB/sec execute 79 sec latency 381.910 ms 20 5632 5.96 MB/sec execute 80 sec latency 104.381 ms 20 5704 5.93 MB/sec execute 81 sec latency 83.783 ms 20 5781 5.93 MB/sec execute 82 sec latency 249.764 ms 20 5849 5.92 MB/sec execute 83 sec latency 314.080 ms 20 5924 5.98 MB/sec execute 84 sec latency 391.815 ms 20 5966 5.97 MB/sec execute 85 sec latency 503.738 ms 20 6008 5.95 MB/sec execute 86 sec latency 417.771 ms 20 6066 5.96 MB/sec execute 87 sec latency 430.749 ms 20 6154 6.08 MB/sec execute 88 sec latency 447.643 ms 20 6247 6.22 MB/sec execute 89 sec latency 384.694 ms 20 6355 6.47 MB/sec execute 90 sec latency 403.931 ms 20 6462 6.64 MB/sec execute 91 sec latency 462.388 ms 20 6570 6.71 MB/sec execute 92 sec latency 373.486 ms 20 6653 6.73 MB/sec execute 93 sec latency 375.196 ms 20 6765 6.77 MB/sec execute 94 sec latency 355.262 ms 20 6901 6.95 MB/sec execute 95 sec latency 274.849 ms 20 7017 7.10 MB/sec execute 96 sec latency 219.173 ms 20 7158 7.39 MB/sec execute 97 sec latency 65.982 ms 20 7243 7.40 MB/sec execute 98 sec latency 80.556 ms 20 7322 7.42 MB/sec execute 99 sec latency 101.973 ms 20 7382 7.41 MB/sec execute 100 sec latency 124.457 ms 20 7445 7.36 MB/sec execute 101 sec latency 80.471 ms 20 7502 7.31 MB/sec execute 102 sec latency 97.707 ms 20 7558 7.24 MB/sec execute 103 sec latency 93.828 ms 20 7623 7.18 MB/sec execute 104 sec latency 108.562 ms 20 7674 7.12 MB/sec execute 105 sec latency 327.584 ms 20 7740 7.06 MB/sec execute 106 sec latency 396.522 ms 20 7799 7.02 MB/sec execute 107 sec latency 338.978 ms 20 7836 6.97 MB/sec execute 108 sec latency 288.148 ms 20 7873 6.92 MB/sec execute 109 sec latency 376.738 ms 20 7915 6.88 MB/sec execute 110 sec latency 334.643 ms 20 7960 6.84 MB/sec execute 111 sec latency 247.445 ms 20 8006 6.79 MB/sec execute 112 sec latency 351.004 ms 20 8070 6.79 MB/sec execute 113 sec latency 245.685 ms 20 8131 6.78 MB/sec execute 114 sec latency 350.229 ms 20 8221 6.81 MB/sec execute 115 sec latency 271.797 ms 20 8314 6.84 MB/sec execute 116 sec latency 106.042 ms 20 8407 6.94 MB/sec execute 117 sec latency 184.502 ms 20 8501 7.07 MB/sec execute 118 sec latency 256.777 ms 20 8592 7.13 MB/sec execute 119 sec latency 199.807 ms 20 cleanup 120 sec 20 cleanup 121 sec 0 cleanup 122 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 26404 43.149 268.640 Close 19530 11.487 85.662 Rename 1171 67.635 387.794 Unlink 5195 14.758 155.846 Qpathinfo 24620 11.352 186.792 Qfileinfo 4212 0.311 65.420 Qfsinfo 4402 0.200 36.870 Sfileinfo 2363 44.372 270.282 Find 9231 4.265 208.270 WriteX 13203 5.073 96.754 ReadX 41716 0.034 12.467 LockX 80 14.993 33.058 UnlockX 80 15.360 35.364 Flush 1777 216.335 1165.646 Throughput 7.12799 MB/sec 20 clients 20 procs max_latency=1165.653 ms stopping dbench on /mnt/lustre/d0.oleg221-client.virtnet at Thu Dec 12 10:07:07 EST 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg221-client.virtnet /mnt/lustre/d0.oleg221-client.virtnet /mnt/lustre/d0.oleg221-client.virtnet removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg221-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (157s) == sanity-benchmark test bonnie: bonnie++ ================ 10:07:15 (1734016035) min OST has 3380224kB available, using 5070336kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7714] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4951] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg221-clien 4951M 75537 60 52531 46 144287 38 946.3 144 Latency 51548us 170ms 96624us 628ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg221-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 279 17 6554 29 383 12 339 17 789 12 358 12 Latency 21122us 21100us 58794us 16498us 5686us 32333us 1.97,1.97,oleg221-client.virtnet,1,1734004897,4951M,,,,75537,60,52531,46,,,144287,38,946.3,144,10,,,,,279,17,6554,29,383,12,339,17,789,12,358,12,,51548us,170ms,,96624us,628ms,21122us,21100us,58794us,16498us,5686us,32333us debug=0x33f0484 PASS bonnie (353s) == sanity-benchmark test iozone: iozone ================== 10:13:08 (1734016388) sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete min OST has 3765248kB available, using 5647872kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7714] running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:13:29 2024 Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 110448 99964 111491 174258 66627 94039 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 directio on /mnt/lustre/f.iozone for 1x4194304 bytes PASS sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [iozone] [-I] [-i] [0] [-i] [1] [-i] [2] [-e] [-+d] [-r] [512] [-s] [5647872] [-f] [/mnt/lustre/d0.iozone/iozone.odir] Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Thu Dec 12 10:19:42 2024 O_DIRECT feature enabled Include fsync in write timing >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 512 kB File size set to 5647872 kB Command line used: iozone -I -i 0 -i 1 -i 2 -e -+d -r 512 -s 5647872 -f /mnt/lustre/d0.iozone/iozone.odir Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 5647872 512 25422 27339 110800 111868 95320 35510 iozone test complete. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete debug=0x33f0484 PASS iozone (1160s) == sanity-benchmark test fsx: fsx ======================== 10:32:28 (1734017548) fallocate on zfs doesn't consume space fallocate not supported debug=0 stat: cannot read file system information for '/mnt/lustre/f0.fsxfile': No such file or directory Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 27741 -P /tmp -l 5641728 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 27741 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x2ff65 truncating to largest ever: 0x106a7f truncating to largest ever: 0x325cf1 truncating to largest ever: 0x46c8d4 truncating to largest ever: 0x4b4c18 truncating to largest ever: 0x503d01 truncating to largest ever: 0x54506e 001000 1734017552.340726 write 0x1d4e7b thru 0x1d7ffc (0x3182 bytes) truncating to largest ever: 0x553453 002000 1734017555.722178 mapread 0x140459 thru 0x14dd7a (0xd922 bytes) truncating to largest ever: 0x5552f3 003000 1734017558.575476 mapwrite 0x54e3ae thru 0x553e0d (0x5a60 bytes) truncating to largest ever: 0x560306 truncating to largest ever: 0x560fd7 007000 1734017569.916980 mapwrite 0x003c30 thru 0x003e21 (0x1f2 bytes) 008000 1734017572.866093 trunc from 0x31b70f to 0x0edf1e (0x22d7f0 bytes) 010000 1734017578.536478 read 0x0f83c6 thru 0x1041b0 (0xbdeb bytes) 011000 1734017581.334668 trunc from 0x1f4a7d to 0x36ec1b (0x17a19f bytes) 013000 1734017587.074016 mapread 0x1e13ec thru 0x1ee02f (0xcc44 bytes) 018000 1734017601.342723 mapread 0x048c2f thru 0x055b7d (0xcf4f bytes) 019000 1734017604.070856 read 0x0f9110 thru 0x102ba0 (0x9a91 bytes) 021000 1734017609.606663 mapread 0x12dda1 thru 0x12fa0b (0x1c6b bytes) 022000 1734017612.539251 mapwrite 0x49bc05 thru 0x4a5642 (0x9a3e bytes) 024000 1734017617.883299 write 0x107a08 thru 0x115483 (0xda7c bytes) 025000 1734017620.759279 read 0x003d82 thru 0x00aed4 (0x7153 bytes) 026000 1734017623.494802 mapread 0x46de05 thru 0x47b122 (0xd31e bytes) 027000 1734017626.207696 write 0x074020 thru 0x07e58d (0xa56e bytes) 028000 1734017628.970635 read 0x0233d3 thru 0x030381 (0xcfaf bytes) 029000 1734017631.433003 write 0x0ceb40 thru 0x0d54b5 (0x6976 bytes) 030000 1734017634.287963 read 0x14cc24 thru 0x15646c (0x9849 bytes) 031000 1734017637.116368 read 0x2128e1 thru 0x219a1b (0x713b bytes) 034000 1734017645.707449 mapwrite 0x425ab1 thru 0x426bbb (0x110b bytes) 035000 1734017648.529594 read 0x44c6b8 thru 0x44f947 (0x3290 bytes) 036000 1734017651.461607 write 0x2737e3 thru 0x2777e7 (0x4005 bytes) 038000 1734017657.128232 mapwrite 0x3bfc23 thru 0x3c64b8 (0x6896 bytes) 039000 1734017660.083490 mapread 0x36af30 thru 0x373682 (0x8753 bytes) 042000 1734017668.567748 mapread 0x15ec9b thru 0x165ed4 (0x723a bytes) 043000 1734017671.752456 mapwrite 0x258dde thru 0x26880a (0xfa2d bytes) 044000 1734017674.776771 mapwrite 0x0faee1 thru 0x0fc684 (0x17a4 bytes) 045000 1734017677.562153 mapread 0x00da54 thru 0x01d2d9 (0xf886 bytes) 046000 1734017680.768143 write 0x276088 thru 0x2832eb (0xd264 bytes) 047000 1734017683.592181 write 0x483e00 thru 0x48618a (0x238b bytes) 048000 1734017686.834710 mapread 0x136181 thru 0x13ee7a (0x8cfa bytes) 051000 1734017695.774720 mapwrite 0x20ac53 thru 0x20e5a6 (0x3954 bytes) 052000 1734017698.521038 read 0x2aa4b8 thru 0x2b43c5 (0x9f0e bytes) 053000 1734017701.391677 read 0x1ad026 thru 0x1bbd5f (0xed3a bytes) 058000 1734017715.099218 mapwrite 0x39489f thru 0x39cced (0x844f bytes) 059000 1734017717.909798 trunc from 0x4bffa0 to 0x34aa0e (0x175591 bytes) 060000 1734017721.072197 mapwrite 0x2a9f13 thru 0x2b6082 (0xc170 bytes) 061000 1734017723.985464 read 0x23c222 thru 0x247bae (0xb98d bytes) 063000 1734017729.681542 write 0x455369 thru 0x45dd24 (0x89bc bytes) 064000 1734017733.140187 read 0x107087 thru 0x114353 (0xd2cd bytes) 066000 1734017739.512317 mapread 0x275582 thru 0x280d3a (0xb7b9 bytes) 067000 1734017742.575351 read 0x20d099 thru 0x21ba97 (0xe9ff bytes) truncating to largest ever: 0x561325 068000 1734017745.361314 mapread 0x0b1f2a thru 0x0bb04a (0x9121 bytes) 069000 1734017748.345389 read 0x246c24 thru 0x248bec (0x1fc9 bytes) 071000 1734017754.191565 mapread 0x1999cd thru 0x19b3a1 (0x19d5 bytes) 074000 1734017762.816107 trunc from 0x42e633 to 0x501f52 (0xd3920 bytes) 076000 1734017769.005362 trunc from 0x4c4dcc to 0x0c11aa (0x403c21 bytes) 077000 1734017772.003407 read 0x0fd175 thru 0x108e3b (0xbcc7 bytes) 078000 1734017774.617085 mapread 0x2fcc91 thru 0x3066ca (0x9a3a bytes) 081000 1734017782.948111 trunc from 0x55db88 to 0x054071 (0x509b16 bytes) 083000 1734017788.810756 write 0x1d25e5 thru 0x1e23b2 (0xfdce bytes) truncating to largest ever: 0x5615c0 085000 1734017794.647820 mapwrite 0x2ef8b6 thru 0x2fcb3a (0xd285 bytes) 089000 1734017805.483244 trunc from 0x1dc68e to 0x026085 (0x1b6608 bytes) 090000 1734017808.295393 write 0x4f4401 thru 0x4f7c77 (0x3877 bytes) 091000 1734017812.901048 read 0x185c84 thru 0x194fba (0xf337 bytes) 092000 1734017816.397171 read 0x2a1522 thru 0x2a2283 (0xd62 bytes) 093000 1734017819.459073 mapwrite 0x2dc69e thru 0x2e82a5 (0xbc08 bytes) 095000 1734017826.895888 write 0x4136fb thru 0x41a84c (0x7152 bytes) 099000 1734017847.295171 trunc from 0x5293ba to 0x0bdc3e (0x46b77b bytes) 100000 1734017851.440362 read 0x10c617 thru 0x1163d5 (0x9dbf bytes) All operations completed A-OK! /mnt/lustre/f0.fsxfile: FIBMAP unsupported Filesystem type is: bd00bd0 File size of /mnt/lustre/f0.fsxfile is 3759197 (3712 blocks of 1024 bytes) debug=0x33f0484 PASS fsx (305s) == sanity-benchmark test complete, duration 2003 sec ===== 10:37:33 (1734017853) === sanity-benchmark: start cleanup 10:37:33 (1734017853) === === sanity-benchmark: finish cleanup 10:37:34 (1734017854) ===