== replay-dual test 26: dbench and tar with mds failover ========================================================== 09:31:07 (1788183067) Starting client oleg349-client.virtnet: -o user_xattr,flock 192.168.203.149@tcp:/lustre /mnt/lustre Started clients oleg349-client.virtnet: 192.168.203.149@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) Started tar loop with pid 65628 Started dbench loop with 65629 striped dir -i0 -c2 -H all_char /mnt/lustre2/d26.replay-dual/run_dbench striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d26.replay-dual/run_tar looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1968 1269336 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1752 1269552 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1564 3605456 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 17928 3589016 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 19492 7194472 1% /mnt/lustre '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 1 -D /mnt/lustre2/d26.replay-dual/run_dbench -t 100' on /mnt/lustre at Mon Aug 31 09:31:15 EDT 2026 waiting for dbench pid 65707 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 100 seconds with load 'client.txt' and minimum warmup 20 secs failed to create barrier semaphore 0 of 1 processes prepared for launch 0 sec 1 of 1 processes prepared for launch 0 sec releasing clients 0 7 0.00 MB/sec warmup 1 sec latency 5.775 ms 1 21 0.23 MB/sec warmup 2 sec latency 67.674 ms 1 70 1.04 MB/sec warmup 3 sec latency 145.116 ms 1 111 1.31 MB/sec warmup 4 sec latency 230.115 ms 1 135 1.19 MB/sec warmup 5 sec latency 238.622 ms 1 155 1.09 MB/sec warmup 6 sec latency 297.745 ms 1 182 1.04 MB/sec warmup 7 sec latency 199.065 ms 1 189 0.95 MB/sec warmup 8 sec latency 878.330 ms 1 213 0.92 MB/sec warmup 9 sec latency 189.626 ms 1 240 0.91 MB/sec warmup 10 sec latency 147.880 ms test_26 fail mds1 1 times 1 287 0.97 MB/sec warmup 11 sec latency 106.701 ms 1 313 0.95 MB/sec warmup 12 sec latency 243.537 ms Failing mds1 on oleg349-server 1 341 0.94 MB/sec warmup 13 sec latency 169.471 ms 1 373 0.95 MB/sec warmup 14 sec latency 163.754 ms Stopping /mnt/lustre-mds1 (opts:) on oleg349-server 1 402 0.95 MB/sec warmup 15 sec latency 172.217 ms 1 437 0.96 MB/sec warmup 16 sec latency 177.090 ms 1 470 0.96 MB/sec warmup 17 sec latency 128.155 ms 1 501 0.97 MB/sec warmup 18 sec latency 239.301 ms 09:31:33 (1788183093) shut down facet: mds1 facet_host: oleg349-server facet_failover_host: oleg349-server 1 501 0.92 MB/sec warmup 19 sec latency 1239.889 ms 1 501 0.00 MB/sec execute 1 sec latency 3240.576 ms 1 501 0.00 MB/sec execute 2 sec latency 4242.542 ms 1 501 0.00 MB/sec execute 3 sec latency 5243.516 ms 1 501 0.00 MB/sec execute 4 sec latency 6243.917 ms 1 501 0.00 MB/sec execute 5 sec latency 7244.171 ms 1 501 0.00 MB/sec execute 6 sec latency 8244.385 ms 1 501 0.00 MB/sec execute 7 sec latency 9244.676 ms 1 501 0.00 MB/sec execute 8 sec latency 10245.493 ms Failover mds1 to oleg349-server mount facets: mds1 1 501 0.00 MB/sec execute 9 sec latency 11246.918 ms 1 501 0.00 MB/sec execute 10 sec latency 12248.033 ms 1 501 0.00 MB/sec execute 11 sec latency 13248.353 ms 1 501 0.00 MB/sec execute 12 sec latency 14248.587 ms 1 501 0.00 MB/sec execute 13 sec latency 15250.915 ms 1 501 0.00 MB/sec execute 14 sec latency 16259.055 ms 1 501 0.00 MB/sec execute 15 sec latency 17259.251 ms 1 501 0.00 MB/sec execute 16 sec latency 18259.500 ms 1 501 0.00 MB/sec execute 17 sec latency 19264.440 ms 1 501 0.00 MB/sec execute 18 sec latency 20264.816 ms Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 1 501 0.00 MB/sec execute 19 sec latency 21265.061 ms 1 501 0.00 MB/sec execute 20 sec latency 22265.746 ms 1 501 0.00 MB/sec execute 21 sec latency 23266.500 ms 1 501 0.00 MB/sec execute 22 sec latency 24268.508 ms 1 501 0.00 MB/sec execute 23 sec latency 25268.799 ms 1 501 0.00 MB/sec execute 24 sec latency 26270.610 ms 1 501 0.00 MB/sec execute 25 sec latency 27271.420 ms 1 501 0.00 MB/sec execute 26 sec latency 28271.845 ms 1 501 0.00 MB/sec execute 27 sec latency 29272.093 ms 1 501 0.00 MB/sec execute 28 sec latency 30272.352 ms 1 501 0.00 MB/sec execute 29 sec latency 31272.608 ms 1 501 0.00 MB/sec execute 30 sec latency 32272.847 ms 1 501 0.00 MB/sec execute 31 sec latency 33273.046 ms oleg349-server: oleg349-server.virtnet: executing set_default_debug -1 all 1 501 0.00 MB/sec execute 32 sec latency 34273.274 ms pdsh@oleg349-client: oleg349-server: ssh exited with exit code 1 1 501 0.00 MB/sec execute 33 sec latency 35278.491 ms Started lustre-MDT0000 09:32:09 (1788183129) targets are mounted 09:32:09 (1788183129) facet_failover done 1 501 0.00 MB/sec execute 34 sec latency 36278.734 ms 1 522 0.02 MB/sec execute 35 sec latency 36551.808 ms 1 552 0.05 MB/sec execute 36 sec latency 349.135 ms 1 606 0.09 MB/sec execute 37 sec latency 688.268 ms 1 654 0.09 MB/sec execute 38 sec latency 116.875 ms 1 678 0.10 MB/sec execute 39 sec latency 135.406 ms 1 703 0.09 MB/sec execute 40 sec latency 176.199 ms 1 731 0.09 MB/sec execute 41 sec latency 204.904 ms oleg349-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 1 759 0.09 MB/sec execute 42 sec latency 131.386 ms 1 779 0.09 MB/sec execute 43 sec latency 192.284 ms 1 803 0.09 MB/sec execute 44 sec latency 119.618 ms mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 1 848 0.09 MB/sec execute 45 sec latency 116.264 ms 1 876 0.09 MB/sec execute 46 sec latency 155.744 ms 1 905 0.09 MB/sec execute 47 sec latency 121.176 ms 1 935 0.09 MB/sec execute 48 sec latency 134.744 ms 1 970 0.09 MB/sec execute 49 sec latency 137.441 ms 1 1035 0.11 MB/sec execute 50 sec latency 81.945 ms 1 1082 0.11 MB/sec execute 51 sec latency 82.010 ms UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2120 1269184 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1892 1269412 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 18356 3586700 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 36872 3567504 2% /mnt/lustre[OST:1] filesystem_summary: 7666232 55228 7154204 1% /mnt/lustre 1 1129 0.11 MB/sec execute 52 sec latency 131.420 ms 1 1156 0.10 MB/sec execute 53 sec latency 128.881 ms 1 1172 0.10 MB/sec execute 54 sec latency 680.292 ms 1 1176 0.10 MB/sec execute 55 sec latency 1459.820 ms 1 1211 0.10 MB/sec execute 56 sec latency 134.952 ms 1 1240 0.10 MB/sec execute 57 sec latency 142.931 ms 1 1271 0.10 MB/sec execute 58 sec latency 178.315 ms 1 1399 0.14 MB/sec execute 59 sec latency 117.306 ms 1 1422 0.14 MB/sec execute 60 sec latency 160.303 ms 1 1465 0.14 MB/sec execute 61 sec latency 130.373 ms 1 1508 0.14 MB/sec execute 62 sec latency 98.388 ms test_26 fail mds2 2 times 1 1550 0.14 MB/sec execute 63 sec latency 103.658 ms 1 1596 0.14 MB/sec execute 64 sec latency 127.689 ms Failing mds2 on oleg349-server 1 1625 0.13 MB/sec execute 65 sec latency 145.933 ms Stopping /mnt/lustre-mds2 (opts:) on oleg349-server 1 1662 0.13 MB/sec execute 66 sec latency 145.697 ms 1 1689 0.13 MB/sec execute 67 sec latency 139.128 ms 1 1689 0.13 MB/sec execute 68 sec latency 1122.456 ms 1 1689 0.13 MB/sec execute 69 sec latency 2123.005 ms 1 1689 0.12 MB/sec execute 70 sec latency 3123.269 ms 09:32:45 (1788183165) shut down facet: mds2 facet_host: oleg349-server facet_failover_host: oleg349-server 1 1689 0.12 MB/sec execute 71 sec latency 4123.716 ms 1 1689 0.12 MB/sec execute 72 sec latency 5124.483 ms 1 1689 0.12 MB/sec execute 73 sec latency 6125.149 ms 1 1689 0.12 MB/sec execute 74 sec latency 7125.703 ms 1 1689 0.12 MB/sec execute 75 sec latency 8126.349 ms 1 1689 0.12 MB/sec execute 76 sec latency 9126.639 ms 1 1689 0.11 MB/sec execute 77 sec latency 10127.067 ms 1 1689 0.11 MB/sec execute 78 sec latency 11127.738 ms 1 1689 0.11 MB/sec execute 79 sec latency 12128.904 ms 1 1689 0.11 MB/sec execute 80 sec latency 13129.180 ms Failover mds2 to oleg349-server mount facets: mds2 1 1689 0.11 MB/sec execute 81 sec latency 14130.127 ms 1 1689 0.11 MB/sec execute 82 sec latency 15130.381 ms 1 1689 0.11 MB/sec execute 83 sec latency 16133.390 ms 1 1689 0.10 MB/sec execute 84 sec latency 17134.874 ms 1 1689 0.10 MB/sec execute 85 sec latency 18135.491 ms 1 1689 0.10 MB/sec execute 86 sec latency 19135.709 ms 1 1689 0.10 MB/sec execute 87 sec latency 20135.977 ms 1 1689 0.10 MB/sec execute 88 sec latency 21136.180 ms 1 1689 0.10 MB/sec execute 89 sec latency 22136.430 ms 1 1689 0.10 MB/sec execute 90 sec latency 23137.566 ms 1 1689 0.10 MB/sec execute 91 sec latency 24139.360 ms Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 1 1689 0.10 MB/sec execute 92 sec latency 25140.359 ms 1 1689 0.09 MB/sec execute 93 sec latency 26142.181 ms 1 1689 0.09 MB/sec execute 94 sec latency 27143.042 ms 1 1689 0.09 MB/sec execute 95 sec latency 28143.708 ms 1 1689 0.09 MB/sec execute 96 sec latency 29145.632 ms 1 1689 0.09 MB/sec execute 97 sec latency 30145.839 ms 1 1689 0.09 MB/sec execute 98 sec latency 31146.142 ms 1 1689 0.09 MB/sec execute 99 sec latency 32146.343 ms oleg349-server: oleg349-server.virtnet: executing set_default_debug -1 all 1 cleanup 100 sec pdsh@oleg349-client: oleg349-server: ssh exited with exit code 1 1 cleanup 101 sec 1 cleanup 102 sec Started lustre-MDT0001 09:33:17 (1788183197) targets are mounted 09:33:17 (1788183197) facet_failover done 1 cleanup 103 sec 1 cleanup 104 sec 1 cleanup 105 sec 1 cleanup 106 sec 1 cleanup 107 sec 0 cleanup 108 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 195 444.369 36551.778 Close 166 16.467 46.241 Rename 11 127.938 204.870 Unlink 22 38.197 71.632 Qpathinfo 152 20.265 105.081 Qfileinfo 48 3.871 21.934 Qfsinfo 33 5.118 27.387 Sfileinfo 34 71.983 135.384 Find 61 15.356 46.687 WriteX 183 15.349 87.075 ReadX 257 0.082 2.716 Flush 27 68.568 155.730 Throughput 0.0883509 MB/sec 1 clients 1 procs max_latency=36551.808 ms stopping dbench on /mnt/lustre at Mon Aug 31 09:33:23 EDT 2026 with return code 0 clean dbench files on /mnt/lustre /mnt/lustre /mnt/lustre removed 'client.txt' /mnt/lustre dbench successfully finished oleg349-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 striped dir -i0 -c2 -H crush2 /mnt/lustre2/d26.replay-dual/run_dbench mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 1 -D /mnt/lustre2/d26.replay-dual/run_dbench -t 100' on /mnt/lustre at Mon Aug 31 09:33:34 EDT 2026 waiting for dbench pid 67833 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 100 seconds with load 'client.txt' and minimum warmup 20 secs 0 of 1 processes prepared for launch 0 sec 1 of 1 processes prepared for launch 0 sec releasing clients 1 15 0.07 MB/sec warmup 1 sec latency 21.337 ms 1 70 1.57 MB/sec warmup 2 sec latency 149.547 ms UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2368 1268936 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2116 1269188 1% /mnt/lustre[MDT:1] 1 111 1.74 MB/sec warmup 3 sec latency 258.891 ms lustre-OST0000_UUID 3833116 20148 3585768 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 26460 3578960 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 46608 7164728 1% /mnt/lustre 1 133 1.45 MB/sec warmup 4 sec latency 297.206 ms 1 157 1.30 MB/sec warmup 5 sec latency 200.528 ms 1 184 1.23 MB/sec warmup 6 sec latency 175.467 ms 1 199 1.12 MB/sec warmup 7 sec latency 649.096 ms 1 224 1.08 MB/sec warmup 8 sec latency 180.844 ms 1 255 1.07 MB/sec warmup 9 sec latency 172.505 ms 1 288 1.07 MB/sec warmup 10 sec latency 151.672 ms 1 332 1.09 MB/sec warmup 11 sec latency 111.993 ms 1 349 1.04 MB/sec warmup 12 sec latency 554.997 ms 1 389 1.06 MB/sec warmup 13 sec latency 145.094 ms 1 421 1.06 MB/sec warmup 14 sec latency 111.307 ms 1 460 1.08 MB/sec warmup 15 sec latency 178.021 ms test_26 fail mds1 3 times 1 488 1.06 MB/sec warmup 16 sec latency 161.797 ms 1 513 1.04 MB/sec warmup 17 sec latency 163.280 ms Failing mds1 on oleg349-server 1 572 1.06 MB/sec warmup 18 sec latency 202.114 ms 1 639 1.11 MB/sec warmup 19 sec latency 119.215 ms Stopping /mnt/lustre-mds1 (opts:) on oleg349-server 1 678 0.02 MB/sec execute 1 sec latency 587.735 ms 1 678 0.01 MB/sec execute 2 sec latency 1589.598 ms 1 678 0.01 MB/sec execute 3 sec latency 2591.254 ms 09:33:57 (1788183237) shut down facet: mds1 facet_host: oleg349-server facet_failover_host: oleg349-server 1 678 0.00 MB/sec execute 4 sec latency 3591.558 ms 1 678 0.00 MB/sec execute 5 sec latency 4595.353 ms 1 678 0.00 MB/sec execute 6 sec latency 5595.633 ms 1 678 0.00 MB/sec execute 7 sec latency 6596.034 ms 1 678 0.00 MB/sec execute 8 sec latency 7596.430 ms 1 678 0.00 MB/sec execute 9 sec latency 8597.984 ms 1 678 0.00 MB/sec execute 10 sec latency 9598.172 ms 1 678 0.00 MB/sec execute 11 sec latency 10598.424 ms 1 678 0.00 MB/sec execute 12 sec latency 11599.937 ms 1 678 0.00 MB/sec execute 13 sec latency 12600.110 ms Failover mds1 to oleg349-server mount facets: mds1 1 678 0.00 MB/sec execute 14 sec latency 13605.111 ms 1 678 0.00 MB/sec execute 15 sec latency 14605.480 ms 1 678 0.00 MB/sec execute 16 sec latency 15607.075 ms 1 678 0.00 MB/sec execute 17 sec latency 16608.835 ms 1 678 0.00 MB/sec execute 18 sec latency 17610.967 ms 1 678 0.00 MB/sec execute 19 sec latency 18611.575 ms 1 678 0.00 MB/sec execute 20 sec latency 19612.141 ms 1 678 0.00 MB/sec execute 21 sec latency 20612.813 ms 1 678 0.00 MB/sec execute 22 sec latency 21613.027 ms 1 678 0.00 MB/sec execute 23 sec latency 22613.612 ms 1 678 0.00 MB/sec execute 24 sec latency 23613.866 ms 1 678 0.00 MB/sec execute 25 sec latency 24619.734 ms Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 1 678 0.00 MB/sec execute 26 sec latency 25620.120 ms 1 678 0.00 MB/sec execute 27 sec latency 26620.505 ms 1 678 0.00 MB/sec execute 28 sec latency 27623.422 ms 1 678 0.00 MB/sec execute 29 sec latency 28623.700 ms 1 678 0.00 MB/sec execute 30 sec latency 29625.449 ms 1 678 0.00 MB/sec execute 31 sec latency 30627.809 ms 1 678 0.00 MB/sec execute 32 sec latency 31628.093 ms 1 678 0.00 MB/sec execute 33 sec latency 32628.980 ms 1 678 0.00 MB/sec execute 34 sec latency 33629.331 ms 1 678 0.00 MB/sec execute 35 sec latency 34629.500 ms 1 678 0.00 MB/sec execute 36 sec latency 35629.855 ms 1 678 0.00 MB/sec execute 37 sec latency 36630.070 ms 1 678 0.00 MB/sec execute 38 sec latency 37630.325 ms 1 678 0.00 MB/sec execute 39 sec latency 38630.734 ms 1 678 0.00 MB/sec execute 40 sec latency 39631.462 ms 1 678 0.00 MB/sec execute 41 sec latency 40631.768 ms 1 678 0.00 MB/sec execute 42 sec latency 41632.476 ms 1 678 0.00 MB/sec execute 43 sec latency 42632.846 ms 1 678 0.00 MB/sec execute 44 sec latency 43638.593 ms 1 678 0.00 MB/sec execute 45 sec latency 44639.590 ms 1 678 0.00 MB/sec execute 46 sec latency 45641.191 ms 1 678 0.00 MB/sec execute 47 sec latency 46641.451 ms oleg349-server: oleg349-server.virtnet: executing set_default_debug -1 all 1 678 0.00 MB/sec execute 48 sec latency 47642.994 ms 1 678 0.00 MB/sec execute 49 sec latency 48644.479 ms pdsh@oleg349-client: oleg349-server: ssh exited with exit code 1 1 678 0.00 MB/sec execute 50 sec latency 49645.803 ms Started lustre-MDT0000 09:34:44 (1788183284) targets are mounted 09:34:44 (1788183284) facet_failover done 1 678 0.00 MB/sec execute 51 sec latency 50646.493 ms 1 678 0.00 MB/sec execute 52 sec latency 51660.600 ms 1 678 0.00 MB/sec execute 53 sec latency 52662.622 ms 1 678 0.00 MB/sec execute 54 sec latency 53662.873 ms 1 678 0.00 MB/sec execute 55 sec latency 54663.127 ms 1 678 0.00 MB/sec execute 56 sec latency 55665.945 ms 1 678 0.00 MB/sec execute 57 sec latency 56666.202 ms 1 678 0.00 MB/sec execute 58 sec latency 57666.486 ms 1 678 0.00 MB/sec execute 59 sec latency 58667.634 ms 1 678 0.00 MB/sec execute 60 sec latency 59667.863 ms 1 678 0.00 MB/sec execute 61 sec latency 60668.179 ms 1 678 0.00 MB/sec execute 62 sec latency 61669.486 ms 1 678 0.00 MB/sec execute 63 sec latency 62669.688 ms 1 678 0.00 MB/sec execute 64 sec latency 63669.896 ms 1 678 0.00 MB/sec execute 65 sec latency 64674.993 ms 1 678 0.00 MB/sec execute 66 sec latency 65676.865 ms 1 678 0.00 MB/sec execute 67 sec latency 66677.119 ms 1 678 0.00 MB/sec execute 68 sec latency 67677.859 ms 1 678 0.00 MB/sec execute 69 sec latency 68678.113 ms 1 678 0.00 MB/sec execute 70 sec latency 69678.405 ms 1 678 0.00 MB/sec execute 71 sec latency 70678.656 ms 1 678 0.00 MB/sec execute 72 sec latency 71678.929 ms 1 678 0.00 MB/sec execute 73 sec latency 72679.456 ms 1 678 0.00 MB/sec execute 74 sec latency 73679.718 ms 1 678 0.00 MB/sec execute 75 sec latency 74681.655 ms 1 678 0.00 MB/sec execute 76 sec latency 75681.904 ms 1 678 0.00 MB/sec execute 77 sec latency 76682.155 ms 1 678 0.00 MB/sec execute 78 sec latency 77682.594 ms 1 678 0.00 MB/sec execute 79 sec latency 78685.174 ms 1 678 0.00 MB/sec execute 80 sec latency 79685.427 ms 1 678 0.00 MB/sec execute 81 sec latency 80687.343 ms 1 678 0.00 MB/sec execute 82 sec latency 81687.938 ms 1 678 0.00 MB/sec execute 83 sec latency 82688.407 ms 1 678 0.00 MB/sec execute 84 sec latency 83689.703 ms 1 678 0.00 MB/sec execute 85 sec latency 84692.063 ms 1 678 0.00 MB/sec execute 86 sec latency 85692.319 ms 1 678 0.00 MB/sec execute 87 sec latency 86694.176 ms 1 678 0.00 MB/sec execute 88 sec latency 87694.429 ms 1 678 0.00 MB/sec execute 89 sec latency 88699.040 ms 1 678 0.00 MB/sec execute 90 sec latency 89699.324 ms 1 678 0.00 MB/sec execute 91 sec latency 90699.922 ms 1 678 0.00 MB/sec execute 92 sec latency 91700.206 ms 1 678 0.00 MB/sec execute 93 sec latency 92700.557 ms 1 678 0.00 MB/sec execute 94 sec latency 93700.820 ms 1 678 0.00 MB/sec execute 95 sec latency 94701.299 ms 1 678 0.00 MB/sec execute 96 sec latency 95701.775 ms 1 678 0.00 MB/sec execute 97 sec latency 96704.580 ms 1 678 0.00 MB/sec execute 98 sec latency 97704.915 ms 1 678 0.00 MB/sec execute 99 sec latency 98705.268 ms 1 cleanup 100 sec 1 cleanup 101 sec 1 cleanup 102 sec 1 cleanup 103 sec 1 cleanup 104 sec 1 cleanup 105 sec 1 cleanup 106 sec 1 cleanup 107 sec 1 cleanup 108 sec 1 cleanup 109 sec 1 cleanup 110 sec 1 cleanup 111 sec 1 cleanup 112 sec 1 cleanup 113 sec 1 cleanup 114 sec 1 cleanup 115 sec 1 cleanup 116 sec 0 cleanup 117 sec 0 cleanup 117 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 1 113122.453 113122.453 Close 1 30.319 30.319 Qfileinfo 1 10.592 10.592 Sfileinfo 1 123.695 123.695 WriteX 4 4.959 10.012 Flush 5 45.195 61.370 Throughput 0.000165298 MB/sec 1 clients 1 procs max_latency=98705.268 ms stopping dbench on /mnt/lustre at Mon Aug 31 09:35:51 EDT 2026 with return code 0 clean dbench files on /mnt/lustre /mnt/lustre /mnt/lustre removed 'client.txt' /mnt/lustre dbench successfully finished oleg349-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 striped dir -i0 -c2 -H crush2 /mnt/lustre2/d26.replay-dual/run_dbench mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 1 -D /mnt/lustre2/d26.replay-dual/run_dbench -t 100' on /mnt/lustre at Mon Aug 31 09:35:59 EDT 2026 waiting for dbench pid 68956 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 100 seconds with load 'client.txt' and minimum warmup 20 secs 0 of 1 processes prepared for launch 0 sec 1 of 1 processes prepared for launch 0 sec releasing clients tar: Unexpected EOF in archive tar: Unexpected EOF in archive 1 30 1.05 MB/sec warmup 1 sec latency 22.905 ms 1 91 2.10 MB/sec warmup 2 sec latency 119.089 ms 1 137 2.01 MB/sec warmup 3 sec latency 150.868 ms 1 175 1.76 MB/sec warmup 4 sec latency 143.150 ms 1 199 1.57 MB/sec warmup 5 sec latency 336.699 ms 1 231 1.48 MB/sec warmup 6 sec latency 235.677 ms 1 274 1.45 MB/sec warmup 7 sec latency 113.495 ms 1 313 1.43 MB/sec warmup 8 sec latency 132.632 ms 1 341 1.36 MB/sec warmup 9 sec latency 143.706 ms tar: Error is not recoverable: exiting now dbench killed by signal 15 stopping dbench on /mnt/lustre at Mon Aug 31 09:36:08 EDT 2026 with return code 0 68956 pts/0 S+ 0:00 dbench -c client.txt 1 -D /mnt/lustre2/d26.replay-dual/run_dbench -t 100 killed dbench main pid 68956 clean dbench files on /mnt/lustre /mnt/lustre /mnt/lustre removed 'client.txt' /mnt/lustre dbench successfully finished