== replay-dual test 26: dbench and tar with mds failover ========================================================== 00:22:54 (1783138974) Starting client oleg255-client.virtnet: -o user_xattr,flock 192.168.202.155@tcp:/lustre /mnt/lustre Started clients oleg255-client.virtnet: 192.168.202.155@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Started tar loop with pid 65646 Started dbench loop with 65647 striped dir -i0 -c2 -H crush2 /mnt/lustre/d26.replay-dual/run_tar striped dir -i0 -c2 -H crush /mnt/lustre2/d26.replay-dual/run_dbench looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1944 1269360 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1768 1269536 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 26140 3576676 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 27684 7182152 1% /mnt/lustre '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 1 -D /mnt/lustre2/d26.replay-dual/run_dbench -t 100' on /mnt/lustre at Sat Jul 4 00:23:00 EDT 2026 waiting for dbench pid 65721 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 100 seconds with load 'client.txt' and minimum warmup 20 secs failed to create barrier semaphore 0 of 1 processes prepared for launch 0 sec 1 of 1 processes prepared for launch 0 sec releasing clients 1 32 1.04 MB/sec warmup 1 sec latency 81.230 ms 1 92 2.09 MB/sec warmup 2 sec latency 134.960 ms 1 137 2.00 MB/sec warmup 3 sec latency 192.416 ms 1 157 1.63 MB/sec warmup 4 sec latency 199.644 ms 1 184 1.47 MB/sec warmup 5 sec latency 225.767 ms 1 200 1.30 MB/sec warmup 6 sec latency 435.999 ms 1 253 1.37 MB/sec warmup 7 sec latency 106.717 ms 1 302 1.38 MB/sec warmup 8 sec latency 95.731 ms test_26 fail mds1 1 times 1 349 1.39 MB/sec warmup 9 sec latency 136.649 ms 1 396 1.40 MB/sec warmup 10 sec latency 100.771 ms Failing mds1 on oleg255-server Stopping /mnt/lustre-mds1 (opts:) on oleg255-server 1 445 1.42 MB/sec warmup 11 sec latency 152.691 ms 1 484 1.41 MB/sec warmup 12 sec latency 260.687 ms 1 484 1.30 MB/sec warmup 13 sec latency 1260.852 ms 00:23:14 (1783138994) shut down facet: mds1 facet_host: oleg255-server facet_failover_host: oleg255-server 1 484 1.21 MB/sec warmup 14 sec latency 2261.709 ms 1 484 1.13 MB/sec warmup 15 sec latency 3265.853 ms 1 484 1.06 MB/sec warmup 16 sec latency 4266.412 ms 1 484 0.99 MB/sec warmup 17 sec latency 5266.624 ms 1 484 0.94 MB/sec warmup 18 sec latency 6266.864 ms 1 484 0.89 MB/sec warmup 19 sec latency 7267.127 ms 1 484 0.00 MB/sec execute 1 sec latency 9268.290 ms 1 484 0.00 MB/sec execute 2 sec latency 10268.547 ms 1 484 0.00 MB/sec execute 3 sec latency 11269.302 ms 1 484 0.00 MB/sec execute 4 sec latency 12269.647 ms Failover mds1 to oleg255-server mount facets: mds1 1 484 0.00 MB/sec execute 5 sec latency 13270.152 ms 1 484 0.00 MB/sec execute 6 sec latency 14272.903 ms 1 484 0.00 MB/sec execute 7 sec latency 15273.084 ms 1 484 0.00 MB/sec execute 8 sec latency 16273.494 ms 1 484 0.00 MB/sec execute 9 sec latency 17274.362 ms 1 484 0.00 MB/sec execute 10 sec latency 18274.764 ms 1 484 0.00 MB/sec execute 11 sec latency 19275.194 ms 1 484 0.00 MB/sec execute 12 sec latency 20276.826 ms Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 1 484 0.00 MB/sec execute 13 sec latency 21277.023 ms 1 484 0.00 MB/sec execute 14 sec latency 22277.524 ms 1 484 0.00 MB/sec execute 15 sec latency 23277.727 ms 1 484 0.00 MB/sec execute 16 sec latency 24277.984 ms 1 484 0.00 MB/sec execute 17 sec latency 25278.700 ms 1 484 0.00 MB/sec execute 18 sec latency 26278.901 ms 1 484 0.00 MB/sec execute 19 sec latency 27279.174 ms 1 484 0.00 MB/sec execute 20 sec latency 28281.429 ms 1 484 0.00 MB/sec execute 21 sec latency 29281.643 ms 1 484 0.00 MB/sec execute 22 sec latency 30281.937 ms 1 484 0.00 MB/sec execute 23 sec latency 31282.140 ms 1 484 0.00 MB/sec execute 24 sec latency 32282.340 ms 1 484 0.00 MB/sec execute 25 sec latency 33282.533 ms 1 484 0.00 MB/sec execute 26 sec latency 34282.913 ms oleg255-server: oleg255-server.virtnet: executing set_default_debug -1 all 1 484 0.00 MB/sec execute 27 sec latency 35285.190 ms pdsh@oleg255-client: oleg255-server: ssh exited with exit code 1 1 484 0.00 MB/sec execute 28 sec latency 36285.434 ms Started lustre-MDT0000 00:23:48 (1783139028) targets are mounted 00:23:48 (1783139028) facet_failover done 1 484 0.00 MB/sec execute 29 sec latency 37290.722 ms 1 501 0.02 MB/sec execute 30 sec latency 37693.633 ms 1 542 0.07 MB/sec execute 31 sec latency 146.799 ms 1 588 0.10 MB/sec execute 32 sec latency 586.903 ms 1 653 0.12 MB/sec execute 33 sec latency 95.193 ms 1 686 0.12 MB/sec execute 34 sec latency 130.696 ms oleg255-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1 718 0.12 MB/sec execute 35 sec latency 128.935 ms 1 759 0.12 MB/sec execute 36 sec latency 79.277 ms mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 1 794 0.12 MB/sec execute 37 sec latency 114.476 ms 1 816 0.12 MB/sec execute 38 sec latency 141.026 ms 1 864 0.12 MB/sec execute 39 sec latency 110.943 ms 1 900 0.12 MB/sec execute 40 sec latency 119.551 ms 1 931 0.12 MB/sec execute 41 sec latency 117.950 ms 1 977 0.12 MB/sec execute 42 sec latency 105.952 ms 1 1041 0.14 MB/sec execute 43 sec latency 76.453 ms UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2112 1269192 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1928 1269376 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 36276 3569108 2% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 18776 3585304 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 55052 7154412 1% /mnt/lustre 1 1080 0.14 MB/sec execute 44 sec latency 151.211 ms 1 1132 0.13 MB/sec execute 45 sec latency 82.976 ms 1 1163 0.13 MB/sec execute 46 sec latency 118.066 ms 1 1173 0.13 MB/sec execute 47 sec latency 912.924 ms 1 1193 0.13 MB/sec execute 48 sec latency 305.878 ms 1 1224 0.12 MB/sec execute 49 sec latency 125.357 ms 1 1246 0.12 MB/sec execute 50 sec latency 189.935 ms 1 1285 0.12 MB/sec execute 51 sec latency 202.647 ms 1 1394 0.17 MB/sec execute 52 sec latency 266.842 ms 1 1422 0.17 MB/sec execute 53 sec latency 147.197 ms 1 1474 0.17 MB/sec execute 54 sec latency 77.210 ms test_26 fail mds2 2 times 1 1512 0.17 MB/sec execute 55 sec latency 115.555 ms 1 1559 0.16 MB/sec execute 56 sec latency 93.677 ms Failing mds2 on oleg255-server 1 1581 0.16 MB/sec execute 57 sec latency 96.914 ms Stopping /mnt/lustre-mds2 (opts:) on oleg255-server 1 1632 0.16 MB/sec execute 58 sec latency 139.681 ms 1 1666 0.16 MB/sec execute 59 sec latency 149.802 ms 1 1706 0.15 MB/sec execute 60 sec latency 125.681 ms 1 1770 0.15 MB/sec execute 61 sec latency 89.044 ms 00:24:22 (1783139062) shut down facet: mds2 facet_host: oleg255-server facet_failover_host: oleg255-server 1 1814 0.15 MB/sec execute 62 sec latency 132.410 ms 1 1861 0.15 MB/sec execute 63 sec latency 97.843 ms 1 1924 0.15 MB/sec execute 64 sec latency 132.362 ms 1 2016 0.15 MB/sec execute 65 sec latency 68.822 ms 1 2122 0.15 MB/sec execute 66 sec latency 56.038 ms 1 2250 0.15 MB/sec execute 67 sec latency 43.080 ms 1 2259 0.14 MB/sec execute 68 sec latency 938.806 ms 1 2259 0.14 MB/sec execute 69 sec latency 1939.320 ms 1 2259 0.14 MB/sec execute 70 sec latency 2940.042 ms 1 2259 0.14 MB/sec execute 71 sec latency 3940.276 ms 1 2259 0.14 MB/sec execute 72 sec latency 4941.041 ms Failover mds2 to oleg255-server mount facets: mds2 1 2259 0.13 MB/sec execute 73 sec latency 5941.314 ms 1 2259 0.13 MB/sec execute 74 sec latency 6941.442 ms 1 2259 0.13 MB/sec execute 75 sec latency 7941.627 ms 1 2259 0.13 MB/sec execute 76 sec latency 8942.318 ms 1 2259 0.13 MB/sec execute 77 sec latency 9943.398 ms 1 2259 0.13 MB/sec execute 78 sec latency 10947.000 ms 1 2259 0.12 MB/sec execute 79 sec latency 11950.285 ms 1 2259 0.12 MB/sec execute 80 sec latency 12951.307 ms Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 1 2259 0.12 MB/sec execute 81 sec latency 13951.670 ms 1 2259 0.12 MB/sec execute 82 sec latency 14952.781 ms 1 2259 0.12 MB/sec execute 83 sec latency 15954.816 ms 1 2259 0.12 MB/sec execute 84 sec latency 16955.023 ms 1 2259 0.12 MB/sec execute 85 sec latency 17956.959 ms 1 2259 0.11 MB/sec execute 86 sec latency 18957.467 ms oleg255-server: oleg255-server.virtnet: executing set_default_debug -1 all 1 2259 0.11 MB/sec execute 87 sec latency 19957.816 ms pdsh@oleg255-client: oleg255-server: ssh exited with exit code 1 1 2259 0.11 MB/sec execute 88 sec latency 20958.075 ms Started lustre-MDT0001 00:24:48 (1783139088) targets are mounted 00:24:48 (1783139088) facet_failover done 1 2259 0.11 MB/sec execute 89 sec latency 21958.218 ms 1 2342 0.12 MB/sec execute 90 sec latency 22114.680 ms 1 2373 0.12 MB/sec execute 91 sec latency 129.038 ms 1 2407 0.12 MB/sec execute 92 sec latency 126.126 ms 1 2448 0.12 MB/sec execute 93 sec latency 129.838 ms 1 2501 0.13 MB/sec execute 94 sec latency 103.192 ms oleg255-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1 2590 0.13 MB/sec execute 95 sec latency 70.515 ms 1 2754 0.16 MB/sec execute 96 sec latency 84.980 ms mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 1 2881 0.16 MB/sec execute 97 sec latency 118.819 ms 1 2931 0.17 MB/sec execute 98 sec latency 110.043 ms 1 3024 0.17 MB/sec execute 99 sec latency 107.483 ms 1 cleanup 100 sec 1 cleanup 101 sec 1 cleanup 102 sec UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2348 1268956 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2156 1269148 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 35000 3571480 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 27416 3576024 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 62416 7147504 1% /mnt/lustre 0 cleanup 103 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 416 104.776 22114.664 Close 348 119.068 37693.611 Rename 22 84.902 140.573 Unlink 49 25.000 64.789 Qpathinfo 407 16.156 151.187 Qfileinfo 107 1.943 16.406 Qfsinfo 59 3.275 24.322 Sfileinfo 50 57.046 116.657 Find 135 12.126 95.176 WriteX 323 12.391 82.806 ReadX 790 1.622 84.481 LockX 2 9.278 11.005 UnlockX 2 13.554 15.048 Flush 39 51.410 119.536 Throughput 0.167396 MB/sec 1 clients 1 procs max_latency=37693.633 ms stopping dbench on /mnt/lustre at Sat Jul 4 00:25:03 EDT 2026 with return code 0 clean dbench files on /mnt/lustre /mnt/lustre /mnt/lustre removed 'client.txt' /mnt/lustre dbench successfully finished striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre2/d26.replay-dual/run_dbench looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 1 -D /mnt/lustre2/d26.replay-dual/run_dbench -t 100' on /mnt/lustre at Sat Jul 4 00:25:12 EDT 2026 waiting for dbench pid 67947 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 100 seconds with load 'client.txt' and minimum warmup 20 secs 0 of 1 processes prepared for launch 0 sec test_26 fail mds1 3 times 1 of 1 processes prepared for launch 0 sec releasing clients 1 31 1.05 MB/sec warmup 1 sec latency 103.187 ms Failing mds1 on oleg255-server 1 105 2.46 MB/sec warmup 2 sec latency 122.437 ms Stopping /mnt/lustre-mds1 (opts:) on oleg255-server 1 150 2.09 MB/sec warmup 3 sec latency 101.800 ms 1 157 1.63 MB/sec warmup 4 sec latency 847.603 ms 1 157 1.31 MB/sec warmup 5 sec latency 1847.830 ms 00:25:17 (1783139117) shut down facet: mds1 facet_host: oleg255-server facet_failover_host: oleg255-server 1 157 1.09 MB/sec warmup 6 sec latency 2848.566 ms 1 157 0.93 MB/sec warmup 7 sec latency 3848.912 ms 1 157 0.82 MB/sec warmup 8 sec latency 4849.239 ms 1 157 0.73 MB/sec warmup 9 sec latency 5854.128 ms 1 157 0.65 MB/sec warmup 10 sec latency 6855.213 ms 1 157 0.59 MB/sec warmup 11 sec latency 7858.202 ms 1 157 0.54 MB/sec warmup 12 sec latency 8858.391 ms 1 157 0.50 MB/sec warmup 13 sec latency 9858.651 ms 1 157 0.47 MB/sec warmup 14 sec latency 10858.902 ms 1 157 0.44 MB/sec warmup 15 sec latency 11859.245 ms Failover mds1 to oleg255-server mount facets: mds1 1 157 0.41 MB/sec warmup 16 sec latency 12859.505 ms 1 157 0.38 MB/sec warmup 17 sec latency 13859.795 ms 1 157 0.36 MB/sec warmup 18 sec latency 14860.026 ms 1 157 0.34 MB/sec warmup 19 sec latency 15860.238 ms 1 157 0.00 MB/sec execute 1 sec latency 17861.228 ms 1 157 0.00 MB/sec execute 2 sec latency 18861.461 ms 1 157 0.00 MB/sec execute 3 sec latency 19862.189 ms 1 157 0.00 MB/sec execute 4 sec latency 20864.470 ms Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 1 157 0.00 MB/sec execute 5 sec latency 21868.265 ms 1 157 0.00 MB/sec execute 6 sec latency 22877.163 ms 1 157 0.00 MB/sec execute 7 sec latency 23877.891 ms 1 157 0.00 MB/sec execute 8 sec latency 24878.141 ms 1 157 0.00 MB/sec execute 9 sec latency 25878.873 ms 1 157 0.00 MB/sec execute 10 sec latency 26879.351 ms 1 157 0.00 MB/sec execute 11 sec latency 27879.599 ms 1 157 0.00 MB/sec execute 12 sec latency 28881.331 ms 1 157 0.00 MB/sec execute 13 sec latency 29881.544 ms 1 157 0.00 MB/sec execute 14 sec latency 30891.931 ms 1 157 0.00 MB/sec execute 15 sec latency 31895.180 ms 1 157 0.00 MB/sec execute 16 sec latency 32895.367 ms 1 157 0.00 MB/sec execute 17 sec latency 33895.588 ms oleg255-server: oleg255-server.virtnet: executing set_default_debug -1 all 1 157 0.00 MB/sec execute 18 sec latency 34895.945 ms pdsh@oleg255-client: oleg255-server: ssh exited with exit code 1 Started lustre-MDT0000 1 157 0.00 MB/sec execute 19 sec latency 35899.905 ms 00:25:51 (1783139151) targets are mounted 00:25:51 (1783139151) facet_failover done 1 173 0.03 MB/sec execute 20 sec latency 36552.978 ms 1 197 0.06 MB/sec execute 21 sec latency 394.333 ms 1 223 0.09 MB/sec execute 22 sec latency 183.986 ms 1 254 0.14 MB/sec execute 23 sec latency 140.704 ms 1 289 0.17 MB/sec execute 24 sec latency 133.851 ms 1 316 0.20 MB/sec execute 25 sec latency 156.863 ms oleg255-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1 356 0.24 MB/sec execute 26 sec latency 128.124 ms 1 397 0.28 MB/sec execute 27 sec latency 123.774 ms mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 1 429 0.31 MB/sec execute 28 sec latency 134.217 ms 1 469 0.34 MB/sec execute 29 sec latency 221.362 ms 1 507 0.37 MB/sec execute 30 sec latency 143.772 ms 1 582 0.43 MB/sec execute 31 sec latency 131.631 ms 1 652 0.45 MB/sec execute 32 sec latency 105.917 ms 1 700 0.44 MB/sec execute 33 sec latency 92.861 ms 1 735 0.43 MB/sec execute 34 sec latency 111.418 ms UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2856 1268448 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2624 1268680 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 33160 3568232 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 25328 3574184 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 58488 7142416 1% /mnt/lustre 1 776 0.42 MB/sec execute 35 sec latency 124.653 ms 1 808 0.41 MB/sec execute 36 sec latency 122.461 ms 1 870 0.41 MB/sec execute 37 sec latency 79.529 ms 1 884 0.40 MB/sec execute 38 sec latency 533.524 ms 1 888 0.39 MB/sec execute 39 sec latency 1225.463 ms 1 921 0.38 MB/sec execute 40 sec latency 148.013 ms 1 968 0.37 MB/sec execute 41 sec latency 115.689 ms 1 986 0.37 MB/sec execute 42 sec latency 170.720 ms 1 1048 0.38 MB/sec execute 43 sec latency 103.689 ms test_26 fail mds2 4 times 1 1084 0.37 MB/sec execute 44 sec latency 100.508 ms 1 1128 0.36 MB/sec execute 45 sec latency 142.823 ms Failing mds2 on oleg255-server 1 1155 0.36 MB/sec execute 46 sec latency 152.895 ms 1 1188 0.35 MB/sec execute 47 sec latency 116.161 ms Stopping /mnt/lustre-mds2 (opts:) on oleg255-server 1 1223 0.34 MB/sec execute 48 sec latency 122.661 ms 1 1251 0.34 MB/sec execute 49 sec latency 140.427 ms 1 1278 0.33 MB/sec execute 50 sec latency 376.704 ms 00:26:23 (1783139183) shut down facet: mds2 facet_host: oleg255-server facet_failover_host: oleg255-server 1 1278 0.32 MB/sec execute 51 sec latency 1377.024 ms 1 1278 0.32 MB/sec execute 52 sec latency 2377.360 ms 1 1278 0.31 MB/sec execute 53 sec latency 3381.021 ms 1 1278 0.31 MB/sec execute 54 sec latency 4382.296 ms 1 1278 0.30 MB/sec execute 55 sec latency 5382.505 ms 1 1278 0.30 MB/sec execute 56 sec latency 6382.746 ms 1 1278 0.29 MB/sec execute 57 sec latency 7382.948 ms 1 1278 0.29 MB/sec execute 58 sec latency 8383.233 ms 1 1278 0.28 MB/sec execute 59 sec latency 9386.234 ms 1 1278 0.28 MB/sec execute 60 sec latency 10387.183 ms 1 1278 0.27 MB/sec execute 61 sec latency 11387.396 ms Failover mds2 to oleg255-server mount facets: mds2 1 1278 0.27 MB/sec execute 62 sec latency 12387.657 ms 1 1278 0.26 MB/sec execute 63 sec latency 13387.875 ms 1 1278 0.26 MB/sec execute 64 sec latency 14388.937 ms 1 1278 0.25 MB/sec execute 65 sec latency 15389.259 ms 1 1278 0.25 MB/sec execute 66 sec latency 16392.718 ms 1 1278 0.25 MB/sec execute 67 sec latency 17393.494 ms 1 1278 0.24 MB/sec execute 68 sec latency 18393.724 ms 1 1278 0.24 MB/sec execute 69 sec latency 19393.930 ms Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 1 1278 0.24 MB/sec execute 70 sec latency 20395.398 ms 1 1278 0.23 MB/sec execute 71 sec latency 21395.734 ms 1 1278 0.23 MB/sec execute 72 sec latency 22396.003 ms 1 1278 0.23 MB/sec execute 73 sec latency 23397.615 ms 1 1278 0.22 MB/sec execute 74 sec latency 24397.768 ms oleg255-server: oleg255-server.virtnet: executing set_default_debug -1 all 1 1278 0.22 MB/sec execute 75 sec latency 25397.981 ms pdsh@oleg255-client: oleg255-server: ssh exited with exit code 1 1 1278 0.22 MB/sec execute 76 sec latency 26399.843 ms 1 1278 0.22 MB/sec execute 77 sec latency 27399.958 ms Started lustre-MDT0001 00:26:49 (1783139209) targets are mounted 00:26:49 (1783139209) facet_failover done 1 1401 0.25 MB/sec execute 78 sec latency 27803.318 ms 1 1446 0.25 MB/sec execute 79 sec latency 88.822 ms 1 1481 0.24 MB/sec execute 80 sec latency 301.237 ms 1 1514 0.24 MB/sec execute 81 sec latency 111.868 ms 1 1568 0.24 MB/sec execute 82 sec latency 82.991 ms 1 1613 0.24 MB/sec execute 83 sec latency 129.086 ms oleg255-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1 1656 0.23 MB/sec execute 84 sec latency 98.525 ms 1 1692 0.23 MB/sec execute 85 sec latency 172.800 ms mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 1 1757 0.23 MB/sec execute 86 sec latency 104.708 ms 1 1810 0.23 MB/sec execute 87 sec latency 70.807 ms 1 1859 0.22 MB/sec execute 88 sec latency 97.609 ms 1 1908 0.22 MB/sec execute 89 sec latency 138.114 ms 1 1980 0.22 MB/sec execute 90 sec latency 173.141 ms 1 2020 0.22 MB/sec execute 91 sec latency 82.802 ms 1 2095 0.22 MB/sec execute 92 sec latency 107.823 ms tar: Unexpected EOF in archive tar: Unexpected EOF in archive 1 2160 0.22 MB/sec execute 93 sec latency 70.540 ms 1 2203 0.21 MB/sec execute 94 sec latency 97.740 ms 1 2273 0.22 MB/sec execute 95 sec latency 132.515 ms 1 2350 0.22 MB/sec execute 96 sec latency 111.445 ms 1 2389 0.22 MB/sec execute 97 sec latency 89.693 ms 1 2417 0.22 MB/sec execute 98 sec latency 154.581 ms 1 2454 0.22 MB/sec execute 99 sec latency 136.852 ms 1 cleanup 100 sec 1 cleanup 101 sec 1 cleanup 102 sec 1 cleanup 103 sec 0 cleanup 104 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 395 153.782 36552.962 Close 345 11.853 34.883 Rename 15 103.259 172.777 Unlink 37 28.536 68.135 Qpathinfo 328 15.618 87.444 Qfileinfo 122 2.314 14.482 Qfsinfo 41 4.252 23.600 Sfileinfo 47 70.664 158.183 Find 111 261.828 27803.303 WriteX 477 15.236 97.437 ReadX 384 0.777 75.249 Flush 34 60.609 170.697 Throughput 0.217536 MB/sec 1 clients 1 procs max_latency=36552.978 ms stopping dbench on /mnt/lustre at Sat Jul 4 00:27:16 EDT 2026 with return code 0 clean dbench files on /mnt/lustre /mnt/lustre /mnt/lustre removed 'client.txt' /mnt/lustre dbench successfully finished tar: Error is not recoverable: exiting now