== replay-dual test 26: dbench and tar with mds failover ========================================================== 16:42:33 (1763156553) Starting client oleg110-client.virtnet: -o user_xattr,flock 192.168.201.110@tcp:/lustre /mnt/lustre Started clients oleg110-client.virtnet: 192.168.201.110@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Started tar loop with pid 65077 Started dbench loop with 65078 striped dir -i0 -c2 -H crush2 /mnt/lustre/d26.replay-dual/run_tar striped dir -i0 -c2 -H crush2 /mnt/lustre2/d26.replay-dual/run_dbench looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 1 -D /mnt/lustre2/d26.replay-dual/run_dbench -t 100' on /mnt/lustre at Fri Nov 14 16:42:37 EST 2025 waiting for dbench pid 65127 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 100 seconds with load 'client.txt' and minimum warmup 20 secs failed to create barrier semaphore 0 of 1 processes prepared for launch 0 sec 1 of 1 processes prepared for launch 0 sec releasing clients UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1988 1269316 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1772 1269532 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 26140 3579724 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 27684 7185200 1% /mnt/lustre 1 41 1.51 MB/sec warmup 1 sec latency 87.650 ms 1 125 2.78 MB/sec warmup 2 sec latency 105.411 ms 1 173 2.35 MB/sec warmup 3 sec latency 115.327 ms 1 199 1.96 MB/sec warmup 4 sec latency 462.588 ms 1 264 1.98 MB/sec warmup 5 sec latency 74.369 ms 1 315 1.91 MB/sec warmup 6 sec latency 102.069 ms 1 381 1.94 MB/sec warmup 7 sec latency 76.495 ms test_26 fail mds1 1 times 1 445 1.95 MB/sec warmup 8 sec latency 70.165 ms Failing mds1 on oleg110-server 1 503 1.94 MB/sec warmup 9 sec latency 117.125 ms Stopping /mnt/lustre-mds1 (opts:) on oleg110-server 1 612 2.10 MB/sec warmup 10 sec latency 81.480 ms 1 639 1.91 MB/sec warmup 11 sec latency 830.532 ms 16:42:49 (1763156569) shut down facet: mds1 facet_host: oleg110-server facet_failover_host: oleg110-server 1 639 1.75 MB/sec warmup 12 sec latency 1832.734 ms 1 639 1.62 MB/sec warmup 13 sec latency 2832.977 ms 1 639 1.50 MB/sec warmup 14 sec latency 3834.991 ms 1 639 1.40 MB/sec warmup 15 sec latency 4835.709 ms 1 639 1.31 MB/sec warmup 16 sec latency 5843.894 ms 1 639 1.24 MB/sec warmup 17 sec latency 6844.180 ms 1 639 1.17 MB/sec warmup 18 sec latency 7845.004 ms 1 639 1.11 MB/sec warmup 19 sec latency 8845.221 ms 1 639 0.00 MB/sec execute 1 sec latency 10845.557 ms 1 639 0.00 MB/sec execute 2 sec latency 11847.976 ms Failover mds1 to oleg110-server mount facets: mds1 1 639 0.00 MB/sec execute 3 sec latency 12850.727 ms 1 639 0.00 MB/sec execute 4 sec latency 13850.996 ms 1 639 0.00 MB/sec execute 5 sec latency 14851.306 ms 1 639 0.00 MB/sec execute 6 sec latency 15852.237 ms 1 639 0.00 MB/sec execute 7 sec latency 16854.695 ms Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 1 639 0.00 MB/sec execute 8 sec latency 17854.885 ms 1 639 0.00 MB/sec execute 9 sec latency 18855.839 ms 1 639 0.00 MB/sec execute 10 sec latency 19856.310 ms 1 639 0.00 MB/sec execute 11 sec latency 20856.547 ms oleg110-server: oleg110-server.virtnet: executing set_default_debug -1 all 1 639 0.00 MB/sec execute 12 sec latency 21858.205 ms pdsh@oleg110-client: oleg110-server: ssh exited with exit code 1 Started lustre-MDT0000 16:43:10 (1763156590) targets are mounted 16:43:10 (1763156590) facet_failover done 1 639 0.00 MB/sec execute 13 sec latency 22858.671 ms 1 639 0.00 MB/sec execute 14 sec latency 23858.888 ms 1 639 0.00 MB/sec execute 15 sec latency 24859.256 ms 1 640 0.00 MB/sec execute 16 sec latency 25828.538 ms 1 692 0.01 MB/sec execute 17 sec latency 72.074 ms oleg110-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1 731 0.01 MB/sec execute 18 sec latency 116.020 ms mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 1 773 0.02 MB/sec execute 19 sec latency 93.052 ms 1 817 0.02 MB/sec execute 20 sec latency 102.518 ms 1 884 0.03 MB/sec execute 21 sec latency 61.527 ms 1 885 0.03 MB/sec execute 22 sec latency 1025.516 ms 1 923 0.03 MB/sec execute 23 sec latency 121.902 ms 1 977 0.03 MB/sec execute 24 sec latency 76.705 ms UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2136 1269168 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1904 1269400 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 42420 3550684 2% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 12204 3594060 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 54624 7144744 1% /mnt/lustre 1 1051 0.07 MB/sec execute 25 sec latency 80.553 ms 1 1126 0.07 MB/sec execute 26 sec latency 72.229 ms 1 1182 0.07 MB/sec execute 27 sec latency 76.407 ms 1 1243 0.07 MB/sec execute 28 sec latency 55.055 ms 1 1389 0.17 MB/sec execute 29 sec latency 103.326 ms 1 1459 0.17 MB/sec execute 30 sec latency 84.391 ms 1 1526 0.16 MB/sec execute 31 sec latency 139.294 ms test_26 fail mds2 2 times 1 1593 0.16 MB/sec execute 32 sec latency 55.596 ms Failing mds2 on oleg110-server 1 1660 0.16 MB/sec execute 33 sec latency 68.924 ms Stopping /mnt/lustre-mds2 (opts:) on oleg110-server 1 1727 0.15 MB/sec execute 34 sec latency 79.813 ms 1 1845 0.15 MB/sec execute 35 sec latency 51.286 ms 1 1961 0.15 MB/sec execute 36 sec latency 53.957 ms 1 2030 0.15 MB/sec execute 37 sec latency 58.812 ms 1 2146 0.15 MB/sec execute 38 sec latency 51.306 ms 1 2212 0.15 MB/sec execute 39 sec latency 65.104 ms 1 2259 0.14 MB/sec execute 40 sec latency 750.811 ms 1 2259 0.14 MB/sec execute 41 sec latency 1750.998 ms 16:43:38 (1763156618) shut down facet: mds2 facet_host: oleg110-server facet_failover_host: oleg110-server 1 2259 0.14 MB/sec execute 42 sec latency 2751.220 ms 1 2259 0.13 MB/sec execute 43 sec latency 3751.678 ms 1 2259 0.13 MB/sec execute 44 sec latency 4751.872 ms 1 2259 0.13 MB/sec execute 45 sec latency 5752.078 ms 1 2259 0.12 MB/sec execute 46 sec latency 6753.098 ms 1 2259 0.12 MB/sec execute 47 sec latency 7753.669 ms 1 2259 0.12 MB/sec execute 48 sec latency 8754.110 ms 1 2259 0.12 MB/sec execute 49 sec latency 9754.309 ms 1 2259 0.11 MB/sec execute 50 sec latency 10754.550 ms 1 2259 0.11 MB/sec execute 51 sec latency 11756.245 ms Failover mds2 to oleg110-server mount facets: mds2 1 2259 0.11 MB/sec execute 52 sec latency 12757.945 ms 1 2259 0.11 MB/sec execute 53 sec latency 13758.192 ms 1 2259 0.11 MB/sec execute 54 sec latency 14760.002 ms 1 2259 0.10 MB/sec execute 55 sec latency 15760.277 ms 1 2259 0.10 MB/sec execute 56 sec latency 16760.492 ms 1 2259 0.10 MB/sec execute 57 sec latency 17761.114 ms Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 1 2259 0.10 MB/sec execute 58 sec latency 18762.822 ms 1 2259 0.10 MB/sec execute 59 sec latency 19763.079 ms 1 2259 0.10 MB/sec execute 60 sec latency 20764.051 ms 1 2259 0.09 MB/sec execute 61 sec latency 21764.425 ms oleg110-server: oleg110-server.virtnet: executing set_default_debug -1 all 1 2259 0.09 MB/sec execute 62 sec latency 22767.750 ms pdsh@oleg110-client: oleg110-server: ssh exited with exit code 1 1 2259 0.09 MB/sec execute 63 sec latency 23770.158 ms Started lustre-MDT0001 16:44:00 (1763156640) targets are mounted 16:44:00 (1763156640) facet_failover done 1 2259 0.09 MB/sec execute 64 sec latency 24770.337 ms 1 2259 0.09 MB/sec execute 65 sec latency 25771.621 ms 1 2336 0.10 MB/sec execute 66 sec latency 26185.575 ms oleg110-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1 2389 0.10 MB/sec execute 67 sec latency 69.999 ms mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 1 2436 0.10 MB/sec execute 68 sec latency 115.812 ms 1 2489 0.11 MB/sec execute 69 sec latency 86.961 ms 1 2597 0.11 MB/sec execute 70 sec latency 98.040 ms 1 2782 0.15 MB/sec execute 71 sec latency 63.487 ms 1 2973 0.17 MB/sec execute 72 sec latency 74.361 ms 1 3175 0.18 MB/sec execute 73 sec latency 64.256 ms UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2380 1268924 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2144 1269160 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 48412 3554800 2% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 20764 3585812 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 69176 7140612 1% /mnt/lustre 1 3277 0.19 MB/sec execute 74 sec latency 64.797 ms 1 3373 0.19 MB/sec execute 75 sec latency 58.097 ms 1 3533 0.23 MB/sec execute 76 sec latency 89.866 ms 1 3626 0.23 MB/sec execute 77 sec latency 59.296 ms 1 3696 0.23 MB/sec execute 78 sec latency 54.371 ms 1 3776 0.24 MB/sec execute 79 sec latency 72.719 ms 1 3840 0.23 MB/sec execute 80 sec latency 54.155 ms test_26 fail mds1 3 times 1 3902 0.23 MB/sec execute 81 sec latency 61.745 ms Failing mds1 on oleg110-server 1 3951 0.23 MB/sec execute 82 sec latency 90.551 ms Stopping /mnt/lustre-mds1 (opts:) on oleg110-server 1 4006 0.23 MB/sec execute 83 sec latency 72.250 ms 1 4067 0.23 MB/sec execute 84 sec latency 81.303 ms 16:44:21 (1763156661) shut down facet: mds1 facet_host: oleg110-server facet_failover_host: oleg110-server 1 4083 0.22 MB/sec execute 85 sec latency 742.127 ms 1 4083 0.22 MB/sec execute 86 sec latency 1742.353 ms 1 4083 0.22 MB/sec execute 87 sec latency 2743.537 ms 1 4083 0.22 MB/sec execute 88 sec latency 3743.824 ms 1 4083 0.21 MB/sec execute 89 sec latency 4744.411 ms 1 4083 0.21 MB/sec execute 90 sec latency 5744.752 ms 1 4083 0.21 MB/sec execute 91 sec latency 6745.226 ms 1 4083 0.21 MB/sec execute 92 sec latency 7745.688 ms 1 4083 0.20 MB/sec execute 93 sec latency 8746.787 ms 1 4083 0.20 MB/sec execute 94 sec latency 9746.963 ms Failover mds1 to oleg110-server mount facets: mds1 1 4083 0.20 MB/sec execute 95 sec latency 10750.387 ms 1 4083 0.20 MB/sec execute 96 sec latency 11753.632 ms 1 4083 0.20 MB/sec execute 97 sec latency 12756.191 ms 1 4083 0.19 MB/sec execute 98 sec latency 13759.778 ms 1 4083 0.19 MB/sec execute 99 sec latency 14761.591 ms 1 cleanup 100 sec Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 1 cleanup 101 sec 1 cleanup 102 sec 1 cleanup 103 sec 1 cleanup 104 sec 1 cleanup 105 sec 1 cleanup 106 sec 1 cleanup 107 sec 1 cleanup 108 sec 1 cleanup 109 sec 1 cleanup 110 sec 1 cleanup 111 sec 1 cleanup 112 sec 1 cleanup 113 sec oleg110-server: oleg110-server.virtnet: executing set_default_debug -1 all pdsh@oleg110-client: oleg110-server: ssh exited with exit code 1 1 cleanup 114 sec Started lustre-MDT0000 16:44:51 (1763156691) targets are mounted 16:44:51 (1763156691) facet_failover done 1 cleanup 115 sec 1 cleanup 116 sec 1 cleanup 117 sec 1 cleanup 118 sec oleg110-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1 cleanup 119 sec 0 cleanup 119 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 610 117.493 26185.555 Close 445 8.148 25.059 Rename 26 59.733 121.880 Unlink 96 17.106 58.184 Qpathinfo 532 71.862 32777.242 Qfileinfo 97 1.135 9.429 Qfsinfo 98 2.307 37.508 Sfileinfo 49 41.821 93.039 Find 202 7.009 36.326 WriteX 302 8.331 54.171 ReadX 941 1.047 76.679 LockX 2 5.969 6.297 UnlockX 2 5.808 6.130 Flush 43 37.763 86.062 Throughput 0.192035 MB/sec 1 clients 1 procs max_latency=26185.575 ms stopping dbench on /mnt/lustre at Fri Nov 14 16:44:56 EST 2025 with return code 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec clean dbench files on /mnt/lustre /mnt/lustre /mnt/lustre removed 'client.txt' /mnt/lustre dbench successfully finished striped dir -i0 -c2 -H crush2 /mnt/lustre2/d26.replay-dual/run_dbench looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 1 -D /mnt/lustre2/d26.replay-dual/run_dbench -t 100' on /mnt/lustre at Fri Nov 14 16:45:00 EST 2025 waiting for dbench pid 68277 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 100 seconds with load 'client.txt' and minimum warmup 20 secs 0 of 1 processes prepared for launch 0 sec 1 of 1 processes prepared for launch 0 sec releasing clients UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2820 1268484 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2528 1268776 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 12324 3594140 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 36432 3568836 2% /mnt/lustre[OST:1] filesystem_summary: 7666232 48756 7162976 1% /mnt/lustre 1 81 3.60 MB/sec warmup 1 sec latency 54.551 ms 1 166 3.40 MB/sec warmup 2 sec latency 74.843 ms 1 237 3.03 MB/sec warmup 3 sec latency 196.051 ms 1 296 2.74 MB/sec warmup 4 sec latency 296.425 ms 1 360 2.56 MB/sec warmup 5 sec latency 410.695 ms 1 453 2.65 MB/sec warmup 6 sec latency 73.551 ms test_26 fail mds2 4 times 1 553 2.73 MB/sec warmup 7 sec latency 56.269 ms Failing mds2 on oleg110-server 1 692 2.65 MB/sec warmup 8 sec latency 48.479 ms Stopping /mnt/lustre-mds2 (opts:) on oleg110-server 1 740 2.37 MB/sec warmup 9 sec latency 166.949 ms 1 849 2.16 MB/sec warmup 10 sec latency 53.613 ms 1 885 1.97 MB/sec warmup 11 sec latency 529.465 ms 1 955 1.82 MB/sec warmup 12 sec latency 146.686 ms 1 995 1.68 MB/sec warmup 13 sec latency 418.230 ms 1 995 1.56 MB/sec warmup 14 sec latency 1418.526 ms 1 995 1.46 MB/sec warmup 15 sec latency 2418.799 ms 16:45:16 (1763156716) shut down 1 995 1.37 MB/sec warmup 16 sec latency 3419.352 ms facet: mds2 facet_host: oleg110-server facet_failover_host: oleg110-server 1 995 1.29 MB/sec warmup 17 sec latency 4419.547 ms 1 995 1.22 MB/sec warmup 18 sec latency 5419.846 ms 1 995 1.15 MB/sec warmup 19 sec latency 6421.130 ms 1 995 0.00 MB/sec execute 1 sec latency 8421.526 ms 1 995 0.00 MB/sec execute 2 sec latency 9422.494 ms 1 995 0.00 MB/sec execute 3 sec latency 10424.476 ms 1 995 0.00 MB/sec execute 4 sec latency 11426.859 ms 1 995 0.00 MB/sec execute 5 sec latency 12427.248 ms 1 995 0.00 MB/sec execute 6 sec latency 13427.631 ms Failover mds2 to oleg110-server mount facets: mds2 1 995 0.00 MB/sec execute 7 sec latency 14427.925 ms 1 995 0.00 MB/sec execute 8 sec latency 15428.296 ms 1 995 0.00 MB/sec execute 9 sec latency 16428.713 ms 1 995 0.00 MB/sec execute 10 sec latency 17428.939 ms Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 1 995 0.00 MB/sec execute 11 sec latency 18429.267 ms 1 995 0.00 MB/sec execute 12 sec latency 19429.526 ms 1 995 0.00 MB/sec execute 13 sec latency 20429.759 ms oleg110-server: oleg110-server.virtnet: executing set_default_debug -1 all 1 995 0.00 MB/sec execute 14 sec latency 21430.040 ms pdsh@oleg110-client: oleg110-server: ssh exited with exit code 1 Started lustre-MDT0001 16:45:35 (1763156735) targets are mounted 16:45:35 (1763156735) facet_failover done 1 995 0.00 MB/sec execute 15 sec latency 22430.348 ms 1 995 0.00 MB/sec execute 16 sec latency 23430.788 ms 1 995 0.00 MB/sec execute 17 sec latency 24431.032 ms 1 995 0.00 MB/sec execute 18 sec latency 25431.181 ms 1 1076 0.05 MB/sec execute 19 sec latency 25561.214 ms oleg110-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1 1164 0.06 MB/sec execute 20 sec latency 59.957 ms mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 1 1243 0.06 MB/sec execute 21 sec latency 44.556 ms 1 1405 0.19 MB/sec execute 22 sec latency 68.151 ms 1 1486 0.18 MB/sec execute 23 sec latency 151.316 ms 1 1590 0.18 MB/sec execute 24 sec latency 52.993 ms 1 1685 0.17 MB/sec execute 25 sec latency 60.233 ms UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 3196 1268108 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2996 1268308 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 25228 3581368 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 47860 3558080 2% /mnt/lustre[OST:1] filesystem_summary: 7666232 73088 7139448 2% /mnt/lustre 1 1781 0.17 MB/sec execute 26 sec latency 68.962 ms 1 1886 0.17 MB/sec execute 27 sec latency 41.333 ms 1 2008 0.16 MB/sec execute 28 sec latency 40.312 ms 1 2116 0.16 MB/sec execute 29 sec latency 191.820 ms 1 2226 0.16 MB/sec execute 30 sec latency 48.974 ms test_26 fail mds1 5 times 1 2356 0.19 MB/sec execute 31 sec latency 48.970 ms Failing mds1 on oleg110-server 1 2428 0.19 MB/sec execute 32 sec latency 54.983 ms Stopping /mnt/lustre-mds1 (opts:) on oleg110-server 1 2499 0.21 MB/sec execute 33 sec latency 148.369 ms 1 2716 0.29 MB/sec execute 34 sec latency 45.236 ms 16:45:54 (1763156754) shut down facet: mds1 facet_host: oleg110-server facet_failover_host: oleg110-server 1 2931 0.33 MB/sec execute 35 sec latency 46.449 ms 1 3186 0.34 MB/sec execute 36 sec latency 50.922 ms 1 3352 0.36 MB/sec execute 37 sec latency 47.432 ms 1 3555 0.43 MB/sec execute 38 sec latency 34.235 ms 1 3684 0.43 MB/sec execute 39 sec latency 33.886 ms 1 3801 0.45 MB/sec execute 40 sec latency 42.946 ms 1 3897 0.44 MB/sec execute 41 sec latency 38.592 ms 1 3991 0.43 MB/sec execute 42 sec latency 82.805 ms 1 4083 0.42 MB/sec execute 43 sec latency 46.065 ms 1 4083 0.41 MB/sec execute 44 sec latency 1033.226 ms Failover mds1 to oleg110-server mount facets: mds1 1 4083 0.40 MB/sec execute 45 sec latency 2034.360 ms 1 4083 0.40 MB/sec execute 46 sec latency 3034.509 ms 1 4083 0.39 MB/sec execute 47 sec latency 4035.236 ms 1 4083 0.38 MB/sec execute 48 sec latency 5035.784 ms Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 1 4083 0.37 MB/sec execute 49 sec latency 6036.060 ms 1 4083 0.36 MB/sec execute 50 sec latency 7036.993 ms 1 4083 0.36 MB/sec execute 51 sec latency 8037.770 ms 1 4083 0.35 MB/sec execute 52 sec latency 9038.701 ms oleg110-server: oleg110-server.virtnet: executing set_default_debug -1 all pdsh@oleg110-client: oleg110-server: ssh exited with exit code 1 1 4083 0.34 MB/sec execute 53 sec latency 10039.059 ms Started lustre-MDT0000 16:46:14 (1763156774) targets are mounted 16:46:14 (1763156774) facet_failover done 1 4083 0.34 MB/sec execute 54 sec latency 11039.400 ms 1 4083 0.33 MB/sec execute 55 sec latency 12039.694 ms 1 4083 0.32 MB/sec execute 56 sec latency 13039.955 ms 1 4127 0.32 MB/sec execute 57 sec latency 13473.820 ms oleg110-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1 4220 0.31 MB/sec execute 58 sec latency 54.182 ms mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 1 4283 0.31 MB/sec execute 59 sec latency 74.584 ms 1 4357 0.31 MB/sec execute 60 sec latency 59.667 ms 1 4450 0.31 MB/sec execute 61 sec latency 49.653 ms 1 4523 0.31 MB/sec execute 62 sec latency 56.094 ms 1 4619 0.32 MB/sec execute 63 sec latency 55.797 ms 1 4714 0.32 MB/sec execute 64 sec latency 55.781 ms tar: Unexpected EOF in archive tar: Unexpected EOF in archive 1 4795 0.31 MB/sec execute 65 sec latency 52.283 ms 1 4946 0.35 MB/sec execute 66 sec latency 58.123 ms 1 5017 0.35 MB/sec execute 67 sec latency 55.596 ms 1 5089 0.34 MB/sec execute 68 sec latency 168.864 ms 1 5181 0.34 MB/sec execute 69 sec latency 41.353 ms 1 5260 0.33 MB/sec execute 70 sec latency 70.595 ms 1 5346 0.33 MB/sec execute 71 sec latency 50.619 ms 1 5416 0.33 MB/sec execute 72 sec latency 53.041 ms 1 5537 0.32 MB/sec execute 73 sec latency 53.024 ms tar: Error is not recoverable: exiting now dbench killed by signal 15 stopping dbench on /mnt/lustre at Fri Nov 14 16:46:34 EST 2025 with return code 0 68277 pts/0 S+ 0:00 dbench -c client.txt 1 -D /mnt/lustre2/d26.replay-dual/run_dbench -t 100 killed dbench main pid 68277 clean dbench files on /mnt/lustre /mnt/lustre /mnt/lustre removed 'client.txt' /mnt/lustre dbench successfully finished