== replay-dual test 26: dbench and tar with mds failover ========================================================== 10:08:08 (1781618888) Starting client oleg207-client.virtnet: -o user_xattr,flock 192.168.202.107@tcp:/lustre /mnt/lustre Started clients oleg207-client.virtnet: 192.168.202.107@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Started tar loop with pid 44867 Started dbench loop with 44870 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210560 2048 2206464 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 18432 3737600 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3762176 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 20480 7499776 1% /mnt/lustre '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 1 -D /mnt/lustre2/d26.replay-dual/run_dbench -t 100' on /mnt/lustre at Tue Jun 16 10:08:14 EDT 2026 waiting for dbench pid 44936 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 100 seconds with load 'client.txt' and minimum warmup 20 secs failed to create barrier semaphore 0 of 1 processes prepared for launch 0 sec 1 of 1 processes prepared for launch 0 sec releasing clients 1 18 0.26 MB/sec warmup 1 sec latency 16.357 ms 1 51 1.05 MB/sec warmup 2 sec latency 168.856 ms 1 91 1.39 MB/sec warmup 3 sec latency 214.758 ms 1 121 1.37 MB/sec warmup 4 sec latency 234.753 ms 1 157 1.30 MB/sec warmup 5 sec latency 158.435 ms test_26 fail mds1 1 times 1 192 1.26 MB/sec warmup 6 sec latency 171.085 ms 1 222 1.23 MB/sec warmup 7 sec latency 170.922 ms 1 248 1.17 MB/sec warmup 8 sec latency 148.432 ms Failing mds1 on oleg207-server 1 280 1.16 MB/sec warmup 9 sec latency 123.407 ms Stopping /mnt/lustre-mds1 (opts:) on oleg207-server 1 305 1.12 MB/sec warmup 10 sec latency 195.423 ms 1 329 1.08 MB/sec warmup 11 sec latency 191.150 ms 1 330 1.00 MB/sec warmup 12 sec latency 992.999 ms 1 330 0.92 MB/sec warmup 13 sec latency 1993.168 ms 1 330 0.86 MB/sec warmup 14 sec latency 2993.531 ms 10:08:28 (1781618908) shut down facet: mds1 facet_host: oleg207-server facet_failover_host: oleg207-server 1 330 0.80 MB/sec warmup 15 sec latency 3998.837 ms 1 330 0.75 MB/sec warmup 16 sec latency 4999.106 ms 1 330 0.70 MB/sec warmup 17 sec latency 6000.315 ms 1 330 0.67 MB/sec warmup 18 sec latency 7000.664 ms 1 330 0.63 MB/sec warmup 19 sec latency 8001.236 ms 1 330 0.00 MB/sec execute 1 sec latency 10003.474 ms 1 330 0.00 MB/sec execute 2 sec latency 11003.762 ms 1 330 0.00 MB/sec execute 3 sec latency 12004.142 ms 1 330 0.00 MB/sec execute 4 sec latency 13004.929 ms Failover mds1 to oleg207-server mount facets: mds1 1 330 0.00 MB/sec execute 5 sec latency 14007.514 ms 1 330 0.00 MB/sec execute 6 sec latency 15007.834 ms 1 330 0.00 MB/sec execute 7 sec latency 16008.125 ms 1 330 0.00 MB/sec execute 8 sec latency 17008.485 ms Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 1 330 0.00 MB/sec execute 9 sec latency 18008.777 ms 1 330 0.00 MB/sec execute 10 sec latency 19012.607 ms 1 330 0.00 MB/sec execute 11 sec latency 20012.951 ms 1 330 0.00 MB/sec execute 12 sec latency 21013.192 ms 1 330 0.00 MB/sec execute 13 sec latency 22014.137 ms 1 330 0.00 MB/sec execute 14 sec latency 23015.701 ms 1 330 0.00 MB/sec execute 15 sec latency 24015.979 ms oleg207-server: oleg207-server.virtnet: executing set_default_debug -1 all 1 330 0.00 MB/sec execute 16 sec latency 25016.151 ms 1 330 0.00 MB/sec execute 17 sec latency 26018.806 ms pdsh@oleg207-client: oleg207-server: ssh exited with exit code 1 Started lustre-MDT0000 1 330 0.00 MB/sec execute 18 sec latency 27024.334 ms 10:08:52 (1781618932) targets are mounted 10:08:52 (1781618932) facet_failover done 1 330 0.00 MB/sec execute 19 sec latency 28024.551 ms 1 330 0.00 MB/sec execute 20 sec latency 29024.731 ms 1 330 0.00 MB/sec execute 21 sec latency 30025.047 ms 1 330 0.00 MB/sec execute 22 sec latency 31025.610 ms 1 330 0.00 MB/sec execute 23 sec latency 32025.965 ms 1 330 0.00 MB/sec execute 24 sec latency 33026.345 ms 1 330 0.00 MB/sec execute 25 sec latency 34028.299 ms 1 330 0.00 MB/sec execute 26 sec latency 35028.540 ms 1 330 0.00 MB/sec execute 27 sec latency 36030.346 ms 1 330 0.00 MB/sec execute 28 sec latency 37030.658 ms 1 330 0.00 MB/sec execute 29 sec latency 38030.991 ms 1 330 0.00 MB/sec execute 30 sec latency 39034.834 ms 1 330 0.00 MB/sec execute 31 sec latency 40035.224 ms 1 330 0.00 MB/sec execute 32 sec latency 41035.474 ms 1 337 0.01 MB/sec execute 33 sec latency 41565.064 ms 1 374 0.04 MB/sec execute 34 sec latency 158.119 ms 1 413 0.07 MB/sec execute 35 sec latency 143.304 ms 1 454 0.11 MB/sec execute 36 sec latency 130.607 ms 1 486 0.13 MB/sec execute 37 sec latency 144.904 ms 1 513 0.15 MB/sec execute 38 sec latency 174.931 ms oleg207-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1 572 0.18 MB/sec execute 39 sec latency 193.747 ms 1 616 0.22 MB/sec execute 40 sec latency 81.639 ms 1 656 0.22 MB/sec execute 41 sec latency 152.854 ms mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 1 678 0.22 MB/sec execute 42 sec latency 288.280 ms 1 708 0.21 MB/sec execute 43 sec latency 128.921 ms 1 726 0.21 MB/sec execute 44 sec latency 220.961 ms 1 748 0.21 MB/sec execute 45 sec latency 185.042 ms 1 780 0.20 MB/sec execute 46 sec latency 136.256 ms 1 799 0.20 MB/sec execute 47 sec latency 225.076 ms 1 825 0.20 MB/sec execute 48 sec latency 143.152 ms UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210560 2304 2206208 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 37888 3694592 2% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 10240 3719168 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 48128 7413760 1% /mnt/lustre 1 873 0.20 MB/sec execute 49 sec latency 181.358 ms 1 888 0.19 MB/sec execute 50 sec latency 261.450 ms 1 913 0.19 MB/sec execute 51 sec latency 188.723 ms 1 936 0.19 MB/sec execute 52 sec latency 303.948 ms 1 969 0.18 MB/sec execute 53 sec latency 93.795 ms 1 988 0.18 MB/sec execute 54 sec latency 181.816 ms 1 1051 0.20 MB/sec execute 55 sec latency 104.148 ms test_26 fail mds1 2 times 1 1086 0.19 MB/sec execute 56 sec latency 113.404 ms 1 1127 0.19 MB/sec execute 57 sec latency 123.209 ms Failing mds1 on oleg207-server 1 1155 0.19 MB/sec execute 58 sec latency 160.702 ms Stopping /mnt/lustre-mds1 (opts:) on oleg207-server 1 1190 0.19 MB/sec execute 59 sec latency 126.877 ms 1 1221 0.18 MB/sec execute 60 sec latency 167.091 ms 1 1221 0.18 MB/sec execute 61 sec latency 1168.762 ms 1 1221 0.18 MB/sec execute 62 sec latency 2171.812 ms 1 1221 0.18 MB/sec execute 63 sec latency 3172.933 ms 1 1221 0.17 MB/sec execute 64 sec latency 4175.926 ms 1 1221 0.17 MB/sec execute 65 sec latency 5177.161 ms 1 1221 0.17 MB/sec execute 66 sec latency 6177.615 ms 1 1221 0.16 MB/sec execute 67 sec latency 7178.363 ms 1 1221 0.16 MB/sec execute 68 sec latency 8179.658 ms 10:09:43 (1781618983) shut down facet: mds1 facet_host: oleg207-server facet_failover_host: oleg207-server 1 1221 0.16 MB/sec execute 69 sec latency 9180.974 ms 1 1221 0.16 MB/sec execute 70 sec latency 10183.557 ms 1 1221 0.16 MB/sec execute 71 sec latency 11183.886 ms 1 1221 0.15 MB/sec execute 72 sec latency 12184.241 ms 1 1221 0.15 MB/sec execute 73 sec latency 13184.500 ms 1 1221 0.15 MB/sec execute 74 sec latency 14186.210 ms 1 1221 0.15 MB/sec execute 75 sec latency 15187.655 ms 1 1221 0.15 MB/sec execute 76 sec latency 16188.022 ms 1 1221 0.14 MB/sec execute 77 sec latency 17191.523 ms 1 1221 0.14 MB/sec execute 78 sec latency 18191.749 ms Failover mds1 to oleg207-server mount facets: mds1 1 1221 0.14 MB/sec execute 79 sec latency 19193.992 ms 1 1221 0.14 MB/sec execute 80 sec latency 20194.229 ms 1 1221 0.14 MB/sec execute 81 sec latency 21194.519 ms 1 1221 0.13 MB/sec execute 82 sec latency 22195.177 ms Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 1 1221 0.13 MB/sec execute 83 sec latency 23195.387 ms 1 1221 0.13 MB/sec execute 84 sec latency 24195.731 ms 1 1221 0.13 MB/sec execute 85 sec latency 25196.016 ms 1 1221 0.13 MB/sec execute 86 sec latency 26196.294 ms 1 1221 0.13 MB/sec execute 87 sec latency 27196.565 ms 1 1221 0.13 MB/sec execute 88 sec latency 28196.773 ms oleg207-server: oleg207-server.virtnet: executing set_default_debug -1 all 1 1221 0.12 MB/sec execute 89 sec latency 29196.983 ms 1 1221 0.12 MB/sec execute 90 sec latency 30197.386 ms pdsh@oleg207-client: oleg207-server: ssh exited with exit code 1 1 1221 0.12 MB/sec execute 91 sec latency 31203.336 ms Started lustre-MDT0000 10:10:05 (1781619005) targets are mounted 10:10:05 (1781619005) facet_failover done 1 1221 0.12 MB/sec execute 92 sec latency 32203.737 ms 1 1221 0.12 MB/sec execute 93 sec latency 33205.224 ms 1 1221 0.12 MB/sec execute 94 sec latency 34206.152 ms 1 1221 0.12 MB/sec execute 95 sec latency 35206.439 ms 1 1221 0.12 MB/sec execute 96 sec latency 36207.692 ms 1 1221 0.11 MB/sec execute 97 sec latency 37210.831 ms 1 1221 0.11 MB/sec execute 98 sec latency 38211.161 ms 1 1221 0.11 MB/sec execute 99 sec latency 39230.046 ms 1 cleanup 100 sec 1 cleanup 101 sec 1 cleanup 102 sec 1 cleanup 103 sec 0 cleanup 104 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 130 389.132 39294.889 Close 121 358.958 41565.029 Rename 9 125.031 220.929 Unlink 14 36.147 53.039 Qpathinfo 83 27.714 123.778 Qfileinfo 53 2.204 11.692 Qfsinfo 28 5.496 30.180 Sfileinfo 30 78.532 291.165 Find 37 9.669 66.180 WriteX 254 15.303 70.061 ReadX 128 7.005 126.846 Flush 24 143.686 303.924 Throughput 0.111568 MB/sec 1 clients 1 procs max_latency=41565.064 ms stopping dbench on /mnt/lustre at Tue Jun 16 10:10:18 EDT 2026 with return code 0 oleg207-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid clean dbench files on /mnt/lustre /mnt/lustre /mnt/lustre removed 'client.txt' /mnt/lustre dbench successfully finished mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 1 -D /mnt/lustre2/d26.replay-dual/run_dbench -t 100' on /mnt/lustre at Tue Jun 16 10:10:25 EDT 2026 waiting for dbench pid 46906 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 100 seconds with load 'client.txt' and minimum warmup 20 secs 0 of 1 processes prepared for launch 0 sec 1 of 1 processes prepared for launch 0 sec releasing clients 1 31 1.05 MB/sec warmup 1 sec latency 156.106 ms 1 76 1.64 MB/sec warmup 2 sec latency 219.289 ms UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210560 2560 2205952 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 12288 3752960 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 30720 3694592 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 43008 7447552 1% /mnt/lustre 1 113 1.75 MB/sec warmup 3 sec latency 320.579 ms 1 137 1.50 MB/sec warmup 4 sec latency 205.667 ms 1 164 1.36 MB/sec warmup 5 sec latency 175.379 ms 1 187 1.25 MB/sec warmup 6 sec latency 210.597 ms 1 208 1.16 MB/sec warmup 7 sec latency 188.345 ms 1 240 1.14 MB/sec warmup 8 sec latency 119.474 ms 1 287 1.19 MB/sec warmup 9 sec latency 118.738 ms test_26 fail mds1 3 times 1 315 1.15 MB/sec warmup 10 sec latency 185.141 ms 1 341 1.11 MB/sec warmup 11 sec latency 161.250 ms 1 365 1.09 MB/sec warmup 12 sec latency 190.944 ms Failing mds1 on oleg207-server 1 389 1.06 MB/sec warmup 13 sec latency 179.239 ms Stopping /mnt/lustre-mds1 (opts:) on oleg207-server 1 421 1.06 MB/sec warmup 14 sec latency 173.157 ms 1 452 1.06 MB/sec warmup 15 sec latency 154.935 ms 1 452 0.99 MB/sec warmup 16 sec latency 1155.479 ms 1 452 0.93 MB/sec warmup 17 sec latency 2158.565 ms 10:10:43 (1781619043) shut down 1 452 0.88 MB/sec warmup 18 sec latency 3158.759 ms facet: mds1 facet_host: oleg207-server facet_failover_host: oleg207-server 1 452 0.84 MB/sec warmup 19 sec latency 4159.525 ms 1 452 0.00 MB/sec execute 1 sec latency 6160.489 ms 1 452 0.00 MB/sec execute 2 sec latency 7160.694 ms 1 452 0.00 MB/sec execute 3 sec latency 8160.921 ms 1 452 0.00 MB/sec execute 4 sec latency 9161.223 ms 1 452 0.00 MB/sec execute 5 sec latency 10161.718 ms 1 452 0.00 MB/sec execute 6 sec latency 11161.927 ms 1 452 0.00 MB/sec execute 7 sec latency 12162.747 ms 1 452 0.00 MB/sec execute 8 sec latency 13163.012 ms Failover mds1 to oleg207-server mount facets: mds1 1 452 0.00 MB/sec execute 9 sec latency 14163.382 ms 1 452 0.00 MB/sec execute 10 sec latency 15167.481 ms 1 452 0.00 MB/sec execute 11 sec latency 16167.836 ms 1 452 0.00 MB/sec execute 12 sec latency 17168.263 ms Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 1 452 0.00 MB/sec execute 13 sec latency 18168.501 ms 1 452 0.00 MB/sec execute 14 sec latency 19168.830 ms 1 452 0.00 MB/sec execute 15 sec latency 20170.630 ms 1 452 0.00 MB/sec execute 16 sec latency 21170.912 ms 1 452 0.00 MB/sec execute 17 sec latency 22171.736 ms 1 452 0.00 MB/sec execute 18 sec latency 23172.061 ms 1 452 0.00 MB/sec execute 19 sec latency 24173.782 ms oleg207-server: oleg207-server.virtnet: executing set_default_debug -1 all 1 452 0.00 MB/sec execute 20 sec latency 25181.881 ms pdsh@oleg207-client: oleg207-server: ssh exited with exit code 1 1 452 0.00 MB/sec execute 21 sec latency 26182.186 ms 1 452 0.00 MB/sec execute 22 sec latency 27183.607 ms Started lustre-MDT0000 10:11:08 (1781619068) targets are mounted 10:11:08 (1781619068) facet_failover done 1 452 0.00 MB/sec execute 23 sec latency 28188.795 ms 1 452 0.00 MB/sec execute 24 sec latency 29191.628 ms 1 453 0.00 MB/sec execute 25 sec latency 30077.722 ms 1 481 0.04 MB/sec execute 26 sec latency 318.590 ms 1 511 0.07 MB/sec execute 27 sec latency 155.794 ms 1 543 0.11 MB/sec execute 28 sec latency 181.348 ms 1 642 0.18 MB/sec execute 29 sec latency 84.819 ms 1 664 0.17 MB/sec execute 30 sec latency 264.505 ms oleg207-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1 686 0.17 MB/sec execute 31 sec latency 289.860 ms 1 711 0.17 MB/sec execute 32 sec latency 157.037 ms mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 1 728 0.16 MB/sec execute 33 sec latency 452.296 ms 1 747 0.16 MB/sec execute 34 sec latency 159.701 ms 1 776 0.16 MB/sec execute 35 sec latency 160.461 ms 1 796 0.15 MB/sec execute 36 sec latency 218.718 ms 1 808 0.15 MB/sec execute 37 sec latency 263.142 ms 1 863 0.15 MB/sec execute 38 sec latency 125.752 ms 1 888 0.15 MB/sec execute 39 sec latency 292.689 ms 1 914 0.15 MB/sec execute 40 sec latency 258.349 ms UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210560 2944 2205568 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 25600 3710976 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 47104 3695616 2% /mnt/lustre[OST:1] filesystem_summary: 7542784 72704 7406592 1% /mnt/lustre 1 933 0.14 MB/sec execute 41 sec latency 152.753 ms 1 968 0.14 MB/sec execute 42 sec latency 145.942 ms 1 983 0.14 MB/sec execute 43 sec latency 377.702 ms 1 1028 0.16 MB/sec execute 44 sec latency 222.636 ms 1 1074 0.16 MB/sec execute 45 sec latency 104.807 ms 1 1119 0.15 MB/sec execute 46 sec latency 131.449 ms 1 1155 0.15 MB/sec execute 47 sec latency 109.915 ms test_26 fail mds1 4 times 1 1198 0.15 MB/sec execute 48 sec latency 95.893 ms 1 1230 0.15 MB/sec execute 49 sec latency 125.225 ms Failing mds1 on oleg207-server 1 1257 0.14 MB/sec execute 50 sec latency 180.304 ms 1 1379 0.20 MB/sec execute 51 sec latency 141.962 ms Stopping /mnt/lustre-mds1 (opts:) on oleg207-server 1 1410 0.19 MB/sec execute 52 sec latency 94.329 ms 1 1418 0.19 MB/sec execute 53 sec latency 855.432 ms 1 1418 0.19 MB/sec execute 54 sec latency 1855.797 ms 10:11:40 (1781619100) shut down 1 1418 0.18 MB/sec execute 55 sec latency 2855.971 ms facet: mds1 facet_host: oleg207-server facet_failover_host: oleg207-server 1 1418 0.18 MB/sec execute 56 sec latency 3856.224 ms 1 1418 0.18 MB/sec execute 57 sec latency 4856.666 ms 1 1418 0.17 MB/sec execute 58 sec latency 5866.677 ms 1 1418 0.17 MB/sec execute 59 sec latency 6872.246 ms 1 1418 0.17 MB/sec execute 60 sec latency 7872.432 ms 1 1418 0.17 MB/sec execute 61 sec latency 8873.397 ms 1 1418 0.16 MB/sec execute 62 sec latency 9873.636 ms 1 1418 0.16 MB/sec execute 63 sec latency 10876.123 ms 1 1418 0.16 MB/sec execute 64 sec latency 11876.330 ms 1 1418 0.16 MB/sec execute 65 sec latency 12876.885 ms Failover mds1 to oleg207-server mount facets: mds1 1 1418 0.15 MB/sec execute 66 sec latency 13877.062 ms 1 1418 0.15 MB/sec execute 67 sec latency 14877.413 ms 1 1418 0.15 MB/sec execute 68 sec latency 15878.172 ms 1 1418 0.15 MB/sec execute 69 sec latency 16878.374 ms Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 1 1418 0.14 MB/sec execute 70 sec latency 17878.618 ms 1 1418 0.14 MB/sec execute 71 sec latency 18878.930 ms 1 1418 0.14 MB/sec execute 72 sec latency 19881.891 ms 1 1418 0.14 MB/sec execute 73 sec latency 20882.973 ms 1 1418 0.14 MB/sec execute 74 sec latency 21883.165 ms 1 1418 0.13 MB/sec execute 75 sec latency 22883.489 ms 1 1418 0.13 MB/sec execute 76 sec latency 23885.546 ms oleg207-server: oleg207-server.virtnet: executing set_default_debug -1 all 1 1442 0.13 MB/sec execute 77 sec latency 24195.964 ms pdsh@oleg207-client: oleg207-server: ssh exited with exit code 1 1 1481 0.13 MB/sec execute 78 sec latency 161.741 ms Started lustre-MDT0000 10:12:04 (1781619124) targets are mounted 10:12:04 (1781619124) facet_failover done 1 1509 0.13 MB/sec execute 79 sec latency 324.673 ms 1 1555 0.13 MB/sec execute 80 sec latency 113.182 ms 1 1582 0.13 MB/sec execute 81 sec latency 83.001 ms 1 1619 0.12 MB/sec execute 82 sec latency 151.406 ms 1 1643 0.12 MB/sec execute 83 sec latency 367.559 ms 1 1662 0.12 MB/sec execute 84 sec latency 232.979 ms 1 1691 0.12 MB/sec execute 85 sec latency 144.654 ms 1 1735 0.12 MB/sec execute 86 sec latency 128.544 ms oleg207-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1 1795 0.12 MB/sec execute 87 sec latency 78.841 ms 1 1830 0.12 MB/sec execute 88 sec latency 180.822 ms 1 1857 0.12 MB/sec execute 89 sec latency 181.050 ms mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 1 1884 0.12 MB/sec execute 90 sec latency 149.116 ms 1 1914 0.12 MB/sec execute 91 sec latency 188.107 ms 1 1968 0.11 MB/sec execute 92 sec latency 124.707 ms 1 2000 0.11 MB/sec execute 93 sec latency 121.868 ms 1 2060 0.11 MB/sec execute 94 sec latency 123.053 ms 1 2119 0.11 MB/sec execute 95 sec latency 121.424 ms 1 2166 0.11 MB/sec execute 96 sec latency 131.319 ms 1 2212 0.11 MB/sec execute 97 sec latency 141.745 ms 1 2345 0.12 MB/sec execute 98 sec latency 57.432 ms tar: Unexpected EOF in archive tar: Unexpected EOF in archive 1 2378 0.12 MB/sec execute 99 sec latency 212.791 ms 1 cleanup 100 sec 1 cleanup 101 sec 1 cleanup 102 sec 1 cleanup 103 sec 0 cleanup 104 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 342 139.086 24195.931 Close 296 116.911 30077.688 Rename 13 103.638 180.279 Unlink 33 36.712 78.321 Qpathinfo 317 18.583 125.148 Qfileinfo 82 2.594 20.114 Qfsinfo 39 5.205 28.682 Sfileinfo 43 73.218 160.443 Find 107 7.161 83.239 WriteX 280 12.599 99.962 ReadX 381 1.899 89.809 Flush 33 184.632 452.279 Throughput 0.121579 MB/sec 1 clients 1 procs max_latency=30077.722 ms stopping dbench on /mnt/lustre at Tue Jun 16 10:12:29 EDT 2026 with return code 0 clean dbench files on /mnt/lustre /mnt/lustre /mnt/lustre removed 'client.txt' /mnt/lustre dbench successfully finished looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' tar: Error is not recoverable: exiting now running 'dbench 1 -D /mnt/lustre2/d26.replay-dual/run_dbench -t 100' on /mnt/lustre at Tue Jun 16 10:12:35 EDT 2026 stopping dbench on /mnt/lustre at Tue Jun 16 10:12:35 EDT 2026 with return code 0 clean dbench files on /mnt/lustre /mnt/lustre /mnt/lustre removed 'client.txt' /mnt/lustre dbench successfully finished