== replay-dual test 26: dbench and tar with mds failover ========================================================== 14:14:05 (1776190445) Starting client oleg218-client.virtnet: -o user_xattr,flock oleg218-server@tcp:/lustre /mnt/lustre Started clients oleg218-client.virtnet: 192.168.202.118@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt) Started tar loop with pid 45121 Started dbench loop with 45123 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 1 -D /mnt/lustre2/d26.replay-dual/run_dbench -t 100' on /mnt/lustre at Tue Apr 14 14:14:11 EDT 2026 waiting for dbench pid 45157 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210560 3328 2205184 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 3072 3714048 1% /mnt/lustre[OST:0] dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 100 seconds with load 'client.txt' and minimum warmup 20 secs lustre-OST0001_UUID 3771392 3072 3750912 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 6144 7464960 1% /mnt/lustre failed to create barrier semaphore 0 of 1 processes prepared for launch 0 sec 1 of 1 processes prepared for launch 0 sec releasing clients 1 19 0.33 MB/sec warmup 1 sec latency 353.686 ms 1 66 1.44 MB/sec warmup 2 sec latency 227.031 ms 1 117 1.77 MB/sec warmup 3 sec latency 147.242 ms 1 147 1.57 MB/sec warmup 4 sec latency 202.790 ms 1 181 1.46 MB/sec warmup 5 sec latency 156.186 ms 1 214 1.39 MB/sec warmup 6 sec latency 141.272 ms test_26 fail mds1 1 times 1 239 1.30 MB/sec warmup 7 sec latency 179.259 ms 1 271 1.27 MB/sec warmup 8 sec latency 161.535 ms Failing mds1 on oleg218-server 1 313 1.27 MB/sec warmup 9 sec latency 140.941 ms Stopping /mnt/lustre-mds1 (opts:) on oleg218-server 1 339 1.22 MB/sec warmup 10 sec latency 192.439 ms 1 341 1.11 MB/sec warmup 11 sec latency 952.273 ms 1 341 1.02 MB/sec warmup 12 sec latency 1952.537 ms reboot facets: mds1 1 341 0.94 MB/sec warmup 13 sec latency 2952.988 ms 1 341 0.88 MB/sec warmup 14 sec latency 3953.359 ms 1 341 0.82 MB/sec warmup 15 sec latency 4953.607 ms 1 341 0.77 MB/sec warmup 16 sec latency 5953.996 ms 1 341 0.72 MB/sec warmup 17 sec latency 6954.318 ms 1 341 0.68 MB/sec warmup 18 sec latency 7954.906 ms 1 341 0.64 MB/sec warmup 19 sec latency 8955.140 ms 1 341 0.00 MB/sec execute 1 sec latency 10959.357 ms 1 341 0.00 MB/sec execute 2 sec latency 11959.578 ms 1 341 0.00 MB/sec execute 3 sec latency 12961.897 ms Failover mds1 to oleg218-server 1 341 0.00 MB/sec execute 4 sec latency 13962.089 ms 1 341 0.00 MB/sec execute 5 sec latency 14963.990 ms mount facets: mds1 1 341 0.00 MB/sec execute 6 sec latency 15965.244 ms 1 341 0.00 MB/sec execute 7 sec latency 16974.048 ms Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 1 341 0.00 MB/sec execute 8 sec latency 17983.715 ms 1 341 0.00 MB/sec execute 9 sec latency 18983.938 ms 1 341 0.00 MB/sec execute 10 sec latency 19984.362 ms 1 341 0.00 MB/sec execute 11 sec latency 20986.269 ms 1 341 0.00 MB/sec execute 12 sec latency 21986.564 ms 1 341 0.00 MB/sec execute 13 sec latency 22986.781 ms 1 341 0.00 MB/sec execute 14 sec latency 23987.650 ms 1 341 0.00 MB/sec execute 15 sec latency 24988.038 ms 1 341 0.00 MB/sec execute 16 sec latency 25988.479 ms 1 341 0.00 MB/sec execute 17 sec latency 26990.591 ms 1 341 0.00 MB/sec execute 18 sec latency 27990.915 ms 1 341 0.00 MB/sec execute 19 sec latency 28993.364 ms 1 341 0.00 MB/sec execute 20 sec latency 29993.599 ms 1 341 0.00 MB/sec execute 21 sec latency 30993.988 ms 1 341 0.00 MB/sec execute 22 sec latency 31998.046 ms 1 341 0.00 MB/sec execute 23 sec latency 32998.998 ms oleg218-server: oleg218-server.virtnet: executing set_default_debug -1 all 8 1 349 0.01 MB/sec execute 24 sec latency 33758.998 ms 1 389 0.06 MB/sec execute 25 sec latency 193.236 ms pdsh@oleg218-client: oleg218-server: ssh exited with exit code 1 1 427 0.11 MB/sec execute 26 sec latency 154.964 ms Started lustre-MDT0000 1 469 0.15 MB/sec execute 27 sec latency 144.462 ms 1 502 0.19 MB/sec execute 28 sec latency 142.950 ms 1 542 0.24 MB/sec execute 29 sec latency 139.702 ms 1 639 0.29 MB/sec execute 30 sec latency 166.132 ms 1 666 0.29 MB/sec execute 31 sec latency 246.488 ms 1 695 0.28 MB/sec execute 32 sec latency 160.145 ms 1 723 0.27 MB/sec execute 33 sec latency 238.406 ms oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1 759 0.27 MB/sec execute 34 sec latency 120.104 ms 1 789 0.26 MB/sec execute 35 sec latency 128.061 ms mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 1 804 0.26 MB/sec execute 36 sec latency 360.200 ms 1 862 0.25 MB/sec execute 37 sec latency 133.018 ms 1 888 0.25 MB/sec execute 38 sec latency 197.544 ms 1 914 0.24 MB/sec execute 39 sec latency 199.960 ms 1 952 0.24 MB/sec execute 40 sec latency 107.631 ms 1 983 0.23 MB/sec execute 41 sec latency 245.838 ms 1 1056 0.25 MB/sec execute 42 sec latency 122.875 ms UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210560 3712 2204800 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 38912 3706880 2% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 18432 3679232 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 57344 7386112 1% /mnt/lustre 1 1124 0.25 MB/sec execute 43 sec latency 87.197 ms 1 1163 0.24 MB/sec execute 44 sec latency 114.861 ms 1 1216 0.24 MB/sec execute 45 sec latency 101.817 ms 1 1274 0.24 MB/sec execute 46 sec latency 71.669 ms 1 1419 0.29 MB/sec execute 47 sec latency 93.006 ms test_26 fail mds1 2 times 1 1481 0.29 MB/sec execute 48 sec latency 90.758 ms 1 1537 0.28 MB/sec execute 49 sec latency 166.228 ms Failing mds1 on oleg218-server 1 1609 0.28 MB/sec execute 50 sec latency 87.833 ms Stopping /mnt/lustre-mds1 (opts:) on oleg218-server 1 1651 0.27 MB/sec execute 51 sec latency 187.667 ms 1 1653 0.27 MB/sec execute 52 sec latency 978.547 ms 1 1653 0.26 MB/sec execute 53 sec latency 1979.594 ms 1 1653 0.26 MB/sec execute 54 sec latency 2979.945 ms 1 1653 0.25 MB/sec execute 55 sec latency 3980.919 ms reboot facets: mds1 1 1653 0.25 MB/sec execute 56 sec latency 4981.670 ms 1 1653 0.24 MB/sec execute 57 sec latency 5983.744 ms 1 1653 0.24 MB/sec execute 58 sec latency 6983.927 ms 1 1653 0.24 MB/sec execute 59 sec latency 7984.276 ms 1 1653 0.23 MB/sec execute 60 sec latency 8984.495 ms 1 1653 0.23 MB/sec execute 61 sec latency 9984.925 ms 1 1653 0.22 MB/sec execute 62 sec latency 10985.203 ms 1 1653 0.22 MB/sec execute 63 sec latency 11985.451 ms 1 1653 0.22 MB/sec execute 64 sec latency 12986.290 ms 1 1653 0.21 MB/sec execute 65 sec latency 13986.920 ms Failover mds1 to oleg218-server 1 1653 0.21 MB/sec execute 66 sec latency 14988.428 ms 1 1653 0.21 MB/sec execute 67 sec latency 15991.853 ms mount facets: mds1 1 1653 0.20 MB/sec execute 68 sec latency 16996.170 ms 1 1653 0.20 MB/sec execute 69 sec latency 17997.548 ms 1 1653 0.20 MB/sec execute 70 sec latency 18999.808 ms Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 1 1653 0.20 MB/sec execute 71 sec latency 20000.700 ms 1 1653 0.19 MB/sec execute 72 sec latency 21001.269 ms 1 1653 0.19 MB/sec execute 73 sec latency 22001.456 ms 1 1653 0.19 MB/sec execute 74 sec latency 23001.672 ms 1 1653 0.19 MB/sec execute 75 sec latency 24001.868 ms 1 1653 0.18 MB/sec execute 76 sec latency 25002.173 ms 1 1653 0.18 MB/sec execute 77 sec latency 26002.411 ms 1 1653 0.18 MB/sec execute 78 sec latency 27004.123 ms 1 1653 0.18 MB/sec execute 79 sec latency 28004.351 ms 1 1653 0.17 MB/sec execute 80 sec latency 29004.562 ms 1 1653 0.17 MB/sec execute 81 sec latency 30004.779 ms 1 1653 0.17 MB/sec execute 82 sec latency 31005.099 ms 1 1653 0.17 MB/sec execute 83 sec latency 32005.794 ms oleg218-server: oleg218-server.virtnet: executing set_default_debug -1 all 8 1 1653 0.17 MB/sec execute 84 sec latency 33005.943 ms pdsh@oleg218-client: oleg218-server: ssh exited with exit code 1 1 1653 0.16 MB/sec execute 85 sec latency 34010.355 ms Started lustre-MDT0000 1 1653 0.16 MB/sec execute 86 sec latency 35010.546 ms 1 1653 0.16 MB/sec execute 87 sec latency 36011.549 ms 1 1653 0.16 MB/sec execute 88 sec latency 37011.736 ms 1 1653 0.16 MB/sec execute 89 sec latency 38011.943 ms 1 1653 0.15 MB/sec execute 90 sec latency 39013.974 ms 1 1653 0.15 MB/sec execute 91 sec latency 40016.200 ms 1 1653 0.15 MB/sec execute 92 sec latency 41016.494 ms 1 1653 0.15 MB/sec execute 93 sec latency 42017.050 ms 1 1653 0.15 MB/sec execute 94 sec latency 43017.346 ms 1 1653 0.15 MB/sec execute 95 sec latency 44018.356 ms 1 1653 0.15 MB/sec execute 96 sec latency 45020.766 ms 1 1655 0.14 MB/sec execute 97 sec latency 45983.897 ms 1 1696 0.14 MB/sec execute 98 sec latency 127.715 ms 1 1751 0.14 MB/sec execute 99 sec latency 84.429 ms 1 cleanup 100 sec 1 cleanup 101 sec 1 cleanup 102 sec 1 cleanup 103 sec oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 0 cleanup 104 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 251 376.275 45983.880 Close 209 12.893 49.160 Rename 11 63.392 114.838 Unlink 24 19.774 33.692 Qpathinfo 174 14.282 102.870 Qfileinfo 71 1.368 8.799 Qfsinfo 33 2.919 30.501 Sfileinfo 34 32.294 72.880 Find 65 6.544 84.408 WriteX 285 10.939 51.784 ReadX 284 1.838 89.994 Flush 27 146.078 360.054 Throughput 0.141343 MB/sec 1 clients 1 procs max_latency=45983.897 ms stopping dbench on /mnt/lustre at Tue Apr 14 14:16:15 EDT 2026 with return code 0 clean dbench files on /mnt/lustre /mnt/lustre /mnt/lustre removed 'client.txt' /mnt/lustre dbench successfully finished mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 1 -D /mnt/lustre2/d26.replay-dual/run_dbench -t 100' on /mnt/lustre at Tue Apr 14 14:16:22 EDT 2026 waiting for dbench pid 47286 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 100 seconds with load 'client.txt' and minimum warmup 20 secs 0 of 1 processes prepared for launch 0 sec 1 of 1 processes prepared for launch 0 sec releasing clients 1 71 3.13 MB/sec warmup 1 sec latency 108.593 ms UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210560 4096 2204416 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 14336 3691520 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 22528 3737600 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 36864 7429120 1% /mnt/lustre 1 113 2.61 MB/sec warmup 2 sec latency 246.084 ms 1 162 2.22 MB/sec warmup 3 sec latency 100.436 ms 1 197 1.96 MB/sec warmup 4 sec latency 151.186 ms 1 231 1.77 MB/sec warmup 5 sec latency 154.456 ms 1 279 1.74 MB/sec warmup 6 sec latency 119.712 ms 1 322 1.68 MB/sec warmup 7 sec latency 145.075 ms test_26 fail mds1 3 times 1 349 1.56 MB/sec warmup 8 sec latency 228.987 ms 1 384 1.51 MB/sec warmup 9 sec latency 179.883 ms Failing mds1 on oleg218-server 1 421 1.48 MB/sec warmup 10 sec latency 137.864 ms Stopping /mnt/lustre-mds1 (opts:) on oleg218-server 1 469 1.49 MB/sec warmup 11 sec latency 115.603 ms 1 485 1.41 MB/sec warmup 12 sec latency 764.937 ms 1 485 1.30 MB/sec warmup 13 sec latency 1765.934 ms reboot facets: mds1 1 485 1.21 MB/sec warmup 14 sec latency 2766.188 ms 1 485 1.13 MB/sec warmup 15 sec latency 3766.424 ms 1 485 1.06 MB/sec warmup 16 sec latency 4766.768 ms 1 485 1.00 MB/sec warmup 17 sec latency 5768.088 ms 1 485 0.94 MB/sec warmup 18 sec latency 6770.596 ms 1 485 0.89 MB/sec warmup 19 sec latency 7770.975 ms 1 485 0.00 MB/sec execute 1 sec latency 9772.262 ms 1 485 0.00 MB/sec execute 2 sec latency 10772.930 ms 1 485 0.00 MB/sec execute 3 sec latency 11775.068 ms Failover mds1 to oleg218-server 1 485 0.00 MB/sec execute 4 sec latency 12775.304 ms 1 485 0.00 MB/sec execute 5 sec latency 13775.628 ms mount facets: mds1 1 485 0.00 MB/sec execute 6 sec latency 14782.542 ms 1 485 0.00 MB/sec execute 7 sec latency 15782.725 ms 1 485 0.00 MB/sec execute 8 sec latency 16783.126 ms Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 1 485 0.00 MB/sec execute 9 sec latency 17783.413 ms 1 485 0.00 MB/sec execute 10 sec latency 18783.965 ms 1 485 0.00 MB/sec execute 11 sec latency 19785.169 ms 1 485 0.00 MB/sec execute 12 sec latency 20785.393 ms 1 485 0.00 MB/sec execute 13 sec latency 21785.601 ms 1 485 0.00 MB/sec execute 14 sec latency 22786.226 ms 1 485 0.00 MB/sec execute 15 sec latency 23786.675 ms 1 485 0.00 MB/sec execute 16 sec latency 24786.935 ms 1 485 0.00 MB/sec execute 17 sec latency 25787.182 ms 1 485 0.00 MB/sec execute 18 sec latency 26788.686 ms 1 485 0.00 MB/sec execute 19 sec latency 27791.736 ms 1 485 0.00 MB/sec execute 20 sec latency 28792.136 ms 1 485 0.00 MB/sec execute 21 sec latency 29796.427 ms oleg218-server: oleg218-server.virtnet: executing set_default_debug -1 all 8 1 485 0.00 MB/sec execute 22 sec latency 30796.561 ms 1 485 0.00 MB/sec execute 23 sec latency 31797.075 ms pdsh@oleg218-client: oleg218-server: ssh exited with exit code 1 1 511 0.03 MB/sec execute 24 sec latency 32108.625 ms Started lustre-MDT0000 1 598 0.16 MB/sec execute 25 sec latency 125.404 ms 1 664 0.16 MB/sec execute 26 sec latency 95.239 ms 1 701 0.16 MB/sec execute 27 sec latency 216.256 ms 1 726 0.16 MB/sec execute 28 sec latency 320.722 ms 1 747 0.15 MB/sec execute 29 sec latency 179.739 ms 1 786 0.15 MB/sec execute 30 sec latency 136.056 ms oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1 801 0.15 MB/sec execute 31 sec latency 267.849 ms 1 853 0.14 MB/sec execute 32 sec latency 129.494 ms mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 1 888 0.14 MB/sec execute 33 sec latency 193.739 ms 1 914 0.14 MB/sec execute 34 sec latency 198.493 ms 1 952 0.14 MB/sec execute 35 sec latency 150.120 ms 1 985 0.14 MB/sec execute 36 sec latency 141.164 ms 1 1045 0.16 MB/sec execute 37 sec latency 107.980 ms 1 1095 0.16 MB/sec execute 38 sec latency 77.833 ms UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210560 4992 2203520 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 44032 3706880 2% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 31744 3722240 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 75776 7429120 2% /mnt/lustre 1 1154 0.16 MB/sec execute 39 sec latency 91.091 ms 1 1198 0.15 MB/sec execute 40 sec latency 93.288 ms 1 1244 0.15 MB/sec execute 41 sec latency 97.400 ms 1 1274 0.15 MB/sec execute 42 sec latency 149.673 ms 1 1403 0.21 MB/sec execute 43 sec latency 123.417 ms 1 1451 0.21 MB/sec execute 44 sec latency 87.402 ms test_26 fail mds1 4 times 1 1502 0.20 MB/sec execute 45 sec latency 247.408 ms 1 1538 0.20 MB/sec execute 46 sec latency 113.174 ms Failing mds1 on oleg218-server 1 1572 0.20 MB/sec execute 47 sec latency 106.773 ms 1 1609 0.19 MB/sec execute 48 sec latency 85.740 ms Stopping /mnt/lustre-mds1 (opts:) on oleg218-server 1 1642 0.19 MB/sec execute 49 sec latency 317.646 ms 1 1659 0.18 MB/sec execute 50 sec latency 436.943 ms 1 1659 0.18 MB/sec execute 51 sec latency 1437.423 ms 1 1659 0.18 MB/sec execute 52 sec latency 2437.622 ms reboot facets: mds1 1 1659 0.17 MB/sec execute 53 sec latency 3437.817 ms 1 1659 0.17 MB/sec execute 54 sec latency 4438.064 ms 1 1659 0.17 MB/sec execute 55 sec latency 5439.163 ms 1 1659 0.17 MB/sec execute 56 sec latency 6460.001 ms 1 1659 0.16 MB/sec execute 57 sec latency 7462.154 ms 1 1659 0.16 MB/sec execute 58 sec latency 8483.913 ms 1 1659 0.16 MB/sec execute 59 sec latency 9484.388 ms 1 1659 0.15 MB/sec execute 60 sec latency 10484.683 ms 1 1659 0.15 MB/sec execute 61 sec latency 11484.987 ms 1 1659 0.15 MB/sec execute 62 sec latency 12485.292 ms Failover mds1 to oleg218-server 1 1659 0.15 MB/sec execute 63 sec latency 13485.764 ms 1 1659 0.14 MB/sec execute 64 sec latency 14486.231 ms 1 1659 0.14 MB/sec execute 65 sec latency 15486.425 ms mount facets: mds1 1 1659 0.14 MB/sec execute 66 sec latency 16491.286 ms 1 1659 0.14 MB/sec execute 67 sec latency 17491.611 ms 1 1659 0.14 MB/sec execute 68 sec latency 18491.820 ms 1 1659 0.13 MB/sec execute 69 sec latency 19493.829 ms 1 1659 0.13 MB/sec execute 70 sec latency 20495.018 ms Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 1 1659 0.13 MB/sec execute 71 sec latency 21495.381 ms 1 1659 0.13 MB/sec execute 72 sec latency 22495.588 ms 1 1659 0.13 MB/sec execute 73 sec latency 23496.174 ms 1 1659 0.12 MB/sec execute 74 sec latency 24497.013 ms 1 1659 0.12 MB/sec execute 75 sec latency 25498.041 ms 1 1659 0.12 MB/sec execute 76 sec latency 26498.289 ms 1 1659 0.12 MB/sec execute 77 sec latency 27498.490 ms 1 1659 0.12 MB/sec execute 78 sec latency 28498.722 ms 1 1659 0.12 MB/sec execute 79 sec latency 29502.766 ms 1 1659 0.12 MB/sec execute 80 sec latency 30502.921 ms 1 1659 0.11 MB/sec execute 81 sec latency 31508.906 ms 1 1659 0.11 MB/sec execute 82 sec latency 32511.334 ms 1 1669 0.11 MB/sec execute 83 sec latency 32886.043 ms 1 1689 0.11 MB/sec execute 84 sec latency 192.451 ms oleg218-server: oleg218-server.virtnet: executing set_default_debug -1 all 8 1 1721 0.11 MB/sec execute 85 sec latency 214.075 ms pdsh@oleg218-client: oleg218-server: ssh exited with exit code 1 1 1785 0.11 MB/sec execute 86 sec latency 77.969 ms 1 1830 0.11 MB/sec execute 87 sec latency 127.650 ms Started lustre-MDT0000 1 1871 0.11 MB/sec execute 88 sec latency 136.023 ms 1 1894 0.11 MB/sec execute 89 sec latency 384.346 ms 1 1943 0.11 MB/sec execute 90 sec latency 143.656 ms 1 1982 0.10 MB/sec execute 91 sec latency 181.903 ms 1 2014 0.10 MB/sec execute 92 sec latency 94.863 ms 1 2068 0.10 MB/sec execute 93 sec latency 132.479 ms 1 2108 0.10 MB/sec execute 94 sec latency 156.131 ms 1 2154 0.10 MB/sec execute 95 sec latency 139.651 ms 1 2181 0.10 MB/sec execute 96 sec latency 119.157 ms oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1 2226 0.10 MB/sec execute 97 sec latency 143.002 ms 1 2291 0.11 MB/sec execute 98 sec latency 107.593 ms mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 1 2345 0.11 MB/sec execute 99 sec latency 101.908 ms 1 cleanup 100 sec 1 cleanup 101 sec 1 cleanup 102 sec 1 cleanup 103 sec 0 cleanup 104 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 331 161.277 32108.609 Close 286 131.895 32886.016 Rename 12 71.691 192.426 Unlink 31 27.567 63.057 Qpathinfo 311 15.957 133.974 Qfileinfo 75 1.943 47.524 Qfsinfo 38 4.005 22.920 Sfileinfo 39 40.041 149.658 Find 105 6.344 50.933 WriteX 253 10.786 86.014 ReadX 379 2.056 143.627 Flush 32 162.985 384.329 Throughput 0.110309 MB/sec 1 clients 1 procs max_latency=32886.043 ms stopping dbench on /mnt/lustre at Tue Apr 14 14:18:26 EDT 2026 with return code 0 clean dbench files on /mnt/lustre /mnt/lustre /mnt/lustre removed 'client.txt' /mnt/lustre dbench successfully finished looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 1 -D /mnt/lustre2/d26.replay-dual/run_dbench -t 100' on /mnt/lustre at Tue Apr 14 14:18:33 EDT 2026 waiting for dbench pid 49422 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 100 seconds with load 'client.txt' and minimum warmup 20 secs 0 of 1 processes prepared for launch 0 sec 1 of 1 processes prepared for launch 0 sec releasing clients 1 31 1.05 MB/sec warmup 1 sec latency 107.438 ms 1 102 2.36 MB/sec warmup 2 sec latency 118.216 ms 1 139 2.00 MB/sec warmup 3 sec latency 145.160 ms 1 181 1.83 MB/sec warmup 4 sec latency 111.126 ms 1 215 1.67 MB/sec warmup 5 sec latency 167.236 ms 1 256 1.61 MB/sec warmup 6 sec latency 165.500 ms 1 305 1.60 MB/sec warmup 7 sec latency 105.563 ms 1 344 1.53 MB/sec warmup 8 sec latency 95.932 ms 1 389 1.53 MB/sec warmup 9 sec latency 110.879 ms 1 429 1.51 MB/sec warmup 10 sec latency 132.760 ms 1 477 1.51 MB/sec warmup 11 sec latency 102.201 ms 1 517 1.48 MB/sec warmup 12 sec latency 121.755 ms 1 642 1.62 MB/sec warmup 13 sec latency 118.992 ms 1 671 1.51 MB/sec warmup 14 sec latency 434.108 ms 1 710 1.41 MB/sec warmup 15 sec latency 112.118 ms dbench killed by signal 15 stopping dbench on /mnt/lustre at Tue Apr 14 14:18:48 EDT 2026 with return code 0 49422 pts/0 S+ 0:00 dbench -c client.txt 1 -D /mnt/lustre2/d26.replay-dual/run_dbench -t 100 killed dbench main pid 49422 clean dbench files on /mnt/lustre /mnt/lustre /mnt/lustre removed 'client.txt' /mnt/lustre dbench successfully finished