== replay-single test 70b: dbench 2mdts recovery; 1 clients ========================================================== 18:49:43 (1787611783) Starting client oleg602-client.virtnet: -o user_xattr,flock 192.168.206.102@tcp:/lustre /mnt/lustre Started clients oleg602-client.virtnet: 192.168.206.102@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) striped dir -i0 -c2 -H all_char /mnt/lustre/d70b.replay-single + MISSING_DBENCH_OK= + PATH=/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin::/home/green/git/lustre-release/lustre/utils:/home/green/git/lustre-release/lustre/tests:/sbin:/usr/sbin:/home/green/git/lustre-release/lustre/utils:/home/green/git/lustre-release/lustre/tests/: + DBENCH_LIB= + TESTSUITE=replay-single + TESTNAME=test_70b + MOUNT=/mnt/lustre ++ hostname + DIR=/mnt/lustre/d70b.replay-single/oleg602-client.virtnet + LCTL=/home/green/git/lustre-release/lustre/utils/lctl + rundbench 1 -t 120 dbench: no process found dbench: no process found dbench: no process found Started rundbench load pid=131510 ... UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210304 2688 2205568 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 2210688 2304 2206336 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3771392 31744 3722240 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3731456 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 33792 7453696 1% /mnt/lustre test_70b fail mds1 1 times Failing mds1 on oleg602-server Stopping /mnt/lustre-mds1 (opts:) on oleg602-server 18:50:04 (1787611804) shut down facet: mds1 facet_host: oleg602-server facet_failover_host: oleg602-server Failover mds1 to oleg602-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg602-client.virtnet: looking for dbench program oleg602-client.virtnet: /usr/bin/dbench oleg602-client.virtnet: creating output directory /mnt/lustre/d70b.replay-single/oleg602-client.virtnet oleg602-client.virtnet: mkdir: created directory '/mnt/lustre/d70b.replay-single/oleg602-client.virtnet' oleg602-client.virtnet: found dbench client file /usr/share/dbench/client.txt oleg602-client.virtnet: '/usr/share/dbench/client.txt' -> 'client.txt' oleg602-client.virtnet: running 'dbench 1 -t 120' on /mnt/lustre/d70b.replay-single/oleg602-client.virtnet at Mon Aug 24 18:49:47 EDT 2026 oleg602-client.virtnet: waiting for dbench pid 131548 oleg602-client.virtnet: dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 oleg602-client.virtnet: oleg602-client.virtnet: Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs oleg602-client.virtnet: failed to create barrier semaphore oleg602-client.virtnet: 0 of 1 processes prepared for launch 0 sec oleg602-client.virtnet: 1 of 1 processes prepared for launch 0 sec oleg602-client.virtnet: releasing clients oleg602-client.virtnet: 1 34 1.05 MB/sec warmup 1 sec latency 143.847 ms oleg602-client.virtnet: 1 126 2.81 MB/sec warmup 2 sec latency 164.310 ms oleg602-client.virtnet: 1 182 2.44 MB/sec warmup 3 sec latency 114.128 ms oleg602-client.virtnet: 1 305 2.80 MB/sec warmup 4 sec latency 41.611 ms oleg602-client.virtnet: 1 374 2.66 MB/sec warmup 5 sec latency 88.644 ms oleg602-client.virtnet: 1 453 2.65 MB/sec warmup 6 sec latency 98.840 ms oleg602-client.virtnet: 1 527 2.59 MB/sec warmup 7 sec latency 67.592 ms oleg602-client.virtnet: 1 664 2.64 MB/sec warmup 8 sec latency 237.999 ms oleg602-client.virtnet: 1 726 2.36 MB/sec warmup 9 sec latency 260.729 ms oleg602-client.virtnet: 1 778 2.13 MB/sec warmup 10 sec latency 134.075 ms oleg602-client.virtnet: 1 803 1.95 MB/sec warmup 11 sec latency 156.488 ms oleg602-client.virtnet: 1 873 1.80 MB/sec warmup 12 sec latency 234.487 ms oleg602-client.virtnet: 1 913 1.67 MB/sec warmup 13 sec latency 258.328 ms oleg602-client.virtnet: 1 959 1.56 MB/sec warmup 14 sec latency 201.603 ms oleg602-client.virtnet: 1 985 1.46 MB/sec warmup 15 sec latency 257.713 ms oleg602-client.virtnet: 1 1084 1.43 MB/sec warmup 16 sec latency 89.390 ms oleg602-client.virtnet: 1 1156 1.35 MB/sec warmup 17 sec latency 73.314 ms oleg602-client.virtnet: 1 1242 1.28 MB/sec warmup 18 sec latency 47.035 ms oleg602-client.virtnet: 1 1405 1.37 MB/sec warmup 19 sec latency 75.629 ms oleg602-client.virtnet: 1 1497 1.30 MB/sec warmup 20 sec latency 222.933 ms oleg602-client.virtnet: 1 1609 1.24 MB/sec warmup 21 sec latency 69.142 ms oleg602-client.virtnet: 1 1684 1.19 MB/sec warmup 22 sec latency 125.809 ms oleg602-client.virtnet: 1 1795 1.14 MB/sec warmup 23 sec latency 67.947 ms oleg602-client.virtnet: 1 2008 0.14 MB/sec execute 1 sec latency 142.668 ms oleg602-client.virtnet: 1 2145 0.15 MB/sec execute 2 sec latency 58.502 ms oleg602-client.virtnet: 1 2226 0.14 MB/sec execute 3 sec latency 88.221 ms oleg602-client.virtnet: 1 2356 0.38 MB/sec execute 4 sec latency 142.404 ms oleg602-client.virtnet: 1 2416 0.34 MB/sec execute 5 sec latency 126.522 ms oleg602-client.virtnet: 1 2477 0.39 MB/sec execute 6 sec latency 215.397 ms oleg602-client.virtnet: 1 2566 0.36 MB/sec execute 7 sec latency 200.549 ms oleg602-client.virtnet: 1 2633 0.38 MB/sec execute 8 sec latency 170.813 ms oleg602-client.virtnet: 1 2922 0.79 MB/sec execute 9 sec latency 102.294 ms oleg602-client.virtnet: 1 3176 0.77 MB/sec execute 10 sec latency 98.838 ms oleg602-coleg602-server: oleg602-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg602-client: oleg602-server: ssh exited with exit code 1 Started lustre-MDT0000 18:50:35 (1787611835) targets are mounted 18:50:35 (1787611835) facet_failover done oleg602-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210304 2688 2205568 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 2210688 2432 2206208 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3771392 38912 3721216 2% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 13312 3740672 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 52224 7461888 1% /mnt/lustre test_70b fail mds2 2 times Failing mds2 on oleg602-server Stopping /mnt/lustre-mds2 (opts:) on oleg602-server 18:51:00 (1787611860) shut down facet: mds2 facet_host: oleg602-server facet_failover_host: oleg602-server lient.virtnet: 1 3297 0.81 MB/sec execute 11 sec latency 101.596 ms oleg602-client.virtnet: 1 3516 1.00 MB/sec execute 12 sec latency 138.040 ms oleg602-client.virtnet: 1 3663 0.95 MB/sec execute 13 sec latency 42.792 ms oleg602-client.virtnet: 1 3792 0.96 MB/sec execute 14 sec latency 47.726 ms oleg602-client.virtnet: 1 3907 0.91 MB/sec execute 15 sec latency 53.586 ms oleg602-client.virtnet: 1 3979 0.85 MB/sec execute 16 sec latency 88.334 ms oleg602-client.virtnet: 1 4073 0.80 MB/sec execute 17 sec latency 55.111 ms oleg602-client.virtnet: 1 4214 0.77 MB/sec execute 18 sec latency 43.445 ms oleg602-client.virtnet: 1 4273 0.73 MB/sec execute 19 sec latency 169.180 ms oleg602-client.virtnet: 1 4302 0.70 MB/sec execute 20 sec latency 302.664 ms oleg602-client.virtnet: 1 4302 0.67 MB/sec execute 21 sec latency 1304.063 ms oleg602-client.virtnet: 1 4302 0.64 MB/sec execute 22 sec latency 2309.955 ms oleg602-client.virtnet: 1 4302 0.61 MB/sec execute 23 sec latency 3310.160 ms oleg602-client.virtnet: 1 4340 0.59 MB/sec execute 24 sec latency 3805.693 ms oleg602-client.virtnet: 1 4386 0.57 MB/sec execute 25 sec latency 139.282 ms oleg602-client.virtnet: 1 4462 0.55 MB/sec execute 26 sec latency 166.423 ms oleg602-client.virtnet: 1 4524 0.54 MB/sec execute 27 sec latency 94.226 ms oleg602-client.virtnet: 1 4610 0.56 MB/sec execute 28 sec latency 108.554 ms oleg602-client.virtnet: 1 4724 0.54 MB/sec execute 29 sec latency 49.855 ms oleg602-client.virtnet: 1 4810 0.53 MB/sec execute 30 sec latency 52.566 ms oleg602-client.virtnet: 1 4953 0.60 MB/sec execute 31 sec latency 161.660 ms oleg602-client.virtnet: 1 5017 0.59 MB/sec execute 32 sec latency 72.224 ms oleg602-client.virtnet: 1 5078 0.57 MB/sec execute 33 sec latency 170.533 ms oleg602-client.virtnet: 1 5162 0.56 MB/sec execute 34 sec latency 70.113 ms oleg602-client.virtnet: 1 5218 0.54 MB/sec execute 35 sec latency 173.987 ms oleg602-client.virtnet: 1 5286 0.53 MB/sec execute 36 sec latency 83.709 ms oleg602-client.virtnet: 1 5356 0.51 MB/sec execute 37 sec latency 61.517 ms oleg602-client.virtnet: 1 5414 0.50 MB/sec execute 38 sec latency 79.164 ms oleg602-client.virtnet: 1 5515 0.49 MB/sec execute 39 sec latency 107.926 ms oleg602-client.virtnet: 1 5571 0.48 MB/sec execute 40 sec latency 103.535 ms oleg602-client.virtnet: 1 5645 0.47 MB/sec execute 41 sec latency 105.315 ms oleg602-client.virtnet: 1 5724 0.46 MB/sec execute 42 sec latency 82.124 ms oleg602-client.virtnet: 1 5787 0.45 MB/sec execute 43 sec latency 99.181 ms oleg602-client.virtnet: 1 5905 0.47 MB/sec execute 44 sec latency 96.176 ms oleg602-client.virtnet: 1 5947 0.46 MB/sec execute 45 sec latency 160.214 ms oleg602-client.virtnet: 1 5978 0.45 MB/sec execute 46 sec latency 184.617 ms oleg602-client.virtnet: 1 5978 0.44 MB/sec execute 47 sec latency 1184.998 ms oleg602-client.virtnet: 1 5978 0.43 MB/sec execute 48 sec latency 2185.734 ms oleg602-client.virtnet: 1 5978 0.42 MB/sec execute 49 sec latency 3187.482 ms oleg602-client.virtnet: 1 5978 0.42 MB/sec execute 50 sec latency 4190.890 ms oleg602-client.virtnet: 1 5978 0.41 MB/sec execute 51 sec latency 5191.724 ms oleg602-client.virtnet: 1 5978 0.40 MB/sec execute 52 sec latency 6191.939 ms oleg602-client.virtnet: 1 5978 0.39 MB/sec execute 53 sec latency 7193.016 ms oleg602-client.virtnet: 1 5978 0.39 MB/sec execute 54 sec latency 8193.261 ms oleg602-client.virtnet: 1 5978 0.38 MB/sec executFailover mds2 to oleg602-server mount facets: mds2 Start mds2: mount -t lustre -o localrecov lustre-mdt2/mdt2 /mnt/lustre-mds2 oleg602-server: oleg602-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg602-client: oleg602-server: ssh exited with exit code 1 Started lustre-MDT0001 18:51:24 (1787611884) targets are mounted 18:51:24 (1787611884) facet_failover done oleg602-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210304 2688 2205568 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 2210688 2432 2206208 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3771392 39936 3716096 2% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 13312 3751936 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 53248 7468032 1% /mnt/lustre test_70b fail mds1 3 times Failing mds1 on oleg602-server Stopping /mnt/lustre-mds1 (opts:) on oleg602-server 18:51:47 (1787611907) shut down facet: mds1 facet_host: oleg602-server facet_failover_host: oleg602-server e 55 sec latency 9193.565 ms oleg602-client.virtnet: 1 5978 0.37 MB/sec execute 56 sec latency 10193.843 ms oleg602-client.virtnet: 1 5978 0.37 MB/sec execute 57 sec latency 11194.126 ms oleg602-client.virtnet: 1 5978 0.36 MB/sec execute 58 sec latency 12194.340 ms oleg602-client.virtnet: 1 5978 0.35 MB/sec execute 59 sec latency 13195.092 ms oleg602-client.virtnet: 1 5978 0.35 MB/sec execute 60 sec latency 14198.191 ms oleg602-client.virtnet: 1 5978 0.34 MB/sec execute 61 sec latency 15200.383 ms oleg602-client.virtnet: 1 5978 0.34 MB/sec execute 62 sec latency 16200.570 ms oleg602-client.virtnet: 1 5978 0.33 MB/sec execute 63 sec latency 17201.010 ms oleg602-client.virtnet: 1 5978 0.33 MB/sec execute 64 sec latency 18201.201 ms oleg602-client.virtnet: 1 5978 0.32 MB/sec execute 65 sec latency 19203.196 ms oleg602-client.virtnet: 1 5978 0.32 MB/sec execute 66 sec latency 20205.090 ms oleg602-client.virtnet: 1 5978 0.31 MB/sec execute 67 sec latency 21205.463 ms oleg602-client.virtnet: 1 5978 0.31 MB/sec execute 68 sec latency 22205.673 ms oleg602-client.virtnet: 1 5978 0.30 MB/sec execute 69 sec latency 23208.194 ms oleg602-client.virtnet: 1 5978 0.30 MB/sec execute 70 sec latency 24208.510 ms oleg602-client.virtnet: 1 5978 0.29 MB/sec execute 71 sec latency 25209.268 ms oleg602-client.virtnet: 1 6037 0.30 MB/sec execute 72 sec latency 25211.719 ms oleg602-client.virtnet: 1 6134 0.30 MB/sec execute 73 sec latency 148.768 ms oleg602-client.virtnet: 1 6332 0.33 MB/sec execute 74 sec latency 186.516 ms oleg602-client.virtnet: 1 6487 0.35 MB/sec execute 75 sec latency 150.400 ms oleg602-client.virtnet: 1 6565 0.35 MB/sec execute 76 sec latency 224.674 ms oleg602-client.virtnet: 1 6797 0.35 MB/sec execute 77 sec latency 100.534 ms oleg602-client.virtnet: 1 6921 0.36 MB/sec execute 78 sec latency 94.203 ms oleg602-client.virtnet: 1 7092 0.39 MB/sec execute 79 sec latency 65.540 ms oleg602-client.virtnet: 1 7185 0.39 MB/sec execute 80 sec latency 64.134 ms oleg602-client.virtnet: 1 7247 0.39 MB/sec execute 81 sec latency 70.999 ms oleg602-client.virtnet: 1 7336 0.40 MB/sec execute 82 sec latency 83.164 ms oleg602-client.virtnet: 1 7405 0.39 MB/sec execute 83 sec latency 102.319 ms oleg602-client.virtnet: 1 7488 0.39 MB/sec execute 84 sec latency 69.648 ms oleg602-client.virtnet: 1 7588 0.39 MB/sec execute 85 sec latency 69.253 ms oleg602-client.virtnet: 1 7678 0.38 MB/sec execute 86 sec latency 55.923 ms oleg602-client.virtnet: 1 7775 0.38 MB/sec execute 87 sec latency 116.864 ms oleg602-client.virtnet: 1 7802 0.38 MB/sec execute 88 sec latency 324.284 ms oleg602-client.virtnet: 1 7846 0.37 MB/sec execute 89 sec latency 153.200 ms oleg602-client.virtnet: 1 7904 0.37 MB/sec execute 90 sec latency 288.110 ms oleg602-client.virtnet: 1 7960 0.37 MB/sec execute 91 sec latency 98.079 ms oleg602-client.virtnet: 1 8010 0.36 MB/sec execute 92 sec latency 169.486 ms oleg602-client.virtnet: 1 8071 0.36 MB/sec execute 93 sec latency 155.143 ms oleg602-client.virtnet: 1 8148 0.37 MB/sec execute 94 sec latency 150.031 ms oleg602-client.virtnet: 1 8265 0.37 MB/sec execute 95 sec latency 48.277 ms oleg602-client.virtnet: 1 8354 0.36 MB/sec execute 96 sec latency 57.347 ms oleg602-client.virtnet: 1 8540 0.39 MB/sec execute 97 sec latency 44.088 ms oleg602-client.virtnet: 1 8621 0.39 MB/sec execute 98 sec latency 155.865 ms oleg602-client.virtnet: 1 8705 0.38 MB/sec execute 99 sec latency 62.613Failover mds1 to oleg602-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg602-server: oleg602-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg602-client: oleg602-server: ssh exited with exit code 1 Started lustre-MDT0000 18:52:09 (1787611929) targets are mounted 18:52:10 (1787611930) facet_failover done ms oleg602-client.virtnet: 1 8797 0.38 MB/sec execute 100 sec latency 106.624 ms oleg602-client.virtnet: 1 8883 0.38 MB/sec execute 101 sec latency 57.614 ms oleg602-client.virtnet: 1 8963 0.37 MB/sec execute 102 sec latency 59.558 ms oleg602-client.virtnet: 1 9087 0.37 MB/sec execute 103 sec latency 137.546 ms oleg602-client.virtnet: 1 9169 0.37 MB/sec execute 104 sec latency 58.335 ms oleg602-client.virtnet: 1 9276 0.37 MB/sec execute 105 sec latency 54.608 ms oleg602-client.virtnet: 1 9438 0.37 MB/sec execute 106 sec latency 105.416 ms oleg602-client.virtnet: 1 9488 0.37 MB/sec execute 107 sec latency 187.954 ms oleg602-client.virtnet: 1 9556 0.37 MB/sec execute 108 sec latency 166.703 ms oleg602-client.virtnet: 1 9664 0.37 MB/sec execute 109 sec latency 200.412 ms oleg602-client.virtnet: 1 9861 0.40 MB/sec execute 110 sec latency 72.817 ms oleg602-client.virtnet: 1 10021 0.41 MB/sec execute 111 sec latency 119.952 ms oleg602-client.virtnet: 1 10112 0.40 MB/sec execute 112 sec latency 134.846 ms oleg602-client.virtnet: 1 10112 0.40 MB/sec execute 113 sec latency 1060.889 ms oleg602-client.virtnet: 1 10112 0.40 MB/sec execute 114 sec latency 2062.261 ms oleg602-client.virtnet: 1 10112 0.39 MB/sec execute 115 sec latency 3064.753 ms oleg602-client.virtnet: 1 10112 0.39 MB/sec execute 116 sec latency 4064.904 ms oleg602-client.virtnet: 1 10112 0.39 MB/sec execute 117 sec latency 5065.238 ms oleg602-client.virtnet: 1 10345 0.39 MB/sec execute 118 sec latency 5105.453 ms oleg602-client.virtnet: 1 10488 0.40 MB/sec execute 119 sec latency 97.090 ms oleg602-client.virtnet: 1 cleanup 120 sec oleg602-client.virtnet: 1 cleanup 121 sec oleg602-client.virtnet: 0 cleanup 122 sec oleg602-client.virtnet: oleg602-client.virtnet: Operation Count AvgLat MaxLat oleg602-client.virtnet: ---------------------------------------- oleg602-client.virtnet: NTCreateX 1426 32.702 5105.338 oleg602-client.virtnet: Close 1079 6.803 38.095 oleg602-client.virtnet: Rename 63 43.942 105.579 oleg602-client.virtnet: Unlink 281 11.467 33.311 oleg602-client.virtnet: Qpathinfo 1367 7.800 170.786 oleg602-client.virtnet: Qfileinfo 247 0.690 8.362 oleg602-client.virtnet: Qfsinfo 257 1.319 47.681 oleg602-client.virtnet: Sfileinfo 116 281.015 25211.694 oleg602-client.virtnet: Find 547 1.943 46.483 oleg602-client.virtnet: WriteX 754 4.947 55.080 oleg602-client.virtnet: ReadX 2537 0.049 14.452 oleg602-client.virtnet: LockX 6 7.434 12.505 oleg602-client.virtnet: UnlockX 6 10.039 18.767 oleg602-client.virtnet: Flush 100 110.331 324.263 oleg602-client.virtnet: oleg602-client.virtnet: Throughput 0.397396 MB/sec 1 clients 1 procs max_latency=25211.719 ms oleg602-client.virtnet: stopping dbench on /mnt/lustre/d70b.replay-single/oleg602-client.virtnet at Mon Aug 24 18:52:13 EDT 2026 with return code 0 oleg602-client.virtnet: clean dbench files on /mnt/lustre/d70b.replay-single/oleg602-client.virtnet oleg602-client.virtnet: /mnt/lustre/d70b.replay-single/oleg602-client.virtnet /mnt/lustre/d70b.replay-single/oleg602-client.virtnet oleg602-client.virtnet: removed directory 'clients/client0/~dmtmp/WORDPRO' oleg602-client.virtnet: removed directory 'clients/client0/~dmtmp/PWRPNT' oleg602-client.virtnet: removed directory 'clients/client0/~dmtmp/COREL' oleg602-client.virtnet: removed directory 'clients/client0/~dmtmp/PM' oleg602-client.virtnet: removed directory 'clients/client0/~dmtmp/PARADOX' oleg602-client.virtnet: removed directory 'clients/client0/~dmtmp/WORD' oleg602-client.virtnet: removed directory 'clients/client0/~dmtmp/SEED' oleg602-client.virtnet: removed directory 'clients/client0/~dmtmp/ACCESS' oleg602-client.virtnet: removed directory 'clients/client0/~dmtmp/EXCEL' oleg602-client.virtnet: removed directory 'clients/client0/~dmtmp' oleg602-client.virtnet: removed directory 'clients/client0' oleg602-client.virtnet: removed directory 'clients' oleg602-client.virtnet: removed 'client.txt' oleg602-client.virtnet: /mnt/lustre/d70b.replay-single/oleg602-client.virtnet oleg602-client.virtnet: dbench successfully finished oleg602-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec