== replay-single test 70c: tar 2mdts recovery ============ 22:13:11 (1746151991)
Starting client oleg303-client.virtnet:  -o user_xattr,flock 192.168.203.103@tcp:/lustre /mnt/lustre
Started clients oleg303-client.virtnet: 
192.168.203.103@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Started tar 25161
striped dir -i0 -c2 -H crush2 /mnt/lustre/d70c.replay-single
tar: Removing leading `/' from member names
tar: Removing leading `/' from hard link targets
tar: Removing leading `/' from member names
tar: Removing leading `/' from hard link targets
UUID                   1K-blocks        Used   Available Use% Mounted on
lustre-MDT0000_UUID      1414116        6368     1281320   1% /mnt/lustre[MDT:0]
lustre-MDT0001_UUID      1414116        4172     1283516   1% /mnt/lustre[MDT:1]
lustre-OST0000_UUID      3833116       12060     3586944   1% /mnt/lustre[OST:0]
lustre-OST0001_UUID      3833116       17564     3580048   1% /mnt/lustre[OST:1]

filesystem_summary:      7666232       29624     7166992   1% /mnt/lustre

test_70c fail mds1 1 times
Failing mds1 on oleg303-server
Stopping /mnt/lustre-mds1 (opts:) on oleg303-server
22:15:29 (1746152129) shut down
facet: mds1 facet_host: oleg303-server facet_failover_host: oleg303-server
Failover mds1 to oleg303-server
mount facets: mds1
Starting mds1: -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
oleg303-server: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg303-client: oleg303-server: ssh exited with exit code 1
Started lustre-MDT0000
22:15:48 (1746152148) targets are mounted
22:15:48 (1746152148) facet_failover done
oleg303-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
tar: Removing leading `/' from member names
tar: Removing leading `/' from hard link targets
UUID                   1K-blocks        Used   Available Use% Mounted on
lustre-MDT0000_UUID      1414116        6280     1281408   1% /mnt/lustre[MDT:0]
lustre-MDT0001_UUID      1414116        4032     1283656   1% /mnt/lustre[MDT:1]
lustre-OST0000_UUID      3833116       20472     3578820   1% /mnt/lustre[OST:0]
lustre-OST0001_UUID      3833116       13852     3585228   1% /mnt/lustre[OST:1]

filesystem_summary:      7666232       34324     7164048   1% /mnt/lustre

test_70c fail mds1 2 times
Failing mds1 on oleg303-server
Stopping /mnt/lustre-mds1 (opts:) on oleg303-server
22:18:18 (1746152298) shut down
facet: mds1 facet_host: oleg303-server facet_failover_host: oleg303-server
Failover mds1 to oleg303-server
mount facets: mds1
Starting mds1: -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
oleg303-server: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg303-client: oleg303-server: ssh exited with exit code 1
Started lustre-MDT0000
22:18:36 (1746152316) targets are mounted
22:18:36 (1746152316) facet_failover done
oleg303-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec