== replay-single test 70c: tar 2mdts recovery ============ 17:44:25 (1746135865) Starting client oleg302-client.virtnet: -o user_xattr,flock 192.168.203.102@tcp:/lustre /mnt/lustre Started clients oleg302-client.virtnet: 192.168.203.102@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Started tar 26230 striped dir -i0 -c2 -H crush2 /mnt/lustre/d70c.replay-single tar: Removing leading `/' from member names tar: Removing leading `/' from hard link targets tar: Removing leading `/' from member names tar: Removing leading `/' from hard link targets UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 6432 1281256 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 4172 1283516 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 13276 3585284 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 20456 3578224 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 33732 7163508 1% /mnt/lustre test_70c fail mds2 1 times Failing mds2 on oleg302-server Stopping /mnt/lustre-mds2 (opts:) on oleg302-server 17:46:40 (1746136000) shut down facet: mds2 facet_host: oleg302-server facet_failover_host: oleg302-server Failover mds2 to oleg302-server mount facets: mds2 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg302-server: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg302-client: oleg302-server: ssh exited with exit code 1 Started lustre-MDT0001 17:46:57 (1746136017) targets are mounted 17:46:57 (1746136017) facet_failover done oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec tar: Removing leading `/' from member names tar: Removing leading `/' from hard link targets tar: Removing leading `/' from member names tar: Removing leading `/' from hard link targets UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 6588 1281100 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 4192 1283496 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 18848 3578288 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 11476 3588068 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 30324 7166356 1% /mnt/lustre test_70c fail mds2 2 times Failing mds2 on oleg302-server Stopping /mnt/lustre-mds2 (opts:) on oleg302-server 17:49:20 (1746136160) shut down facet: mds2 facet_host: oleg302-server facet_failover_host: oleg302-server Failover mds2 to oleg302-server mount facets: mds2 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg302-server: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg302-client: oleg302-server: ssh exited with exit code 1 Started lustre-MDT0001 17:49:37 (1746136177) targets are mounted 17:49:37 (1746136177) facet_failover done oleg302-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec