== recovery-small test 170: Reconnect after REPLAY_LOCKS hangs (LU-18154) ========================================================== 10:10:02 (1789308602)
UUID                   1K-blocks        Used   Available Use% Mounted on 
lustre-MDT0000_UUID      2210304        6528     2201728   1% /mnt/lustre[MDT:0] 
lustre-OST0000_UUID      3771392        4096     3763200   1% /mnt/lustre[OST:0] 
lustre-OST0001_UUID      3771392        3072     3766272   1% /mnt/lustre[OST:1] 

filesystem_summary:      7542784        7168     7529472   1% /mnt/lustre 

1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00488967 s, 838 kB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0043063 s, 951 kB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00390116 s, 1.0 MB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00768889 s, 533 kB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00375443 s, 1.1 MB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00381988 s, 1.1 MB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00425651 s, 962 kB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00411959 s, 994 kB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00362721 s, 1.1 MB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00869325 s, 471 kB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00459499 s, 891 kB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00414142 s, 989 kB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00393241 s, 1.0 MB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00377784 s, 1.1 MB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00433029 s, 946 kB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00568023 s, 721 kB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00459984 s, 890 kB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0039124 s, 1.0 MB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00386892 s, 1.1 MB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00372684 s, 1.1 MB/s
fail_loc=0x0000537
fail_val=10
fail_loc=0x80000537
Failing ost1 on oleg228-server
Stopping /mnt/lustre-ost1 (opts:) on oleg228-server
10:10:06 (1789308606) shut down
facet: ost1 facet_host: oleg228-server facet_failover_host: oleg228-server
Failover ost1 to oleg228-server
mount facets: ost1
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg228-server: oleg228-server.virtnet: executing set_default_debug -1 all
pdsh@oleg228-client: oleg228-server: ssh exited with exit code 1
Started lustre-OST0000
10:10:20 (1789308620) targets are mounted
10:10:20 (1789308620) facet_failover done
oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 60 0
osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 7 sec
osc.lustre-OST0000-osc-ffff8b6a90be2800.state=
current_state: FULL
state_history:
 - [ 1789308584, CONNECTING ]
 - [ 1789308584, FULL ]
 - [ 1789308607, DISCONN ]
 - [ 1789308607, CONNECTING ]
 - [ 1789308607, DISCONN ]
 - [ 1789308613, CONNECTING ]
 - [ 1789308613, DISCONN ]
 - [ 1789308618, CONNECTING ]
 - [ 1789308618, REPLAY ]
 - [ 1789308619, REPLAY_LOCKS ]
 - [ 1789308629, CONNECTING ]
 - [ 1789308629, REPLAY ]
 - [ 1789308629, REPLAY_LOCKS ]
 - [ 1789308629, REPLAY_WAIT ]
 - [ 1789308629, RECOVER ]
 - [ 1789308629, FULL ]