[ 2064.575255] LustreError: lustre-OST0000-osc-ffff98c32021e000: This client was evicted by lustre-OST0000; in progress operations using this service will fail.
[ 2064.594490] Lustre: 2346:0:(llite_lib.c:4342:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.201.151@tcp:/lustre/fid: [0x200000404:0x35:0x0]// may get corrupted (rc -108)
[ 2072.465390] Lustre: DEBUG MARKER: == recovery-small test 26a: evict dead exports =========== 14:23:30 (1788200610)
[ 2075.470951] Lustre: DEBUG MARKER: SKIP: recovery-small test_26a msg and ost1 are at the same node
[ 2076.928950] Lustre: DEBUG MARKER: == recovery-small test 26b: evict dead exports =========== 14:23:35 (1788200615)
[ 2078.624183] Lustre: DEBUG MARKER: SKIP: recovery-small test_26b msg and ost1 are at the same node
[ 2080.325610] Lustre: DEBUG MARKER: == recovery-small test 27: fail LOV while using OSC's ==== 14:23:39 (1788200619)
[ 2105.823489] LustreError: MGC192.168.201.151@tcp: Connection to MGS (at 192.168.201.151@tcp) was lost; in progress operations using this service will fail
[ 2105.877060] Lustre: Evicted from MGS (at 192.168.201.151@tcp) after server handle changed from 0xb9166fe986766ab to 0xb9166fe98677df7
[ 2107.124504] Lustre: 15949:0:(mgc_request.c:1900:mgc_process_log()) MGC192.168.201.151@tcp: IR log lustre-cliir failed, not fatal: rc = -2
[ 2215.152197] LustreError: lustre-MDT0000-mdc-ffff98c32021e000: operation ldlm_enqueue to node 192.168.201.151@tcp failed: rc = -19
[ 2215.162248] LustreError: Skipped 3 previous similar messages
[ 2232.799247] LustreError: MGC192.168.201.151@tcp: Connection to MGS (at 192.168.201.151@tcp) was lost; in progress operations using this service will fail
[ 2242.994780] Lustre: Evicted from MGS (at 192.168.201.151@tcp) after server handle changed from 0xb9166fe98677df7 to 0xb9166fe98694464
[ 2258.697669] Lustre: DEBUG MARKER: == recovery-small test 28: handle error adding new clients (bug 6086) ========================================================== 14:26:37 (1788200797)
[ 2259.226600] Lustre: *** cfs_fail_loc=305, val=0***
[ 2259.230398] Lustre: Skipped 4 previous similar messages
[ 2297.311290] LustreError: MGC192.168.201.151@tcp: Connection to MGS (at 192.168.201.151@tcp) was lost; in progress operations using this service will fail
[ 2307.630232] Lustre: Evicted from MGS (at 192.168.201.151@tcp) after server handle changed from 0xb9166fe98694464 to 0xb9166fe98695130
[ 2315.475839] Lustre: DEBUG MARKER: oleg151-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
[ 2316.692146] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 2325.420100] Lustre: DEBUG MARKER: == recovery-small test 29a: error adding new clients doesn't cause LBUG (bug 22273) ========================================================== 14:27:44 (1788200864)
[ 2343.417292] LustreError: MGC192.168.201.151@tcp: Connection to MGS (at 192.168.201.151@tcp) was lost; in progress operations using this service will fail
[ 2343.492274] Lustre: Evicted from MGS (at 192.168.201.151@tcp) after server handle changed from 0xb9166fe98695130 to 0xb9166fe98695233
[ 2345.699249] LustreError: lustre-MDT0000-mdc-ffff98c32021e000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 2375.124331] Lustre: DEBUG MARKER: == recovery-small test 29b: error adding new clients doesn't cause LBUG (bug 22273) ========================================================== 14:28:33 (1788200913)
[ 2411.831826] Lustre: DEBUG MARKER: == recovery-small test 50: failover MDS under load ======= 14:29:10 (1788200950)
[ 2427.355758] LustreError: lustre-MDT0000-mdc-ffff98c32021e000: operation mds_close to node 192.168.201.151@tcp failed: rc = -19
[ 2446.815687] LustreError: MGC192.168.201.151@tcp: Connection to MGS (at 192.168.201.151@tcp) was lost; in progress operations using this service will fail
[ 2455.975563] Lustre: Evicted from MGS (at 192.168.201.151@tcp) after server handle changed from 0xb9166fe98695233 to 0xb9166fe98699810
[ 2473.642705] Lustre: DEBUG MARKER: oleg151-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
[ 2475.977604] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 2563.551233] Lustre: 2349:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201087/real 1788201087]  req@ffff98c310c0f480 x1875062201574144/t0(0) o400->MGC192.168.201.151@tcp@192.168.201.151@tcp:26/25 lens 224/224 e 0 to 1 dl 1788201103 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 2563.576357] Lustre: 2349:0:(client.c:2503:ptlrpc_expire_one_request()) Skipped 15 previous similar messages
[ 2563.583862] LustreError: MGC192.168.201.151@tcp: Connection to MGS (at 192.168.201.151@tcp) was lost; in progress operations using this service will fail
[ 2573.806517] Lustre: Evicted from MGS (at 192.168.201.151@tcp) after server handle changed from 0xb9166fe98699810 to 0xb9166fe986b08a8
[ 2594.078230] Lustre: DEBUG MARKER: oleg151-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
[ 2597.490187] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 2663.756648] LustreError: lustre-MDT0000-mdc-ffff98c32021e000: operation ldlm_enqueue to node 192.168.201.151@tcp failed: rc = -19
[ 2663.773017] LustreError: Skipped 4 previous similar messages
[ 2663.779977] Lustre: lustre-MDT0000-mdc-ffff98c32021e000: Connection to lustre-MDT0000 (at 192.168.201.151@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 2663.795077] Lustre: Skipped 10 previous similar messages
[ 2685.154223] LustreError: MGC192.168.201.151@tcp: Connection to MGS (at 192.168.201.151@tcp) was lost; in progress operations using this service will fail
[ 2685.191605] Lustre: Evicted from MGS (at 192.168.201.151@tcp) after server handle changed from 0xb9166fe986b08a8 to 0xb9166fe986c938e
[ 2685.210565] Lustre: MGC192.168.201.151@tcp: Connection restored to 192.168.201.151@tcp (at 192.168.201.151@tcp)
[ 2685.223723] Lustre: Skipped 14 previous similar messages
[ 2686.542909] Lustre: 15949:0:(mgc_request.c:1900:mgc_process_log()) MGC192.168.201.151@tcp: IR log lustre-cliir failed, not fatal: rc = -2
[ 2712.942392] Lustre: DEBUG MARKER: oleg151-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
[ 2715.750538] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 2745.475483] Lustre: DEBUG MARKER: == recovery-small test 51: failover MDS during recovery == 14:34:44 (1788201284)
[ 2772.447731] LustreError: MGC192.168.201.151@tcp: Connection to MGS (at 192.168.201.151@tcp) was lost; in progress operations using this service will fail
[ 2772.465546] Lustre: Evicted from MGS (at 192.168.201.151@tcp) after server handle changed from 0xb9166fe986c938e to 0xb9166fe986d4ef8
[ 2774.331456] Lustre: 15949:0:(mgc_request.c:1900:mgc_process_log()) MGC192.168.201.151@tcp: IR log lustre-cliir failed, not fatal: rc = -2
[ 2787.815572] Lustre: DEBUG MARKER: test_51: failover in 1 sec
[ 2827.921531] Lustre: DEBUG MARKER: test_51: failover in 5 sec
[ 2872.880993] Lustre: DEBUG MARKER: test_51: failover in 10 sec
[ 2903.519432] LustreError: MGC192.168.201.151@tcp: Connection to MGS (at 192.168.201.151@tcp) was lost; in progress operations using this service will fail
[ 2903.532867] LustreError: Skipped 2 previous similar messages
[ 2913.717413] Lustre: Evicted from MGS (at 192.168.201.151@tcp) after server handle changed from 0xb9166fe986d5327 to 0xb9166fe986d69cb
[ 2913.727780] Lustre: Skipped 2 previous similar messages
[ 2926.448396] Lustre: DEBUG MARKER: test_51: failover in 20 sec
[ 2950.381588] LustreError: lustre-MDT0000-mdc-ffff98c32021e000: operation ldlm_enqueue to node 192.168.201.151@tcp failed: rc = -19
[ 2950.392511] LustreError: Skipped 4 previous similar messages
[ 2988.891522] Lustre: DEBUG MARKER: test_51: failover in 25 sec
[ 3046.263342] Lustre: 15949:0:(mgc_request.c:1900:mgc_process_log()) MGC192.168.201.151@tcp: IR log lustre-cliir failed, not fatal: rc = -2
[ 3059.325432] Lustre: DEBUG MARKER: test_51: failover in 30 sec
[ 3147.290506] Lustre: DEBUG MARKER: == recovery-small test 52: failover OST under load ======= 14:41:26 (1788201686)
[ 3166.175155] Lustre: 47418:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201690/real 1788201690]  req@ffff98c3104af800 x1875062205589888/t0(0) o35->lustre-MDT0000-mdc-ffff98c32021e000@192.168.201.151@tcp:23/10 lens 392/624 e 0 to 1 dl 1788201706 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'writemany.0' uid:0 gid:0 projid:0
[ 3166.182982] Lustre: 47418:0:(client.c:2503:ptlrpc_expire_one_request()) Skipped 8 previous similar messages
[ 3170.783335] LustreError: MGC192.168.201.151@tcp: Connection to MGS (at 192.168.201.151@tcp) was lost; in progress operations using this service will fail
[ 3170.786064] LustreError: Skipped 3 previous similar messages
[ 3208.602785] Lustre: DEBUG MARKER: recovery-small test_52: @@@@@@ FAIL: Restart of ost1 failed!