[ 1994.934478] LustreError: lustre-OST0000-osc-ffff993644bc1800: This client was evicted by lustre-OST0000; in progress operations using this service will fail.
[ 1994.952358] Lustre: 2389:0:(llite_lib.c:4158:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.203.144@tcp:/lustre/fid: [0x200000404:0x35:0x0]// may get corrupted (rc -108)
[ 2003.533138] Lustre: DEBUG MARKER: == recovery-small test 26a: evict dead exports =========== 17:19:39 (1773609579)
[ 2006.116689] Lustre: DEBUG MARKER: SKIP: recovery-small test_26a msg and ost1 are at the same node
[ 2007.744746] Lustre: DEBUG MARKER: == recovery-small test 26b: evict dead exports =========== 17:19:44 (1773609584)
[ 2009.516988] Lustre: DEBUG MARKER: SKIP: recovery-small test_26b msg and ost1 are at the same node
[ 2011.341201] Lustre: DEBUG MARKER: == recovery-small test 27: fail LOV while using OSC's ==== 17:19:47 (1773609587)
[ 2035.679977] LustreError: MGC192.168.203.144@tcp: Connection to MGS (at 192.168.203.144@tcp) was lost; in progress operations using this service will fail
[ 2045.934947] Lustre: Evicted from MGS (at 192.168.203.144@tcp) after server handle changed from 0x1dc4d5fc0a869e6d to 0x1dc4d5fc0a86b8bb
[ 2155.728179] LustreError: lustre-MDT0000-mdc-ffff993644bc1800: operation mds_close to node 192.168.203.144@tcp failed: rc = -19
[ 2155.740714] LustreError: Skipped 2 previous similar messages
[ 2173.797710] LustreError: MGC192.168.203.144@tcp: Connection to MGS (at 192.168.203.144@tcp) was lost; in progress operations using this service will fail
[ 2184.045830] Lustre: Evicted from MGS (at 192.168.203.144@tcp) after server handle changed from 0x1dc4d5fc0a86b8bb to 0x1dc4d5fc0a886558
[ 2202.087357] Lustre: DEBUG MARKER: == recovery-small test 28: handle error adding new clients (bug 6086) ========================================================== 17:22:57 (1773609777)
[ 2202.765769] Lustre: *** cfs_fail_loc=305, val=0***
[ 2202.768312] Lustre: Skipped 2 previous similar messages
[ 2244.575394] LustreError: MGC192.168.203.144@tcp: Connection to MGS (at 192.168.203.144@tcp) was lost; in progress operations using this service will fail
[ 2244.614214] Lustre: lustre-MDT0000-mdc-ffff993644bc1800: Connection to lustre-MDT0000 (at 192.168.203.144@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 2244.615941] Lustre: Evicted from MGS (at 192.168.203.144@tcp) after server handle changed from 0x1dc4d5fc0a886558 to 0x1dc4d5fc0a8869c6
[ 2244.638025] Lustre: Skipped 11 previous similar messages
[ 2244.656615] Lustre: MGC192.168.203.144@tcp: Connection restored to 192.168.203.144@tcp (at 192.168.203.144@tcp)
[ 2244.664526] Lustre: Skipped 13 previous similar messages
[ 2257.211947] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 2259.286179] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 2268.166392] Lustre: DEBUG MARKER: == recovery-small test 29a: error adding new clients doesn't cause LBUG (bug 22273) ========================================================== 17:24:04 (1773609844)
[ 2285.551830] LustreError: MGC192.168.203.144@tcp: Connection to MGS (at 192.168.203.144@tcp) was lost; in progress operations using this service will fail
[ 2285.581535] Lustre: Evicted from MGS (at 192.168.203.144@tcp) after server handle changed from 0x1dc4d5fc0a8869c6 to 0x1dc4d5fc0a886fae
[ 2285.629586] LustreError: lustre-MDT0000-mdc-ffff993644bc1800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 2307.469943] Lustre: DEBUG MARKER: == recovery-small test 29b: error adding new clients doesn't cause LBUG (bug 22273) ========================================================== 17:24:43 (1773609883)
[ 2321.390537] LustreError: lustre-OST0000-osc-ffff993644bc1800: This client was evicted by lustre-OST0000; in progress operations using this service will fail.
[ 2343.098864] Lustre: DEBUG MARKER: == recovery-small test 50: failover MDS under load ======= 17:25:19 (1773609919)
[ 2358.106661] LustreError: lustre-MDT0000-mdc-ffff993644bc1800: operation mds_close to node 192.168.203.144@tcp failed: rc = -19
[ 2358.110617] LustreError: Skipped 1 previous similar message
[ 2377.699313] LustreError: MGC192.168.203.144@tcp: Connection to MGS (at 192.168.203.144@tcp) was lost; in progress operations using this service will fail
[ 2387.878599] Lustre: Evicted from MGS (at 192.168.203.144@tcp) after server handle changed from 0x1dc4d5fc0a886fae to 0x1dc4d5fc0a88b45e
[ 2409.756387] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 2413.261230] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 2499.560606] LustreError: MGC192.168.203.144@tcp: Connection to MGS (at 192.168.203.144@tcp) was lost; in progress operations using this service will fail
[ 2499.586263] Lustre: Evicted from MGS (at 192.168.203.144@tcp) after server handle changed from 0x1dc4d5fc0a88b45e to 0x1dc4d5fc0a8a540c
[ 2513.425240] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 2515.928480] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 2582.485133] LustreError: lustre-MDT0000-mdc-ffff993644bc1800: operation mds_reint to node 192.168.203.144@tcp failed: rc = -19
[ 2582.499215] LustreError: Skipped 2 previous similar messages
[ 2601.695705] Lustre: 2392:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1773610163/real 1773610163]  req@ffff993658ef5500 x1859762451717504/t0(0) o400->MGC192.168.203.144@tcp@192.168.203.144@tcp:26/25 lens 224/224 e 0 to 1 dl 1773610179 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 2601.725696] Lustre: 2392:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 13 previous similar messages
[ 2601.735022] LustreError: MGC192.168.203.144@tcp: Connection to MGS (at 192.168.203.144@tcp) was lost; in progress operations using this service will fail
[ 2601.801850] Lustre: Evicted from MGS (at 192.168.203.144@tcp) after server handle changed from 0x1dc4d5fc0a8a540c to 0x1dc4d5fc0a8c1bad
[ 2628.316940] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 2631.425254] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 2666.194782] Lustre: DEBUG MARKER: == recovery-small test 51: failover MDS during recovery == 17:30:41 (1773610241)
[ 2688.991254] LustreError: MGC192.168.203.144@tcp: Connection to MGS (at 192.168.203.144@tcp) was lost; in progress operations using this service will fail
[ 2699.196872] Lustre: Evicted from MGS (at 192.168.203.144@tcp) after server handle changed from 0x1dc4d5fc0a8c1bad to 0x1dc4d5fc0a8ce135
[ 2709.682282] Lustre: DEBUG MARKER: test_51: failover in 1 sec
[ 2750.351446] Lustre: DEBUG MARKER: test_51: failover in 5 sec
[ 2798.579155] Lustre: DEBUG MARKER: test_51: failover in 10 sec
[ 2832.351318] LustreError: MGC192.168.203.144@tcp: Connection to MGS (at 192.168.203.144@tcp) was lost; in progress operations using this service will fail
[ 2832.358655] LustreError: Skipped 2 previous similar messages
[ 2841.540774] Lustre: Evicted from MGS (at 192.168.203.144@tcp) after server handle changed from 0x1dc4d5fc0a8d12ba to 0x1dc4d5fc0a8d6c78
[ 2841.551622] Lustre: Skipped 2 previous similar messages
[ 2850.921848] Lustre: lustre-MDT0000-mdc-ffff993644bc1800: Connection restored to 192.168.203.144@tcp (at 192.168.203.144@tcp)
[ 2850.938826] Lustre: Skipped 17 previous similar messages
[ 2853.011012] Lustre: DEBUG MARKER: test_51: failover in 20 sec
[ 2876.213400] LustreError: lustre-MDT0000-mdc-ffff993644bc1800: operation ldlm_enqueue to node 192.168.203.144@tcp failed: rc = -19
[ 2876.232657] Lustre: lustre-MDT0000-mdc-ffff993644bc1800: Connection to lustre-MDT0000 (at 192.168.203.144@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 2876.232904] LustreError: Skipped 7 previous similar messages
[ 2876.263409] Lustre: Skipped 9 previous similar messages
[ 2913.747065] Lustre: DEBUG MARKER: test_51: failover in 25 sec
[ 2969.785423] Lustre: DEBUG MARKER: test_51: failover in 30 sec
[ 3058.620512] Lustre: DEBUG MARKER: == recovery-small test 52: failover OST under load ======= 17:37:14 (1773610634)
[ 3112.818206] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
[ 3116.086418] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec
[ 3405.282092] LustreError: lustre-OST0000-osc-ffff993644bc1800: operation ldlm_enqueue to node 192.168.203.144@tcp failed: rc = -19
[ 3405.302965] LustreError: Skipped 4 previous similar messages
[ 3446.988516] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
[ 3450.375445] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec
[ 3736.156455] Lustre: lustre-OST0000-osc-ffff993644bc1800: Connection to lustre-OST0000 (at 192.168.203.144@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3736.174346] Lustre: Skipped 4 previous similar messages
[ 3759.115142] Lustre: lustre-OST0000-osc-ffff993644bc1800: Connection restored to 192.168.203.144@tcp (at 192.168.203.144@tcp)
[ 3759.128585] Lustre: Skipped 8 previous similar messages
[ 3774.936845] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
[ 3777.901061] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec
[ 4031.927596] Lustre: DEBUG MARKER: == recovery-small test 53a: touch: drop rep ============== 17:53:28 (1773611608)
[ 4049.375770] Lustre: 50332:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1773611610/real 1773611610]  req@ffff993660691500 x1859762472184704/t0(0) o101->lustre-MDT0000-mdc-ffff993644bc1800@192.168.203.144@tcp:12/10 lens 576/1152 e 0 to 1 dl 1773611626 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'openfile.0' uid:0 gid:0 projid:0
[ 4049.429775] Lustre: 50332:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 5 previous similar messages
[ 4058.174479] Lustre: DEBUG MARKER: == recovery-small test 53b: touch: drop rep ============== 17:53:53 (1773611633)
[ 4085.526990] Lustre: DEBUG MARKER: == recovery-small test 53c: touch: drop rep ============== 17:54:21 (1773611661)
[ 4112.237535] Lustre: DEBUG MARKER: == recovery-small test 54: back in time ================== 17:54:48 (1773611688)
[ 4112.773445] Lustre: Mounted lustre-client
[ 4143.583875] Lustre: 2391:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1773611705/real 1773611705]  req@ffff99364b040700 x1859762472204416/t0(0) o400->lustre-MDT0000-mdc-ffff993644bc1800@192.168.203.144@tcp:12/10 lens 224/224 e 0 to 1 dl 1773611721 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 4143.634599] Lustre: 2391:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[ 4143.661860] LustreError: MGC192.168.203.144@tcp: Connection to MGS (at 192.168.203.144@tcp) was lost; in progress operations using this service will fail
[ 4143.673604] LustreError: Skipped 3 previous similar messages
[ 4153.873991] Lustre: Evicted from MGS (at 192.168.203.144@tcp) after server handle changed from 0x1dc4d5fc0a8f2a9c to 0x1dc4d5fc0aa41a65
[ 4153.886502] Lustre: Skipped 3 previous similar messages
[ 4158.180471] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 4160.282936] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 4162.688873] LustreError: 53102:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff99366069a000: lov tgt 0 not cleaned! deathrow=0, lovrc=1
[ 4162.719403] LustreError: 53102:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message
[ 4162.770923] Lustre: Unmounted lustre-client
[ 4170.723855] Lustre: DEBUG MARKER: == recovery-small test 55: ost_brw_read/write drops timed-out read/write request ========================================================== 17:55:46 (1773611746)
[ 4293.600385] Lustre: 2392:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1773611855/real 1773611855]  req@ffff993650ecea00 x1859762472237952/t0(0) o4->lustre-OST0000-osc-ffff993644bc1800@192.168.203.144@tcp:6/4 lens 488/448 e 0 to 1 dl 1773611871 ref 2 fl Rpc:XQr/602/ffffffff rc -11/-1 job:'dd.0' uid:0 gid:0 projid:0
[ 4293.650714] Lustre: 2392:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 54 previous similar messages
[ 4341.727321] Lustre: lustre-OST0000-osc-ffff993644bc1800: Connection to lustre-OST0000 (at 192.168.203.144@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 4341.760487] Lustre: Skipped 14 previous similar messages
[ 4374.507721] Lustre: lustre-OST0000-osc-ffff993644bc1800: Connection restored to 192.168.203.144@tcp (at 192.168.203.144@tcp)
[ 4374.514332] Lustre: Skipped 17 previous similar messages
[ 4469.775793] Lustre: DEBUG MARKER: == recovery-small test 56: do not fail on getattr resend ========================================================== 18:00:45 (1773612045)
[ 4519.594401] Lustre: DEBUG MARKER: == recovery-small test 57: read procfs entries causes kernel crash ========================================================== 18:01:35 (1773612095)
[ 4523.615818] LustreError: 55271:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff993644bc1800: lov tgt 0 not cleaned! deathrow=0, lovrc=1
[ 4523.629471] LustreError: 55271:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message
[ 4523.720579] Lustre: Unmounted lustre-client
[ 4545.163526] Lustre: Mounted lustre-client
[ 4551.796674] Lustre: DEBUG MARKER: == recovery-small test 58: Eviction in the middle of open RPC reply processing ========================================================== 18:02:07 (1773612127)
[ 4552.102944] LustreError: 56257:0:(mdc_locks.c:1335:mdc_finish_intent_lock()) cfs_fail_timeout id 801 sleeping for 20000ms
[ 4553.159129] LustreError: 56257:0:(mdc_locks.c:1335:mdc_finish_intent_lock()) cfs_fail_timeout interrupted
[ 4553.340832] Lustre: *** cfs_fail_loc=305, val=0***
[ 4577.591252] Lustre: DEBUG MARKER: == recovery-small test 59: Read cancel race on client eviction ========================================================== 18:02:33 (1773612153)
[ 4578.103892] Lustre: Mounted lustre-client
[ 4580.578990] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request
[ 4590.936529] Lustre: Unmounted lustre-client
[ 4603.748328] Lustre: DEBUG MARKER: == recovery-small test 60: Add Changelog entries during MDS failover ========================================================== 18:02:59 (1773612179)
[ 4680.428995] LustreError: lustre-MDT0000-mdc-ffff993643f4b000: operation mds_reint to node 192.168.203.144@tcp failed: rc = -19
[ 4680.437493] LustreError: Skipped 1 previous similar message
[ 4701.157215] LustreError: MGC192.168.203.144@tcp: Connection to MGS (at 192.168.203.144@tcp) was lost; in progress operations using this service will fail
[ 4701.182155] Lustre: Evicted from MGS (at 192.168.203.144@tcp) after server handle changed from 0x1dc4d5fc0aa43435 to 0x1dc4d5fc0aa6edbf
[ 4828.415914] Lustre: DEBUG MARKER: == recovery-small test 61: Verify to not reuse orphan objects - bug 17025 ========================================================== 18:06:44 (1773612404)
[ 4832.886432] Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000
[ 4844.540410] LustreError: MGC192.168.203.144@tcp: Connection to MGS (at 192.168.203.144@tcp) was lost; in progress operations using this service will fail
[ 4844.561794] Lustre: Evicted from MGS (at 192.168.203.144@tcp) after server handle changed from 0x1dc4d5fc0aa6edbf to 0x1dc4d5fc0aabb0d7
[ 4844.638915] LustreError: lustre-MDT0000-mdc-ffff993643f4b000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 4861.203790] Lustre: DEBUG MARKER: == recovery-small test 65: lock enqueue for destroyed export ========================================================== 18:07:17 (1773612437)
[ 4861.740954] Lustre: Mounted lustre-client
[ 4869.082767] LustreError: lustre-OST0000-osc-ffff993643f4b000: operation ldlm_enqueue to node 192.168.203.144@tcp failed: rc = -107
[ 4869.103611] LustreError: lustre-OST0000-osc-ffff993643f4b000: This client was evicted by lustre-OST0000; in progress operations using this service will fail.
[ 4879.327191] Lustre: 2389:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1773612440/real 1773612440]  req@ffff9936590e6d80 x1859762476891008/t0(0) o103->lustre-OST0000-osc-ffff993643ffb000@192.168.203.144@tcp:17/18 lens 328/224 e 0 to 1 dl 1773612456 ref 1 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295
[ 4879.380125] Lustre: 2389:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 93 previous similar messages
[ 4882.035215] LustreError: 60009:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff993643ffb000: lov tgt 0 not cleaned! deathrow=0, lovrc=1
[ 4882.050096] LustreError: 60009:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message
[ 4882.134043] Lustre: Unmounted lustre-client
[ 4890.316918] Lustre: DEBUG MARKER: == recovery-small test 66: lock enqueue re-send vs client eviction ========================================================== 18:07:46 (1773612466)
[ 4897.017492] LustreError: lustre-MDT0000-mdc-ffff993643f4b000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 4897.042828] LustreError: 60651:0:(file.c:6089:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -5
[ 4904.218355] Lustre: DEBUG MARKER: == recovery-small test 67: connect vs import invalidate race ========================================================== 18:08:00 (1773612480)
[ 4904.368757] LustreError: 61349:0:(recover.c:330:ptlrpc_recover_import()) cfs_race id 531 sleeping
[ 4909.535283] LustreError: 61349:0:(recover.c:330:ptlrpc_recover_import()) cfs_fail_race id 531 awake: rc=0
[ 4909.557654] LustreError: 61349:0:(import.c:710:ptlrpc_connect_import_locked()) already connected
[ 4909.901460] LustreError: lustre-MDT0000-mdc-ffff993643f4b000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 4909.914631] LustreError: 61372:0:(import.c:291:ptlrpc_invalidate_import()) cfs_fail_race id 531 waking
[ 4909.953470] LustreError: 61377:0:(file.c:6089:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 4911.026499] LustreError: 61383:0:(file.c:6089:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 4911.047020] LustreError: 61383:0:(file.c:6089:ll_inode_revalidate_fini()) Skipped 5 previous similar messages
[ 4913.305915] LustreError: 61406:0:(file.c:6089:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 4913.316084] LustreError: 61406:0:(file.c:6089:ll_inode_revalidate_fini()) Skipped 13 previous similar messages
[ 4917.934525] LustreError: 61450:0:(file.c:6089:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 4917.955430] LustreError: 61450:0:(file.c:6089:ll_inode_revalidate_fini()) Skipped 27 previous similar messages
[ 4927.433983] Lustre: DEBUG MARKER: == recovery-small test 100: IR: Make sure normal recovery still works w/o IR ========================================================== 18:08:23 (1773612503)
[ 4966.162523] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
[ 4967.787621] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec
[ 4978.343439] Lustre: DEBUG MARKER: == recovery-small test 101a: IR: Make sure IR works w/o normal recovery ========================================================== 18:09:14 (1773612554)
[ 4985.851941] Lustre: lustre-OST0000-osc-ffff993643f4b000: Connection to lustre-OST0000 (at 192.168.203.144@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 4985.868119] Lustre: Skipped 19 previous similar messages
[ 5001.817155] Lustre: lustre-OST0000-osc-ffff993643f4b000: Connection restored to 192.168.203.144@tcp (at 192.168.203.144@tcp)
[ 5001.830676] Lustre: Skipped 17 previous similar messages
[ 5013.650914] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
[ 5015.190346] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec
[ 5025.253490] Lustre: DEBUG MARKER: == recovery-small test 101b: IR: Make sure IR works w/o normal recovery and proceed EAGAIN ========================================================== 18:10:01 (1773612601)
[ 5085.454477] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
[ 5087.033547] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec
[ 5095.829218] Lustre: DEBUG MARKER: == recovery-small test 102: IR: New client gets updated nidtbl after MGS restart ========================================================== 18:11:11 (1773612671)
[ 5132.807313] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
[ 5134.562350] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec
[ 5141.692218] LustreError: 67024:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff993643f4b000: lov tgt 0 not cleaned! deathrow=0, lovrc=1
[ 5141.704373] LustreError: 67024:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message
[ 5141.759189] Lustre: Unmounted lustre-client
[ 5192.538741] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
[ 5195.094753] Lustre: Mounted lustre-client
[ 5200.871162] Lustre: DEBUG MARKER: == recovery-small test 103: IR: MDS can start w/o MGS and get updated nidtbl later ========================================================== 18:12:57 (1773612777)
[ 5203.869042] Lustre: DEBUG MARKER: SKIP: recovery-small test_103 needs separate mgs and mds
[ 5205.569797] Lustre: DEBUG MARKER: == recovery-small test 104: IR: ost can disable IR voluntarily ========================================================== 18:13:01 (1773612781)
[ 5233.782176] Lustre: DEBUG MARKER: == recovery-small test 105: IR: NON IR clients support === 18:13:30 (1773612810)
[ 5235.010268] Lustre: DEBUG MARKER: SKIP: recovery-small test_105 Needs multiple clients
[ 5236.511406] Lustre: DEBUG MARKER: == recovery-small test 106: lightweight connection support ========================================================== 18:13:32 (1773612812)
[ 5237.692984] Lustre: *** cfs_fail_loc=805, val=0***
[ 5237.724105] Lustre: Mounted lustre-client
[ 5241.789830] Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000
[ 5263.352828] LustreError: MGC192.168.203.144@tcp: Connection to MGS (at 192.168.203.144@tcp) was lost; in progress operations using this service will fail
[ 5263.389183] Lustre: Evicted from MGS (at 192.168.203.144@tcp) after server handle changed from 0x1dc4d5fc0aabbacb to 0x1dc4d5fc0aabbde9
[ 5270.567937] LustreError: 70380:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff99364b4f4000: lov tgt 0 not cleaned! deathrow=0, lovrc=1
[ 5270.574505] LustreError: 70380:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message
[ 5270.613245] Lustre: Unmounted lustre-client
[ 5278.537599] Lustre: DEBUG MARKER: == recovery-small test 107: drop reint reply, then restart MDT ========================================================== 18:14:14 (1773612854)
[ 5320.763081] LustreError: 2388:0:(client.c:3418:ptlrpc_replay_interpret()) @@@ status 301, old was 0  req@ffff99364a706300 x1859762476970752/t94489280516(94489280516) o101->lustre-MDT0000-mdc-ffff993644bc9800@192.168.203.144@tcp:12/10 lens 648/608 e 0 to 0 dl 1773612914 ref 2 fl Interpret:RPQU/604/0 rc 301/301 job:'multiop.0' uid:0 gid:0 projid:0
[ 5324.047891] Lustre: DEBUG MARKER: oleg344-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 5325.863079] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 5333.322182] Lustre: DEBUG MARKER: == recovery-small test 108: client eviction don't crash == 18:15:09 (1773612909)
[ 5334.594258] LustreError: lustre-OST0000-osc-ffff993644bc9800: operation ost_write to node 192.168.203.144@tcp failed: rc = -107
[ 5334.605944] LustreError: Skipped 2 previous similar messages
[ 5334.618930] LustreError: lustre-OST0000-osc-ffff993644bc9800: This client was evicted by lustre-OST0000; in progress operations using this service will fail.
[ 5334.639672] Lustre: 2390:0:(llite_lib.c:4158:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.203.144@tcp:/lustre/fid: [0x20000a042:0x6:0x0]// may get corrupted (rc -5)
[ 5334.680759] LustreError: 72379:0:(ldlm_resource.c:1170:ldlm_resource_complain()) lustre-OST0000-osc-ffff993644bc9800: namespace resource [0x240000400:0x3e22:0x0].0x0 (ffff99364a9aaa00) refcount nonzero (1) after lock cleanup; forcing cleanup.
[ 5341.961662] Lustre: DEBUG MARKER: == recovery-small test 110a: create remote directory: drop client req ========================================================== 18:15:18 (1773612918)
[ 5343.078883] Lustre: DEBUG MARKER: SKIP: recovery-small test_110a needs >= 2 MDTs
[ 5344.381180] Lustre: DEBUG MARKER: == recovery-small test 110b: create remote directory: drop Master rep ========================================================== 18:15:20 (1773612920)
[ 5345.705362] Lustre: DEBUG MARKER: SKIP: recovery-small test_110b needs >= 2 MDTs
[ 5347.123498] Lustre: DEBUG MARKER: == recovery-small test 110c: create remote directory: drop update rep on slave MDT ========================================================== 18:15:23 (1773612923)
[ 5348.290132] Lustre: DEBUG MARKER: SKIP: recovery-small test_110c needs >= 2 MDTs
[ 5349.825136] Lustre: DEBUG MARKER: == recovery-small test 110d: remove remote directory: drop client req ========================================================== 18:15:26 (1773612926)
[ 5351.001694] Lustre: DEBUG MARKER: SKIP: recovery-small test_110d needs >= 2 MDTs
[ 5352.494139] Lustre: DEBUG MARKER: == recovery-small test 110e: remove remote directory: drop master rep ========================================================== 18:15:28 (1773612928)
[ 5354.107619] Lustre: DEBUG MARKER: SKIP: recovery-small test_110e needs >= 2 MDTs
[ 5355.896484] Lustre: DEBUG MARKER: == recovery-small test 110f: remove remote directory: drop slave rep ========================================================== 18:15:31 (1773612931)
[ 5357.415698] Lustre: DEBUG MARKER: SKIP: recovery-small test_110f needs >= 2 MDTs
[ 5358.806607] Lustre: DEBUG MARKER: == recovery-small test 110g: drop reply during migration ========================================================== 18:15:35 (1773612935)
[ 5360.318806] Lustre: DEBUG MARKER: SKIP: recovery-small test_110g needs >= 2 MDTs
[ 5361.775416] Lustre: DEBUG MARKER: == recovery-small test 110h: drop update reply during cross-MDT file rename ========================================================== 18:15:38 (1773612938)
[ 5363.242333] Lustre: DEBUG MARKER: SKIP: recovery-small test_110h needs >= 2 MDTs
[ 5364.521551] Lustre: DEBUG MARKER: == recovery-small test 110i: drop update reply during cross-MDT dir rename ========================================================== 18:15:40 (1773612940)
[ 5366.001567] Lustre: DEBUG MARKER: SKIP: recovery-small test_110i needs >= 2 MDTs
[ 5367.573135] Lustre: DEBUG MARKER: == recovery-small test 110j: drop update reply during cross-MDT ln ========================================================== 18:15:43 (1773612943)
[ 5368.973037] Lustre: DEBUG MARKER: SKIP: recovery-small test_110j needs >= 2 MDTs
[ 5370.495930] Lustre: DEBUG MARKER: == recovery-small test 110k: FID_QUERY failed during recovery ========================================================== 18:15:46 (1773612946)
[ 5371.924724] Lustre: DEBUG MARKER: SKIP: recovery-small test_110k needs >= 2 MDTS
[ 5373.380471] Lustre: DEBUG MARKER: == recovery-small test 110m: update resent vs original RPC race ========================================================== 18:15:49 (1773612949)
[ 5375.759301] Lustre: DEBUG MARKER: SKIP: recovery-small test_110m needs at least 2 MDTs
[ 5377.196806] Lustre: DEBUG MARKER: == recovery-small test 111: mdd setup fail should not cause umount oops ========================================================== 18:15:53 (1773612953)
[ 5406.590570] Lustre: DEBUG MARKER: == recovery-small test 112a: bulk resend while orignal request is in progress ========================================================== 18:16:23 (1773612983)
[ 5435.515873] Lustre: DEBUG MARKER: == recovery-small test 115a: read: late REQ MDunlink and no bulk ========================================================== 18:16:51 (1773613011)
[ 5435.865696] Lustre: *** cfs_fail_loc=51b, val=3***
[ 5446.091856] Lustre: DEBUG MARKER: == recovery-small test 115b: write: late REQ MDunlink and no bulk ========================================================== 18:17:02 (1773613022)
[ 5446.338206] Lustre: *** cfs_fail_loc=51b, val=4***
[ 5455.916134] Lustre: DEBUG MARKER: == recovery-small test 115c: read: late Reply MDunlink and no bulk ========================================================== 18:17:12 (1773613032)
[ 5456.139788] Lustre: *** cfs_fail_loc=50f, val=3***
[ 5463.817975] Lustre: DEBUG MARKER: == recovery-small test 115d: write: late Reply MDunlink and no bulk ========================================================== 18:17:20 (1773613040)
[ 5464.049059] Lustre: *** cfs_fail_loc=50f, val=4***
[ 5471.747490] Lustre: DEBUG MARKER: == recovery-small test 115e: read: late Bulk MDunlink and no reply ========================================================== 18:17:28 (1773613048)
[ 5471.997484] Lustre: *** cfs_fail_loc=510, val=3***
[ 5479.187307] Lustre: DEBUG MARKER: == recovery-small test 115f: read: late REQ MDunlink and no reply ========================================================== 18:17:35 (1773613055)
[ 5479.436032] Lustre: *** cfs_fail_loc=51b, val=3***
[ 5489.550421] Lustre: DEBUG MARKER: == recovery-small test 115g: read: late REQ MDunlink and Reply MDunlink ========================================================== 18:17:45 (1773613065)
[ 5490.127980] Lustre: *** cfs_fail_loc=51c, val=3***
[ 5490.978438] Lustre: 2391:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1773613051/real 1773613051]  req@ffff99364a704380 x1859762477009664/t0(0) o400->lustre-OST0000-osc-ffff993644bc9800@192.168.203.144@tcp:28/4 lens 224/224 e 0 to 1 dl 1773613067 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 5491.020919] Lustre: 2391:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 14 previous similar messages
[ 5554.967634] Lustre: DEBUG MARKER: == recovery-small test 120: flock race: completion vs. evict ========================================================== 18:18:51 (1773613131)
[ 5555.170068] LustreError: 82574:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 sleeping for 4000ms
[ 5557.872674] LustreError: lustre-MDT0000-mdc-ffff993644bc9800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 5557.898299] LustreError: 82588:0:(file.c:249:ll_close_inode_openhandle()) lustre-clilmv-ffff993644bc9800: inode [0x20000a042:0x8:0x0] mdc close failed: rc = -108
[ 5557.929353] LustreError: 82588:0:(ldlm_resource.c:1170:ldlm_resource_complain()) lustre-MDT0000-mdc-ffff993644bc9800: namespace resource [0x20000a042:0x11:0x0].0xc (ffff99364a08d500) refcount nonzero (1) after lock cleanup; forcing cleanup.
[ 5557.958714] LustreError: 82593:0:(file.c:6089:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 5557.970242] LustreError: 82593:0:(file.c:6089:ll_inode_revalidate_fini()) Skipped 14 previous similar messages
[ 5559.239140] LustreError: 82574:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 awake
[ 5561.339270] LustreError: 82604:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 sleeping for 4000ms
[ 5564.225312] LustreError: lustre-MDT0000-mdc-ffff993644bc9800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 5564.246587] LustreError: 82618:0:(ldlm_resource.c:1170:ldlm_resource_complain()) lustre-MDT0000-mdc-ffff993644bc9800: namespace resource [0x20000a042:0x11:0x0].0xc (ffff99364a08da00) refcount nonzero (1) after lock cleanup; forcing cleanup.
[ 5564.269016] LustreError: 82618:0:(ldlm_resource.c:1170:ldlm_resource_complain()) Skipped 1 previous similar message
[ 5565.415131] LustreError: 82604:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 awake
[ 5572.186759] LustreError: lustre-MDT0000-mdc-ffff993644bc9800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 5572.526228] LustreError: 82659:0:(ldlm_flock.c:807:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 sleeping for 4000ms
[ 5575.460281] LustreError: lustre-MDT0000-mdc-ffff993644bc9800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 5575.529893] LustreError: 82679:0:(file.c:6089:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 5576.604778] LustreError: 82659:0:(ldlm_flock.c:807:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 awake
[ 5576.611094] LustreError: 82659:0:(file.c:249:ll_close_inode_openhandle()) lustre-clilmv-ffff993644bc9800: inode [0x20000a042:0x11:0x0] mdc close failed: rc = -108
[ 5577.745595] LustreError: 82696:0:(file.c:6089:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 5577.757537] LustreError: 82696:0:(file.c:6089:ll_inode_revalidate_fini()) Skipped 12 previous similar messages
[ 5582.299635] LustreError: 82733:0:(ldlm_flock.c:807:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 sleeping for 4000ms
[ 5585.074078] LustreError: lustre-MDT0000-mdc-ffff993644bc9800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 5585.092495] LustreError: 82748:0:(ldlm_resource.c:1170:ldlm_resource_complain()) lustre-MDT0000-mdc-ffff993644bc9800: namespace resource [0x20000a042:0x11:0x0].0xc (ffff99364cbeb300) refcount nonzero (1) after lock cleanup; forcing cleanup.
[ 5585.133587] LustreError: 82748:0:(ldlm_resource.c:1170:ldlm_resource_complain()) Skipped 1 previous similar message
[ 5586.375122] LustreError: 82733:0:(ldlm_flock.c:807:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 awake
[ 5592.872827] Lustre: lustre-MDT0000-mdc-ffff993644bc9800: Connection to lustre-MDT0000 (at 192.168.203.144@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 5592.880505] Lustre: Skipped 14 previous similar messages
[ 5592.886876] LustreError: lustre-MDT0000-mdc-ffff993644bc9800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 5593.183325] LustreError: 82790:0:(ldlm_flock.c:856:ldlm_flock_completion_ast()) cfs_fail_timeout id 322 sleeping for 4000ms
[ 5595.742029] LustreError: lustre-MDT0000-mdc-ffff993644bc9800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 5595.756027] LustreError: 82804:0:(ldlm_resource.c:1170:ldlm_resource_complain()) lustre-MDT0000-mdc-ffff993644bc9800: namespace resource [0x20000a042:0x11:0x0].0xc (ffff99364a9aa400) refcount nonzero (1) after lock cleanup; forcing cleanup.
[ 5595.774401] LustreError: 82804:0:(ldlm_resource.c:1170:ldlm_resource_complain()) Skipped 1 previous similar message
[ 5597.263134] LustreError: 82790:0:(ldlm_flock.c:856:ldlm_flock_completion_ast()) cfs_fail_timeout id 322 awake
[ 5600.109072] LustreError: lustre-MDT0000-mdc-ffff993644bc9800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 5600.198441] LustreError: 82837:0:(file.c:6089:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 5600.206786] LustreError: 82837:0:(file.c:6089:ll_inode_revalidate_fini()) Skipped 13 previous similar messages
[ 5601.415928] LustreError: 82817:0:(file.c:249:ll_close_inode_openhandle()) lustre-clilmv-ffff993644bc9800: inode [0x20000a042:0x11:0x0] mdc close failed: rc = -108
[ 5604.133550] Lustre: lustre-MDT0000-mdc-ffff993644bc9800: Connection restored to 192.168.203.144@tcp (at 192.168.203.144@tcp)
[ 5604.143292] Lustre: Skipped 17 previous similar messages
[ 5609.105173] LustreError: 82888:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 sleeping for 4000ms
[ 5609.117088] LustreError: 82888:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) Skipped 1 previous similar message
[ 5612.458671] LustreError: lustre-MDT0000-mdc-ffff993644bc9800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 5612.546115] LustreError: 82910:0:(file.c:6089:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 5612.562663] LustreError: 82910:0:(file.c:6089:ll_inode_revalidate_fini()) Skipped 26 previous similar messages
[ 5613.207760] LustreError: 82888:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 awake
[ 5613.218037] LustreError: 82888:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) Skipped 1 previous similar message
[ 5613.241135] LustreError: 82888:0:(file.c:249:ll_close_inode_openhandle()) lustre-clilmv-ffff993644bc9800: inode [0x20000a042:0x11:0x0] mdc close failed: rc = -108
[ 5622.528814] Lustre: DEBUG MARKER: == recovery-small test 113: ldlm enqueue dropped reply should not cause deadlocks ========================================================== 18:19:58 (1773613198)
[ 5641.585893] LustreError: 67856:0:(ldlm_lockd.c:2883:ldlm_bl_thread_blwi()) cfs_fail_timeout id 31f sleeping for 4000ms
[ 5641.590908] LustreError: 67856:0:(ldlm_lockd.c:2883:ldlm_bl_thread_blwi()) Skipped 1 previous similar message
[ 5645.651654] LustreError: 67856:0:(ldlm_lockd.c:2883:ldlm_bl_thread_blwi()) cfs_fail_timeout id 31f awake
[ 5645.663630] LustreError: 67856:0:(ldlm_lockd.c:2883:ldlm_bl_thread_blwi()) Skipped 1 previous similar message
[ 5651.047566] Lustre: DEBUG MARKER: == recovery-small test 130a: enqueue resend on not existing file ========================================================== 18:20:27 (1773613227)
[ 5698.498433] Lustre: DEBUG MARKER: == recovery-small test 130b: enqueue resend on a stale inode ========================================================== 18:21:15 (1773613275)
[ 5760.159396] Lustre: DEBUG MARKER: == recovery-small test 130c: layout intent resend on a stale inode ========================================================== 18:22:16 (1773613336)
[ 5798.248162] Lustre: DEBUG MARKER: == recovery-small test 132: long punch =================== 18:22:53 (1773613373)
[ 5799.174830] Lustre: Mounted lustre-client
[ 5925.499222] LustreError: 86601:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff99365922b000: lov tgt 0 not cleaned! deathrow=0, lovrc=1
[ 5925.516973] LustreError: 86601:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message
[ 5925.581624] Lustre: Unmounted lustre-client
[ 5934.934367] Lustre: DEBUG MARKER: == recovery-small test 131: IO vs evict results to IO under staled lock ========================================================== 18:25:10 (1773613510)
[ 5935.588397] LustreError: 87216:0:(osc_request.c:2983:osc_build_rpc()) cfs_fail_timeout id 414 sleeping for 4000ms
[ 5939.671263] LustreError: 87216:0:(osc_request.c:2983:osc_build_rpc()) cfs_fail_timeout id 414 awake
[ 5940.071457] LustreError: lustre-OST0000-osc-ffff993644bc9800: operation ldlm_enqueue to node 192.168.203.144@tcp failed: rc = -107
[ 5940.081975] LustreError: Skipped 9 previous similar messages
[ 5940.113935] LustreError: lustre-OST0000-osc-ffff993644bc9800: This client was evicted by lustre-OST0000; in progress operations using this service will fail.
[ 5941.790507] Lustre: DEBUG MARKER: recovery-small test_131: @@@@@@ FAIL: dd succeeded