[ 1450.298619] Lustre: DEBUG MARKER: == recovery-small test 24b: test dirty page discard due to client eviction ========================================================== 23:27:15 (1717558035)
[ 1450.751431] LustreError: 11-0: lustre-OST0000-osc-ffff8800aa579800: operation ost_sync to node 192.168.202.146@tcp failed: rc = -107
[ 1450.755574] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 1450.763846] LustreError: 167-0: lustre-OST0000-osc-ffff8800aa579800: This client was evicted by lustre-OST0000; in progress operations using this service will fail.
[ 1450.770978] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/llite/llite_lib.c:4076:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.202.146@tcp:/lustre/fid: [0x200000404:0x35:0x0]// may get corrupted (rc -108)
[ 1451.237094] Lustre: DEBUG MARKER: recovery-small test_24b: @@@@@@ FAIL: no discarded dirty page found!
[ 1451.788859] Lustre: 1953:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717558021/real 1717558021]  req@ffff8800abff0e00 x1800988641096000/t0(0) o400->lustre-MDT0000-mdc-ffff8800aa579800@192.168.202.146@tcp:12/10 lens 224/224 e 0 to 1 dl 1717558037 ref 1 fl Rpc:XNQr/200/ff
[ 1454.402174] Lustre: DEBUG MARKER: == recovery-small test 26a: evict dead exports =========== 23:27:19 (1717558039)
[ 1455.068891] Lustre: DEBUG MARKER: SKIP: recovery-small test_26a msg and ost1 are at the same node
[ 1455.669117] Lustre: DEBUG MARKER: == recovery-small test 26b: evict dead exports =========== 23:27:21 (1717558041)
[ 1456.159896] Lustre: DEBUG MARKER: SKIP: recovery-small test_26b msg and ost1 are at the same node
[ 1456.654018] Lustre: DEBUG MARKER: == recovery-small test 27: fail LOV while using OSC's ==== 23:27:22 (1717558042)
[ 1458.266594] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aa579800: operation ldlm_enqueue to node 192.168.202.146@tcp failed: rc = -19
[ 1458.269641] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 1459.197953] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717558026/real 1717558026]  req@ffff88012e169f80 x1800988641096192/t0(0) o400->lustre-MDT0000-mdc-ffff8800aa579800@192.168.202.146@tcp:12/10 lens 224/224 e 0 to 1 dl 1717558042 ref 1 fl Rpc:XNQr/200/ff
[ 1475.613749] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 1475.651846] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a64040ecd to 0x9ec10a1a6404b0b4
[ 1564.026065] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aa579800: operation mds_reint to node 192.168.202.146@tcp failed: rc = -19
[ 1564.028769] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 1575.845143] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 1575.852010] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a6404b0b4 to 0x9ec10a1a6429c929
[ 1582.278114] Lustre: DEBUG MARKER: == recovery-small test 28: handle error adding new clients (bug 6086) ========================================================== 23:29:27 (1717558167)
[ 1614.592996] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aa579800: operation ldlm_enqueue to node 192.168.202.146@tcp failed: rc = -107
[ 1614.595226] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 1615.158239] Lustre: DEBUG MARKER: oleg246-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 1615.537765] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 1615.909773] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 1615.914350] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a6429c929 to 0x9ec10a1a6429f655
[ 1618.155643] Lustre: DEBUG MARKER: == recovery-small test 29a: error adding new clients doesn't cause LBUG (bug 22273) ========================================================== 23:30:03 (1717558203)
[ 1620.917481] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 1620.921610] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 1622.916833] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a6429f655 to 0x9ec10a1a6429f870
[ 1629.046765] LustreError: 167-0: lustre-MDT0000-mdc-ffff8800aa579800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 1630.933542] Lustre: DEBUG MARKER: == recovery-small test 29b: error adding new clients doesn't cause LBUG (bug 22273) ========================================================== 23:30:14 (1717558214)
[ 1633.718340] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 1638.724551] LustreError: 167-0: lustre-OST0000-osc-ffff8800aa579800: This client was evicted by lustre-OST0000; in progress operations using this service will fail.
[ 1649.286603] Lustre: DEBUG MARKER: == recovery-small test 50: failover MDS under load ======= 23:30:24 (1717558224)
[ 1649.288817] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aa579800: operation mds_reint to node 192.168.202.146@tcp failed: rc = -19
[ 1665.966587] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 1665.973693] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 1666.637215] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a6429f870 to 0x9ec10a1a642de66a
[ 1667.018877] Lustre: DEBUG MARKER: oleg246-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 1728.799455] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 1728.799478] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aa579800: operation mds_close to node 192.168.202.146@tcp failed: rc = -19
[ 1728.799482] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aa579800: operation ldlm_enqueue to node 192.168.202.146@tcp failed: rc = -19
[ 1741.156863] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 1741.164306] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 1746.729391] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a642de66a to 0x9ec10a1a64471b44
[ 1747.147267] Lustre: DEBUG MARKER: oleg246-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 1808.937605] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 1808.942275] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aa579800: operation ldlm_enqueue to node 192.168.202.146@tcp failed: rc = -19
[ 1808.942282] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aa579800: operation mds_close to node 192.168.202.146@tcp failed: rc = -19
[ 1826.318598] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 1826.370483] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 1826.949174] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a64471b44 to 0x9ec10a1a645b3181
[ 1827.340697] Lustre: DEBUG MARKER: oleg246-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 1850.778492] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 1852.923483] Lustre: DEBUG MARKER: == recovery-small test 51: failover MDS during recovery == 23:33:56 (1717558436)
[ 1852.923566] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aa579800: operation mds_close to node 192.168.202.146@tcp failed: rc = -19
[ 1852.923573] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aa579800: operation mds_reint to node 192.168.202.146@tcp failed: rc = -19
[ 1866.389885] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 1866.405232] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 1868.325340] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a645b3181 to 0x9ec10a1a6461f04a
[ 1883.841765] Lustre: DEBUG MARKER: test_51: failover in 1 sec
[ 1886.437400] Lustre: DEBUG MARKER: test_51: failover in 5 sec
[ 1886.439560] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 1901.461095] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a6461f04a to 0x9ec10a1a6461f27a
[ 1901.464397] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 1902.473669] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a6461f27a to 0x9ec10a1a6461f3a7
[ 1926.486103] Lustre: DEBUG MARKER: test_51: failover in 10 sec
[ 1926.490786] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 1927.528493] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a6461f3a7 to 0x9ec10a1a6461f5d7
[ 1948.284163] Lustre: DEBUG MARKER: test_51: failover in 20 sec
[ 1948.285434] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aa579800: operation mds_reint to node 192.168.202.146@tcp failed: rc = -19
[ 1948.285441] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aa579800: operation mds_close to node 192.168.202.146@tcp failed: rc = -19
[ 1961.526122] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 1961.539699] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 1963.520866] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a6461f5d7 to 0x9ec10a1a64625ef3
[ 1989.033085] Lustre: DEBUG MARKER: test_51: failover in 25 sec
[ 1989.033102] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aa579800: operation mds_close to node 192.168.202.146@tcp failed: rc = -19
[ 1989.033106] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aa579800: operation ldlm_enqueue to node 192.168.202.146@tcp failed: rc = -19
[ 2001.605466] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 2001.612147] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 2002.268025] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a64625ef3 to 0x9ec10a1a64688c91
[ 2032.999684] Lustre: DEBUG MARKER: test_51: failover in 30 sec
[ 2033.002484] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aa579800: operation ldlm_enqueue to node 192.168.202.146@tcp failed: rc = -19
[ 2046.678115] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 2046.687031] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 2069.657797] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a64688c91 to 0x9ec10a1a647191e2
[ 2080.578403] Lustre: DEBUG MARKER: == recovery-small test 52: failover OST under load ======= 23:37:35 (1717558655)
[ 2080.585271] LustreError: 11-0: lustre-OST0000-osc-ffff8800aa579800: operation ldlm_enqueue to node 192.168.202.146@tcp failed: rc = -19
[ 2097.224431] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 2097.584036] Lustre: DEBUG MARKER: oleg246-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
[ 2410.670408] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec
[ 2410.672744] LustreError: 11-0: lustre-OST0000-osc-ffff8800aa579800: operation ldlm_enqueue to node 192.168.202.146@tcp failed: rc = -19
[ 2410.672748] LustreError: 11-0: lustre-OST0000-osc-ffff8800aa579800: operation ldlm_enqueue to node 192.168.202.146@tcp failed: rc = -19
[ 2425.957681] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 2426.331892] Lustre: DEBUG MARKER: oleg246-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
[ 2741.779240] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec
[ 2741.785806] LustreError: 11-0: lustre-OST0000-osc-ffff8800aa579800: operation ldlm_enqueue to node 192.168.202.146@tcp failed: rc = -19
[ 2757.961680] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 2758.326825] Lustre: DEBUG MARKER: oleg246-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
[ 3033.423915] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec
[ 3049.732010] Lustre: DEBUG MARKER: == recovery-small test 53a: touch: drop rep ============== 23:53:39 (1717559619)
[ 3049.737365] Lustre: 21577:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559619/real 1717559619]  req@ffff880130fcd180 x1800988830618688/t0(0) o101->lustre-MDT0000-mdc-ffff8800aa579800@192.168.202.146@tcp:12/10 lens 576/1024 e 0 to 1 dl 1717559635 ref 2 fl Rpc:XQr/200/ff
[ 3052.054575] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3068.489995] Lustre: DEBUG MARKER: == recovery-small test 53b: touch: drop rep ============== 23:53:57 (1717559637)
[ 3068.494864] Lustre: 22318:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559638/real 1717559638]  req@ffff88012da12300 x1800988830679168/t0(0) o101->lustre-MDT0000-mdc-ffff8800aa579800@192.168.202.146@tcp:12/10 lens 576/1024 e 0 to 1 dl 1717559654 ref 2 fl Rpc:XQr/200/ff
[ 3070.435798] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3086.750024] Lustre: DEBUG MARKER: == recovery-small test 53c: touch: drop rep ============== 23:54:16 (1717559656)
[ 3086.756644] Lustre: 23058:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559656/real 1717559656]  req@ffff8800a8d22d80 x1800988830680768/t0(0) o101->lustre-MDT0000-mdc-ffff8800aa579800@192.168.202.146@tcp:12/10 lens 664/66320 e 0 to 1 dl 1717559672 ref 2 fl Rpc:XPQr/200/
[ 3088.828357] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3088.897717] Lustre: DEBUG MARKER: == recovery-small test 54: back in time ================== 23:54:34 (1717559674)
[ 3113.942340] Lustre: Mounted lustre-client
[ 3113.942438] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3113.945648] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 3113.962382] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a647191e2 to 0x9ec10a1a65a3dbc1
[ 3116.487563] Lustre: lustre-MDT0000-mdc-ffff8800b5d25800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3117.085321] Lustre: DEBUG MARKER: oleg246-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 3118.471980] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 3119.947926] Lustre: Unmounted lustre-client
[ 3120.527667] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559689/real 1717559689]  req@ffff8800a7666d80 x1800988830685632/t0(0) o400->lustre-MDT0000-mdc-ffff8800aa579800@192.168.202.146@tcp:12/10 lens 224/224 e 0 to 1 dl 1717559705 ref 1 fl Rpc:XNQr/200/ff
[ 3124.956020] Lustre: DEBUG MARKER: == recovery-small test 55: ost_brw_read/write drops timed-out read/write request ========================================================== 23:55:06 (1717559706)
[ 3138.971962] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559694/real 1717559694]  req@ffff8800a7666a00 x1800988830686080/t0(0) o400->lustre-MDT0000-mdc-ffff8800aa579800@192.168.202.146@tcp:12/10 lens 224/224 e 0 to 1 dl 1717559710 ref 1 fl Rpc:XNQr/200/ff
[ 3138.971975] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559708/real 1717559708]  req@ffff8800a8d23100 x1800988830706368/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559724 ref 2 fl Rpc:XQr/200/fffffff
[ 3138.972032] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559708/real 1717559708]  req@ffff8800a8d20000 x1800988830706304/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559724 ref 2 fl Rpc:XQr/200/fffffff
[ 3138.972085] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3138.972127] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559708/real 1717559708]  req@ffff8800a8d21180 x1800988830706432/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559724 ref 2 fl Rpc:XQr/200/fffffff
[ 3138.972166] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559708/real 1717559708]  req@ffff8800a8d20e00 x1800988830706560/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559724 ref 2 fl Rpc:XQr/200/fffffff
[ 3138.972207] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559708/real 1717559708]  req@ffff8800a8d20380 x1800988830706688/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559724 ref 2 fl Rpc:XQr/200/fffffff
[ 3139.058039] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559708/real 1717559708]  req@ffff8800a8d22300 x1800988830706816/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559724 ref 2 fl Rpc:XQr/200/fffffff
[ 3154.997994] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559708/real 1717559708]  req@ffff8800a8d23100 x1800988830706368/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559724 ref 2 fl Rpc:eXSQU/200/ff
[ 3155.011138] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559725/real 1717559725]  req@ffff8800a8d20000 x1800988830706304/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559741 ref 2 fl Rpc:XQr/202/fffffff
[ 3155.023837] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3155.031413] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559725/real 1717559725]  req@ffff8800a8d21180 x1800988830706432/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559741 ref 2 fl Rpc:XQr/202/fffffff
[ 3155.049791] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559725/real 1717559725]  req@ffff8800a8d20e00 x1800988830706560/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559741 ref 2 fl Rpc:XQr/202/fffffff
[ 3171.036884] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559725/real 1717559725]  req@ffff8800a8d20e00 x1800988830706560/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559741 ref 2 fl Rpc:eXSQU/202/ff
[ 3171.044495] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559741/real 1717559741]  req@ffff8800a8d23100 x1800988830706368/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559757 ref 2 fl Rpc:XQr/202/fffffff
[ 3171.051955] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3171.056184] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559741/real 1717559741]  req@ffff8800a8d20a80 x1800988830706496/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559757 ref 2 fl Rpc:XQr/202/fffffff
[ 3171.063865] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559741/real 1717559741]  req@ffff8800a8d23480 x1800988830706624/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559757 ref 2 fl Rpc:XQr/202/fffffff
[ 3171.063893] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559741/real 1717559741]  req@ffff8800a8d20000 x1800988830706304/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559757 ref 2 fl Rpc:XQr/202/fffffff
[ 3171.063908] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559741/real 1717559741]  req@ffff8800a8d21180 x1800988830706432/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559757 ref 2 fl Rpc:XQr/202/fffffff
[ 3171.063923] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559741/real 1717559741]  req@ffff8800a8d20e00 x1800988830706560/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559757 ref 2 fl Rpc:XQr/202/fffffff
[ 3171.063937] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559741/real 1717559741]  req@ffff8800a8d20380 x1800988830706688/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559757 ref 2 fl Rpc:XQr/202/fffffff
[ 3171.110495] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559741/real 1717559741]  req@ffff8800a8d22300 x1800988830706816/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559757 ref 2 fl Rpc:XQr/202/fffffff
[ 3187.130964] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559741/real 1717559741]  req@ffff8800a8d23480 x1800988830706624/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559757 ref 2 fl Rpc:eXSQU/202/ff
[ 3187.130973] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559757/real 1717559757]  req@ffff8800a8d20000 x1800988830706304/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559773 ref 2 fl Rpc:XQr/202/fffffff
[ 3187.131019] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559757/real 1717559757]  req@ffff8800a8d23100 x1800988830706368/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559773 ref 2 fl Rpc:XQr/202/fffffff
[ 3187.131058] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3187.131086] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559757/real 1717559757]  req@ffff8800a8d20a80 x1800988830706496/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559773 ref 2 fl Rpc:XQr/202/fffffff
[ 3187.131113] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559757/real 1717559757]  req@ffff8800a8d23480 x1800988830706624/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559773 ref 2 fl Rpc:XQr/202/fffffff
[ 3187.208773] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559757/real 1717559757]  req@ffff8800a8d20700 x1800988830706752/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559773 ref 2 fl Rpc:XQr/202/fffffff
[ 3203.142013] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559757/real 1717559757]  req@ffff8800a8d20000 x1800988830706304/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559773 ref 2 fl Rpc:eXSQU/202/ff
[ 3203.160287] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559773/real 1717559773]  req@ffff8800a7666300 x1800988830712320/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559789 ref 2 fl Rpc:XQr/202/fffffff
[ 3203.178416] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3203.188219] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559773/real 1717559773]  req@ffff8800a7665f80 x1800988830712256/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559789 ref 2 fl Rpc:XQr/202/fffffff
[ 3203.205931] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559773/real 1717559773]  req@ffff8800a7667480 x1800988830712192/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559789 ref 2 fl Rpc:XQr/202/fffffff
[ 3219.188972] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559773/real 1717559773]  req@ffff8800a7667480 x1800988830712192/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559789 ref 2 fl Rpc:eXSQU/202/ff
[ 3219.199918] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559789/real 1717559789]  req@ffff8800a7667800 x1800988830712384/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:XQr/202/fffffff
[ 3219.209937] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3219.214946] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559789/real 1717559789]  req@ffff8800a8d20000 x1800988830706304/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:XQr/202/fffffff
[ 3219.222902] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559789/real 1717559789]  req@ffff8800a8d21180 x1800988830706432/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:XQr/202/fffffff
[ 3219.222937] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559789/real 1717559789]  req@ffff8800a7666300 x1800988830712320/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:XQr/202/fffffff
[ 3219.222963] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559789/real 1717559789]  req@ffff8800a7665f80 x1800988830712256/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:XQr/202/fffffff
[ 3219.222986] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559789/real 1717559789]  req@ffff8800a7667480 x1800988830712192/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:XQr/202/fffffff
[ 3219.223026] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559789/real 1717559789]  req@ffff8800a7664380 x1800988830712128/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:XQr/202/fffffff
[ 3219.223064] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559789/real 1717559789]  req@ffff8800a7665c00 x1800988830712064/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:XQr/202/fffffff
[ 3219.223089] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559789/real 1717559789]  req@ffff8800a7667b80 x1800988830712000/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:XQr/202/fffffff
[ 3219.223122] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559789/real 1717559789]  req@ffff8800a7664a80 x1800988830711936/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:XQr/202/fffffff
[ 3219.223148] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559789/real 1717559789]  req@ffff8800a7665500 x1800988830711872/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:XQr/202/fffffff
[ 3219.223173] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559789/real 1717559789]  req@ffff8800a7666d80 x1800988830711808/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:XQr/202/fffffff
[ 3219.223198] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559789/real 1717559789]  req@ffff8800a8d23100 x1800988830706368/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:XQr/202/fffffff
[ 3219.223224] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559789/real 1717559789]  req@ffff8800a8d20a80 x1800988830706496/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:XQr/202/fffffff
[ 3219.223249] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559789/real 1717559789]  req@ffff8800a8d23480 x1800988830706624/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:XQr/202/fffffff
[ 3219.325296] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559789/real 1717559789]  req@ffff8800a8d20700 x1800988830706752/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:XQr/202/fffffff
[ 3235.226157] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559789/real 1717559789]  req@ffff8800a8d21180 x1800988830706432/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559805 ref 2 fl Rpc:eXSQU/202/ff
[ 3235.240146] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559805/real 1717559805]  req@ffff8800a7666300 x1800988830712320/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559821 ref 2 fl Rpc:XQr/202/fffffff
[ 3235.253828] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3235.262180] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559805/real 1717559805]  req@ffff8800a7665f80 x1800988830712256/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559821 ref 2 fl Rpc:XQr/202/fffffff
[ 3235.276451] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559805/real 1717559805]  req@ffff8800a7667480 x1800988830712192/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559821 ref 2 fl Rpc:XQr/202/fffffff
[ 3235.290996] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559805/real 1717559805]  req@ffff8800a7664380 x1800988830712128/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559821 ref 2 fl Rpc:XQr/202/fffffff
[ 3251.275956] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559805/real 1717559805]  req@ffff8800a7664380 x1800988830712128/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559821 ref 2 fl Rpc:eXSQU/202/ff
[ 3251.275962] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559821/real 1717559821]  req@ffff8800a7667800 x1800988830712384/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559837 ref 2 fl Rpc:XQr/202/fffffff
[ 3251.276000] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559821/real 1717559821]  req@ffff8800a7666300 x1800988830712320/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559837 ref 2 fl Rpc:XQr/202/fffffff
[ 3251.276029] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3251.276049] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559821/real 1717559821]  req@ffff8800a7665f80 x1800988830712256/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559837 ref 2 fl Rpc:XQr/202/fffffff
[ 3251.276067] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559821/real 1717559821]  req@ffff8800a7667480 x1800988830712192/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559837 ref 2 fl Rpc:XQr/202/fffffff
[ 3251.276086] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559821/real 1717559821]  req@ffff8800a7664380 x1800988830712128/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559837 ref 2 fl Rpc:XQr/202/fffffff
[ 3251.276104] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559821/real 1717559821]  req@ffff8800a7665c00 x1800988830712064/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559837 ref 2 fl Rpc:XQr/202/fffffff
[ 3251.276122] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559821/real 1717559821]  req@ffff8800a7667b80 x1800988830712000/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559837 ref 2 fl Rpc:XQr/202/fffffff
[ 3251.276140] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559821/real 1717559821]  req@ffff8800a7664a80 x1800988830711936/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559837 ref 2 fl Rpc:XQr/202/fffffff
[ 3251.276159] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559821/real 1717559821]  req@ffff8800a7665500 x1800988830711872/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559837 ref 2 fl Rpc:XQr/202/fffffff
[ 3251.276176] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559821/real 1717559821]  req@ffff8800a7666d80 x1800988830711808/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559837 ref 2 fl Rpc:XQr/202/fffffff
[ 3251.276194] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559821/real 1717559821]  req@ffff8800a8d23100 x1800988830706368/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559837 ref 2 fl Rpc:XQr/202/fffffff
[ 3251.276214] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559821/real 1717559821]  req@ffff8800a8d20a80 x1800988830706496/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559837 ref 2 fl Rpc:XQr/202/fffffff
[ 3251.276232] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559821/real 1717559821]  req@ffff8800a8d23480 x1800988830706624/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559837 ref 2 fl Rpc:XQr/202/fffffff
[ 3251.420075] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559821/real 1717559821]  req@ffff8800a8d20700 x1800988830706752/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559837 ref 2 fl Rpc:XQr/202/fffffff
[ 3267.307947] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559821/real 1717559821]  req@ffff8800a7667800 x1800988830712384/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559837 ref 2 fl Rpc:eXSQU/202/ff
[ 3267.307959] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559837/real 1717559837]  req@ffff8800a7666300 x1800988830712320/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559853 ref 2 fl Rpc:XQr/202/fffffff
[ 3267.308001] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559837/real 1717559837]  req@ffff8800a7667800 x1800988830712384/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559853 ref 2 fl Rpc:XQr/202/fffffff
[ 3267.308034] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3267.308063] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559837/real 1717559837]  req@ffff8800a8d20000 x1800988830706304/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559853 ref 2 fl Rpc:XQr/202/fffffff
[ 3267.308091] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559837/real 1717559837]  req@ffff8800a8d21180 x1800988830706432/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559853 ref 2 fl Rpc:XQr/202/fffffff
[ 3267.308118] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559837/real 1717559837]  req@ffff8800a8d20e00 x1800988830706560/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559853 ref 2 fl Rpc:XQr/202/fffffff
[ 3267.308143] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559837/real 1717559837]  req@ffff8800a8d20380 x1800988830706688/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559853 ref 2 fl Rpc:XQr/202/fffffff
[ 3267.406293] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559837/real 1717559837]  req@ffff8800a8d22300 x1800988830706816/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559853 ref 2 fl Rpc:XQr/202/fffffff
[ 3283.316945] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559837/real 1717559837]  req@ffff8800a7666300 x1800988830712320/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559853 ref 2 fl Rpc:eXSQU/202/ff
[ 3283.329350] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559853/real 1717559853]  req@ffff8800a7667800 x1800988830712384/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559869 ref 2 fl Rpc:XQr/202/fffffff
[ 3283.341410] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3283.347879] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559853/real 1717559853]  req@ffff8800a8d20000 x1800988830706304/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559869 ref 2 fl Rpc:XQr/202/fffffff
[ 3283.357209] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559853/real 1717559853]  req@ffff8800a8d21180 x1800988830706432/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559869 ref 2 fl Rpc:XQr/202/fffffff
[ 3299.348073] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559853/real 1717559853]  req@ffff8800a8d21180 x1800988830706432/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559869 ref 2 fl Rpc:eXSQU/202/ff
[ 3299.363499] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559869/real 1717559869]  req@ffff8800a7666300 x1800988830712320/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559885 ref 2 fl Rpc:XQr/202/fffffff
[ 3299.364924] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3299.391396] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559869/real 1717559869]  req@ffff8800a7667800 x1800988830712384/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559885 ref 2 fl Rpc:XQr/202/fffffff
[ 3299.391408] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559869/real 1717559869]  req@ffff8800a8d20000 x1800988830706304/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559885 ref 2 fl Rpc:XQr/202/fffffff
[ 3299.391466] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559869/real 1717559869]  req@ffff8800a7665f80 x1800988830712256/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559885 ref 2 fl Rpc:XQr/202/fffffff
[ 3299.391512] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559869/real 1717559869]  req@ffff8800a7667480 x1800988830712192/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559885 ref 2 fl Rpc:XQr/202/fffffff
[ 3299.391556] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559869/real 1717559869]  req@ffff8800a7664380 x1800988830712128/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559885 ref 2 fl Rpc:XQr/202/fffffff
[ 3299.391605] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559869/real 1717559869]  req@ffff8800a7665c00 x1800988830712064/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559885 ref 2 fl Rpc:XQr/202/fffffff
[ 3299.391652] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559869/real 1717559869]  req@ffff8800a7667b80 x1800988830712000/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559885 ref 2 fl Rpc:XQr/202/fffffff
[ 3299.391696] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559869/real 1717559869]  req@ffff8800a7664a80 x1800988830711936/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559885 ref 2 fl Rpc:XQr/202/fffffff
[ 3299.391744] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559869/real 1717559869]  req@ffff8800a7665500 x1800988830711872/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559885 ref 2 fl Rpc:XQr/202/fffffff
[ 3299.391789] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559869/real 1717559869]  req@ffff8800a7666d80 x1800988830711808/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559885 ref 2 fl Rpc:XQr/202/fffffff
[ 3299.391885] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559869/real 1717559869]  req@ffff8800a8d23100 x1800988830706368/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559885 ref 2 fl Rpc:XQr/202/fffffff
[ 3299.391931] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559869/real 1717559869]  req@ffff8800a8d20a80 x1800988830706496/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559885 ref 2 fl Rpc:XQr/202/fffffff
[ 3299.391976] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559869/real 1717559869]  req@ffff8800a8d23480 x1800988830706624/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559885 ref 2 fl Rpc:XQr/202/fffffff
[ 3299.523005] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559869/real 1717559869]  req@ffff8800a8d20700 x1800988830706752/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559885 ref 2 fl Rpc:XQr/202/fffffff
[ 3315.437045] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559869/real 1717559869]  req@ffff8800a8d20000 x1800988830706304/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559885 ref 2 fl Rpc:eXSQU/202/ff
[ 3315.451403] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559885/real 1717559885]  req@ffff8800a7666300 x1800988830712320/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559901 ref 2 fl Rpc:XQr/202/fffffff
[ 3315.462069] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3315.468952] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559885/real 1717559885]  req@ffff8800a7665f80 x1800988830712256/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559901 ref 2 fl Rpc:XQr/202/fffffff
[ 3315.481345] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559885/real 1717559885]  req@ffff8800a7667480 x1800988830712192/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559901 ref 2 fl Rpc:XQr/202/fffffff
[ 3331.481161] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559885/real 1717559885]  req@ffff8800a7667480 x1800988830712192/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559901 ref 2 fl Rpc:eXSQU/202/ff
[ 3331.491947] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559901/real 1717559901]  req@ffff8800a7667800 x1800988830712384/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559917 ref 2 fl Rpc:XQr/202/fffffff
[ 3331.491994] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559901/real 1717559901]  req@ffff8800a7666300 x1800988830712320/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559917 ref 2 fl Rpc:XQr/202/fffffff
[ 3331.492032] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3331.492083] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559901/real 1717559901]  req@ffff8800a7665f80 x1800988830712256/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559917 ref 2 fl Rpc:XQr/202/fffffff
[ 3331.492110] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559901/real 1717559901]  req@ffff8800a7667480 x1800988830712192/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559917 ref 2 fl Rpc:XQr/202/fffffff
[ 3331.492136] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559901/real 1717559901]  req@ffff8800a7664380 x1800988830712128/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559917 ref 2 fl Rpc:XQr/202/fffffff
[ 3331.492162] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559901/real 1717559901]  req@ffff8800a7665c00 x1800988830712064/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559917 ref 2 fl Rpc:XQr/202/fffffff
[ 3331.492188] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559901/real 1717559901]  req@ffff8800a7667b80 x1800988830712000/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559917 ref 2 fl Rpc:XQr/202/fffffff
[ 3331.492214] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559901/real 1717559901]  req@ffff8800a7664a80 x1800988830711936/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559917 ref 2 fl Rpc:XQr/202/fffffff
[ 3331.492240] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559901/real 1717559901]  req@ffff8800a7665500 x1800988830711872/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559917 ref 2 fl Rpc:XQr/202/fffffff
[ 3331.492277] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559901/real 1717559901]  req@ffff8800a7666d80 x1800988830711808/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559917 ref 2 fl Rpc:XQr/202/fffffff
[ 3331.492305] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559901/real 1717559901]  req@ffff8800a8d23100 x1800988830706368/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559917 ref 2 fl Rpc:XQr/202/fffffff
[ 3331.492334] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559901/real 1717559901]  req@ffff8800a8d20a80 x1800988830706496/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559917 ref 2 fl Rpc:XQr/202/fffffff
[ 3331.492362] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559901/real 1717559901]  req@ffff8800a8d23480 x1800988830706624/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559917 ref 2 fl Rpc:XQr/202/fffffff
[ 3331.626895] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559901/real 1717559901]  req@ffff8800a8d20700 x1800988830706752/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559917 ref 2 fl Rpc:XQr/202/fffffff
[ 3347.516100] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559901/real 1717559901]  req@ffff8800a7667800 x1800988830712384/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559917 ref 2 fl Rpc:eXSQU/202/ff
[ 3347.516121] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559917/real 1717559917]  req@ffff8800a7666300 x1800988830712320/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559933 ref 2 fl Rpc:XQr/202/fffffff
[ 3347.516175] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559917/real 1717559917]  req@ffff8800a7667800 x1800988830712384/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559933 ref 2 fl Rpc:XQr/202/fffffff
[ 3347.516221] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3347.516255] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559917/real 1717559917]  req@ffff8800a8d20000 x1800988830706304/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559933 ref 2 fl Rpc:XQr/202/fffffff
[ 3347.516284] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559917/real 1717559917]  req@ffff8800a8d21180 x1800988830706432/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559933 ref 2 fl Rpc:XQr/202/fffffff
[ 3347.516310] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559917/real 1717559917]  req@ffff8800a8d20e00 x1800988830706560/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559933 ref 2 fl Rpc:XQr/202/fffffff
[ 3347.516336] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559917/real 1717559917]  req@ffff8800a8d20380 x1800988830706688/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559933 ref 2 fl Rpc:XQr/202/fffffff
[ 3347.608127] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559917/real 1717559917]  req@ffff8800a8d22300 x1800988830706816/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559933 ref 2 fl Rpc:XQr/202/fffffff
[ 3363.524949] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559917/real 1717559917]  req@ffff8800a7666300 x1800988830712320/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559933 ref 2 fl Rpc:eXSQU/202/ff
[ 3363.542345] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559933/real 1717559933]  req@ffff8800a7667800 x1800988830712384/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559949 ref 2 fl Rpc:XQr/202/fffffff
[ 3363.560149] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3363.570196] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559933/real 1717559933]  req@ffff8800a8d20000 x1800988830706304/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559949 ref 2 fl Rpc:XQr/202/fffffff
[ 3363.589357] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559933/real 1717559933]  req@ffff8800a8d21180 x1800988830706432/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559949 ref 2 fl Rpc:XQr/202/fffffff
[ 3363.607391] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559933/real 1717559933]  req@ffff8800a8d20e00 x1800988830706560/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559949 ref 2 fl Rpc:XQr/202/fffffff
[ 3379.580010] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559933/real 1717559933]  req@ffff8800a8d20e00 x1800988830706560/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559949 ref 2 fl Rpc:eXSQU/202/ff
[ 3379.580019] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559949/real 1717559949]  req@ffff8800a7667800 x1800988830712384/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559965 ref 2 fl Rpc:XQr/202/fffffff
[ 3379.580069] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559949/real 1717559949]  req@ffff8800a7666300 x1800988830712320/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559965 ref 2 fl Rpc:XQr/202/fffffff
[ 3379.580115] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3379.580144] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559949/real 1717559949]  req@ffff8800a7665f80 x1800988830712256/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559965 ref 2 fl Rpc:XQr/202/fffffff
[ 3379.580172] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559949/real 1717559949]  req@ffff8800a7667480 x1800988830712192/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559965 ref 2 fl Rpc:XQr/202/fffffff
[ 3379.580201] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559949/real 1717559949]  req@ffff8800a7664380 x1800988830712128/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559965 ref 2 fl Rpc:XQr/202/fffffff
[ 3379.580227] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559949/real 1717559949]  req@ffff8800a7665c00 x1800988830712064/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559965 ref 2 fl Rpc:XQr/202/fffffff
[ 3379.580254] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559949/real 1717559949]  req@ffff8800a7667b80 x1800988830712000/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559965 ref 2 fl Rpc:XQr/202/fffffff
[ 3379.580281] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559949/real 1717559949]  req@ffff8800a7664a80 x1800988830711936/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559965 ref 2 fl Rpc:XQr/202/fffffff
[ 3379.580306] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559949/real 1717559949]  req@ffff8800a7665500 x1800988830711872/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559965 ref 2 fl Rpc:XQr/202/fffffff
[ 3379.580333] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559949/real 1717559949]  req@ffff8800a7666d80 x1800988830711808/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559965 ref 2 fl Rpc:XQr/202/fffffff
[ 3379.580360] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559949/real 1717559949]  req@ffff8800a8d23100 x1800988830706368/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559965 ref 2 fl Rpc:XQr/202/fffffff
[ 3379.580387] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559949/real 1717559949]  req@ffff8800a8d20a80 x1800988830706496/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559965 ref 2 fl Rpc:XQr/202/fffffff
[ 3379.580414] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559949/real 1717559949]  req@ffff8800a8d23480 x1800988830706624/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559965 ref 2 fl Rpc:XQr/202/fffffff
[ 3379.718787] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559949/real 1717559949]  req@ffff8800a8d20700 x1800988830706752/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559965 ref 2 fl Rpc:XQr/202/fffffff
[ 3395.595884] Lustre: 1952:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559949/real 1717559949]  req@ffff8800a7667800 x1800988830712384/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559965 ref 2 fl Rpc:eXSQU/202/ff
[ 3395.602051] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559965/real 1717559965]  req@ffff8800a7666300 x1800988830712320/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559981 ref 2 fl Rpc:XQr/202/fffffff
[ 3395.608278] Lustre: lustre-OST0000-osc-ffff8800aa579800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3395.611985] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559965/real 1717559965]  req@ffff8800a7665f80 x1800988830712256/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559981 ref 2 fl Rpc:XQr/202/fffffff
[ 3395.620229] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559965/real 1717559965]  req@ffff8800a7667480 x1800988830712192/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559981 ref 2 fl Rpc:XQr/202/fffffff
[ 3398.737159] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1717559965/real 1717559965]  req@ffff8800a7667480 x1800988830712192/t0(0) o4->lustre-OST0000-osc-ffff8800aa579800@192.168.202.146@tcp:6/4 lens 488/448 e 0 to 1 dl 1717559981 ref 2 fl Rpc:eXSQU/202/ff
[ 3415.145961] Lustre: DEBUG MARKER: == recovery-small test 56: do not fail on getattr resend ========================================================== 23:59:44 (1717559984)
[ 3415.148978] Lustre: 26380:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717559985/real 1717559985]  req@ffff88012da10700 x1800988830756800/t0(0) o101->lustre-MDT0000-mdc-ffff8800aa579800@192.168.202.146@tcp:12/10 lens 576/1024 e 0 to 1 dl 1717560001 ref 2 fl Rpc:XQr/200/ff
[ 3431.162990] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3431.166576] Lustre: 26380:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717560001/real 1717560001]  req@ffff88012da10700 x1800988830756800/t0(0) o101->lustre-MDT0000-mdc-ffff8800aa579800@192.168.202.146@tcp:12/10 lens 576/1024 e 0 to 1 dl 1717560017 ref 2 fl Rpc:XQr/202/ff
[ 3440.724945] Lustre: lustre-MDT0000-mdc-ffff8800aa579800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3441.881844] Lustre: DEBUG MARKER: == recovery-small test 57: read procfs entries causes kernel crash ========================================================== 00:00:26 (1717560026)
[ 3448.786609] Lustre: Unmounted lustre-client
[ 3451.070956] Lustre: Mounted lustre-client
[ 3451.186752] Lustre: DEBUG MARKER: == recovery-small test 58: Eviction in the middle of open RPC reply processing ========================================================== 00:00:36 (1717560036)
[ 3452.193959] LustreError: 28114:0:(/home/green/git/lustre-release/libcfs/libcfs/fail.c:141:__cfs_fail_timeout_set()) cfs_fail_timeout id 801 sleeping for 20000ms
[ 3469.658981] LustreError: 28114:0:(/home/green/git/lustre-release/libcfs/libcfs/fail.c:148:__cfs_fail_timeout_set()) cfs_fail_timeout interrupted
[ 3469.732944] Lustre: DEBUG MARKER: == recovery-small test 59: Read cancel race on client eviction ========================================================== 00:00:55 (1717560055)
[ 3469.906421] Lustre: Mounted lustre-client
[ 3469.909059] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request
[ 3469.911050] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request
[ 3479.940863] Lustre: setting import lustre-OST0001_UUID INACTIVE by administrator request
[ 3482.077137] Lustre: Unmounted lustre-client
[ 3512.538539] Lustre: DEBUG MARKER: == recovery-small test 60: Add Changelog entries during MDS failover ========================================================== 00:01:07 (1717560067)
[ 3512.549896] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aae24800: operation mds_reint to node 192.168.202.146@tcp failed: rc = -19
[ 3529.805690] Lustre: lustre-MDT0000-mdc-ffff8800aae24800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3529.814608] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 3555.300033] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a65a44802 to 0x9ec10a1a65a72e02
[ 3557.030034] Lustre: DEBUG MARKER: == recovery-small test 61: Verify to not reuse orphan objects - bug 17025 ========================================================== 00:02:20 (1717560140)
[ 3563.796577] Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000
[ 3563.800859] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aae24800: operation mds_statfs to node 192.168.202.146@tcp failed: rc = -107
[ 3563.823437] Lustre: lustre-MDT0000-mdc-ffff8800aae24800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3564.869871] LustreError: 167-0: lustre-MDT0000-mdc-ffff8800aae24800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 3564.875692] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 3566.647959] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a65a72e02 to 0x9ec10a1a65aba111
[ 3566.822398] Lustre: DEBUG MARKER: == recovery-small test 65: lock enqueue for destroyed export ========================================================== 00:02:32 (1717560152)
[ 3571.830758] Lustre: Mounted lustre-client
[ 3571.834127] Lustre: lustre-OST0000-osc-ffff8800aae24800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3571.843423] LustreError: 167-0: lustre-OST0000-osc-ffff8800aae24800: This client was evicted by lustre-OST0000; in progress operations using this service will fail.
[ 3583.263105] LustreError: 32071:0:(/home/green/git/lustre-release/lustre/ptlrpc/../../lustre/ldlm/ldlm_resource.c:1128:ldlm_resource_complain()) lustre-OST0000-osc-ffff8800aae24800: namespace resource [0x2400013a0:0xd623:0x0].0x0 (ffff8800adc6cd00) refcount nonzero (2) after lock cleanup; forcing cleanup.
[ 3583.275718] Lustre: 1951:0:(/home/green/git/lustre-release/lustre/ptlrpc/client.c:2343:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1717560153/real 1717560153]  req@ffff8800a8d22a00 x1800988833019456/t0(0) o103->lustre-OST0000-osc-ffff8800a80e7000@192.168.202.146@tcp:17/18 lens 328/224 e 0 to 1 dl 1717560169 ref 1 fl Rpc:XQr/200/fff
[ 3583.535891] Lustre: lustre-OST0000-osc-ffff8800a80e7000: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3585.555670] Lustre: Unmounted lustre-client
[ 3588.078572] Lustre: DEBUG MARKER: == recovery-small test 66: lock enqueue re-send vs client eviction ========================================================== 00:02:51 (1717560171)
[ 3590.400351] Lustre: lustre-MDT0000-mdc-ffff8800aae24800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3590.404375] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aae24800: operation ldlm_enqueue to node 192.168.202.146@tcp failed: rc = -107
[ 3590.408580] Lustre: lustre-MDT0000-mdc-ffff8800aae24800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3590.417157] LustreError: 167-0: lustre-MDT0000-mdc-ffff8800aae24800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 3592.728381] LustreError: 363:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -5
[ 3592.785231] Lustre: DEBUG MARKER: == recovery-small test 67: connect vs import invalidate race ========================================================== 00:02:58 (1717560178)
[ 3592.792206] Lustre: lustre-MDT0000-mdc-ffff8800aae24800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3596.116753] LustreError: 1136:0:(/home/green/git/lustre-release/libcfs/include/libcfs/libcfs_fail.h:197:cfs_race_loc()) cfs_race id 531 sleeping
[ 3596.122746] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800aae24800: operation ldlm_enqueue to node 192.168.202.146@tcp failed: rc = -107
[ 3596.130582] Lustre: lustre-MDT0000-mdc-ffff8800aae24800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3596.142159] LustreError: 167-0: lustre-MDT0000-mdc-ffff8800aae24800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
[ 3596.150859] LustreError: 1159:0:(/home/green/git/lustre-release/libcfs/include/libcfs/libcfs_fail.h:210:cfs_race_loc()) cfs_fail_race id 531 waking
[ 3596.158704] LustreError: 1136:0:(/home/green/git/lustre-release/libcfs/include/libcfs/libcfs_fail.h:208:cfs_race_loc()) cfs_fail_race id 531 awake: rc=1649
[ 3596.160894] LustreError: 1136:0:(/home/green/git/lustre-release/lustre/ptlrpc/import.c:705:ptlrpc_connect_import_locked()) already connecting
[ 3596.162607] LustreError: 1165:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3596.170892] LustreError: 1166:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3596.176242] LustreError: 1167:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3596.179255] LustreError: 1168:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3596.179381] LustreError: 1169:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3597.184870] LustreError: 1169:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3597.207195] LustreError: 1172:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3597.216494] LustreError: 1177:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3597.232137] LustreError: 1178:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3597.244785] LustreError: 1179:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3597.255506] LustreError: 1180:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3597.263286] LustreError: 1181:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3598.276633] LustreError: 1181:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3598.303455] LustreError: 1184:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3598.315104] LustreError: 1189:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3598.338564] LustreError: 1190:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3598.354772] LustreError: 1191:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3598.365344] LustreError: 1192:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3598.370830] LustreError: 1193:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3599.381106] LustreError: 1193:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3599.407074] LustreError: 1195:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3599.416660] LustreError: 1200:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3599.434062] LustreError: 1201:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3599.448016] LustreError: 1202:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3599.458477] LustreError: 1203:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3599.465115] LustreError: 1204:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3600.479221] LustreError: 1204:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3600.503141] LustreError: 1207:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3600.510908] LustreError: 1212:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3600.522019] LustreError: 1213:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3600.529661] LustreError: 1214:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3600.536971] LustreError: 1215:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3600.542844] LustreError: 1216:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3601.554981] LustreError: 1216:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3601.582355] LustreError: 1219:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3601.594695] LustreError: 1224:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3601.611148] LustreError: 1225:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3601.626178] LustreError: 1226:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3601.641835] LustreError: 1227:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3601.648624] LustreError: 1228:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3602.661065] LustreError: 1228:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3602.687114] LustreError: 1231:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3602.696434] LustreError: 1236:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3602.715089] LustreError: 1237:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3602.729608] LustreError: 1238:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3602.740972] LustreError: 1239:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3602.748620] LustreError: 1240:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3603.762256] LustreError: 1240:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3603.785486] LustreError: 1243:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3603.792896] LustreError: 1248:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3603.804464] LustreError: 1249:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3603.816217] LustreError: 1250:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3603.825229] LustreError: 1251:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3603.830289] LustreError: 1252:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3604.840508] LustreError: 1252:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3604.867459] LustreError: 1255:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3604.877948] LustreError: 1260:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3604.894252] LustreError: 1261:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3604.908497] LustreError: 1262:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3604.920126] LustreError: 1263:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3604.927171] LustreError: 1264:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3605.940086] LustreError: 1264:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3605.965121] LustreError: 1267:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3605.974473] LustreError: 1272:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3605.990338] LustreError: 1273:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3606.003344] LustreError: 1274:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3606.014323] LustreError: 1275:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3606.022382] LustreError: 1276:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3609.197478] LustreError: 1276:0:(/home/green/git/lustre-release/lustre/llite/file.c:5683:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108
[ 3611.349948] Lustre: DEBUG MARKER: == recovery-small test 100: IR: Make sure normal recovery still works w/o IR ========================================================== 00:03:14 (1717560194)
[ 3629.163741] Lustre: lustre-OST0000-osc-ffff8800aae24800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3629.755162] Lustre: DEBUG MARKER: oleg246-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
[ 3633.867222] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec
[ 3636.390454] Lustre: DEBUG MARKER: == recovery-small test 101a: IR: Make sure IR works w/o normal recovery ========================================================== 00:03:39 (1717560219)
[ 3651.959972] Lustre: lustre-OST0000-osc-ffff8800aae24800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3652.381151] Lustre: DEBUG MARKER: oleg246-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
[ 3656.600456] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec
[ 3661.430714] Lustre: DEBUG MARKER: == recovery-small test 101b: IR: Make sure IR works w/o normal recovery and proceed EAGAIN ========================================================== 00:04:02 (1717560242)
[ 3700.372449] Lustre: lustre-OST0000-osc-ffff8800aae24800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3700.913210] Lustre: DEBUG MARKER: oleg246-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
[ 3704.245601] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec
[ 3706.502469] Lustre: DEBUG MARKER: == recovery-small test 102: IR: New client gets updated nidtbl after MGS restart ========================================================== 00:04:49 (1717560289)
[ 3722.643917] Lustre: lustre-OST0000-osc-ffff8800aae24800: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3723.199569] Lustre: DEBUG MARKER: oleg246-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
[ 3725.470908] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec
[ 3748.116873] Lustre: Unmounted lustre-client
[ 3749.457895] Lustre: DEBUG MARKER: oleg246-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
[ 3751.585389] Lustre: Mounted lustre-client
[ 3752.452383] Lustre: DEBUG MARKER: == recovery-small test 103: IR: MDS can start w/o MGS and get updated nidtbl later ========================================================== 00:05:37 (1717560337)
[ 3753.090722] Lustre: DEBUG MARKER: SKIP: recovery-small test_103 needs separate mgs and mds
[ 3754.470313] Lustre: DEBUG MARKER: == recovery-small test 104: IR: ost can disable IR voluntarily ========================================================== 00:05:38 (1717560338)
[ 3763.148486] Lustre: lustre-OST0000-osc-ffff8800a84fa000: Connection to lustre-OST0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3763.692993] Lustre: DEBUG MARKER: == recovery-small test 105: IR: NON IR clients support === 00:05:48 (1717560348)
[ 3764.271418] Lustre: DEBUG MARKER: SKIP: recovery-small test_105 Needs multiple clients
[ 3764.578306] Lustre: DEBUG MARKER: == recovery-small test 106: lightweight connection support ========================================================== 00:05:49 (1717560349)
[ 3765.990568] Lustre: Mounted lustre-client
[ 3779.605456] Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000
[ 3779.605464] LustreError: 166-1: MGC192.168.202.146@tcp: Connection to MGS (at 192.168.202.146@tcp) was lost; in progress operations using this service will fail
[ 3779.613033] Lustre: lustre-MDT0000-mdc-ffff8800a84fa000: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3779.614486] Lustre: lustre-MDT0000-mdc-ffff8800aae25800: Connection to lustre-MDT0000 (at 192.168.202.146@tcp) was lost; in progress operations using this service will wait for recovery to complete
[ 3781.870952] Lustre: Evicted from MGS (at 192.168.202.146@tcp) after server handle changed from 0x9ec10a1a65abaacd to 0x9ec10a1a65abadcf