[ 5606.639249] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 5609.917336] Lustre: DEBUG MARKER: Write 100M (buffered) ...
[ 5611.824908] LustreError: 122930:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 5612.527987] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 5613.503648] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 5614.822290] Lustre: Failing over lustre-MDT0000
[ 5615.173841] Lustre: server umount lustre-MDT0000 complete
[ 5630.009220] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 5630.248123] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 5630.258961] Lustre: Skipped 1 previous similar message
[ 5630.380825] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 5630.437774] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 5632.288063] Lustre: 3329:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779692885/real 1779692885]  req@ffff8a1a05bbce00 x1866137515367424/t0(0) o601->lustre-MDT0000-lwp-OST0000@0@lo:23/10 lens 336/336 e 0 to 1 dl 1779692901 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'lquota_wb_lustr.0' uid:0 gid:0 projid:4294967295
[ 5632.369184] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 5632.452167] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 5632.471832] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1168 to 0x240000400:1185)
[ 5632.472507] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1164 to 0x280000400:1185)
[ 5632.724519] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5635.559882] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo)
[ 5636.575416] Lustre: 3329:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779692890/real 1779692890]  req@ffff8a1947302a00 x1866137515367808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1779692906 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 5636.592444] Lustre: 3329:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[ 5638.642493] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 5639.655794] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 5641.695485] Lustre: 3330:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779692895/real 1779692895]  req@ffff8a1a05bbfb80 x1866137515368064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1779692911 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 5641.707096] Lustre: 3330:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 5648.735877] Lustre: DEBUG MARKER: (dd_pid=115402, time=3, timeout=600)
[ 5724.011409] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 5734.528829] Lustre: DEBUG MARKER: Write 100M (directio) ...
[ 5741.253050] LustreError: 125678:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 5743.752544] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 5748.295868] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 5754.826362] Lustre: Failing over lustre-MDT0000
[ 5755.813536] Lustre: server umount lustre-MDT0000 complete
[ 5773.792774] Lustre: 3330:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693027/real 1779693027]  req@ffff8a1905d5aa00 x1866137515410944/t0(0) o601->lustre-MDT0000-lwp-OST0000@0@lo:23/10 lens 336/336 e 0 to 1 dl 1779693043 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'lquota_wb_lustr.0' uid:0 gid:0 projid:4294967295
[ 5773.835803] Lustre: 3330:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 5773.870146] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 5774.815170] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 5780.004116] Lustre: 3331:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693033/real 1779693033]  req@ffff8a1a3eb19180 x1866137515411584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1779693049 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 5780.058104] Lustre: 3331:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 5784.993645] LustreError: 3327:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight  req@ffff8a1a03675f80 x1866137515414272/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 5785.847686] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 5786.136660] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 5789.729279] Lustre: 3331:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693043/real 1779693043]  req@ffff8a1a03676d80 x1866137515412480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1779693059 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 5789.789593] Lustre: 3331:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 5794.497377] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5796.979349] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 5797.162179] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 5797.197875] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1187 to 0x240000400:1217)
[ 5797.198926] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1164 to 0x280000400:1217)
[ 5799.016496] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo)
[ 5799.026613] Lustre: Skipped 1 previous similar message
[ 5805.674831] Lustre: DEBUG MARKER: oleg152-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 5808.320714] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 5824.743701] Lustre: DEBUG MARKER: (dd_pid=117811, time=7, timeout=600)
[ 5900.941680] Lustre: DEBUG MARKER: == sanity-quota test 19: Updating admin limits doesn't zero operational limits(b14790) ========================================================== 03:12:48 (1779693168)
[ 5929.715877] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 5931.976412] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 5940.142736] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 5942.584960] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 5982.407826] Lustre: DEBUG MARKER: == sanity-quota test 20: Test if setquota specifiers work properly (b15754) ========================================================== 03:14:10 (1779693250)
[ 6017.425655] Lustre: DEBUG MARKER: == sanity-quota test 21: Setquota while writing
[ 6037.737222] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for user: quota_usr
[ 6040.170835] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for group: quota_usr
[ 6042.760632] Lustre: DEBUG MARKER: Set limit(block:10G; file:) for project: 1000
[ 6045.462387] Lustre: DEBUG MARKER: Set quota for 1 times
[ 6051.401887] Lustre: DEBUG MARKER: Set quota for 2 times
[ 6056.958087] Lustre: DEBUG MARKER: Set quota for 3 times
[ 6062.337972] Lustre: DEBUG MARKER: Set quota for 4 times
[ 6067.923824] Lustre: DEBUG MARKER: Set quota for 5 times
[ 6073.386530] Lustre: DEBUG MARKER: Set quota for 6 times
[ 6128.927696] Lustre: DEBUG MARKER: == sanity-quota test 22: enable/disable quota by 'lctl conf_param/set_param -P' ========================================================== 03:16:36 (1779693396)
[ 6151.193747] Lustre: server umount lustre-MDT0000 complete
[ 6158.239181] LustreError: 20154:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1779693427 with bad export cookie 1500163724697915751
[ 6158.268168] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 6167.731294] Lustre: server umount lustre-OST0000 complete
[ 6170.015736] Lustre: 3331:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693423/real 1779693423]  req@ffff8a1a03682680 x1866137515546880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1779693439 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 6170.065173] Lustre: 3331:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 6170.093767] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 6170.129758] Lustre: Skipped 1 previous similar message
[ 6174.767971] Lustre: server umount lustre-OST0001 complete
[ 6197.869564] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local
[ 6214.253253] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 6220.968634] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6226.409881] Lustre: 135040:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 6236.147656] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 6240.171279] LustreError: 135363:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 6240.218383] LustreError: 135363:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message
[ 6240.257714] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1220 to 0x240000400:1249)
[ 6245.360226] LustreError: 135364:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 6246.385741] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6250.471499] LustreError: 135363:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 6255.588143] LustreError: 135366:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 6258.551892] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 6263.828358] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1219 to 0x280000400:1249)
[ 6268.639420] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6280.637554] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 6286.150988] Lustre: 136842:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 6311.315373] Lustre: server umount lustre-MDT0000 complete
[ 6318.366586] LustreError: 134603:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1779693588 with bad export cookie 1500163724697921729
[ 6318.391035] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 6329.014503] Lustre: server umount lustre-OST0000 complete
[ 6331.360606] Lustre: 3328:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693584/real 1779693584]  req@ffff8a1a3e489180 x1866137515594624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1779693600 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 6331.408519] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 6335.789436] Lustre: server umount lustre-OST0001 complete
[ 6362.136480] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local
[ 6376.999939] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 6385.153286] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6389.940100] Lustre: 139412:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 6399.087544] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 6402.084176] LustreError: 139738:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 6402.136306] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1220 to 0x240000400:1281)
[ 6410.130601] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6412.255970] LustreError: 139843:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 6412.292621] LustreError: 139843:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message
[ 6426.633188] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1219 to 0x280000400:1281)
[ 6432.052826] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6443.630648] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 6449.103743] Lustre: 141208:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 6464.467059] Lustre: DEBUG MARKER: == sanity-quota test 23: Quota should be honored with directIO (b16125) ========================================================== 03:22:11 (1779693731)
[ 6467.303496] Lustre: DEBUG MARKER: SKIP: sanity-quota test_23 Overwrite in place is not guaranteed to be space neutral on ZFS
[ 6469.490544] Lustre: DEBUG MARKER: == sanity-quota test 24: lfs draws an asterix when limit is reached (b16646) ========================================================== 03:22:17 (1779693737)
[ 6545.541651] Lustre: DEBUG MARKER: == sanity-quota test 25: check indexes versions ========== 03:23:33 (1779693813)
[ 6614.839893] Lustre: DEBUG MARKER: Write...
[ 6621.453981] Lustre: DEBUG MARKER: Write out of block quota ...
[ 6695.660183] Lustre: DEBUG MARKER: == sanity-quota test 27a: lfs quota/setquota should handle wrong arguments (b19612) ========================================================== 03:26:02 (1779693962)
[ 6706.666553] Lustre: DEBUG MARKER: == sanity-quota test 27b: lfs quota/setquota should handle user/group/project ID (b20200) ========================================================== 03:26:13 (1779693973)
[ 6720.963861] Lustre: DEBUG MARKER: == sanity-quota test 27c: lfs quota should support human-readable output ========================================================== 03:26:28 (1779693988)
[ 6733.878749] Lustre: DEBUG MARKER: == sanity-quota test 27d: lfs setquota should support fraction block limit ========================================================== 03:26:41 (1779694001)
[ 6746.380049] Lustre: DEBUG MARKER: == sanity-quota test 30: Hard limit updates should not reset grace times ========================================================== 03:26:53 (1779694013)
[ 6830.717657] Lustre: DEBUG MARKER: == sanity-quota test 33: Basic usage tracking for user
[ 7047.592203] Lustre: DEBUG MARKER: == sanity-quota test 34: Usage transfer for user
[ 7283.523341] Lustre: DEBUG MARKER: == sanity-quota test 35: Usage is still accessible across reboot ========================================================== 03:35:51 (1779694551)
[ 7370.600436] Lustre: DEBUG MARKER: Restart...
[ 7378.962422] Lustre: server umount lustre-MDT0000 complete
[ 7385.563849] LustreError: 138984:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1779694655 with bad export cookie 1500163724697923262
[ 7385.582956] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 7394.783723] Lustre: 3330:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779694648/real 1779694648]  req@ffff8a1a3d732d80 x1866137515868032/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1779694664 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 7394.820602] Lustre: 3330:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 7394.833435] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 7396.027927] Lustre: server umount lustre-OST0000 complete
[ 7401.766283] Lustre: server umount lustre-OST0001 complete
[ 7425.244447] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local
[ 7440.519789] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 7440.523320] Lustre: Skipped 1 previous similar message
[ 7447.186912] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7451.972314] Lustre: 159390:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 7459.571286] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 7464.685601] LustreError: 159715:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7464.737056] LustreError: 159715:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message
[ 7464.824792] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1290 to 0x240000400:1313)
[ 7468.865728] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7470.057442] LustreError: 159713:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7475.172830] LustreError: 159715:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7480.573537] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 7486.000043] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1290 to 0x280000400:1313)
[ 7489.104282] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7499.552557] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 7504.812075] Lustre: 161183:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 7589.367916] Lustre: DEBUG MARKER: == sanity-quota test 37: Quota accounted properly for file created by 'lfs setstripe' ========================================================== 03:40:56 (1779694856)
[ 7674.403580] Lustre: DEBUG MARKER: == sanity-quota test 38: Quota accounting iterator doesn't skip id entries ========================================================== 03:42:21 (1779694941)
[10111.867646] Lustre: DEBUG MARKER: == sanity-quota test 39: Project ID interface works correctly ========================================================== 04:22:59 (1779697379)
[10131.465563] Lustre: server umount lustre-MDT0000 complete
[10137.701696] LustreError: 165646:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1779697407 with bad export cookie 1500163724697929786
[10137.723157] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[10148.565269] Lustre: server umount lustre-OST0000 complete
[10149.355236] Lustre: 3330:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779697402/real 1779697402]  req@ffff8a19425d3b80 x1866137518961024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1779697418 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[10149.405144] Lustre: 3330:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[10149.422658] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[10153.503409] Lustre: 3328:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779697407/real 1779697407]  req@ffff8a1943634380 x1866137518961536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1779697423 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[10154.715595] Lustre: server umount lustre-OST0001 complete
[10176.352512] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local
[10193.304732] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[10200.847158] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[10205.117268] Lustre: 169579:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[10214.501287] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[10217.513201] LustreError: 169898:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[10217.594627] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6316 to 0x240000400:6337)
[10222.567439] LustreError: 169898:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[10224.226269] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[10227.682864] LustreError: 169900:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[10232.808862] LustreError: 169898:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[10234.162340] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[10239.493398] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6314 to 0x280000400:6337)
[10244.005562] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[10254.024561] Lustre: DEBUG MARKER: Using TIMEOUT=20
[10258.588497] Lustre: 171363:0:(mgs_llog.c:1437:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[10295.534049] Lustre: DEBUG MARKER: == sanity-quota test 40a: Hard link across different project ID ========================================================== 04:26:03 (1779697563)
[10345.393685] Lustre: DEBUG MARKER: == sanity-quota test 40b: Mv across different project ID ========================================================== 04:26:52 (1779697612)
[10406.211296] Lustre: DEBUG MARKER: == sanity-quota test 40c: Remote child Dir inherit project quota properly ========================================================== 04:27:53 (1779697673)
[10408.768766] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40c needs >= 2 MDTs
[10411.586168] Lustre: DEBUG MARKER: == sanity-quota test 40d: Stripe Directory inherit project quota properly ========================================================== 04:27:59 (1779697679)
[10413.571290] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40d needs >= 2 MDTs
[10416.488397] Lustre: DEBUG MARKER: == sanity-quota test 41: df should return projid-specific values ========================================================== 04:28:04 (1779697684)
[10521.833804] Lustre: DEBUG MARKER: == sanity-quota test 42: lfs quota should include default quota info ========================================================== 04:29:49 (1779697789)
[10582.934645] Lustre: DEBUG MARKER: == sanity-quota test 48: lfs quota --delete should delete quota project ID ========================================================== 04:30:50 (1779697850)
[10699.033522] Lustre: DEBUG MARKER: == sanity-quota test 49a: lfs quota -a prints the quota usage for all quota IDs ========================================================== 04:32:46 (1779697966)
[10714.089898] Lustre: *** cfs_fail_loc=a09, val=0***
[10714.091702] Lustre: Skipped 1 previous similar message
[10715.150540] Lustre: *** cfs_fail_loc=a09, val=0***
[10715.161957] Lustre: Skipped 33 previous similar messages
[10717.183244] Lustre: *** cfs_fail_loc=a09, val=0***
[10717.188306] Lustre: Skipped 79 previous similar messages
[10721.228431] Lustre: *** cfs_fail_loc=a09, val=0***
[10721.237151] Lustre: Skipped 117 previous similar messages
[10729.229599] Lustre: *** cfs_fail_loc=a09, val=0***
[10729.233538] Lustre: Skipped 236 previous similar messages
[10745.276345] Lustre: *** cfs_fail_loc=a09, val=0***
[10745.285821] Lustre: Skipped 612 previous similar messages
[10777.292628] Lustre: *** cfs_fail_loc=a09, val=0***
[10777.303595] Lustre: Skipped 1153 previous similar messages
[10841.330508] Lustre: *** cfs_fail_loc=a09, val=0***
[10841.333211] Lustre: Skipped 2099 previous similar messages
[11576.624627] Lustre: *** cfs_fail_loc=a08, val=0***
[11576.639168] Lustre: Skipped 3664 previous similar messages
[11576.652385] Lustre: *** cfs_fail_loc=a08, val=0***
[11581.761288] Lustre: *** cfs_fail_loc=a08, val=0***
[11581.766850] Lustre: Skipped 124 previous similar messages
[11586.877689] Lustre: *** cfs_fail_loc=a08, val=0***
[11586.895512] Lustre: Skipped 141 previous similar messages
[11592.001026] Lustre: *** cfs_fail_loc=a08, val=0***
[11592.002721] Lustre: Skipped 254 previous similar messages
[11596.150932] Lustre: *** cfs_fail_loc=a08, val=0***
[11596.158143] Lustre: Skipped 267 previous similar messages
[11606.518603] Lustre: *** cfs_fail_loc=a08, val=0***
[11606.530637] Lustre: Skipped 455 previous similar messages
[11626.987762] Lustre: *** cfs_fail_loc=a08, val=0***
[11626.997735] Lustre: Skipped 957 previous similar messages
[11661.057377] Lustre: *** cfs_fail_loc=a08, val=0***
[11661.067550] Lustre: Skipped 1594 previous similar messages
[11741.982404] Lustre: *** cfs_fail_loc=a08, val=0***
[11741.986978] Lustre: Skipped 146 previous similar messages
[11761.532566] LustreError: lustre-MDT0000-lwp-OST0001: operation quota_acquire to node 0@lo failed: rc = -107
[11761.540411] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[11761.546588] LustreError: Skipped 1 previous similar message
[11761.547553] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[11761.604130] Lustre: Skipped 1 previous similar message
[11765.221575] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[11765.227734] Lustre: Skipped 2 previous similar messages
[11767.906119] Lustre: server umount lustre-MDT0000 complete
[11774.808941] LustreError: 169148:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1779699044 with bad export cookie 1500163724699715794
[11774.834603] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[11775.078500] Lustre: server umount lustre-OST0000 complete
[11781.750239] Lustre: server umount lustre-OST0001 complete
[11793.093535] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_hostid
[11806.187621] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local
[11821.361979]  vdc: vdc1 vdc9
[11835.879102]  vde: vde1 vde9
[11835.911853]  vde: vde1 vde9
[11850.536376]  vdf: vdf1 vdf9
[11878.471411] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local
[11892.955624] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000
[11893.335375] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space.
[11893.565766] Lustre: lustre-MDT0000: new disk, initializing
[11894.122384] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[11894.197350] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt
[11901.298744] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[11907.827567] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params
[11915.820153] Lustre: lustre-OST0000: new disk, initializing
[11915.825611] Lustre: srv-lustre-OST0000: No data found on store. Initialize space.
[11915.829560] Lustre: Skipped 1 previous similar message
[11915.976565] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[11917.702383] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost
[11917.717225] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost]
[11917.999642] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400
[11925.332200] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[11939.377968] Lustre: lustre-OST0001: new disk, initializing
[11939.383575] Lustre: srv-lustre-OST0001: No data found on store. Initialize space.
[11939.516423] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[11941.159910] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost
[11941.183428] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost]
[11941.350982] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400
[11949.866862] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[11964.338761] Lustre: DEBUG MARKER: Using TIMEOUT=20
[11969.249984] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params
[12017.967760] Lustre: DEBUG MARKER: == sanity-quota test 49b: lfs quota -a --blocks has a delimiter ========================================================== 04:54:45 (1779699285)
[12027.114978] Lustre: DEBUG MARKER: == sanity-quota test 50: Test if lfs find --projid works ========================================================== 04:54:54 (1779699294)
[12092.250795] Lustre: DEBUG MARKER: == sanity-quota test 51: Test project accounting with mv/cp ========================================================== 04:55:59 (1779699359)
[12181.010615] Lustre: DEBUG MARKER: == sanity-quota test 52: Rename normal file across project ID ========================================================== 04:57:28 (1779699448)
[12223.593641] Lustre: DEBUG MARKER: rename directory return 255
[12293.556564] Lustre: DEBUG MARKER: == sanity-quota test 53: Project inherit attribute could be cleared ========================================================== 04:59:21 (1779699561)
[12339.635639] Lustre: DEBUG MARKER: == sanity-quota test 54: basic lfs project interface test ========================================================== 05:00:06 (1779699606)
[12409.782849] Lustre: DEBUG MARKER: == sanity-quota test 55: Chgrp should be affected by group quota ========================================================== 05:01:17 (1779699677)
[12570.805979] LustreError: 196083:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:dt-0x0 id:60001 enforced:1 hard:51200 soft:0 granted:51200 time:0 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[12622.203986] Lustre: DEBUG MARKER: == sanity-quota test 56: lfs quota -t should work well === 05:04:49 (1779699889)
[12674.811839] Lustre: DEBUG MARKER: == sanity-quota test 57: lfs project could tolerate errors ========================================================== 05:05:42 (1779699942)
[12735.660662] Lustre: DEBUG MARKER: == sanity-quota test 58: project ID should be kept for new mirrors created by FID ========================================================== 05:06:42 (1779700002)
[12997.681889] Lustre: DEBUG MARKER: == sanity-quota test 59: lfs project dosen't crash kernel with project disabled ========================================================== 05:11:04 (1779700264)
[13000.471477] Lustre: DEBUG MARKER: SKIP: sanity-quota test_59 ldiskfs only test
[13003.116728] Lustre: DEBUG MARKER: == sanity-quota test 60: Test quota for root with setgid ========================================================== 05:11:10 (1779700270)
[13082.683061] Lustre: DEBUG MARKER: SKIP: sanity-quota test_61 skipping SLOW test 61
[13084.917171] Lustre: DEBUG MARKER: == sanity-quota test 62: Project inherit should be only changed by root ========================================================== 05:12:32 (1779700352)
[13130.568741] Lustre: DEBUG MARKER: SKIP: sanity-quota test_63 skipping excluded test 63
[13133.773393] Lustre: DEBUG MARKER: == sanity-quota test 64: lfs project on non-dir/files should succeed ========================================================== 05:13:21 (1779700401)
[13206.472899] Lustre: DEBUG MARKER: SKIP: sanity-quota test_65 skipping excluded test 65
[13209.083773] Lustre: DEBUG MARKER: == sanity-quota test 66: nonroot user can not change project state in default ========================================================== 05:14:36 (1779700476)
[13273.099975] Lustre: DEBUG MARKER: == sanity-quota test 67: quota pools recalculation ======= 05:15:39 (1779700539)
[13276.937840] Lustre: DEBUG MARKER: SKIP: sanity-quota test_67 ZFS grants some block space together with inode
[13280.948426] Lustre: DEBUG MARKER: == sanity-quota test 68: slave number in quota pool changed after each add/remove OST ========================================================== 05:15:47 (1779700547)
[13319.515440] LustreError: 208895:0:(mgs_handler.c:1140:mgs_iocontrol_pool()) OBD_IOC_POOL err -17, cmd CE021 for pool lustre.qpool1
[13380.519856] Lustre: DEBUG MARKER: == sanity-quota test 69: EDQUOT at one of pools shouldn't affect DOM ========================================================== 05:17:27 (1779700647)
[13420.931990] Lustre: DEBUG MARKER: User quota (block hardlimit:200 MB)
[13423.484609] Lustre: DEBUG MARKER: User quota (block hardlimit:10 MB)
[13686.938800] LustreError: 3328:0:(qsd_reint.c:627:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[13686.961255] LustreError: 3328:0:(qsd_reint.c:627:qqi_reint_delayed()) Skipped 1 previous similar message
[13691.560891] Lustre: DEBUG MARKER: == sanity-quota test 70a: check lfs setquota/quota with a pool option ========================================================== 05:22:39 (1779700959)
[13760.017513] Lustre: DEBUG MARKER: == sanity-quota test 70b: lfs setquota pool works properly ========================================================== 05:23:47 (1779701027)
[13810.554818] Lustre: DEBUG MARKER: == sanity-quota test 71a: Check PFL with quota pools ===== 05:24:37 (1779701077)
[13813.257467] Lustre: DEBUG MARKER: SKIP: sanity-quota test_71a ZFS grants some block space together with inode
[13816.086122] Lustre: DEBUG MARKER: == sanity-quota test 71b: Check SEL with quota pools ===== 05:24:43 (1779701083)
[13818.902200] Lustre: DEBUG MARKER: SKIP: sanity-quota test_71b ZFS grants some block space together with inode
[13822.192448] Lustre: DEBUG MARKER: == sanity-quota test 72: lfs quota --pool prints only pool's OSTs ========================================================== 05:24:49 (1779701089)
[13847.290412] Lustre: DEBUG MARKER: User quota (block hardlimit:50 MB)
[13871.834746] Lustre: DEBUG MARKER: Write...
[13875.404690] Lustre: DEBUG MARKER: Write out of block quota ...
[13955.276970] Lustre: DEBUG MARKER: == sanity-quota test 73a: default limits at OST Pool Quotas ========================================================== 05:27:02 (1779701222)
[13991.888467] Lustre: DEBUG MARKER: set to use default quota
[13994.698972] Lustre: DEBUG MARKER: set default quota
[13997.089902] Lustre: DEBUG MARKER: get default quota
[14006.545629] Lustre: DEBUG MARKER: Test not out of quota
[14012.827956] Lustre: DEBUG MARKER: Test out of quota
[14030.166670] Lustre: DEBUG MARKER: Increase default quota
[14071.574041] Lustre: DEBUG MARKER: Set quota to override default quota
[14071.675527] LustreError: 186022:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:dt-qpool1 id:60000 enforced:1 hard:20480 soft:20480 granted:45063 time:1780306141 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[14090.149463] Lustre: DEBUG MARKER: Set to use default quota again
[14122.239870] Lustre: DEBUG MARKER: Cleanup
[14212.420270] Lustre: DEBUG MARKER: == sanity-quota test 73b: default OST Pool Quotas limit for new user ========================================================== 05:31:20 (1779701480)
[14245.751597] Lustre: DEBUG MARKER: set default quota for qpool1
[14248.026951] Lustre: DEBUG MARKER: Write from user that hasn't lqe
[14313.760210] Lustre: DEBUG MARKER: == sanity-quota test 74: check quota pools per user ====== 05:33:00 (1779701580)
[14426.887728] Lustre: DEBUG MARKER: == sanity-quota test 75: nodemap squashed root respects quota enforcement ========================================================== 05:34:53 (1779701693)
[14529.857472] Lustre: DEBUG MARKER: Write...
[14536.108987] Lustre: DEBUG MARKER: Write out of block quota ...
[14694.170768] Lustre: DEBUG MARKER: == sanity-quota test 76: project ID 4294967295 should be not allowed ========================================================== 05:39:22 (1779701962)
[14755.973083] Lustre: DEBUG MARKER: == sanity-quota test 77: lfs setquota should fail in Lustre mount with 'ro' ========================================================== 05:40:23 (1779702023)
[14766.011910] Lustre: DEBUG MARKER: == sanity-quota test 78A: Check fallocate increase quota usage ========================================================== 05:40:33 (1779702033)
[14768.567566] Lustre: DEBUG MARKER: SKIP: sanity-quota test_78A need >= 2.13.57 and ldiskfs for fallocate
[14770.777462] Lustre: DEBUG MARKER: == sanity-quota test 78a: Check fallocate increase projectid usage ========================================================== 05:40:38 (1779702038)
[14772.929478] Lustre: DEBUG MARKER: SKIP: sanity-quota test_78a need >= 2.13.57 and ldiskfs for fallocate
[14775.569839] Lustre: DEBUG MARKER: == sanity-quota test 79: access to non-existed dt-pool/info doesn't cause a panic ========================================================== 05:40:43 (1779702043)
[14808.286216] Lustre: DEBUG MARKER: == sanity-quota test 80: check for EDQUOT after OST failover ========================================================== 05:41:15 (1779702075)
[14811.368185] Lustre: DEBUG MARKER: SKIP: sanity-quota test_80 ZFS grants some block space together with inode
[14813.765408] Lustre: DEBUG MARKER: == sanity-quota test 81: Race qmt_start_pool_recalc with qmt_pool_free ========================================================== 05:41:21 (1779702081)
[14838.095311] Lustre: DEBUG MARKER: User quota (block hardlimit:20 MB)
[14846.713462] LustreError: 233817:0:(qmt_pool.c:1399:qmt_pool_recalc()) cfs_fail_timeout id a07 sleeping for 10000ms
[14852.065039] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[14852.068763] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[14852.122747] Lustre: Skipped 1 previous similar message
[14854.311556] Lustre: lustre-MDT0000: Not available for connect from 192.168.201.52@tcp (stopping)
[14854.317927] Lustre: Skipped 1 previous similar message
[14856.723184] LustreError: 233817:0:(qmt_pool.c:1399:qmt_pool_recalc()) cfs_fail_timeout id a07 awake
[14857.231718] Lustre: server umount lustre-MDT0000 complete
[14868.700267] LustreError: MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[14869.283405] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[14869.481451] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:27 to 0x280000400:65)
[14869.485104] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:27 to 0x240000400:65)
[14872.327821] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo)
[14872.333794] Lustre: Skipped 1 previous similar message
[14876.099885] Lustre: DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[14933.107770] Lustre: DEBUG MARKER: == sanity-quota test 82: verify more than 8 qids for single operation ========================================================== 05:43:20 (1779702200)
[14981.303648] Lustre: DEBUG MARKER: == sanity-quota test 83: Setting default quota shouldn't affect grace time ========================================================== 05:44:08 (1779702248)
[15027.528302] Lustre: DEBUG MARKER: == sanity-quota test 84: Reset quota should fix the insane granted quota ========================================================== 05:44:54 (1779702294)
[15100.138549] Lustre: *** cfs_fail_loc=a08, val=0***
[15100.142266] Lustre: Skipped 4046 previous similar messages
[15100.148289] Lustre: *** cfs_fail_loc=a08, val=0***
[15100.151969] Lustre: Skipped 99 previous similar messages
[15277.280210] Lustre: DEBUG MARKER: == sanity-quota test 85: do not hung at write with the least_qunit ========================================================== 05:49:04 (1779702544)
[15388.074075] Lustre: DEBUG MARKER: == sanity-quota test 86: Pre-acquired quota should be released if quota is over limit ========================================================== 05:50:55 (1779702655)
[15516.211867] LustreError: 234347:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:60000 enforced:1 hard:2048 soft:2048 granted:65536 time:1780307585 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[15530.600402] Lustre: DEBUG MARKER: sanity-quota test_86: @@@@@@ FAIL: succeed to create files, expect failed