[ 5783.737432] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 5789.982473] Lustre: DEBUG MARKER: Write 100M (buffered) ...
[ 5793.411388] LustreError: 108081:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 5794.332117] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 5795.744727] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 5797.850272] Lustre: Failing over lustre-MDT0000
[ 5798.299164] Lustre: server umount lustre-MDT0000 complete
[ 5814.908255] LustreError: MGC192.168.201.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 5815.300184] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 5815.327166] Lustre: Skipped 1 previous similar message
[ 5815.678459] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 5815.732370] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 5816.270644] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 5816.484180] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 5816.564517] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:668 to 0x240000400:705)
[ 5816.568459] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:665 to 0x280000400:705)
[ 5816.686901] Lustre: 3314:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775198644/real 1775198644]  req@ffff996604629180 x1861424703168640/t0(0) o601->lustre-MDT0000-lwp-OST0000@0@lo:23/10 lens 336/336 e 0 to 1 dl 1775198660 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'lquota_wb_lustr.0' uid:0 gid:0 projid:4294967295
[ 5816.728689] Lustre: 3314:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 5818.015433] Lustre: 3311:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775198646/real 1775198646]  req@ffff9966c4efe300 x1861424703168896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1775198662 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 5818.039682] Lustre: 3311:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 5820.329512] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5820.901547] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo)
[ 5823.135184] Lustre: 3311:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775198651/real 1775198651]  req@ffff9966d1e4ea00 x1861424703169408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1775198667 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 5827.231381] Lustre: 3314:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775198656/real 1775198656]  req@ffff9966c8c3f100 x1861424703169664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1775198672 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 5827.327236] Lustre: 3314:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 5830.317940] Lustre: DEBUG MARKER: oleg135-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 5832.708540] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 5839.558986] Lustre: DEBUG MARKER: (dd_pid=108469, time=0, timeout=600)
[ 5888.942880] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 5896.828310] Lustre: DEBUG MARKER: Write 100M (directio) ...
[ 5900.604697] LustreError: 110583:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 5901.700862] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 5903.733829] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 5905.979975] Lustre: Failing over lustre-MDT0000
[ 5906.227614] Lustre: server umount lustre-MDT0000 complete
[ 5922.271294] Lustre: 3311:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775198751/real 1775198751]  req@ffff9966fd6bf100 x1861424703205504/t0(0) o601->lustre-MDT0000-lwp-OST0000@0@lo:23/10 lens 336/336 e 0 to 1 dl 1775198767 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'lquota_wb_lustr.0' uid:0 gid:0 projid:4294967295
[ 5922.316828] Lustre: 3311:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 5922.336505] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 5923.297568] LustreError: MGC192.168.201.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 5933.986796] LustreError: 3310:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight  req@ffff9966fd6bf100 x1861424703208704/t0(0) o250->MGC192.168.201.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 5934.791812] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 5934.881879] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 5938.719241] Lustre: 3314:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775198767/real 1775198767]  req@ffff99660339b480 x1861424703206912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1775198783 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 5938.777839] Lustre: 3314:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[ 5940.715893] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5948.007365] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo)
[ 5948.015344] Lustre: Skipped 1 previous similar message
[ 5948.823044] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 5948.987052] LustreError: 111197:0:(tgt_handler.c:526:tgt_filter_recovery_request()) @@@ not permitted during recovery  req@ffff9966fd6bd180 x1861424703220992/t0(0) o601->lustre-MDT0000-lwp-OST0000_UUID@0@lo:524/0 lens 336/0 e 0 to 0 dl 1775198804 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'qsd_reint_0.lus.0' uid:0 gid:0 projid:4294967295
[ 5949.012447] LustreError: lustre-MDT0000-lwp-OST0000: operation quota_acquire to node 0@lo failed: rc = -11
[ 5949.044964] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 5949.092261] LustreError: 3310:0:(ldlm_resource.c:1170:ldlm_resource_complain()) lustre-MDT0000-lwp-OST0001: namespace resource [0x200000006:0x20000:0x0].0x0 (ffff996603c86a00) refcount nonzero (1) after lock cleanup; forcing cleanup.
[ 5949.100523] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:707 to 0x240000400:737)
[ 5949.100814] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:665 to 0x280000400:737)
[ 5949.109153] LustreError: 3310:0:(ldlm_resource.c:1170:ldlm_resource_complain()) Skipped 5 previous similar messages
[ 5955.527884] Lustre: DEBUG MARKER: oleg135-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 5957.680840] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 5966.653615] Lustre: DEBUG MARKER: (dd_pid=110742, time=3, timeout=600)
[ 6028.818665] Lustre: DEBUG MARKER: == sanity-quota test 19: Updating admin limits doesn't zero operational limits(b14790) ========================================================== 02:47:52 (1775198872)
[ 6050.084986] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 6051.791622] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 6057.736248] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 6059.550221] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 6092.082539] Lustre: DEBUG MARKER: == sanity-quota test 20: Test if setquota specifiers work properly (b15754) ========================================================== 02:48:55 (1775198935)
[ 6116.024080] Lustre: DEBUG MARKER: == sanity-quota test 21: Setquota while writing
[ 6131.572491] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for user: quota_usr
[ 6133.476444] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for group: quota_usr
[ 6135.670567] Lustre: DEBUG MARKER: Set limit(block:10G; file:) for project: 1000
[ 6138.172277] Lustre: DEBUG MARKER: Set quota for 1 times
[ 6142.838577] Lustre: DEBUG MARKER: Set quota for 2 times
[ 6147.691531] Lustre: DEBUG MARKER: Set quota for 3 times
[ 6151.190291] Lustre: DEBUG MARKER: Set quota for 4 times
[ 6154.809773] Lustre: DEBUG MARKER: Set quota for 5 times
[ 6157.956759] Lustre: DEBUG MARKER: Set quota for 6 times
[ 6161.380130] Lustre: DEBUG MARKER: Set quota for 7 times
[ 6164.698290] Lustre: DEBUG MARKER: Set quota for 8 times
[ 6222.742794] Lustre: DEBUG MARKER: == sanity-quota test 22: enable/disable quota by 'lctl conf_param/set_param -P' ========================================================== 02:51:05 (1775199065)
[ 6236.129103] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 6236.147431] Lustre: Skipped 1 previous similar message
[ 6236.159876] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 6236.174695] Lustre: Skipped 1 previous similar message
[ 6237.995305] Lustre: server umount lustre-MDT0000 complete
[ 6242.092979] LustreError: 5761:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775199086 with bad export cookie 4836325970266881240
[ 6242.094882] LustreError: MGC192.168.201.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 6242.099539] LustreError: 5761:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message
[ 6242.228794] Lustre: server umount lustre-OST0000 complete
[ 6246.593772] Lustre: server umount lustre-OST0001 complete
[ 6259.627664] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing load_modules_local
[ 6268.358076] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 6272.581763] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6275.541210] Lustre: 119550:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 6280.527316] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 6286.165974] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6293.459535] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 6294.462328] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:740 to 0x240000400:769)
[ 6294.470990] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:739 to 0x280000400:769)
[ 6299.795203] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6307.553107] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 6311.220109] Lustre: 121344:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 6334.751505] Lustre: server umount lustre-MDT0000 complete
[ 6339.045214] LustreError: 121595:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775199183 with bad export cookie 4836325970266888548
[ 6339.077187] LustreError: MGC192.168.201.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 6348.375934] Lustre: server umount lustre-OST0000 complete
[ 6351.839125] Lustre: 3313:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775199180/real 1775199180]  req@ffff9966c8c3df80 x1861424703363456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1775199196 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 6351.863917] Lustre: 3313:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 6351.878204] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 6351.890967] Lustre: Skipped 1 previous similar message
[ 6353.239439] Lustre: server umount lustre-OST0001 complete
[ 6370.301905] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing load_modules_local
[ 6380.527427] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 6384.832601] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6388.780660] Lustre: 123964:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 6400.469202] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6405.666828] LustreError: 124278:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 6405.689961] LustreError: 124278:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message
[ 6405.766774] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:740 to 0x240000400:801)
[ 6409.602841] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 6409.607387] Lustre: Skipped 1 previous similar message
[ 6411.189499] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:739 to 0x280000400:801)
[ 6416.310651] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6424.643112] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 6429.323375] Lustre: 125742:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 6444.565985] Lustre: DEBUG MARKER: == sanity-quota test 23: Quota should be honored with directIO (b16125) ========================================================== 02:54:47 (1775199287)
[ 6445.953636] Lustre: DEBUG MARKER: SKIP: sanity-quota test_23 Overwrite in place is not guaranteed to be space neutral on ZFS
[ 6447.692088] Lustre: DEBUG MARKER: == sanity-quota test 24: lfs draws an asterix when limit is reached (b16646) ========================================================== 02:54:50 (1775199290)
[ 6501.589569] Lustre: DEBUG MARKER: == sanity-quota test 25: check indexes versions ========== 02:55:44 (1775199344)
[ 6545.045332] Lustre: DEBUG MARKER: Write...
[ 6547.817868] Lustre: DEBUG MARKER: Write out of block quota ...
[ 6604.343449] Lustre: DEBUG MARKER: == sanity-quota test 27a: lfs quota/setquota should handle wrong arguments (b19612) ========================================================== 02:57:27 (1775199447)
[ 6610.686520] Lustre: DEBUG MARKER: == sanity-quota test 27b: lfs quota/setquota should handle user/group/project ID (b20200) ========================================================== 02:57:33 (1775199453)
[ 6620.274777] Lustre: DEBUG MARKER: == sanity-quota test 27c: lfs quota should support human-readable output ========================================================== 02:57:43 (1775199463)
[ 6631.292370] Lustre: DEBUG MARKER: == sanity-quota test 27d: lfs setquota should support fraction block limit ========================================================== 02:57:54 (1775199474)
[ 6639.179027] Lustre: DEBUG MARKER: == sanity-quota test 30: Hard limit updates should not reset grace times ========================================================== 02:58:02 (1775199482)
[ 6701.502580] Lustre: DEBUG MARKER: == sanity-quota test 33: Basic usage tracking for user
[ 6865.227311] Lustre: DEBUG MARKER: == sanity-quota test 34: Usage transfer for user
[ 7038.900671] Lustre: DEBUG MARKER: == sanity-quota test 35: Usage is still accessible across reboot ========================================================== 03:04:42 (1775199882)
[ 7106.311918] Lustre: DEBUG MARKER: Restart...
[ 7110.776940] Lustre: server umount lustre-MDT0000 complete
[ 7115.404752] LustreError: 123536:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775199960 with bad export cookie 4836325970266890081
[ 7115.414754] LustreError: MGC192.168.201.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 7126.097539] Lustre: server umount lustre-OST0000 complete
[ 7127.519703] Lustre: 3311:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775199956/real 1775199956]  req@ffff9965c2264380 x1861424703594624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1775199972 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 7127.578666] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 7130.889084] Lustre: server umount lustre-OST0001 complete
[ 7146.627256] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing load_modules_local
[ 7155.969944] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 7161.218399] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7165.380187] Lustre: 142431:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 7174.964688] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 7181.042316] LustreError: 142754:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7181.088323] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:810 to 0x240000400:833)
[ 7181.738289] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7186.413508] LustreError: 142754:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7191.522194] LustreError: 143066:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7192.913218] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 7194.984404] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:810 to 0x280000400:833)
[ 7200.803851] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7210.149739] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 7215.761978] Lustre: 144233:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 7286.210693] Lustre: DEBUG MARKER: == sanity-quota test 37: Quota accounted properly for file created by 'lfs setstripe' ========================================================== 03:08:49 (1775200129)
[ 7357.980045] Lustre: DEBUG MARKER: == sanity-quota test 38: Quota accounting iterator doesn't skip id entries ========================================================== 03:10:00 (1775200200)
[ 8912.907148] Lustre: DEBUG MARKER: == sanity-quota test 39: Project ID interface works correctly ========================================================== 03:35:56 (1775201756)
[ 8926.688961] Lustre: server umount lustre-MDT0000 complete
[ 8931.702782] LustreError: 141997:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775201776 with bad export cookie 4836325970266896577
[ 8931.724643] LustreError: MGC192.168.201.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 8942.179775] Lustre: server umount lustre-OST0000 complete
[ 8945.121472] Lustre: 3311:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775201773/real 1775201773]  req@ffff9965ffbca680 x1861424706570496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1775201789 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 8945.151137] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 8946.463912] Lustre: server umount lustre-OST0001 complete
[ 8962.150381] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing load_modules_local
[ 8971.619994] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 8976.140848] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 8979.074799] Lustre: 151723:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 8985.925121] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 8993.593612] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 8997.103134] LustreError: 152040:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 8997.143197] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:5836 to 0x240000400:5857)
[ 9001.664743] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 9003.660440] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:5834 to 0x280000400:5857)
[ 9008.895596] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 9016.238450] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 9019.611974] Lustre: 153494:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 9065.360695] Lustre: DEBUG MARKER: == sanity-quota test 40a: Hard link across different project ID ========================================================== 03:38:28 (1775201908)
[ 9112.777520] Lustre: DEBUG MARKER: == sanity-quota test 40b: Mv across different project ID ========================================================== 03:39:15 (1775201955)
[ 9157.135218] Lustre: DEBUG MARKER: == sanity-quota test 40c: Remote child Dir inherit project quota properly ========================================================== 03:40:00 (1775202000)
[ 9158.166553] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40c needs >= 2 MDTs
[ 9160.052608] Lustre: DEBUG MARKER: == sanity-quota test 40d: Stripe Directory inherit project quota properly ========================================================== 03:40:03 (1775202003)
[ 9161.572459] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40d needs >= 2 MDTs
[ 9163.400964] Lustre: DEBUG MARKER: == sanity-quota test 41: df should return projid-specific values ========================================================== 03:40:06 (1775202006)
[ 9256.804455] Lustre: DEBUG MARKER: == sanity-quota test 42: lfs quota should include default quota info ========================================================== 03:41:39 (1775202099)
[ 9302.779959] Lustre: DEBUG MARKER: == sanity-quota test 48: lfs quota --delete should delete quota project ID ========================================================== 03:42:26 (1775202146)
[ 9389.968792] Lustre: DEBUG MARKER: == sanity-quota test 49a: lfs quota -a prints the quota usage for all quota IDs ========================================================== 03:43:52 (1775202232)
[ 9401.615627] Lustre: *** cfs_fail_loc=a09, val=0***
[ 9401.625559] Lustre: Skipped 2 previous similar messages
[ 9403.631964] Lustre: *** cfs_fail_loc=a09, val=0***
[ 9403.637627] Lustre: Skipped 79 previous similar messages
[ 9407.683979] Lustre: *** cfs_fail_loc=a09, val=0***
[ 9407.688614] Lustre: Skipped 149 previous similar messages
[ 9415.696611] Lustre: *** cfs_fail_loc=a09, val=0***
[ 9415.698522] Lustre: Skipped 361 previous similar messages
[ 9431.710723] Lustre: *** cfs_fail_loc=a09, val=0***
[ 9431.713838] Lustre: Skipped 939 previous similar messages
[ 9463.748389] Lustre: *** cfs_fail_loc=a09, val=0***
[ 9463.756760] Lustre: Skipped 1943 previous similar messages
[ 9527.757220] Lustre: *** cfs_fail_loc=a09, val=0***
[ 9527.760498] Lustre: Skipped 3163 previous similar messages
[ 9941.871456] Lustre: *** cfs_fail_loc=a08, val=0***
[ 9941.873145] Lustre: Skipped 1359 previous similar messages
[ 9941.876716] Lustre: *** cfs_fail_loc=a08, val=0***
[ 9941.908674] Lustre: Skipped 5 previous similar messages
[10172.266058] LustreError: lustre-MDT0000-lwp-OST0000: operation quota_acquire to node 0@lo failed: rc = -107
[10172.266446] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[10172.283548] LustreError: Skipped 2 previous similar messages
[10172.305310] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[10172.320047] Lustre: Skipped 1 previous similar message
[10176.725839] Lustre: server umount lustre-MDT0000 complete
[10181.290935] LustreError: 151292:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1775203026 with bad export cookie 4836325970268671014
[10181.303350] LustreError: MGC192.168.201.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[10181.601515] Lustre: server umount lustre-OST0000 complete
[10186.407914] Lustre: server umount lustre-OST0001 complete
[10194.624741] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_hostid
[10204.924859] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing load_modules_local
[10216.063560]  vdc: vdc1 vdc9
[10216.086895]  vdc: vdc1 vdc9
[10216.134413]  vdc: vdc1 vdc9
[10226.878048]  vde: vde1 vde9
[10226.897427]  vde: vde1 vde9
[10226.952477]  vde: vde1 vde9
[10238.812114]  vdf: vdf1 vdf9
[10238.852305]  vdf: vdf1 vdf9
[10257.907641] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing load_modules_local
[10266.113791] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000
[10266.436417] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space.
[10266.547345] Lustre: lustre-MDT0000: new disk, initializing
[10267.204442] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[10267.288523] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt
[10272.007759] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[10277.287697] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params
[10283.434827] Lustre: lustre-OST0000: new disk, initializing
[10283.439097] Lustre: srv-lustre-OST0000: No data found on store. Initialize space.
[10283.444807] Lustre: Skipped 1 previous similar message
[10283.508633] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[10285.333948] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost
[10285.339759] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost]
[10285.546148] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400
[10289.663608] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[10299.100349] Lustre: lustre-OST0001: new disk, initializing
[10299.104632] Lustre: srv-lustre-OST0001: No data found on store. Initialize space.
[10299.206436] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[10301.119753] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost
[10301.130577] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost]
[10301.352484] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400
[10305.401274] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[10315.188898] Lustre: DEBUG MARKER: Using TIMEOUT=20
[10318.730989] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params
[10359.809872] Lustre: DEBUG MARKER: == sanity-quota test 49b: lfs quota -a --blocks has a delimiter ========================================================== 04:00:03 (1775203203)
[10366.380702] Lustre: DEBUG MARKER: == sanity-quota test 50: Test if lfs find --projid works ========================================================== 04:00:09 (1775203209)
[10411.112375] Lustre: DEBUG MARKER: == sanity-quota test 51: Test project accounting with mv/cp ========================================================== 04:00:54 (1775203254)
[10468.601823] Lustre: DEBUG MARKER: == sanity-quota test 52: Rename normal file across project ID ========================================================== 04:01:51 (1775203311)
[10498.289396] Lustre: DEBUG MARKER: rename directory return 255
[10545.549570] Lustre: DEBUG MARKER: == sanity-quota test 53: Project inherit attribute could be cleared ========================================================== 04:03:08 (1775203388)
[10574.403914] Lustre: DEBUG MARKER: == sanity-quota test 54: basic lfs project interface test ========================================================== 04:03:37 (1775203417)
[10624.578358] Lustre: DEBUG MARKER: == sanity-quota test 55: Chgrp should be affected by group quota ========================================================== 04:04:27 (1775203467)
[10778.752331] Lustre: DEBUG MARKER: == sanity-quota test 56: lfs quota -t should work well === 04:07:02 (1775203622)
[10816.315279] Lustre: DEBUG MARKER: == sanity-quota test 57: lfs project could tolerate errors ========================================================== 04:07:39 (1775203659)
[10860.406506] Lustre: DEBUG MARKER: == sanity-quota test 58: project ID should be kept for new mirrors created by FID ========================================================== 04:08:22 (1775203702)
[10887.790627] LustreError: 168364:0:(qsd_reint.c:627:qqi_reint_delayed()) lustre-OST0001: Delaying reintegration for qtype:0 until pending updates are flushed.
[11054.280829] Lustre: DEBUG MARKER: == sanity-quota test 59: lfs project dosen't crash kernel with project disabled ========================================================== 04:11:36 (1775203896)
[11056.940462] Lustre: DEBUG MARKER: SKIP: sanity-quota test_59 ldiskfs only test
[11059.612357] Lustre: DEBUG MARKER: == sanity-quota test 60: Test quota for root with setgid ========================================================== 04:11:41 (1775203901)
[11128.092446] Lustre: DEBUG MARKER: SKIP: sanity-quota test_61 skipping SLOW test 61
[11130.066379] Lustre: DEBUG MARKER: == sanity-quota test 62: Project inherit should be only changed by root ========================================================== 04:12:52 (1775203972)
[11159.759723] Lustre: DEBUG MARKER: SKIP: sanity-quota test_63 skipping excluded test 63
[11161.980114] Lustre: DEBUG MARKER: == sanity-quota test 64: lfs project on non-dir/files should succeed ========================================================== 04:13:24 (1775204004)
[11218.374910] Lustre: DEBUG MARKER: SKIP: sanity-quota test_65 skipping excluded test 65
[11221.075336] Lustre: DEBUG MARKER: == sanity-quota test 66: nonroot user can not change project state in default ========================================================== 04:14:23 (1775204063)
[11268.383362] Lustre: DEBUG MARKER: == sanity-quota test 67: quota pools recalculation ======= 04:15:11 (1775204111)
[11270.500396] Lustre: DEBUG MARKER: SKIP: sanity-quota test_67 ZFS grants some block space together with inode
[11272.994786] Lustre: DEBUG MARKER: == sanity-quota test 68: slave number in quota pool changed after each add/remove OST ========================================================== 04:15:15 (1775204115)
[11299.544276] LustreError: 186556:0:(mgs_handler.c:1102:mgs_iocontrol_pool()) OBD_IOC_POOL err -17, cmd CE021 for pool lustre.qpool1
[11345.842246] Lustre: DEBUG MARKER: == sanity-quota test 69: EDQUOT at one of pools shouldn't affect DOM ========================================================== 04:16:28 (1775204188)
[11371.449643] Lustre: DEBUG MARKER: User quota (block hardlimit:200 MB)
[11373.210291] Lustre: DEBUG MARKER: User quota (block hardlimit:10 MB)
[11541.580247] Lustre: DEBUG MARKER: == sanity-quota test 70a: check lfs setquota/quota with a pool option ========================================================== 04:19:44 (1775204384)
[11592.816129] Lustre: DEBUG MARKER: == sanity-quota test 70b: lfs setquota pool works properly ========================================================== 04:20:35 (1775204435)
[11627.273849] Lustre: DEBUG MARKER: == sanity-quota test 71a: Check PFL with quota pools ===== 04:21:10 (1775204470)
[11628.640565] Lustre: DEBUG MARKER: SKIP: sanity-quota test_71a ZFS grants some block space together with inode
[11631.104597] Lustre: DEBUG MARKER: == sanity-quota test 71b: Check SEL with quota pools ===== 04:21:13 (1775204473)
[11632.694765] Lustre: DEBUG MARKER: SKIP: sanity-quota test_71b ZFS grants some block space together with inode
[11634.372913] Lustre: DEBUG MARKER: == sanity-quota test 72: lfs quota --pool prints only pool's OSTs ========================================================== 04:21:17 (1775204477)
[11648.653255] Lustre: DEBUG MARKER: User quota (block hardlimit:50 MB)
[11663.963214] Lustre: DEBUG MARKER: Write...
[11666.646633] Lustre: DEBUG MARKER: Write out of block quota ...
[11725.539658] Lustre: DEBUG MARKER: == sanity-quota test 73a: default limits at OST Pool Quotas ========================================================== 04:22:48 (1775204568)
[11752.504395] Lustre: DEBUG MARKER: set to use default quota
[11754.009044] Lustre: DEBUG MARKER: set default quota
[11755.595924] Lustre: DEBUG MARKER: get default quota
[11761.033704] Lustre: DEBUG MARKER: Test not out of quota
[11764.426614] Lustre: DEBUG MARKER: Test out of quota
[11775.534246] Lustre: DEBUG MARKER: Increase default quota
[11807.886312] Lustre: DEBUG MARKER: Set quota to override default quota
[11807.959529] LustreError: 166740:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:dt-qpool1 id:60000 enforced:1 hard:20480 soft:20480 granted:45063 time:1775809452 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[11821.949816] Lustre: DEBUG MARKER: Set to use default quota again
[11840.735691] Lustre: DEBUG MARKER: Cleanup
[11908.755181] Lustre: DEBUG MARKER: == sanity-quota test 73b: default OST Pool Quotas limit for new user ========================================================== 04:25:52 (1775204752)
[11934.808756] Lustre: DEBUG MARKER: set default quota for qpool1
[11936.809468] Lustre: DEBUG MARKER: Write from user that hasn't lqe
[11987.111052] Lustre: DEBUG MARKER: == sanity-quota test 74: check quota pools per user ====== 04:27:09 (1775204829)
[12087.597620] Lustre: DEBUG MARKER: == sanity-quota test 75: nodemap squashed root respects quota enforcement ========================================================== 04:28:50 (1775204930)
[12163.085727] Lustre: DEBUG MARKER: Write...
[12166.919279] Lustre: DEBUG MARKER: Write out of block quota ...
[12294.640887] Lustre: DEBUG MARKER: == sanity-quota test 76: project ID 4294967295 should be not allowed ========================================================== 04:32:17 (1775205137)
[12338.261552] Lustre: DEBUG MARKER: == sanity-quota test 77: lfs setquota should fail in Lustre mount with 'ro' ========================================================== 04:33:01 (1775205181)
[12345.820160] Lustre: DEBUG MARKER: == sanity-quota test 78A: Check fallocate increase quota usage ========================================================== 04:33:08 (1775205188)
[12347.264221] Lustre: DEBUG MARKER: SKIP: sanity-quota test_78A need >= 2.13.57 and ldiskfs for fallocate
[12349.168351] Lustre: DEBUG MARKER: == sanity-quota test 78a: Check fallocate increase projectid usage ========================================================== 04:33:12 (1775205192)
[12351.002220] Lustre: DEBUG MARKER: SKIP: sanity-quota test_78a need >= 2.13.57 and ldiskfs for fallocate
[12352.950190] Lustre: DEBUG MARKER: == sanity-quota test 79: access to non-existed dt-pool/info doesn't cause a panic ========================================================== 04:33:15 (1775205195)
[12375.917641] Lustre: DEBUG MARKER: == sanity-quota test 80: check for EDQUOT after OST failover ========================================================== 04:33:38 (1775205218)
[12377.480124] Lustre: DEBUG MARKER: SKIP: sanity-quota test_80 ZFS grants some block space together with inode
[12380.275927] Lustre: DEBUG MARKER: == sanity-quota test 81: Race qmt_start_pool_recalc with qmt_pool_free ========================================================== 04:33:42 (1775205222)
[12396.654967] Lustre: DEBUG MARKER: User quota (block hardlimit:20 MB)
[12403.541858] LustreError: 209305:0:(qmt_pool.c:1399:qmt_pool_recalc()) cfs_fail_timeout id a07 sleeping for 10000ms
[12403.550125] LustreError: 209305:0:(qmt_pool.c:1399:qmt_pool_recalc()) Skipped 5 previous similar messages
[12408.288793] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[12408.293526] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[12408.322944] Lustre: Skipped 2 previous similar messages
[12408.338078] Lustre: Skipped 1 previous similar message
[12410.793332] Lustre: lustre-MDT0000: Not available for connect from 192.168.201.35@tcp (stopping)
[12413.412354] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[12413.423106] Lustre: Skipped 1 previous similar message
[12413.543568] LustreError: 209305:0:(qmt_pool.c:1399:qmt_pool_recalc()) cfs_fail_timeout id a07 awake
[12413.972968] Lustre: server umount lustre-MDT0000 complete
[12421.671336] LustreError: MGC192.168.201.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[12422.235389] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[12422.382629] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:27 to 0x240000400:65)
[12422.384739] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:27 to 0x280000400:65)
[12427.503317] Lustre: DEBUG MARKER: oleg135-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[12438.566896] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo)
[12438.573597] Lustre: Skipped 1 previous similar message
[12461.857971] Lustre: DEBUG MARKER: == sanity-quota test 82: verify more than 8 qids for single operation ========================================================== 04:35:04 (1775205304)
[12493.164623] Lustre: DEBUG MARKER: == sanity-quota test 83: Setting default quota shouldn't affect grace time ========================================================== 04:35:36 (1775205336)
[12524.030290] Lustre: DEBUG MARKER: == sanity-quota test 84: Reset quota should fix the insane granted quota ========================================================== 04:36:06 (1775205366)
[12577.635474] Lustre: *** cfs_fail_loc=a08, val=0***
[12577.646328] Lustre: Skipped 9 previous similar messages
[12577.670144] Lustre: *** cfs_fail_loc=a08, val=0***
[12577.679109] Lustre: Skipped 11 previous similar messages
[12701.191794] Lustre: DEBUG MARKER: == sanity-quota test 85: do not hung at write with the least_qunit ========================================================== 04:39:04 (1775205544)
[12715.943981] LustreError: 3314:0:(qsd_reint.c:627:qqi_reint_delayed()) lustre-OST0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[12788.847182] Lustre: DEBUG MARKER: == sanity-quota test 86: Pre-acquired quota should be released if quota is over limit ========================================================== 04:40:32 (1775205632)
[12863.831561] LustreError: 209820:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:60000 enforced:1 hard:2048 soft:2048 granted:65536 time:1775810508 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[13035.492487] LustreError: 210631:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:60000 enforced:1 hard:2048 soft:2048 granted:65536 time:1775810680 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[13046.019545] Lustre: DEBUG MARKER: sanity-quota test_86: @@@@@@ FAIL: succeed to create files, expect failed