[ 5838.107838] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 5846.044911] Lustre: DEBUG MARKER: Write 100M (buffered) ...
[ 5850.067278] LustreError: 120740:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 5851.404966] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 5853.384249] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 5856.272979] Lustre: Failing over lustre-MDT0000
[ 5856.831441] Lustre: server umount lustre-MDT0000 complete
[ 5873.999949] Lustre: 3323:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786108177/real 1786108177]  req@ffff96334e4dd180 x1872864137703552/t0(0) o400->MGC192.168.202.149@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786108193 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 5874.027935] Lustre: 3323:0:(client.c:2490:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 5874.035483] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 5874.655401] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 5874.667448] Lustre: Skipped 1 previous similar message
[ 5875.106770] Lustre: 3323:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786108178/real 1786108178]  req@ffff963348c86d80 x1872864137703936/t0(0) o601->lustre-MDT0000-lwp-OST0000@0@lo:23/10 lens 336/336 e 0 to 1 dl 1786108194 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'lquota_wb_lustr.0' uid:0 gid:0 projid:4294967295
[ 5875.147296] Lustre: 3323:0:(client.c:2490:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[ 5879.781477] Lustre: 3325:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786108182/real 1786108182]  req@ffff96345f0ca300 x1872864137704192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786108198 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 5883.807324] Lustre: 3322:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786108187/real 1786108187]  req@ffff963348c87480 x1872864137704576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786108203 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 5883.870232] Lustre: 3322:0:(client.c:2490:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 5883.874109] LustreError: 3321:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight  req@ffff96334e4ddc00 x1872864137706624/t0(0) o250->MGC192.168.202.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 5884.551735] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 5884.630404] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 5886.537958] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 5886.834494] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 5886.898914] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:628 to 0x280000400:673)
[ 5886.907247] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:632 to 0x240000400:673)
[ 5889.728203] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5899.785344] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo)
[ 5899.788819] Lustre: Skipped 1 previous similar message
[ 5903.911485] Lustre: DEBUG MARKER: oleg249-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
[ 5906.407596] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 5920.672522] Lustre: DEBUG MARKER: (dd_pid=114030, time=6, timeout=600)
[ 5979.100762] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 5987.268704] Lustre: DEBUG MARKER: Write 100M (directio) ...
[ 5992.200657] LustreError: 123703:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 5993.817505] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 5996.601945] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 5998.626800] Lustre: Failing over lustre-MDT0000
[ 5998.709175] LustreError: lustre-MDT0000-lwp-OST0000: operation quota_acquire to node 0@lo failed: rc = -107
[ 5998.714241] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 5998.722017] Lustre: Skipped 1 previous similar message
[ 5998.741760] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 5999.149447] Lustre: server umount lustre-MDT0000 complete
[ 6018.783091] Lustre: 3325:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786108321/real 1786108321]  req@ffff963346804380 x1872864137748608/t0(0) o400->MGC192.168.202.149@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786108337 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 6018.814682] Lustre: 3325:0:(client.c:2490:ptlrpc_expire_one_request()) Skipped 5 previous similar messages
[ 6018.819552] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 6029.028957] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x2a53fbc5ab0326fc
[ 6029.041780] Lustre: MGC192.168.202.149@tcp: Connection restored to 0@lo (at 0@lo)
[ 6029.044416] Lustre: Skipped 1 previous similar message
[ 6029.675092] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 6029.766558] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 6035.936499] Lustre: 3324:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786108338/real 1786108338]  req@ffff9633478a2d80 x1872864137751040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786108354 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 6035.982360] Lustre: 3324:0:(client.c:2490:ptlrpc_expire_one_request()) Skipped 4 previous similar messages
[ 6036.377357] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6040.640901] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 6040.838667] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 6040.957884] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:628 to 0x280000400:705)
[ 6040.959586] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:675 to 0x240000400:705)
[ 6049.000123] Lustre: DEBUG MARKER: oleg249-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
[ 6051.849181] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 6068.959634] Lustre: DEBUG MARKER: (dd_pid=116514, time=8, timeout=600)
[ 6148.314403] Lustre: DEBUG MARKER: == sanity-quota test 19: Updating admin limits doesn't zero operational limits(b14790) ========================================================== 09:14:26 (1786108466)
[ 6177.644422] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 6180.842796] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 6188.874684] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 6190.776532] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 6228.608763] Lustre: DEBUG MARKER: == sanity-quota test 20: Test if setquota specifiers work properly (b15754) ========================================================== 09:15:46 (1786108546)
[ 6260.806236] Lustre: DEBUG MARKER: == sanity-quota test 21: Setquota while writing
[ 6285.826812] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for user: quota_usr
[ 6287.963503] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for group: quota_usr
[ 6290.799366] Lustre: DEBUG MARKER: Set limit(block:10G; file:) for project: 1000
[ 6293.807268] Lustre: DEBUG MARKER: Set quota for 1 times
[ 6298.075662] Lustre: DEBUG MARKER: Set quota for 2 times
[ 6301.974305] Lustre: DEBUG MARKER: Set quota for 3 times
[ 6306.437864] Lustre: DEBUG MARKER: Set quota for 4 times
[ 6310.542244] Lustre: DEBUG MARKER: Set quota for 5 times
[ 6315.001451] Lustre: DEBUG MARKER: Set quota for 6 times
[ 6319.698523] Lustre: DEBUG MARKER: Set quota for 7 times
[ 6394.023736] Lustre: DEBUG MARKER: == sanity-quota test 22: enable/disable quota by 'lctl conf_param/set_param -P' ========================================================== 09:18:32 (1786108712)
[ 6413.999880] Lustre: server umount lustre-MDT0000 complete
[ 6419.073860] LustreError: 11374:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786108738 with bad export cookie 3050058199056197372
[ 6419.097167] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 6429.804444] Lustre: server umount lustre-OST0000 complete
[ 6434.275177] Lustre: 3322:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786108737/real 1786108737]  req@ffff96345e8a3b80 x1872864137890816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786108753 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 6434.330772] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 6434.338655] Lustre: Skipped 1 previous similar message
[ 6435.412257] Lustre: server umount lustre-OST0001 complete
[ 6461.374073] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local
[ 6478.219981] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 6483.012617] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6486.187791] Lustre: 133497:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 6493.428432] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 6503.589192] LustreError: 133871:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 6503.630822] LustreError: 133871:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message
[ 6503.700393] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:707 to 0x240000400:737)
[ 6503.719433] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6509.058665] LustreError: 134239:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 6514.204309] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 6519.311475] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:708 to 0x280000400:737)
[ 6520.836824] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6529.773879] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 6534.760076] Lustre: 135437:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 6556.700720] Lustre: server umount lustre-MDT0000 complete
[ 6561.003653] LustreError: 135440:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786108880 with bad export cookie 3050058199056204197
[ 6561.023112] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 6571.608794] Lustre: server umount lustre-OST0000 complete
[ 6574.559812] Lustre: 3322:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786108877/real 1786108877]  req@ffff963345d60e00 x1872864137933568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786108893 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 6574.606641] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 6576.002362] Lustre: server umount lustre-OST0001 complete
[ 6594.093468] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local
[ 6609.200101] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 6614.669462] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6619.748334] Lustre: 138101:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 6633.446577] LustreError: 138459:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 6633.733910] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 6639.082888] LustreError: 138457:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 6639.154095] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:707 to 0x240000400:769)
[ 6644.984648] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6649.312188] LustreError: 138457:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 6649.343915] LustreError: 138457:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message
[ 6662.166191] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:708 to 0x280000400:769)
[ 6666.713804] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6676.383322] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 6680.342307] Lustre: 140022:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 6691.879494] Lustre: DEBUG MARKER: == sanity-quota test 23: Quota should be honored with directIO (b16125) ========================================================== 09:23:30 (1786109010)
[ 6693.578673] Lustre: DEBUG MARKER: SKIP: sanity-quota test_23 Overwrite in place is not guaranteed to be space neutral on ZFS
[ 6696.101068] Lustre: DEBUG MARKER: == sanity-quota test 24: lfs draws an asterix when limit is reached (b16646) ========================================================== 09:23:34 (1786109014)
[ 6755.179238] Lustre: DEBUG MARKER: == sanity-quota test 25: check indexes versions ========== 09:24:33 (1786109073)
[ 6798.767349] Lustre: DEBUG MARKER: Write...
[ 6800.762392] Lustre: DEBUG MARKER: Write out of block quota ...
[ 6854.055802] Lustre: DEBUG MARKER: == sanity-quota test 27a: lfs quota/setquota should handle wrong arguments (b19612) ========================================================== 09:26:12 (1786109172)
[ 6859.334506] Lustre: DEBUG MARKER: == sanity-quota test 27b: lfs quota/setquota should handle user/group/project ID (b20200) ========================================================== 09:26:18 (1786109178)
[ 6867.572654] Lustre: DEBUG MARKER: == sanity-quota test 27c: lfs quota should support human-readable output ========================================================== 09:26:26 (1786109186)
[ 6874.881107] Lustre: DEBUG MARKER: == sanity-quota test 27d: lfs setquota should support fraction block limit ========================================================== 09:26:33 (1786109193)
[ 6881.006221] Lustre: DEBUG MARKER: == sanity-quota test 30: Hard limit updates should not reset grace times ========================================================== 09:26:40 (1786109200)
[ 6931.862088] Lustre: DEBUG MARKER: == sanity-quota test 33: Basic usage tracking for user
[ 7108.240894] Lustre: DEBUG MARKER: == sanity-quota test 34: Usage transfer for user
[ 7302.989649] Lustre: DEBUG MARKER: == sanity-quota test 35: Usage is still accessible across reboot ========================================================== 09:33:41 (1786109621)
[ 7368.630408] Lustre: DEBUG MARKER: Restart...
[ 7376.868727] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 7376.899877] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 7379.524859] Lustre: server umount lustre-MDT0000 complete
[ 7384.145314] LustreError: 137653:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786109703 with bad export cookie 3050058199056205730
[ 7384.152083] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 7384.155470] LustreError: 137653:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message
[ 7384.220047] Lustre: server umount lustre-OST0000 complete
[ 7387.987827] Lustre: server umount lustre-OST0001 complete
[ 7404.438370] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local
[ 7416.060638] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 7416.064956] Lustre: Skipped 1 previous similar message
[ 7420.662746] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7424.172508] Lustre: 158400:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 7431.338675] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 7438.108432] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7441.569297] LustreError: 158770:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7441.605638] LustreError: 158770:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message
[ 7441.641743] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:778 to 0x240000400:801)
[ 7447.033215] LustreError: 158770:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7447.407887] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 7452.693853] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:778 to 0x280000400:801)
[ 7454.657671] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7463.413573] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 7467.605922] Lustre: 160325:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 7541.173585] Lustre: DEBUG MARKER: == sanity-quota test 37: Quota accounted properly for file created by 'lfs setstripe' ========================================================== 09:37:39 (1786109859)
[ 7617.271280] Lustre: DEBUG MARKER: == sanity-quota test 38: Quota accounting iterator doesn't skip id entries ========================================================== 09:38:55 (1786109935)
[ 9045.761799] Lustre: DEBUG MARKER: == sanity-quota test 39: Project ID interface works correctly ========================================================== 10:02:45 (1786111365)
[ 9058.277853] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 9058.279747] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 9058.287598] Lustre: Skipped 2 previous similar messages
[ 9058.292736] Lustre: Skipped 2 previous similar messages
[ 9063.283871] Lustre: server umount lustre-MDT0000 complete
[ 9066.216675] LustreError: 157954:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786111385 with bad export cookie 3050058199056212205
[ 9066.217855] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 9066.227466] LustreError: 157954:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 9066.284648] Lustre: server umount lustre-OST0000 complete
[ 9068.783105] Lustre: server umount lustre-OST0001 complete
[ 9077.979642] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local
[ 9084.055280] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 9086.655192] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 9088.448864] Lustre: 168774:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 9092.115242] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 9094.176955] LustreError: 169141:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 9094.209652] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:5804 to 0x240000400:5825)
[ 9095.607910] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 9099.232512] LustreError: 169337:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 9100.350822] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 9103.457179] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 9105.387527] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:5802 to 0x280000400:5825)
[ 9107.731062] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 9109.594617] Lustre: 170682:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 9132.112788] Lustre: DEBUG MARKER: == sanity-quota test 40a: Hard link across different project ID ========================================================== 10:04:11 (1786111451)
[ 9163.391879] Lustre: DEBUG MARKER: == sanity-quota test 40b: Mv across different project ID ========================================================== 10:04:42 (1786111482)
[ 9220.061840] Lustre: DEBUG MARKER: == sanity-quota test 40c: Remote child Dir inherit project quota properly ========================================================== 10:05:37 (1786111537)
[ 9223.271353] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40c needs >= 2 MDTs
[ 9227.101458] Lustre: DEBUG MARKER: == sanity-quota test 40d: Stripe Directory inherit project quota properly ========================================================== 10:05:44 (1786111544)
[ 9230.421192] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40d needs >= 2 MDTs
[ 9233.510766] Lustre: DEBUG MARKER: == sanity-quota test 41: df should return projid-specific values ========================================================== 10:05:51 (1786111551)
[ 9331.258910] Lustre: DEBUG MARKER: == sanity-quota test 42: lfs quota should include default quota info ========================================================== 10:07:30 (1786111650)
[ 9383.722790] Lustre: DEBUG MARKER: == sanity-quota test 48: lfs quota --delete should delete quota project ID ========================================================== 10:08:22 (1786111702)
[ 9472.400889] Lustre: DEBUG MARKER: == sanity-quota test 49a: lfs quota -a prints the quota usage for all quota IDs ========================================================== 10:09:51 (1786111791)
[ 9484.850778] Lustre: *** cfs_fail_loc=a09, val=0***
[ 9484.861777] Lustre: Skipped 4 previous similar messages
[ 9486.877835] Lustre: *** cfs_fail_loc=a09, val=0***
[ 9486.883786] Lustre: Skipped 75 previous similar messages
[ 9490.908927] Lustre: *** cfs_fail_loc=a09, val=0***
[ 9490.914049] Lustre: Skipped 163 previous similar messages
[ 9498.912547] Lustre: *** cfs_fail_loc=a09, val=0***
[ 9498.919589] Lustre: Skipped 342 previous similar messages
[ 9514.929647] Lustre: *** cfs_fail_loc=a09, val=0***
[ 9514.931419] Lustre: Skipped 880 previous similar messages
[ 9546.965082] Lustre: *** cfs_fail_loc=a09, val=0***
[ 9546.971697] Lustre: Skipped 1751 previous similar messages
[ 9611.001568] Lustre: *** cfs_fail_loc=a09, val=0***
[ 9611.005209] Lustre: Skipped 3235 previous similar messages
[10021.800830] Lustre: *** cfs_fail_loc=a08, val=0***
[10021.808634] Lustre: Skipped 1551 previous similar messages
[10021.825368] Lustre: *** cfs_fail_loc=a08, val=0***
[10021.829555] Lustre: Skipped 6 previous similar messages
[10252.256659] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[10252.271028] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[10252.280610] Lustre: Skipped 1 previous similar message
[10257.375966] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[10257.378612] Lustre: Skipped 1 previous similar message
[10257.695176] Lustre: server umount lustre-MDT0000 complete
[10262.269127] LustreError: 168328:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786112581 with bad export cookie 3050058199057985564
[10262.297386] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[10262.878631] Lustre: server umount lustre-OST0000 complete
[10267.896378] Lustre: server umount lustre-OST0001 complete
[10277.469608] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_hostid
[10285.040803] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local
[10294.673041]  vdc: vdc1 vdc9
[10303.760918]  vde: vde1 vde9
[10313.208801]  vdf: vdf1 vdf9
[10331.493722] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local
[10339.462238] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000
[10339.658410] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space.
[10339.716960] Lustre: lustre-MDT0000: new disk, initializing
[10339.988480] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[10340.094233] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt
[10344.241512] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[10348.472815] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params
[10355.108318] Lustre: lustre-OST0000: new disk, initializing
[10355.112506] Lustre: srv-lustre-OST0000: No data found on store. Initialize space.
[10355.116397] Lustre: Skipped 1 previous similar message
[10355.201489] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[10356.624653] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost
[10356.632549] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost]
[10356.824321] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400
[10362.053502] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[10371.077987] Lustre: lustre-OST0001: new disk, initializing
[10371.082207] Lustre: srv-lustre-OST0001: No data found on store. Initialize space.
[10371.173789] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[10373.082630] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost
[10373.087406] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost]
[10373.223475] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400
[10377.590346] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[10386.252869] Lustre: DEBUG MARKER: Using TIMEOUT=20
[10389.276906] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params
[10424.112565] Lustre: DEBUG MARKER: == sanity-quota test 49b: lfs quota -a --blocks has a delimiter ========================================================== 10:25:43 (1786112743)
[10430.158666] Lustre: DEBUG MARKER: == sanity-quota test 50: Test if lfs find --projid works ========================================================== 10:25:49 (1786112749)
[10474.040371] Lustre: DEBUG MARKER: == sanity-quota test 51: Test project accounting with mv/cp ========================================================== 10:26:32 (1786112792)
[10523.708904] Lustre: DEBUG MARKER: == sanity-quota test 52: Rename normal file across project ID ========================================================== 10:27:22 (1786112842)
[10543.733291] Lustre: DEBUG MARKER: rename directory return 255
[10574.232891] Lustre: DEBUG MARKER: == sanity-quota test 53: Project inherit attribute could be cleared ========================================================== 10:28:13 (1786112893)
[10597.123677] Lustre: DEBUG MARKER: == sanity-quota test 54: basic lfs project interface test ========================================================== 10:28:36 (1786112916)
[10624.986674] Lustre: DEBUG MARKER: == sanity-quota test 55: Chgrp should be affected by group quota ========================================================== 10:29:04 (1786112944)
[10667.835437] LustreError: 195640:0:(qmt_entry.c:558:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:dt-0x0 id:60001 enforced:1 hard:51200 soft:0 granted:51200 time:0 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[10692.356823] Lustre: DEBUG MARKER: == sanity-quota test 56: lfs quota -t should work well === 10:30:11 (1786113011)
[10714.383815] Lustre: DEBUG MARKER: == sanity-quota test 57: lfs project could tolerate errors ========================================================== 10:30:34 (1786113034)
[10747.305368] Lustre: DEBUG MARKER: == sanity-quota test 58: project ID should be kept for new mirrors created by FID ========================================================== 10:31:07 (1786113067)
[10838.430102] Lustre: DEBUG MARKER: == sanity-quota test 59: lfs project dosen't crash kernel with project disabled ========================================================== 10:32:38 (1786113158)
[10839.049323] Lustre: DEBUG MARKER: SKIP: sanity-quota test_59 ldiskfs only test
[10839.756438] Lustre: DEBUG MARKER: == sanity-quota test 60: Test quota for root with setgid ========================================================== 10:32:39 (1786113159)
[10874.411967] Lustre: DEBUG MARKER: SKIP: sanity-quota test_61 skipping SLOW test 61
[10875.141527] Lustre: DEBUG MARKER: == sanity-quota test 62: Project inherit should be only changed by root ========================================================== 10:33:14 (1786113194)
[10894.458496] Lustre: DEBUG MARKER: SKIP: sanity-quota test_63 skipping excluded test 63
[10895.265073] Lustre: DEBUG MARKER: == sanity-quota test 64: lfs project on non-dir/files should succeed ========================================================== 10:33:34 (1786113214)
[10931.688741] Lustre: DEBUG MARKER: SKIP: sanity-quota test_65 skipping excluded test 65
[10932.504439] Lustre: DEBUG MARKER: == sanity-quota test 66: nonroot user can not change project state in default ========================================================== 10:34:12 (1786113252)
[10962.238356] Lustre: DEBUG MARKER: == sanity-quota test 67: quota pools recalculation ======= 10:34:41 (1786113281)
[10962.823409] Lustre: DEBUG MARKER: SKIP: sanity-quota test_67 ZFS grants some block space together with inode
[10963.544444] Lustre: DEBUG MARKER: == sanity-quota test 68: slave number in quota pool changed after each add/remove OST ========================================================== 10:34:43 (1786113283)
[10979.114886] LustreError: 209023:0:(mgs_handler.c:1144:mgs_iocontrol_pool()) OBD_IOC_POOL err -17, cmd CE021 for pool lustre.qpool1
[11003.938487] Lustre: DEBUG MARKER: == sanity-quota test 69: EDQUOT at one of pools shouldn't affect DOM ========================================================== 10:35:23 (1786113323)
[11019.694939] Lustre: DEBUG MARKER: User quota (block hardlimit:200 MB)
[11020.257968] Lustre: DEBUG MARKER: User quota (block hardlimit:10 MB)
[11078.935818] Lustre: DEBUG MARKER: == sanity-quota test 70a: check lfs setquota/quota with a pool option ========================================================== 10:36:38 (1786113398)
[11109.617430] Lustre: DEBUG MARKER: == sanity-quota test 70b: lfs setquota pool works properly ========================================================== 10:37:09 (1786113429)
[11127.286901] Lustre: DEBUG MARKER: == sanity-quota test 71a: Check PFL with quota pools ===== 10:37:26 (1786113446)
[11127.991499] Lustre: DEBUG MARKER: SKIP: sanity-quota test_71a ZFS grants some block space together with inode
[11128.646779] Lustre: DEBUG MARKER: == sanity-quota test 71b: Check SEL with quota pools ===== 10:37:28 (1786113448)
[11129.281584] Lustre: DEBUG MARKER: SKIP: sanity-quota test_71b ZFS grants some block space together with inode
[11129.988176] Lustre: DEBUG MARKER: == sanity-quota test 72: lfs quota --pool prints only pool's OSTs ========================================================== 10:37:29 (1786113449)
[11139.449846] Lustre: DEBUG MARKER: User quota (block hardlimit:50 MB)
[11147.919480] Lustre: DEBUG MARKER: Write...
[11148.835372] Lustre: DEBUG MARKER: Write out of block quota ...
[11186.702232] Lustre: DEBUG MARKER: == sanity-quota test 73a: default limits at OST Pool Quotas ========================================================== 10:38:26 (1786113506)
[11201.044370] Lustre: DEBUG MARKER: set to use default quota
[11201.640554] Lustre: DEBUG MARKER: set default quota
[11202.262554] Lustre: DEBUG MARKER: get default quota
[11204.490059] Lustre: DEBUG MARKER: Test not out of quota
[11205.974062] Lustre: DEBUG MARKER: Test out of quota
[11210.044680] Lustre: DEBUG MARKER: Increase default quota
[11232.901130] Lustre: DEBUG MARKER: Set quota to override default quota
[11232.940903] LustreError: 185383:0:(qmt_entry.c:558:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:dt-qpool1 id:60000 enforced:1 hard:20480 soft:20480 granted:45063 time:1786718352 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[11237.093261] Lustre: DEBUG MARKER: Set to use default quota again
[11248.137684] Lustre: DEBUG MARKER: Cleanup
[11292.975299] Lustre: DEBUG MARKER: == sanity-quota test 73b: default OST Pool Quotas limit for new user ========================================================== 10:40:12 (1786113612)
[11306.066847] Lustre: DEBUG MARKER: set default quota for qpool1
[11306.598476] Lustre: DEBUG MARKER: Write from user that hasn't lqe
[11335.312731] Lustre: DEBUG MARKER: == sanity-quota test 74: check quota pools per user ====== 10:40:55 (1786113655)
[11377.900835] Lustre: DEBUG MARKER: == sanity-quota test 75: nodemap squashed root respects quota enforcement ========================================================== 10:41:37 (1786113697)
[11420.288937] Lustre: DEBUG MARKER: Write...
[11421.503387] Lustre: DEBUG MARKER: Write out of block quota ...
[11518.277946] Lustre: DEBUG MARKER: == sanity-quota test 76: project ID 4294967295 should be not allowed ========================================================== 10:43:57 (1786113837)
[11551.900470] Lustre: DEBUG MARKER: == sanity-quota test 77: lfs setquota should fail in Lustre mount with 'ro' ========================================================== 10:44:31 (1786113871)
[11556.289680] Lustre: DEBUG MARKER: == sanity-quota test 78A: Check fallocate increase quota usage ========================================================== 10:44:35 (1786113875)
[11557.323413] Lustre: DEBUG MARKER: SKIP: sanity-quota test_78A need >= 2.13.57 and ldiskfs for fallocate
[11558.300993] Lustre: DEBUG MARKER: == sanity-quota test 78a: Check fallocate increase projectid usage ========================================================== 10:44:37 (1786113877)
[11559.163381] Lustre: DEBUG MARKER: SKIP: sanity-quota test_78a need >= 2.13.57 and ldiskfs for fallocate
[11560.194126] Lustre: DEBUG MARKER: == sanity-quota test 79: access to non-existed dt-pool/info doesn't cause a panic ========================================================== 10:44:39 (1786113879)
[11572.888164] Lustre: DEBUG MARKER: == sanity-quota test 80: check for EDQUOT after OST failover ========================================================== 10:44:52 (1786113892)
[11573.688644] Lustre: DEBUG MARKER: SKIP: sanity-quota test_80 ZFS grants some block space together with inode
[11574.620409] Lustre: DEBUG MARKER: == sanity-quota test 81: Race qmt_start_pool_recalc with qmt_pool_free ========================================================== 10:44:54 (1786113894)
[11585.698414] Lustre: DEBUG MARKER: User quota (block hardlimit:20 MB)
[11590.272725] LustreError: 234857:0:(qmt_pool.c:1407:qmt_pool_recalc()) cfs_fail_timeout id a07 sleeping for 10000ms
[11590.275242] LustreError: 234857:0:(qmt_pool.c:1407:qmt_pool_recalc()) Skipped 5 previous similar messages
[11594.318260] Lustre: lustre-MDT0000: Not available for connect from 192.168.202.49@tcp (stopping)
[11596.769615] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[11596.770203] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[11596.781419] Lustre: Skipped 2 previous similar messages
[11599.420500] Lustre: lustre-MDT0000: Not available for connect from 192.168.202.49@tcp (stopping)
[11599.424967] Lustre: Skipped 1 previous similar message
[11600.336451] LustreError: 234857:0:(qmt_pool.c:1407:qmt_pool_recalc()) cfs_fail_timeout id a07 awake
[11600.531128] Lustre: server umount lustre-MDT0000 complete
[11604.801782] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[11605.066649] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[11605.144589] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:27 to 0x240000400:65)
[11605.145272] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:27 to 0x280000400:65)
[11607.117368] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[11617.315592] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo)
[11617.320675] Lustre: Skipped 2 previous similar messages
[11646.788616] Lustre: DEBUG MARKER: == sanity-quota test 82: verify more than 8 qids for single operation ========================================================== 10:46:05 (1786113965)
[11670.752856] Lustre: DEBUG MARKER: == sanity-quota test 83: Setting default quota shouldn't affect grace time ========================================================== 10:46:30 (1786113990)
[11693.976493] Lustre: DEBUG MARKER: == sanity-quota test 84: Reset quota should fix the insane granted quota ========================================================== 10:46:53 (1786114013)
[11731.015365] Lustre: *** cfs_fail_loc=a08, val=0***
[11731.020968] Lustre: Skipped 8 previous similar messages
[11731.031804] Lustre: *** cfs_fail_loc=a08, val=0***
[11731.035431] Lustre: Skipped 8 previous similar messages
[11807.404413] Lustre: DEBUG MARKER: == sanity-quota test 85: do not hung at write with the least_qunit ========================================================== 10:48:46 (1786114126)
[11875.611176] Lustre: DEBUG MARKER: == sanity-quota test 86: Pre-acquired quota should be released if quota is over limit ========================================================== 10:49:55 (1786114195)
[11929.365754] LustreError: 235436:0:(qmt_entry.c:558:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:60000 enforced:1 hard:2048 soft:2048 granted:65536 time:1786719048 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[12020.869297] LustreError: 235438:0:(qmt_entry.c:558:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:60000 enforced:1 hard:2048 soft:2048 granted:65536 time:1786719140 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[12107.236718] LustreError: 235436:0:(qmt_entry.c:558:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:1000 enforced:1 hard:2048 soft:2048 granted:65536 time:1786719226 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[12114.145536] Lustre: DEBUG MARKER: sanity-quota test_86: @@@@@@ FAIL: succeed to create files, expect failed