[ 3348.553404] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 3350.875270] Lustre: DEBUG MARKER: Write 100M (buffered) ...
[ 3352.554724] LustreError: 8085:0:(osd_handler.c:698:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 3353.082148] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 3353.921486] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 3354.832919] Lustre: Failing over lustre-MDT0000
[ 3355.003971] LustreError: 8491:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 3355.008558] LustreError: 8491:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message
[ 3355.124078] Lustre: server umount lustre-MDT0000 complete
[ 3368.456201] LustreError: MGC192.168.203.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3368.628623] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 3368.725827] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3368.760621] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 3370.215812] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3370.725823] Lustre: 3294:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1746134189/real 1746134189]  req@ffff88013217b480 x1830950920763648/t0(0) o601->lustre-MDT0000-lwp-OST0000@0@lo:23/10 lens 336/336 e 0 to 1 dl 1746134205 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'lquota_wb_lustr.0' uid:0 gid:0
[ 3370.742474] Lustre: 3294:0:(client.c:2346:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 3371.655716] Lustre: 3293:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1746134190/real 1746134190]  req@ffff88008a24d180 x1830950920764032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1746134206 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0
[ 3372.612465] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 3372.703076] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 3372.737092] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:785 to 0x240000400:801)
[ 3372.737118] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:781 to 0x280000400:801)
[ 3373.707013] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to  (at 0@lo)
[ 3374.283643] Lustre: DEBUG MARKER: oleg359-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 3375.031167] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 3375.878542] LustreError: 7901:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-OST0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 3375.888995] LustreError: 7901:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 6 previous similar messages
[ 3377.633198] Lustre: 3292:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1746134195/real 1746134195]  req@ffff88008a24d880 x1830950920764288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1746134211 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0
[ 3377.644690] Lustre: 3292:0:(client.c:2346:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 3381.711792] Lustre: 3294:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1746134200/real 1746134200]  req@ffff88012c0d5c00 x1830950920764672/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1746134216 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0
[ 3381.730727] Lustre: 3294:0:(client.c:2346:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 3383.532347] Lustre: DEBUG MARKER: (dd_pid=1164, time=5, timeout=600)
[ 3416.763481] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 3419.667574] Lustre: DEBUG MARKER: Write 100M (directio) ...
[ 3421.682169] LustreError: 12623:0:(osd_handler.c:698:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 3422.139297] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 3422.939730] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 3424.158521] Lustre: Failing over lustre-MDT0000
[ 3424.380106] LustreError: 13446:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 3424.386197] LustreError: 13446:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages
[ 3424.562768] Lustre: server umount lustre-MDT0000 complete
[ 3437.960280] LustreError: MGC192.168.203.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3438.257127] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3438.296100] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 3439.647796] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 3439.687067] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3439.707450] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 3439.726526] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:803 to 0x240000400:833)
[ 3439.726528] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:781 to 0x280000400:833)
[ 3441.263067] Lustre: 3294:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1746134259/real 1746134259]  req@ffff88008e4b3800 x1830950920793600/t0(0) o601->lustre-MDT0000-lwp-OST0000@0@lo:23/10 lens 336/336 e 0 to 1 dl 1746134275 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'lquota_wb_lustr.0' uid:0 gid:0
[ 3443.296443] LustreError: 7903:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-OST0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 3443.581537] Lustre: DEBUG MARKER: oleg359-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 3444.273775] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 3450.184912] Lustre: 3294:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1746134268/real 1746134268]  req@ffff88013217b480 x1830950920794240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1746134284 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0
[ 3450.201434] Lustre: 3294:0:(client.c:2346:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[ 3451.252344] Lustre: DEBUG MARKER: (dd_pid=3577, time=4, timeout=600)
[ 3493.140610] Lustre: DEBUG MARKER: == sanity-quota test 19: Updating admin limits doesn't zero operational limits(b14790) ========================================================== 17:18:46 (1746134326)
[ 3505.992291] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 3506.716073] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 3508.921942] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 3509.574386] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 3533.700692] Lustre: DEBUG MARKER: == sanity-quota test 20: Test if setquota specifiers work properly (b15754) ========================================================== 17:19:27 (1746134367)
[ 3543.686606] Lustre: DEBUG MARKER: == sanity-quota test 21: Setquota while writing
[ 3553.737061] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for user: quota_usr
[ 3554.504084] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for group: quota_usr
[ 3555.316534] Lustre: DEBUG MARKER: Set limit(block:10G; file:) for project: 1000
[ 3556.242503] Lustre: DEBUG MARKER: Set quota for 1 times
[ 3558.349161] Lustre: DEBUG MARKER: Set quota for 2 times
[ 3560.398967] Lustre: DEBUG MARKER: Set quota for 3 times
[ 3562.589256] Lustre: DEBUG MARKER: Set quota for 4 times
[ 3564.826343] Lustre: DEBUG MARKER: Set quota for 5 times
[ 3566.905458] Lustre: DEBUG MARKER: Set quota for 6 times
[ 3569.117675] Lustre: DEBUG MARKER: Set quota for 7 times
[ 3571.361964] Lustre: DEBUG MARKER: Set quota for 8 times
[ 3573.732973] Lustre: DEBUG MARKER: Set quota for 9 times
[ 3575.876370] Lustre: DEBUG MARKER: Set quota for 10 times
[ 3578.357392] Lustre: DEBUG MARKER: Set quota for 11 times
[ 3580.526289] Lustre: DEBUG MARKER: Set quota for 12 times
[ 3582.506782] Lustre: DEBUG MARKER: Set quota for 13 times
[ 3584.493424] Lustre: DEBUG MARKER: Set quota for 14 times
[ 3607.942345] Lustre: DEBUG MARKER: == sanity-quota test 22: enable/disable quota by 'lctl conf_param/set_param -P' ========================================================== 17:20:41 (1746134441)
[ 3610.298935] LustreError: 26330:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-OST0001: Delaying reintegration for qtype:2 until pending updates are flushed.
[ 3610.306945] LustreError: 26330:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 1 previous similar message
[ 3616.263856] LustreError: 26922:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 3616.266968] LustreError: 26922:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages
[ 3616.360622] Lustre: server umount lustre-MDT0000 complete
[ 3618.328477] LustreError: 17870:0:(ldlm_lockd.c:2549:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1746134452 with bad export cookie 3189785980988498316
[ 3618.336320] LustreError: MGC192.168.203.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3628.375663] Lustre: server umount lustre-OST0000 complete
[ 3640.434459] Lustre: server umount lustre-OST0001 complete
[ 3646.407123] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing load_modules_local
[ 3650.176927] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3651.800928] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3653.243370] Lustre: Modifying parameter general.debug_raw_pointers in log params
[ 3655.866373] Lustre: 29973:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.203.159@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 3656.087894] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 3658.299380] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3660.050723] LustreError: 29976:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 3660.059520] LustreError: 29976:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 2 previous similar messages
[ 3660.069015] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:836 to 0x240000400:865)
[ 3662.081794] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 3663.129204] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:835 to 0x280000400:865)
[ 3664.640595] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3668.447744] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 3670.256899] Lustre: Modifying parameter general.lod.*.mdt_hash in log params
[ 3687.114423] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 3687.116825] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 3687.126572] Lustre: Skipped 4 previous similar messages
[ 3687.733903] LustreError: 639:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup
[ 3687.793480] LustreError: 639:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages
[ 3687.909266] Lustre: server umount lustre-MDT0000 complete
[ 3690.074598] LustreError: 32356:0:(ldlm_lockd.c:2549:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1746134524 with bad export cookie 3189785980988509971
[ 3690.077442] LustreError: MGC192.168.203.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3690.087223] LustreError: 32356:0:(ldlm_lockd.c:2549:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 3690.132210] Lustre: server umount lustre-OST0000 complete
[ 3692.362564] Lustre: server umount lustre-OST0001 complete
[ 3699.716291] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing load_modules_local
[ 3704.747791] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3706.613323] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3708.278173] Lustre: Modifying parameter general.debug_raw_pointers in log params
[ 3711.133608] Lustre: 3648:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.203.159@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 3711.147727] Lustre: 3648:0:(mgc_request_server.c:550:mgc_llog_local_copy()) Skipped 1 previous similar message
[ 3714.348255] LustreError: 4095:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 3714.374179] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:836 to 0x240000400:897)
[ 3714.413285] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3719.168074] mount.lustre (4687) used greatest stack depth: 9512 bytes left
[ 3720.272499] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:835 to 0x280000400:897)
[ 3722.225602] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3726.870327] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 3728.768204] Lustre: Modifying parameter general.lod.*.mdt_hash in log params
[ 3739.158574] Lustre: DEBUG MARKER: == sanity-quota test 23: Quota should be honored with directIO (b16125) ========================================================== 17:22:52 (1746134572)
[ 3739.961976] Lustre: DEBUG MARKER: SKIP: sanity-quota test_23 Overwrite in place is not guaranteed to be space neutral on ZFS
[ 3740.944426] Lustre: DEBUG MARKER: == sanity-quota test 24: lfs draws an asterix when limit is reached (b16646) ========================================================== 17:22:54 (1746134574)
[ 3773.316216] Lustre: DEBUG MARKER: == sanity-quota test 25: check indexes versions ========== 17:23:26 (1746134606)
[ 3798.887131] Lustre: DEBUG MARKER: Write...
[ 3799.973349] Lustre: DEBUG MARKER: Write out of block quota ...
[ 3833.796889] Lustre: DEBUG MARKER: == sanity-quota test 27a: lfs quota/setquota should handle wrong arguments (b19612) ========================================================== 17:24:27 (1746134667)
[ 3835.989223] Lustre: DEBUG MARKER: == sanity-quota test 27b: lfs quota/setquota should handle user/group/project ID (b20200) ========================================================== 17:24:29 (1746134669)
[ 3841.194295] Lustre: DEBUG MARKER: == sanity-quota test 27c: lfs quota should support human-readable output ========================================================== 17:24:34 (1746134674)
[ 3845.131287] Lustre: DEBUG MARKER: == sanity-quota test 27d: lfs setquota should support fraction block limit ========================================================== 17:24:38 (1746134678)
[ 3848.863239] Lustre: DEBUG MARKER: == sanity-quota test 30: Hard limit updates should not reset grace times ========================================================== 17:24:42 (1746134682)
[ 3893.361991] Lustre: DEBUG MARKER: == sanity-quota test 33: Basic usage tracking for user
[ 3968.529784] Lustre: DEBUG MARKER: == sanity-quota test 34: Usage transfer for user
[ 4079.378419] Lustre: DEBUG MARKER: == sanity-quota test 35: Usage is still accessible across reboot ========================================================== 17:28:33 (1746134913)
[ 4112.253178] Lustre: DEBUG MARKER: Restart...
[ 4114.728763] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 4114.736906] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 4114.740080] Lustre: Skipped 2 previous similar messages
[ 4119.543561] LustreError: 29432:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup
[ 4119.546262] LustreError: 29432:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages
[ 4119.614924] Lustre: server umount lustre-MDT0000 complete
[ 4121.494711] LustreError: 5690:0:(ldlm_lockd.c:2549:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1746134955 with bad export cookie 3189785980988511504
[ 4121.499182] LustreError: MGC192.168.203.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 4121.508829] LustreError: 5690:0:(ldlm_lockd.c:2549:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 4121.540592] Lustre: server umount lustre-OST0000 complete
[ 4123.797310] Lustre: server umount lustre-OST0001 complete
[ 4129.083419] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing load_modules_local
[ 4132.622934] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 4132.625323] Lustre: Skipped 2 previous similar messages
[ 4133.824062] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4135.261620] Lustre: Modifying parameter general.debug_raw_pointers in log params
[ 4137.807318] Lustre: 32395:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.203.159@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 4137.812998] Lustre: 32395:0:(mgc_request_server.c:550:mgc_llog_local_copy()) Skipped 1 previous similar message
[ 4140.372415] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4141.979402] LustreError: 32409:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4141.998649] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:906 to 0x240000400:929)
[ 4145.500083] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:906 to 0x280000400:929)
[ 4146.044038] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4149.761646] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 4151.346951] Lustre: Modifying parameter general.lod.*.mdt_hash in log params
[ 4184.324269] Lustre: DEBUG MARKER: == sanity-quota test 37: Quota accounted properly for file created by 'lfs setstripe' ========================================================== 17:30:17 (1746135017)
[ 4231.798911] Lustre: DEBUG MARKER: == sanity-quota test 38: Quota accounting iterator doesn't skip id entries ========================================================== 17:31:05 (1746135065)
[ 5043.884214] Lustre: DEBUG MARKER: == sanity-quota test 39: Project ID interface works correctly ========================================================== 17:44:37 (1746135877)
[ 5052.623273] LustreError: 21758:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup
[ 5052.629564] LustreError: 21758:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages
[ 5052.733836] Lustre: server umount lustre-MDT0000 complete
[ 5054.844035] LustreError: 31401:0:(ldlm_lockd.c:2549:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1746135889 with bad export cookie 3189785980988517867
[ 5054.849864] LustreError: MGC192.168.203.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 5064.896285] Lustre: server umount lustre-OST0000 complete
[ 5076.863423] Lustre: server umount lustre-OST0001 complete
[ 5083.278182] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing load_modules_local
[ 5086.694390] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 5086.697506] Lustre: Skipped 2 previous similar messages
[ 5088.093816] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5089.359119] Lustre: Modifying parameter general.debug_raw_pointers in log params
[ 5091.444728] Lustre: 24720:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.203.159@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 5091.449871] Lustre: 24720:0:(mgc_request_server.c:550:mgc_llog_local_copy()) Skipped 1 previous similar message
[ 5091.585694] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 5093.614520] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5096.384745] Lustre: 25760:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.203.159@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 5097.517172] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:5930 to 0x280000400:5953)
[ 5097.576817] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:5932 to 0x240000400:5953)
[ 5098.568891] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5102.037208] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 5103.484873] Lustre: Modifying parameter general.lod.*.mdt_hash in log params
[ 5132.065421] Lustre: DEBUG MARKER: == sanity-quota test 40a: Hard link across different project ID ========================================================== 17:46:05 (1746135965)
[ 5160.475614] Lustre: DEBUG MARKER: == sanity-quota test 40b: Mv across different project ID ========================================================== 17:46:34 (1746135994)
[ 5186.673140] Lustre: DEBUG MARKER: == sanity-quota test 40c: Remote child Dir inherit project quota properly ========================================================== 17:47:00 (1746136020)
[ 5187.310250] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40c needs >= 2 MDTs
[ 5188.176629] Lustre: DEBUG MARKER: == sanity-quota test 40d: Stripe Directory inherit project quota properly ========================================================== 17:47:01 (1746136021)
[ 5188.830108] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40d needs >= 2 MDTs
[ 5189.618842] Lustre: DEBUG MARKER: == sanity-quota test 41: df should return projid-specific values ========================================================== 17:47:03 (1746136023)
[ 5198.606141] LustreError: 30926:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 5198.611372] LustreError: 30926:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 2 previous similar messages
[ 5226.191052] Lustre: DEBUG MARKER: == sanity-quota test 42: lfs quota should include default quota info ========================================================== 17:47:39 (1746136059)
[ 5254.140787] Lustre: DEBUG MARKER: == sanity-quota test 48: lfs quota --delete should delete quota project ID ========================================================== 17:48:07 (1746136087)
[ 5323.113039] Lustre: DEBUG MARKER: == sanity-quota test 49: lfs quota -a prints the quota usage for all quota IDs ========================================================== 17:49:16 (1746136156)
[ 5330.434238] Lustre: *** cfs_fail_loc=a09, val=0***
[ 5330.439321] Lustre: Skipped 1 previous similar message
[ 5331.445949] Lustre: *** cfs_fail_loc=a09, val=0***
[ 5331.449788] Lustre: Skipped 101 previous similar messages
[ 5333.459392] Lustre: *** cfs_fail_loc=a09, val=0***
[ 5333.462627] Lustre: Skipped 221 previous similar messages
[ 5337.466899] Lustre: *** cfs_fail_loc=a09, val=0***
[ 5337.468599] Lustre: Skipped 467 previous similar messages
[ 5345.485518] Lustre: *** cfs_fail_loc=a09, val=0***
[ 5345.487845] Lustre: Skipped 849 previous similar messages
[ 5361.491689] Lustre: *** cfs_fail_loc=a09, val=0***
[ 5361.494214] Lustre: Skipped 1877 previous similar messages
[ 5393.494634] Lustre: *** cfs_fail_loc=a09, val=0***
[ 5393.497036] Lustre: Skipped 4037 previous similar messages
[ 5638.488504] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 5638.489000] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 5638.496887] Lustre: Skipped 2 previous similar messages
[ 5640.714051] LustreError: 16643:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup
[ 5640.716962] LustreError: 16643:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages
[ 5640.796371] Lustre: server umount lustre-MDT0000 complete
[ 5642.303868] LustreError: 23714:0:(ldlm_lockd.c:2549:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1746136476 with bad export cookie 3189785980990276995
[ 5642.309482] LustreError: MGC192.168.203.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 5642.446599] Lustre: server umount lustre-OST0000 complete
[ 5644.123648] Lustre: server umount lustre-OST0001 complete
[ 5646.459962] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_hostid
[ 5648.597506] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing load_modules_local
[ 5651.890578]  vdc: vdc1 vdc9
[ 5655.229728]  vde: vde1 vde9
[ 5659.414107]  vdf: vdf1 vdf9
[ 5664.879956] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing load_modules_local
[ 5668.094766] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall in log lustre-MDT0000
[ 5668.238776] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space.
[ 5668.285635] Lustre: lustre-MDT0000: new disk, initializing
[ 5668.496477] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 5668.499219] Lustre: Skipped 1 previous similar message
[ 5668.543882] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt
[ 5669.954086] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5675.453027] Lustre: 22901:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.203.159@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 5675.468949] Lustre: lustre-OST0000: new disk, initializing
[ 5675.473009] Lustre: srv-lustre-OST0000: No data found on store. Initialize space.
[ 5675.476590] Lustre: Skipped 1 previous similar message
[ 5677.386733] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost
[ 5677.394025] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost]
[ 5677.509656] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400
[ 5678.297546] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5683.346839] Lustre: lustre-OST0001: new disk, initializing
[ 5683.348771] Lustre: srv-lustre-OST0001: No data found on store. Initialize space.
[ 5684.800664] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost
[ 5684.804710] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost]
[ 5684.893519] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400
[ 5685.996246] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5691.442581] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 5693.155788] Lustre: Setting parameter general.lod.*.mdt_hash in log params
[ 5693.157900] Lustre: Skipped 1 previous similar message
[ 5718.734018] Lustre: DEBUG MARKER: == sanity-quota test 50: Test if lfs find --projid works ========================================================== 17:55:52 (1746136552)
[ 5748.583497] Lustre: DEBUG MARKER: == sanity-quota test 51: Test project accounting with mv/cp ========================================================== 17:56:22 (1746136582)
[ 5783.512470] Lustre: DEBUG MARKER: == sanity-quota test 52: Rename normal file across project ID ========================================================== 17:56:57 (1746136617)
[ 5796.747578] Lustre: DEBUG MARKER: rename directory return 255
[ 5821.872861] Lustre: DEBUG MARKER: == sanity-quota test 53: Project inherit attribute could be cleared ========================================================== 17:57:35 (1746136655)
[ 5840.083578] Lustre: DEBUG MARKER: == sanity-quota test 54: basic lfs project interface test ========================================================== 17:57:53 (1746136673)
[ 5866.247964] Lustre: DEBUG MARKER: == sanity-quota test 55: Chgrp should be affected by group quota ========================================================== 17:58:19 (1746136699)
[ 5902.146304] LustreError: 1730:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:dt-0x0 id:60001 enforced:1 hard:51200 soft:0 granted:51200 time:0 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 5925.257027] Lustre: DEBUG MARKER: == sanity-quota test 56: lfs quota -t should work well === 17:59:18 (1746136758)
[ 5947.092961] Lustre: DEBUG MARKER: == sanity-quota test 57: lfs project could tolerate errors ========================================================== 17:59:40 (1746136780)
[ 5974.923320] Lustre: DEBUG MARKER: == sanity-quota test 58: project ID should be kept for new mirrors created by FID ========================================================== 18:00:08 (1746136808)
[ 6059.247023] Lustre: DEBUG MARKER: == sanity-quota test 59: lfs project dosen't crash kernel with project disabled ========================================================== 18:01:32 (1746136892)
[ 6059.825858] Lustre: DEBUG MARKER: SKIP: sanity-quota test_59 ldiskfs only test
[ 6060.568421] Lustre: DEBUG MARKER: == sanity-quota test 60: Test quota for root with setgid ========================================================== 18:01:34 (1746136894)
[ 6068.976247] LustreError: 18404:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 6068.988338] LustreError: 18404:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 4 previous similar messages
[ 6099.875620] Lustre: DEBUG MARKER: SKIP: sanity-quota test_61 skipping SLOW test 61
[ 6100.649806] Lustre: DEBUG MARKER: == sanity-quota test 62: Project inherit should be only changed by root ========================================================== 18:02:14 (1746136934)
[ 6119.724067] Lustre: DEBUG MARKER: SKIP: sanity-quota test_63 skipping excluded test 63
[ 6120.524393] Lustre: DEBUG MARKER: == sanity-quota test 64: lfs project on non dir/files should succeed ========================================================== 18:02:34 (1746136954)
[ 6149.848504] Lustre: DEBUG MARKER: SKIP: sanity-quota test_65 skipping excluded test 65
[ 6150.607333] Lustre: DEBUG MARKER: == sanity-quota test 66: nonroot user can not change project state in default ========================================================== 18:03:04 (1746136984)
[ 6180.045764] Lustre: DEBUG MARKER: == sanity-quota test 67: quota pools recalculation ======= 18:03:33 (1746137013)
[ 6180.822694] Lustre: DEBUG MARKER: SKIP: sanity-quota test_67 ZFS grants some block space together with inode
[ 6181.886225] Lustre: DEBUG MARKER: == sanity-quota test 68: slave number in quota pool changed after each add/remove OST ========================================================== 18:03:35 (1746137015)
[ 6199.799749] LustreError: 25180:0:(mgs_handler.c:848:mgs_iocontrol_pool()) OBD_IOC_POOL err -17, cmd CE021 for pool lustre.qpool1
[ 6226.627530] Lustre: DEBUG MARKER: == sanity-quota test 69: EDQUOT at one of pools shouldn't affect DOM ========================================================== 18:04:20 (1746137060)
[ 6237.160644] LustreError: 27614:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:2 until pending updates are flushed.
[ 6237.169371] LustreError: 27614:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 5 previous similar messages
[ 6244.179359] Lustre: DEBUG MARKER: User quota (block hardlimit:200 MB)
[ 6244.878896] Lustre: DEBUG MARKER: User quota (block hardlimit:10 MB)
[ 6348.249439] Lustre: DEBUG MARKER: == sanity-quota test 70a: check lfs setquota/quota with a pool option ========================================================== 18:06:21 (1746137181)
[ 6378.930871] Lustre: DEBUG MARKER: == sanity-quota test 70b: lfs setquota pool works properly ========================================================== 18:06:52 (1746137212)
[ 6399.375529] Lustre: DEBUG MARKER: == sanity-quota test 71a: Check PFL with quota pools ===== 18:07:13 (1746137233)
[ 6400.037369] Lustre: DEBUG MARKER: SKIP: sanity-quota test_71a ZFS grants some block space together with inode
[ 6400.656258] Lustre: DEBUG MARKER: == sanity-quota test 71b: Check SEL with quota pools ===== 18:07:14 (1746137234)
[ 6401.188556] Lustre: DEBUG MARKER: SKIP: sanity-quota test_71b ZFS grants some block space together with inode
[ 6401.949496] Lustre: DEBUG MARKER: == sanity-quota test 72: lfs quota --pool prints only pool's OSTs ========================================================== 18:07:15 (1746137235)
[ 6412.090770] Lustre: DEBUG MARKER: User quota (block hardlimit:50 MB)
[ 6421.126663] Lustre: DEBUG MARKER: Write...
[ 6422.160302] Lustre: DEBUG MARKER: Write out of block quota ...
[ 6456.675915] Lustre: DEBUG MARKER: == sanity-quota test 73a: default limits at OST Pool Quotas ========================================================== 18:08:10 (1746137290)
[ 6474.089580] Lustre: DEBUG MARKER: set to use default quota
[ 6475.050413] Lustre: DEBUG MARKER: set default quota
[ 6475.973496] Lustre: DEBUG MARKER: get default quota
[ 6478.265075] Lustre: DEBUG MARKER: Test not out of quota
[ 6480.291121] Lustre: DEBUG MARKER: Test out of quota
[ 6486.323738] Lustre: DEBUG MARKER: Increase default quota
[ 6499.366208] Lustre: DEBUG MARKER: Set quota to override default quota
[ 6499.384550] LustreError: 21662:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:dt-qpool1 id:60000 enforced:1 hard:20480 soft:20480 granted:45063 time:1746742133 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 6505.012705] Lustre: DEBUG MARKER: Set to use default quota again
[ 6519.620502] Lustre: DEBUG MARKER: Cleanup
[ 6568.174492] Lustre: DEBUG MARKER: == sanity-quota test 73b: default OST Pool Quotas limit for new user ========================================================== 18:10:01 (1746137401)
[ 6583.507387] Lustre: DEBUG MARKER: set default quota for qpool1
[ 6584.588067] Lustre: DEBUG MARKER: Write from user that hasn't lqe
[ 6618.904188] Lustre: DEBUG MARKER: == sanity-quota test 74: check quota pools per user ====== 18:10:52 (1746137452)
[ 6667.886825] Lustre: DEBUG MARKER: == sanity-quota test 75: nodemap squashed root respects quota enforcement ========================================================== 18:11:41 (1746137501)
[ 6749.097108] Lustre: DEBUG MARKER: Write...
[ 6750.212998] Lustre: DEBUG MARKER: Write out of block quota ...
[ 6851.040877] Lustre: DEBUG MARKER: == sanity-quota test 76: project ID 4294967295 should be not allowed ========================================================== 18:14:44 (1746137684)
[ 6878.608854] Lustre: DEBUG MARKER: == sanity-quota test 77: lfs setquota should fail in Lustre mount with 'ro' ========================================================== 18:15:12 (1746137712)
[ 6880.925366] Lustre: DEBUG MARKER: == sanity-quota test 78A: Check fallocate increase quota usage ========================================================== 18:15:14 (1746137714)
[ 6881.415617] Lustre: DEBUG MARKER: SKIP: sanity-quota test_78A need >= 2.13.57 and ldiskfs for fallocate
[ 6882.058834] Lustre: DEBUG MARKER: == sanity-quota test 78a: Check fallocate increase projectid usage ========================================================== 18:15:15 (1746137715)
[ 6882.587868] Lustre: DEBUG MARKER: SKIP: sanity-quota test_78a need >= 2.13.57 and ldiskfs for fallocate
[ 6883.135418] Lustre: DEBUG MARKER: == sanity-quota test 79: access to non-existed dt-pool/info doesn't cause a panic ========================================================== 18:15:16 (1746137716)
[ 6894.065422] Lustre: DEBUG MARKER: == sanity-quota test 80: check for EDQUOT after OST failover ========================================================== 18:15:27 (1746137727)
[ 6894.691235] Lustre: DEBUG MARKER: SKIP: sanity-quota test_80 ZFS grants some block space together with inode
[ 6895.337115] Lustre: DEBUG MARKER: == sanity-quota test 81: Race qmt_start_pool_recalc with qmt_pool_free ========================================================== 18:15:29 (1746137729)
[ 6903.976942] Lustre: DEBUG MARKER: User quota (block hardlimit:20 MB)
[ 6909.052784] LustreError: 29837:0:(qmt_pool.c:1295:qmt_pool_recalc()) cfs_fail_timeout id a07 sleeping for 10000ms
[ 6911.743663] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 6911.745069] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 6911.745070] Lustre: Skipped 1 previous similar message
[ 6911.762422] Lustre: Skipped 1 previous similar message
[ 6913.819532] Lustre: lustre-MDT0000: Not available for connect from 192.168.203.59@tcp (stopping)
[ 6913.823110] Lustre: Skipped 1 previous similar message
[ 6916.744297] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 6916.746600] Lustre: Skipped 1 previous similar message
[ 6918.819116] Lustre: lustre-MDT0000: Not available for connect from 192.168.203.59@tcp (stopping)
[ 6919.088785] LustreError: 29837:0:(qmt_pool.c:1295:qmt_pool_recalc()) cfs_fail_timeout id a07 awake
[ 6919.184640] LustreError: 29967:0:(obd_class.h:479:obd_check_dev()) Device 17 not setup
[ 6919.187272] LustreError: 29967:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages
[ 6919.269104] Lustre: server umount lustre-MDT0000 complete
[ 6921.913286] LustreError: MGC192.168.203.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 6922.113301] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 6922.116402] Lustre: Skipped 2 previous similar messages
[ 6922.181929] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:27 to 0x280000400:65)
[ 6922.186143] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:27 to 0x240000400:65)
[ 6923.384766] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6941.188531] Lustre: DEBUG MARKER: == sanity-quota test 82: verify more than 8 qids for single operation ========================================================== 18:16:14 (1746137774)
[ 6942.100455] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 192.168.203.159@tcp (at 0@lo)
[ 6942.104144] Lustre: Skipped 3 previous similar messages
[ 6958.309322] Lustre: DEBUG MARKER: == sanity-quota test 83: Setting default quota shouldn't affect grace time ========================================================== 18:16:32 (1746137792)
[ 6975.384097] Lustre: DEBUG MARKER: == sanity-quota test 84: Reset quota should fix the insane granted quota ========================================================== 18:16:49 (1746137809)
[ 6991.274087] LustreError: 23065:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-OST0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 6991.284189] LustreError: 23065:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 2 previous similar messages
[ 7002.801540] Lustre: *** cfs_fail_loc=a08, val=0***
[ 7002.803295] Lustre: Skipped 441 previous similar messages
[ 7002.810780] Lustre: *** cfs_fail_loc=a08, val=0***
[ 7056.326119] Lustre: DEBUG MARKER: == sanity-quota test 85: do not hung at write with the least_qunit ========================================================== 18:18:10 (1746137890)
[ 7111.021424] Lustre: DEBUG MARKER: == sanity-quota test 86: Pre-acquired quota should be released if quota is over limit ========================================================== 18:19:04 (1746137944)
[ 7210.704071] LustreError: 30661:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:60000 enforced:1 hard:2048 soft:2048 granted:65536 time:1746742845 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 7338.341993] LustreError: 5381:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:60000 enforced:1 hard:2048 soft:2048 granted:65536 time:1746742972 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 7448.077727] LustreError: 32323:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:1000 enforced:1 hard:2048 soft:2048 granted:65536 time:1746743082 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 7498.494374] Lustre: DEBUG MARKER: == sanity-quota test 87: lfs quota -a should print default quota setting ========================================================== 18:25:32 (1746138332)
[ 7505.974775] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7539.816220] Lustre: lustre-MDT0000: Not available for connect from 192.168.203.59@tcp (stopping)
[ 7543.064372] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 7543.066216] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 7543.077715] Lustre: Skipped 1 previous similar message
[ 7544.500880] LustreError: 31439:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 7544.502924] LustreError: 31439:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages
[ 7544.562139] Lustre: server umount lustre-MDT0000 complete
[ 7547.097178] LustreError: MGC192.168.203.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 7547.340258] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 7547.392927] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:67 to 0x240000400:97)
[ 7547.397599] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:67 to 0x280000400:97)
[ 7548.469046] Lustre: DEBUG MARKER: oleg359-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7552.315592] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to  (at 0@lo)
[ 7552.318772] Lustre: Skipped 1 previous similar message
[ 7568.433501] Lustre: DEBUG MARKER: == sanity-quota test 88: Writing over quota should not hang ========================================================== 18:26:42 (1746138402)
[ 7568.907146] Lustre: DEBUG MARKER: SKIP: sanity-quota test_88 require client with >4k pages
[ 7569.519177] Lustre: DEBUG MARKER: == sanity-quota test 89: Show default quota with squash_uid ========================================================== 18:26:43 (1746138403)
[ 7608.506214] Lustre: DEBUG MARKER: == sanity-quota test 90a: lfs quota should work without mount point ========================================================== 18:27:22 (1746138442)
[ 7636.199036] Lustre: DEBUG MARKER: == sanity-quota test 90b: lfs quota should work with multiple mount points ========================================================== 18:27:49 (1746138469)
[ 7645.343911] Lustre: DEBUG MARKER: sanity-quota test_90b: @@@@@@ FAIL: quota info from /mnt/lustre2 not ' /mnt/lustre2 0 11710 0 0 - 374 0 0 -