[ 3000.250688] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 3001.443095] Lustre: DEBUG MARKER: Write 100M (buffered) ...
[ 3002.307877] LustreError: 1257:0:(osd_handler.c:698:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 3002.558808] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 3002.925301] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 3003.429666] Lustre: Failing over lustre-MDT0000
[ 3003.511426] LustreError: 1619:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 3003.513808] LustreError: 1619:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message
[ 3003.570346] Lustre: server umount lustre-MDT0000 complete
[ 3015.312426] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3015.408338] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 3015.417209] Lustre: Skipped 1 previous similar message
[ 3015.443093] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3015.458517] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 3016.205570] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3017.083776] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 3017.118711] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 3017.135660] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1971 to 0x280000400:2017)
[ 3017.140714] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1973 to 0x240000400:2017)
[ 3018.799534] Lustre: DEBUG MARKER: oleg249-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 3019.205674] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 3019.408333] Lustre: 3302:0:(client.c:2451:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1749124493/real 1749124493]  req@ffff880132cedc00 x1834086872263040/t0(0) o601->lustre-MDT0000-lwp-OST0000@0@lo:23/10 lens 336/336 e 0 to 1 dl 1749124509 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'lquota_wb_lustr.0' uid:0 gid:0 projid:4294967295
[ 3020.429769] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to  (at 0@lo)
[ 3021.428191] LustreError: 8429:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-OST0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 3021.431965] LustreError: 8429:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 6 previous similar messages
[ 3022.432265] Lustre: 3305:0:(client.c:2451:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1749124496/real 1749124496]  req@ffff88008a08d500 x1834086872263296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1749124512 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 3026.341094] Lustre: DEBUG MARKER: (dd_pid=4152, time=5, timeout=600)
[ 3027.436258] Lustre: 3304:0:(client.c:2451:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1749124501/real 1749124501]  req@ffff8800a62d1500 x1834086872263680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1749124517 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 3027.436263] Lustre: 3305:0:(client.c:2451:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1749124501/real 1749124501]  req@ffff8800a6266680 x1834086872263808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1749124517 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 3027.436267] Lustre: 3305:0:(client.c:2451:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 3055.322047] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 3056.361480] Lustre: DEBUG MARKER: Write 100M (directio) ...
[ 3057.104754] LustreError: 5900:0:(osd_handler.c:698:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 3057.340469] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 3057.693582] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 3058.193097] Lustre: Failing over lustre-MDT0000
[ 3058.243034] LustreError: lustre-MDT0000-lwp-OST0000: operation quota_acquire to node 0@lo failed: rc = -107
[ 3058.246420] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 3058.274061] LustreError: 6774:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 3058.276819] LustreError: 6774:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages
[ 3058.326828] Lustre: server umount lustre-MDT0000 complete
[ 3070.073596] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3070.219745] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3070.238138] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 3071.078664] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3072.170833] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 3072.207230] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 3072.223138] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1971 to 0x280000400:2049)
[ 3072.223149] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:2019 to 0x240000400:2049)
[ 3073.668987] Lustre: DEBUG MARKER: oleg249-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 3074.095363] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 3077.213292] Lustre: 3302:0:(client.c:2451:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1749124550/real 1749124550]  req@ffff880134aded80 x1834086872292992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1749124566 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 3088.380043] Lustre: DEBUG MARKER: (dd_pid=6658, time=12, timeout=600)
[ 3124.234529] Lustre: DEBUG MARKER: == sanity-quota test 19: Updating admin limits doesn't zero operational limits(b14790) ========================================================== 07:56:52 (1749124612)
[ 3132.165124] LustreError: 11643:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:1 until pending updates are flushed.
[ 3132.171193] LustreError: 11643:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 1 previous similar message
[ 3133.919785] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 3134.311809] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 3135.406324] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 3135.792628] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 3154.585627] Lustre: DEBUG MARKER: == sanity-quota test 20: Test if setquota specifiers work properly (b15754) ========================================================== 07:57:23 (1749124643)
[ 3160.805487] Lustre: DEBUG MARKER: == sanity-quota test 21: Setquota while writing
[ 3168.375781] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for user: quota_usr
[ 3168.755825] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for group: quota_usr
[ 3169.117387] Lustre: DEBUG MARKER: Set limit(block:10G; file:) for project: 1000
[ 3169.522998] Lustre: DEBUG MARKER: Set quota for 1 times
[ 3170.985673] Lustre: DEBUG MARKER: Set quota for 2 times
[ 3172.444938] Lustre: DEBUG MARKER: Set quota for 3 times
[ 3173.904310] Lustre: DEBUG MARKER: Set quota for 4 times
[ 3175.336108] Lustre: DEBUG MARKER: Set quota for 5 times
[ 3176.790963] Lustre: DEBUG MARKER: Set quota for 6 times
[ 3178.250736] Lustre: DEBUG MARKER: Set quota for 7 times
[ 3179.684475] Lustre: DEBUG MARKER: Set quota for 8 times
[ 3181.182495] Lustre: DEBUG MARKER: Set quota for 9 times
[ 3182.628863] Lustre: DEBUG MARKER: Set quota for 10 times
[ 3184.067743] Lustre: DEBUG MARKER: Set quota for 11 times
[ 3185.527951] Lustre: DEBUG MARKER: Set quota for 12 times
[ 3186.994244] Lustre: DEBUG MARKER: Set quota for 13 times
[ 3188.449125] Lustre: DEBUG MARKER: Set quota for 14 times
[ 3189.918913] Lustre: DEBUG MARKER: Set quota for 15 times
[ 3191.407081] Lustre: DEBUG MARKER: Set quota for 16 times
[ 3192.891451] Lustre: DEBUG MARKER: Set quota for 17 times
[ 3194.332192] Lustre: DEBUG MARKER: Set quota for 18 times
[ 3195.802260] Lustre: DEBUG MARKER: Set quota for 19 times
[ 3197.262601] Lustre: DEBUG MARKER: Set quota for 20 times
[ 3198.742094] Lustre: DEBUG MARKER: Set quota for 21 times
[ 3218.751480] Lustre: DEBUG MARKER: == sanity-quota test 22: enable/disable quota by 'lctl conf_param/set_param -P' ========================================================== 07:58:27 (1749124707)
[ 3226.460588] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 3226.464032] Lustre: Skipped 2 previous similar messages
[ 3226.464305] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 3229.742046] LustreError: 21074:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 3229.744623] LustreError: 21074:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages
[ 3229.792427] Lustre: server umount lustre-MDT0000 complete
[ 3230.788807] LustreError: 9785:0:(ldlm_lockd.c:2550:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1749124720 with bad export cookie 16682940149811822239
[ 3230.789590] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3230.796672] LustreError: 9785:0:(ldlm_lockd.c:2550:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 3230.815840] Lustre: server umount lustre-OST0000 complete
[ 3231.867797] Lustre: server umount lustre-OST0001 complete
[ 3234.784101] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local
[ 3236.732936] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3237.544250] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3238.371840] Lustre: 23604:0:(mgs_llog.c:1347:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 3239.654429] Lustre: 24047:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.202.149@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 3239.746381] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 3241.015330] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3244.133327] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3246.839410] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:2052 to 0x240000400:2081)
[ 3246.839726] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:2051 to 0x280000400:2081)
[ 3251.700116] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 3252.596722] Lustre: 26126:0:(mgs_llog.c:1347:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 3265.884739] Lustre: server umount lustre-MDT0000 complete
[ 3266.981793] LustreError: 23031:0:(ldlm_lockd.c:2550:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1749124756 with bad export cookie 16682940149811843785
[ 3266.986489] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3277.010587] Lustre: server umount lustre-OST0000 complete
[ 3288.111565] Lustre: server umount lustre-OST0001 complete
[ 3290.999973] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local
[ 3292.891742] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3292.895173] Lustre: Skipped 1 previous similar message
[ 3293.636960] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3294.376460] Lustre: 29763:0:(mgs_llog.c:1347:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 3295.663262] Lustre: 30196:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.202.149@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 3295.667940] Lustre: 30196:0:(mgc_request_server.c:550:mgc_llog_local_copy()) Skipped 1 previous similar message
[ 3295.767608] mount.lustre (30196) used greatest stack depth: 9536 bytes left
[ 3297.050812] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3300.138730] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3302.895755] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:2052 to 0x240000400:2113)
[ 3302.895972] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:2051 to 0x280000400:2113)
[ 3307.691951] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 3308.541972] Lustre: 32240:0:(mgs_llog.c:1347:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 3316.094750] Lustre: DEBUG MARKER: == sanity-quota test 23: Quota should be honored with directIO (b16125) ========================================================== 08:00:04 (1749124804)
[ 3316.454231] Lustre: DEBUG MARKER: SKIP: sanity-quota test_23 Overwrite in place is not guaranteed to be space neutral on ZFS
[ 3316.861248] Lustre: DEBUG MARKER: == sanity-quota test 24: lfs draws an asterix when limit is reached (b16646) ========================================================== 08:00:05 (1749124805)
[ 3345.506417] Lustre: DEBUG MARKER: == sanity-quota test 25: check indexes versions ========== 08:00:34 (1749124834)
[ 3360.309610] Lustre: DEBUG MARKER: Write...
[ 3360.875531] Lustre: DEBUG MARKER: Write out of block quota ...
[ 3390.474281] Lustre: DEBUG MARKER: == sanity-quota test 27a: lfs quota/setquota should handle wrong arguments (b19612) ========================================================== 08:01:19 (1749124879)
[ 3391.865126] Lustre: DEBUG MARKER: == sanity-quota test 27b: lfs quota/setquota should handle user/group/project ID (b20200) ========================================================== 08:01:20 (1749124880)
[ 3395.411929] Lustre: DEBUG MARKER: == sanity-quota test 27c: lfs quota should support human-readable output ========================================================== 08:01:23 (1749124883)
[ 3398.041310] Lustre: DEBUG MARKER: == sanity-quota test 27d: lfs setquota should support fraction block limit ========================================================== 08:01:26 (1749124886)
[ 3400.519469] Lustre: DEBUG MARKER: == sanity-quota test 30: Hard limit updates should not reset grace times ========================================================== 08:01:29 (1749124889)
[ 3441.592569] Lustre: DEBUG MARKER: == sanity-quota test 33: Basic usage tracking for user
[ 3508.681346] Lustre: DEBUG MARKER: == sanity-quota test 34: Usage transfer for user
[ 3610.896020] Lustre: DEBUG MARKER: == sanity-quota test 35: Usage is still accessible across reboot ========================================================== 08:04:59 (1749125099)
[ 3638.781125] Lustre: DEBUG MARKER: Restart...
[ 3643.436567] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 3643.436814] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 3643.436815] Lustre: Skipped 1 previous similar message
[ 3643.446131] Lustre: Skipped 1 previous similar message
[ 3645.474051] LustreError: 24595:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup
[ 3645.477108] LustreError: 24595:0:(obd_class.h:479:obd_check_dev()) Skipped 23 previous similar messages
[ 3645.528987] Lustre: server umount lustre-MDT0000 complete
[ 3646.493812] LustreError: 29186:0:(ldlm_lockd.c:2550:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1749125136 with bad export cookie 16682940149811845318
[ 3646.494811] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3646.499548] LustreError: 29186:0:(ldlm_lockd.c:2550:ldlm_cancel_handler()) Skipped 1 previous similar message
[ 3646.515452] Lustre: server umount lustre-OST0000 complete
[ 3647.539744] Lustre: server umount lustre-OST0001 complete
[ 3650.349081] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local
[ 3652.300075] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3652.303848] Lustre: Skipped 2 previous similar messages
[ 3653.028734] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3653.749619] Lustre: 27096:0:(mgs_llog.c:1347:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 3654.984360] Lustre: 27543:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.202.149@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 3654.989677] Lustre: 27543:0:(mgc_request_server.c:550:mgc_llog_local_copy()) Skipped 1 previous similar message
[ 3656.242720] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3659.191591] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3661.983441] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:2122 to 0x240000400:2145)
[ 3661.983587] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:2122 to 0x280000400:2145)
[ 3666.685228] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 3667.628652] Lustre: 29645:0:(mgs_llog.c:1347:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 3699.604030] Lustre: DEBUG MARKER: == sanity-quota test 37: Quota accounted properly for file created by 'lfs setstripe' ========================================================== 08:06:28 (1749125188)
[ 3746.095883] Lustre: DEBUG MARKER: == sanity-quota test 38: Quota accounting iterator doesn't skip id entries ========================================================== 08:07:14 (1749125234)
[ 4090.780349] Lustre: DEBUG MARKER: == sanity-quota test 39: Project ID interface works correctly ========================================================== 08:12:59 (1749125579)
[ 4097.677902] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 4097.680059] Lustre: Skipped 1 previous similar message
[ 4099.747461] LustreError: 9210:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup
[ 4099.749938] LustreError: 9210:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages
[ 4099.800399] Lustre: server umount lustre-MDT0000 complete
[ 4100.797920] LustreError: 29647:0:(ldlm_lockd.c:2550:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1749125590 with bad export cookie 16682940149811851548
[ 4100.799171] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 4100.807241] LustreError: 29647:0:(ldlm_lockd.c:2550:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 4100.833815] Lustre: server umount lustre-OST0000 complete
[ 4103.844581] Lustre: server umount lustre-OST0001 complete
[ 4106.627707] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local
[ 4108.513331] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 4108.516450] Lustre: Skipped 2 previous similar messages
[ 4109.410627] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4110.268819] Lustre: 11746:0:(mgs_llog.c:1347:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 4111.477678] Lustre: 12190:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.202.149@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 4111.480444] Lustre: 12190:0:(mgc_request_server.c:550:mgc_llog_local_copy()) Skipped 1 previous similar message
[ 4112.926774] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4115.965284] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4118.701766] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7147 to 0x240000400:7169)
[ 4118.702773] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7147 to 0x280000400:7169)
[ 4123.522502] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 4151.316864] Lustre: DEBUG MARKER: == sanity-quota test 40a: Hard link across different project ID ========================================================== 08:13:59 (1749125639)
[ 4177.170251] Lustre: DEBUG MARKER: == sanity-quota test 40b: Mv across different project ID ========================================================== 08:14:25 (1749125665)
[ 4201.865775] Lustre: DEBUG MARKER: == sanity-quota test 40c: Remote child Dir inherit project quota properly ========================================================== 08:14:50 (1749125690)
[ 4202.309181] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40c needs >= 2 MDTs
[ 4202.751312] Lustre: DEBUG MARKER: == sanity-quota test 40d: Stripe Directory inherit project quota properly ========================================================== 08:14:51 (1749125691)
[ 4203.106979] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40d needs >= 2 MDTs
[ 4203.529640] Lustre: DEBUG MARKER: == sanity-quota test 41: df should return projid-specific values ========================================================== 08:14:52 (1749125692)
[ 4211.814905] LustreError: 18571:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 4211.819899] LustreError: 18571:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 3 previous similar messages
[ 4235.794449] Lustre: DEBUG MARKER: == sanity-quota test 42: lfs quota should include default quota info ========================================================== 08:15:24 (1749125724)
[ 4258.291808] Lustre: DEBUG MARKER: == sanity-quota test 48: lfs quota --delete should delete quota project ID ========================================================== 08:15:46 (1749125746)
[ 4310.711693] Lustre: DEBUG MARKER: == sanity-quota test 49: lfs quota -a prints the quota usage for all quota IDs ========================================================== 08:16:39 (1749125799)
[ 4316.843504] Lustre: *** cfs_fail_loc=a09, val=0***
[ 4316.844601] Lustre: Skipped 1 previous similar message
[ 4318.844568] Lustre: *** cfs_fail_loc=a09, val=0***
[ 4318.846455] Lustre: Skipped 645 previous similar messages
[ 4322.847287] Lustre: *** cfs_fail_loc=a09, val=0***
[ 4322.848741] Lustre: Skipped 1267 previous similar messages
[ 4330.848467] Lustre: *** cfs_fail_loc=a09, val=0***
[ 4330.849583] Lustre: Skipped 2663 previous similar messages
[ 4444.220620] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 4444.220835] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 4444.220846] Lustre: Skipped 1 previous similar message
[ 4444.226688] Lustre: Skipped 3 previous similar messages
[ 4448.300802] Lustre: 32367:0:(qsd_writeback.c:672:qsd_cleanup_deferred()) lustre-MDT0000: Free global deferred upd: ID:3, ver:2049/2047
[ 4448.310749] LustreError: 32367:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup
[ 4448.312773] LustreError: 32367:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages
[ 4448.369779] Lustre: server umount lustre-MDT0000 complete
[ 4449.552746] LustreError: 11161:0:(ldlm_lockd.c:2550:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1749125939 with bad export cookie 16682940149813584860
[ 4449.556765] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 4449.662464] Lustre: server umount lustre-OST0000 complete
[ 4450.869215] Lustre: server umount lustre-OST0001 complete
[ 4452.356976] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_hostid
[ 4453.773949] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local
[ 4455.760283]  vdc: vdc1 vdc9
[ 4458.006107]  vde: vde1 vde9
[ 4460.385937]  vdf: vdf1 vdf9
[ 4464.461538] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local
[ 4466.179261] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000
[ 4466.228076] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space.
[ 4466.261064] Lustre: lustre-MDT0000: new disk, initializing
[ 4466.322564] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 4466.324336] Lustre: Skipped 2 previous similar messages
[ 4466.335990] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt
[ 4467.108397] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4469.073919] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params
[ 4470.389375] Lustre: 6193:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.202.149@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 4470.392126] Lustre: 6193:0:(mgc_request_server.c:550:mgc_llog_local_copy()) Skipped 1 previous similar message
[ 4470.399054] Lustre: lustre-OST0000: new disk, initializing
[ 4470.400872] Lustre: srv-lustre-OST0000: No data found on store. Initialize space.
[ 4470.402758] Lustre: Skipped 1 previous similar message
[ 4470.560112] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost
[ 4470.564345] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost]
[ 4470.582732] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400
[ 4471.655045] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4474.685531] Lustre: lustre-OST0001: new disk, initializing
[ 4474.687344] Lustre: srv-lustre-OST0001: No data found on store. Initialize space.
[ 4475.988396] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4476.584476] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost
[ 4476.586840] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost]
[ 4476.607900] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400
[ 4479.755217] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 4480.644650] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params
[ 4501.910794] Lustre: DEBUG MARKER: == sanity-quota test 50: Test if lfs find --projid works ========================================================== 08:19:50 (1749125990)
[ 4529.763067] Lustre: DEBUG MARKER: == sanity-quota test 51: Test project accounting with mv/cp ========================================================== 08:20:18 (1749126018)
[ 4559.627604] Lustre: DEBUG MARKER: == sanity-quota test 52: Rename normal file across project ID ========================================================== 08:20:48 (1749126048)
[ 4569.417946] Lustre: DEBUG MARKER: rename directory return 255
[ 4589.646912] Lustre: DEBUG MARKER: == sanity-quota test 53: Project inherit attribute could be cleared ========================================================== 08:21:18 (1749126078)
[ 4604.208946] Lustre: DEBUG MARKER: == sanity-quota test 54: basic lfs project interface test ========================================================== 08:21:32 (1749126092)
[ 4621.624508] Lustre: DEBUG MARKER: == sanity-quota test 55: Chgrp should be affected by group quota ========================================================== 08:21:50 (1749126110)
[ 4649.600050] LustreError: 4948:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:dt-0x0 id:60001 enforced:1 hard:51200 soft:0 granted:51200 time:0 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 4669.805794] Lustre: DEBUG MARKER: == sanity-quota test 56: lfs quota -t should work well === 08:22:38 (1749126158)
[ 4686.168314] Lustre: DEBUG MARKER: == sanity-quota test 57: lfs project could tolerate errors ========================================================== 08:22:54 (1749126174)
[ 4715.956120] Lustre: DEBUG MARKER: == sanity-quota test 58: project ID should be kept for new mirrors created by FID ========================================================== 08:23:24 (1749126204)
[ 4786.167301] Lustre: DEBUG MARKER: == sanity-quota test 59: lfs project dosen't crash kernel with project disabled ========================================================== 08:24:34 (1749126274)
[ 4786.529673] Lustre: DEBUG MARKER: SKIP: sanity-quota test_59 ldiskfs only test
[ 4786.902052] Lustre: DEBUG MARKER: == sanity-quota test 60: Test quota for root with setgid ========================================================== 08:24:35 (1749126275)
[ 4795.326625] LustreError: 1821:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 4795.333955] LustreError: 1821:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 4 previous similar messages
[ 4820.653025] Lustre: DEBUG MARKER: SKIP: sanity-quota test_61 skipping SLOW test 61
[ 4821.026915] Lustre: DEBUG MARKER: == sanity-quota test 62: Project inherit should be only changed by root ========================================================== 08:25:09 (1749126309)
[ 4835.594268] Lustre: DEBUG MARKER: SKIP: sanity-quota test_63 skipping excluded test 63
[ 4835.948480] Lustre: DEBUG MARKER: == sanity-quota test 64: lfs project on non dir/files should succeed ========================================================== 08:25:24 (1749126324)
[ 4863.948411] Lustre: DEBUG MARKER: SKIP: sanity-quota test_65 skipping excluded test 65
[ 4864.367765] Lustre: DEBUG MARKER: == sanity-quota test 66: nonroot user can not change project state in default ========================================================== 08:25:52 (1749126352)
[ 4889.944555] Lustre: DEBUG MARKER: == sanity-quota test 67: quota pools recalculation ======= 08:26:18 (1749126378)
[ 4890.277814] Lustre: DEBUG MARKER: SKIP: sanity-quota test_67 ZFS grants some block space together with inode
[ 4890.676418] Lustre: DEBUG MARKER: == sanity-quota test 68: slave number in quota pool changed after each add/remove OST ========================================================== 08:26:19 (1749126379)
[ 4904.226005] LustreError: 8837:0:(mgs_handler.c:848:mgs_iocontrol_pool()) OBD_IOC_POOL err -17, cmd CE021 for pool lustre.qpool1
[ 4922.966371] Lustre: DEBUG MARKER: == sanity-quota test 69: EDQUOT at one of pools shouldn't affect DOM ========================================================== 08:26:51 (1749126411)
[ 4930.534452] LustreError: 11130:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:2 until pending updates are flushed.
[ 4930.539157] LustreError: 11130:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 5 previous similar messages
[ 4935.849481] Lustre: DEBUG MARKER: User quota (block hardlimit:200 MB)
[ 4936.300138] Lustre: DEBUG MARKER: User quota (block hardlimit:10 MB)
[ 4980.966471] Lustre: DEBUG MARKER: == sanity-quota test 70a: check lfs setquota/quota with a pool option ========================================================== 08:27:49 (1749126469)
[ 5005.026826] Lustre: DEBUG MARKER: == sanity-quota test 70b: lfs setquota pool works properly ========================================================== 08:28:13 (1749126493)
[ 5018.952415] Lustre: DEBUG MARKER: == sanity-quota test 71a: Check PFL with quota pools ===== 08:28:27 (1749126507)
[ 5019.338368] Lustre: DEBUG MARKER: SKIP: sanity-quota test_71a ZFS grants some block space together with inode
[ 5019.841280] Lustre: DEBUG MARKER: == sanity-quota test 71b: Check SEL with quota pools ===== 08:28:28 (1749126508)
[ 5020.240809] Lustre: DEBUG MARKER: SKIP: sanity-quota test_71b ZFS grants some block space together with inode
[ 5020.870680] Lustre: DEBUG MARKER: == sanity-quota test 72: lfs quota --pool prints only pool's OSTs ========================================================== 08:28:29 (1749126509)
[ 5028.558347] Lustre: DEBUG MARKER: User quota (block hardlimit:50 MB)
[ 5034.996495] Lustre: DEBUG MARKER: Write...
[ 5035.606609] Lustre: DEBUG MARKER: Write out of block quota ...
[ 5065.120901] Lustre: DEBUG MARKER: == sanity-quota test 73a: default limits at OST Pool Quotas ========================================================== 08:29:13 (1749126553)
[ 5078.735542] Lustre: DEBUG MARKER: set to use default quota
[ 5079.133816] Lustre: DEBUG MARKER: set default quota
[ 5079.502279] Lustre: DEBUG MARKER: get default quota
[ 5080.510018] Lustre: DEBUG MARKER: Test not out of quota
[ 5081.431280] Lustre: DEBUG MARKER: Test out of quota
[ 5084.224940] Lustre: DEBUG MARKER: Increase default quota
[ 5092.726970] Lustre: DEBUG MARKER: Set quota to override default quota
[ 5092.740958] LustreError: 4946:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:dt-qpool1 id:60000 enforced:1 hard:20480 soft:20480 granted:45063 time:1749731382 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 5095.268295] Lustre: DEBUG MARKER: Set to use default quota again
[ 5103.640092] Lustre: DEBUG MARKER: Cleanup
[ 5145.762088] Lustre: DEBUG MARKER: == sanity-quota test 73b: default OST Pool Quotas limit for new user ========================================================== 08:30:34 (1749126634)
[ 5158.481703] Lustre: DEBUG MARKER: set default quota for qpool1
[ 5159.073708] Lustre: DEBUG MARKER: Write from user that hasn't lqe
[ 5185.130358] Lustre: DEBUG MARKER: == sanity-quota test 74: check quota pools per user ====== 08:31:13 (1749126673)
[ 5228.228740] Lustre: DEBUG MARKER: == sanity-quota test 75: nodemap squashed root respects quota enforcement ========================================================== 08:31:56 (1749126716)
[ 5305.228622] Lustre: DEBUG MARKER: Write...
[ 5306.034594] Lustre: DEBUG MARKER: Write out of block quota ...
[ 5397.174545] Lustre: DEBUG MARKER: == sanity-quota test 76: project ID 4294967295 should be not allowed ========================================================== 08:34:45 (1749126885)
[ 5425.765399] Lustre: DEBUG MARKER: == sanity-quota test 77: lfs setquota should fail in Lustre mount with 'ro' ========================================================== 08:35:14 (1749126914)
[ 5428.110028] Lustre: DEBUG MARKER: == sanity-quota test 78A: Check fallocate increase quota usage ========================================================== 08:35:16 (1749126916)
[ 5428.612253] Lustre: DEBUG MARKER: SKIP: sanity-quota test_78A need >= 2.13.57 and ldiskfs for fallocate
[ 5429.246024] Lustre: DEBUG MARKER: == sanity-quota test 78a: Check fallocate increase projectid usage ========================================================== 08:35:17 (1749126917)
[ 5429.819524] Lustre: DEBUG MARKER: SKIP: sanity-quota test_78a need >= 2.13.57 and ldiskfs for fallocate
[ 5430.429593] Lustre: DEBUG MARKER: == sanity-quota test 79: access to non-existed dt-pool/info doesn't cause a panic ========================================================== 08:35:18 (1749126918)
[ 5439.446336] Lustre: DEBUG MARKER: == sanity-quota test 80: check for EDQUOT after OST failover ========================================================== 08:35:27 (1749126927)
[ 5439.812621] Lustre: DEBUG MARKER: SKIP: sanity-quota test_80 ZFS grants some block space together with inode
[ 5440.244521] Lustre: DEBUG MARKER: == sanity-quota test 81: Race qmt_start_pool_recalc with qmt_pool_free ========================================================== 08:35:28 (1749126928)
[ 5448.683056] Lustre: DEBUG MARKER: User quota (block hardlimit:20 MB)
[ 5451.581582] LustreError: 14465:0:(qmt_pool.c:1295:qmt_pool_recalc()) cfs_fail_timeout id a07 sleeping for 10000ms
[ 5454.956029] Lustre: lustre-MDT0000: Not available for connect from 192.168.202.49@tcp (stopping)
[ 5454.957961] Lustre: Skipped 1 previous similar message
[ 5458.140662] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 5458.141170] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 5458.145391] Lustre: Skipped 1 previous similar message
[ 5461.636247] LustreError: 14465:0:(qmt_pool.c:1295:qmt_pool_recalc()) cfs_fail_timeout id a07 awake
[ 5461.712890] LustreError: 14596:0:(obd_class.h:479:obd_check_dev()) Device 17 not setup
[ 5461.717266] LustreError: 14596:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages
[ 5461.785027] Lustre: server umount lustre-MDT0000 complete
[ 5464.282773] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 5464.447760] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 5464.450823] Lustre: Skipped 2 previous similar messages
[ 5464.483430] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:27 to 0x240000400:65)
[ 5464.483549] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:27 to 0x280000400:65)
[ 5465.618143] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5477.449036] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 192.168.202.149@tcp (at 0@lo)
[ 5477.455248] Lustre: Skipped 3 previous similar messages
[ 5483.295483] Lustre: DEBUG MARKER: == sanity-quota test 82: verify more than 8 qids for single operation ========================================================== 08:36:11 (1749126971)
[ 5500.378722] Lustre: DEBUG MARKER: == sanity-quota test 83: Setting default quota shouldn't affect grace time ========================================================== 08:36:28 (1749126988)
[ 5516.842650] Lustre: DEBUG MARKER: == sanity-quota test 84: Reset quota should fix the insane granted quota ========================================================== 08:36:45 (1749127005)
[ 5532.505931] LustreError: 6363:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-OST0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 5532.513689] LustreError: 6363:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 2 previous similar messages
[ 5543.608880] Lustre: *** cfs_fail_loc=a08, val=0***
[ 5543.611448] Lustre: Skipped 3421 previous similar messages
[ 5543.614834] Lustre: *** cfs_fail_loc=a08, val=0***
[ 5601.674685] Lustre: DEBUG MARKER: == sanity-quota test 85: do not hung at write with the least_qunit ========================================================== 08:38:10 (1749127090)
[ 5616.758707] LustreError: 15964:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:dt-qpool1 id:60000 enforced:1 hard:3072 soft:0 granted:3072 time:0 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 5646.456099] Lustre: DEBUG MARKER: == sanity-quota test 86: Pre-acquired quota should be released if quota is over limit ========================================================== 08:38:54 (1749127134)
[ 5731.465424] LustreError: 16505:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:60000 enforced:1 hard:2048 soft:2048 granted:65536 time:1749732021 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 5843.092948] LustreError: 15297:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:60000 enforced:1 hard:2048 soft:2048 granted:65536 time:1749732132 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 5955.810806] LustreError: 16611:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:1000 enforced:1 hard:2048 soft:2048 granted:65536 time:1749732245 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 6000.441305] Lustre: DEBUG MARKER: == sanity-quota test 87: lfs quota -a should print default quota setting ========================================================== 08:44:48 (1749127488)
[ 6007.294518] Lustre: *** cfs_fail_loc=a09, val=0***
[ 6011.295783] Lustre: *** cfs_fail_loc=a09, val=0***
[ 6011.298429] Lustre: Skipped 773 previous similar messages
[ 6033.341342] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 6033.345702] Lustre: Skipped 3 previous similar messages
[ 6037.125056] Lustre: server umount lustre-MDT0000 complete
[ 6039.984488] LustreError: MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 6040.190977] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 6040.233775] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:68 to 0x240000400:97)
[ 6040.233787] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:27 to 0x280000400:97)
[ 6041.411963] Lustre: DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6052.700045] Lustre: DEBUG MARKER: == sanity-quota test 88: Writing over quota should not hang ========================================================== 08:45:41 (1749127541)
[ 6053.183662] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to  (at 0@lo)
[ 6053.187635] Lustre: Skipped 1 previous similar message
[ 6053.237590] Lustre: DEBUG MARKER: SKIP: sanity-quota test_88 require client with >4k pages
[ 6053.863770] Lustre: DEBUG MARKER: == sanity-quota test 89: Show default quota with squash_uid ========================================================== 08:45:42 (1749127542)
[ 6091.047362] Lustre: DEBUG MARKER: == sanity-quota test 90a: lfs quota should work without mount point ========================================================== 08:46:19 (1749127579)
[ 6097.847334] Lustre: DEBUG MARKER: sanity-quota test_90a: @@@@@@ FAIL: quota info not Disk quotas for usr root (uid 0):