[ 3151.522526] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 3153.168702] Lustre: DEBUG MARKER: Write 100M (buffered) ...
[ 3154.282120] LustreError: 9786:0:(osd_handler.c:698:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 3154.609772] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 3155.083058] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 3155.786328] Lustre: Failing over lustre-MDT0000
[ 3155.921679] LustreError: 10186:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 3155.925873] LustreError: 10186:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message
[ 3156.011130] Lustre: server umount lustre-MDT0000 complete
[ 3168.219604] LustreError: MGC192.168.203.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3168.325520] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 3168.390646] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3168.414968] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 3169.251099] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3171.075795] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 3171.114673] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 3171.130883] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:703 to 0x240000400:737)
[ 3171.130885] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:701 to 0x280000400:737)
[ 3172.089150] Lustre: DEBUG MARKER: oleg305-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 3172.327304] Lustre: 3310:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1746146468/real 1746146468]  req@ffff880094f39500 x1830964023598080/t0(0) o601->lustre-MDT0000-lwp-OST0000@0@lo:23/10 lens 336/336 e 0 to 1 dl 1746146484 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'lquota_wb_lustr.0' uid:0 gid:0
[ 3172.340693] Lustre: 3310:0:(client.c:2346:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 3172.638824] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 3173.365265] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to  (at 0@lo)
[ 3174.370174] LustreError: 19742:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-OST0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 3174.377840] LustreError: 19742:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 6 previous similar messages
[ 3175.336926] Lustre: 3312:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1746146471/real 1746146471]  req@ffff880132da7b80 x1830964023598464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1746146487 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0
[ 3180.223166] Lustre: DEBUG MARKER: (dd_pid=2302, time=5, timeout=600)
[ 3180.373115] Lustre: 3311:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1746146476/real 1746146476]  req@ffff880132da5180 x1830964023598848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1746146492 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0
[ 3180.382140] Lustre: 3311:0:(client.c:2346:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 3211.066949] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 3213.060554] Lustre: DEBUG MARKER: Write 100M (directio) ...
[ 3214.302564] LustreError: 14442:0:(osd_handler.c:698:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 3214.638846] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 3215.196850] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 3216.030689] Lustre: Failing over lustre-MDT0000
[ 3216.196171] LustreError: 15364:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 3216.198269] LustreError: 15364:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages
[ 3216.292417] Lustre: server umount lustre-MDT0000 complete
[ 3229.243292] LustreError: MGC192.168.203.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3229.495601] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3229.527799] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 3230.826189] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3231.819438] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 3231.864374] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 3231.882313] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:701 to 0x280000400:769)
[ 3231.882378] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:739 to 0x240000400:769)
[ 3232.422498] Lustre: 3312:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1746146529/real 1746146529]  req@ffff880092d0dc00 x1830964023625728/t0(0) o601->lustre-MDT0000-lwp-OST0000@0@lo:23/10 lens 336/336 e 0 to 1 dl 1746146545 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'lquota_wb_lustr.0' uid:0 gid:0
[ 3232.435330] Lustre: 3312:0:(client.c:2346:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 3233.930728] Lustre: DEBUG MARKER: oleg305-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 3234.432256] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 3239.469459] Lustre: 3311:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1746146536/real 1746146536]  req@ffff880091e4f100 x1830964023626368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1746146552 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0
[ 3239.479640] Lustre: 3311:0:(client.c:2346:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[ 3244.884324] Lustre: DEBUG MARKER: (dd_pid=4747, time=8, timeout=600)
[ 3279.580370] Lustre: DEBUG MARKER: == sanity-quota test 19: Updating admin limits doesn't zero operational limits(b14790) ========================================================== 20:43:12 (1746146592)
[ 3287.630837] LustreError: 20267:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:1 until pending updates are flushed.
[ 3287.636891] LustreError: 20267:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 1 previous similar message
[ 3289.657606] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 3290.149548] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 3291.481672] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 3291.938776] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 3313.226944] Lustre: DEBUG MARKER: == sanity-quota test 20: Test if setquota specifiers work properly (b15754) ========================================================== 20:43:45 (1746146625)
[ 3320.499551] Lustre: DEBUG MARKER: == sanity-quota test 21: Setquota while writing
[ 3329.137850] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for user: quota_usr
[ 3329.758535] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for group: quota_usr
[ 3330.421983] Lustre: DEBUG MARKER: Set limit(block:10G; file:) for project: 1000
[ 3331.182264] Lustre: DEBUG MARKER: Set quota for 1 times
[ 3332.956609] Lustre: DEBUG MARKER: Set quota for 2 times
[ 3334.618319] Lustre: DEBUG MARKER: Set quota for 3 times
[ 3336.297082] Lustre: DEBUG MARKER: Set quota for 4 times
[ 3337.934759] Lustre: DEBUG MARKER: Set quota for 5 times
[ 3339.575685] Lustre: DEBUG MARKER: Set quota for 6 times
[ 3341.271076] Lustre: DEBUG MARKER: Set quota for 7 times
[ 3343.080057] Lustre: DEBUG MARKER: Set quota for 8 times
[ 3344.777511] Lustre: DEBUG MARKER: Set quota for 9 times
[ 3346.724010] Lustre: DEBUG MARKER: Set quota for 10 times
[ 3348.908672] Lustre: DEBUG MARKER: Set quota for 11 times
[ 3350.690442] Lustre: DEBUG MARKER: Set quota for 12 times
[ 3352.316157] Lustre: DEBUG MARKER: Set quota for 13 times
[ 3353.997086] Lustre: DEBUG MARKER: Set quota for 14 times
[ 3355.683831] Lustre: DEBUG MARKER: Set quota for 15 times
[ 3357.457275] Lustre: DEBUG MARKER: Set quota for 16 times
[ 3359.178374] Lustre: DEBUG MARKER: Set quota for 17 times
[ 3388.418783] Lustre: DEBUG MARKER: == sanity-quota test 22: enable/disable quota by 'lctl conf_param/set_param -P' ========================================================== 20:45:00 (1746146700)
[ 3394.724773] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 3394.726531] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 3394.733994] Lustre: Skipped 4 previous similar messages
[ 3398.644834] LustreError: 29282:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 3398.647786] LustreError: 29282:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages
[ 3398.705977] Lustre: server umount lustre-MDT0000 complete
[ 3400.015756] LustreError: 7124:0:(ldlm_lockd.c:2549:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1746146712 with bad export cookie 4302482246226391236
[ 3400.018126] LustreError: MGC192.168.203.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3400.027635] LustreError: 7124:0:(ldlm_lockd.c:2549:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 3400.050083] Lustre: server umount lustre-OST0000 complete
[ 3401.253832] Lustre: server umount lustre-OST0001 complete
[ 3404.732801] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing load_modules_local
[ 3407.316432] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3408.286518] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3409.265810] Lustre: Modifying parameter general.debug_raw_pointers in log params
[ 3410.756051] Lustre: 32247:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.203.105@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 3410.866958] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 3412.328870] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3415.935407] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3416.418187] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:772 to 0x240000400:801)
[ 3416.418216] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:771 to 0x280000400:801)
[ 3418.696626] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 3419.648095] Lustre: Modifying parameter general.lod.*.mdt_hash in log params
[ 3431.444007] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 3431.446685] Lustre: Skipped 2 previous similar messages
[ 3433.479288] Lustre: server umount lustre-MDT0000 complete
[ 3434.671775] LustreError: 2559:0:(ldlm_lockd.c:2549:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1746146747 with bad export cookie 4302482246226407406
[ 3434.671899] LustreError: MGC192.168.203.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3434.681900] LustreError: 2559:0:(ldlm_lockd.c:2549:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 3436.689686] Lustre: server umount lustre-OST0000 complete
[ 3437.852313] Lustre: server umount lustre-OST0001 complete
[ 3441.368446] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing load_modules_local
[ 3444.214663] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3444.217685] Lustre: Skipped 1 previous similar message
[ 3445.552902] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3446.776378] Lustre: Modifying parameter general.debug_raw_pointers in log params
[ 3448.615638] Lustre: 6031:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.203.105@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 3448.620580] Lustre: 6031:0:(mgc_request_server.c:550:mgc_llog_local_copy()) Skipped 1 previous similar message
[ 3448.821174] mount.lustre (6031) used greatest stack depth: 9488 bytes left
[ 3450.514888] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3452.953155] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 3452.956048] Lustre: Skipped 1 previous similar message
[ 3453.945327] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:772 to 0x240000400:833)
[ 3453.958296] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:771 to 0x280000400:833)
[ 3454.637475] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3457.661409] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 3458.914969] Lustre: Modifying parameter general.lod.*.mdt_hash in log params
[ 3466.679797] Lustre: DEBUG MARKER: == sanity-quota test 23: Quota should be honored with directIO (b16125) ========================================================== 20:46:19 (1746146779)
[ 3467.090072] Lustre: DEBUG MARKER: SKIP: sanity-quota test_23 Overwrite in place is not guaranteed to be space neutral on ZFS
[ 3467.569922] Lustre: DEBUG MARKER: == sanity-quota test 24: lfs draws an asterix when limit is reached (b16646) ========================================================== 20:46:19 (1746146779)
[ 3498.009681] Lustre: DEBUG MARKER: == sanity-quota test 25: check indexes versions ========== 20:46:50 (1746146810)
[ 3521.084648] Lustre: DEBUG MARKER: Write...
[ 3522.303098] Lustre: DEBUG MARKER: Write out of block quota ...
[ 3557.999413] Lustre: DEBUG MARKER: == sanity-quota test 27a: lfs quota/setquota should handle wrong arguments (b19612) ========================================================== 20:47:50 (1746146870)
[ 3559.947047] Lustre: DEBUG MARKER: == sanity-quota test 27b: lfs quota/setquota should handle user/group/project ID (b20200) ========================================================== 20:47:52 (1746146872)
[ 3564.431117] Lustre: DEBUG MARKER: == sanity-quota test 27c: lfs quota should support human-readable output ========================================================== 20:47:56 (1746146876)
[ 3568.161895] Lustre: DEBUG MARKER: == sanity-quota test 27d: lfs setquota should support fraction block limit ========================================================== 20:48:00 (1746146880)
[ 3572.000259] Lustre: DEBUG MARKER: == sanity-quota test 30: Hard limit updates should not reset grace times ========================================================== 20:48:04 (1746146884)
[ 3612.756805] Lustre: DEBUG MARKER: == sanity-quota test 33: Basic usage tracking for user
[ 3682.906618] Lustre: DEBUG MARKER: == sanity-quota test 34: Usage transfer for user
[ 3799.215837] Lustre: DEBUG MARKER: == sanity-quota test 35: Usage is still accessible across reboot ========================================================== 20:51:51 (1746147111)
[ 3833.906087] Lustre: DEBUG MARKER: Restart...
[ 3839.604541] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 3839.605094] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 3839.627954] Lustre: Skipped 3 previous similar messages
[ 3841.394829] LustreError: 32168:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup
[ 3841.398577] LustreError: 32168:0:(obd_class.h:479:obd_check_dev()) Skipped 23 previous similar messages
[ 3841.484741] Lustre: server umount lustre-MDT0000 complete
[ 3843.954176] LustreError: 18700:0:(ldlm_lockd.c:2549:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1746147156 with bad export cookie 4302482246226408939
[ 3843.957600] LustreError: MGC192.168.203.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3843.974522] LustreError: 18700:0:(ldlm_lockd.c:2549:ldlm_cancel_handler()) Skipped 1 previous similar message
[ 3844.009896] Lustre: server umount lustre-OST0000 complete
[ 3846.038045] Lustre: server umount lustre-OST0001 complete
[ 3852.242284] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing load_modules_local
[ 3856.188666] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3857.891210] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3859.363208] Lustre: Modifying parameter general.debug_raw_pointers in log params
[ 3862.127069] Lustre: 2704:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.203.105@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 3862.130885] Lustre: 2704:0:(mgc_request_server.c:550:mgc_llog_local_copy()) Skipped 1 previous similar message
[ 3864.825418] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3866.324996] LustreError: 2708:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 3866.339613] LustreError: 2708:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 1 previous similar message
[ 3866.345685] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:843 to 0x240000400:865)
[ 3869.711337] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:841 to 0x280000400:865)
[ 3870.658637] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3874.534336] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 3876.341552] Lustre: Modifying parameter general.lod.*.mdt_hash in log params
[ 3910.932467] Lustre: DEBUG MARKER: == sanity-quota test 37: Quota accounted properly for file created by 'lfs setstripe' ========================================================== 20:53:42 (1746147222)
[ 3961.492147] Lustre: DEBUG MARKER: == sanity-quota test 38: Quota accounting iterator doesn't skip id entries ========================================================== 20:54:33 (1746147273)
[ 4664.057575] Lustre: DEBUG MARKER: == sanity-quota test 39: Project ID interface works correctly ========================================================== 21:06:16 (1746147976)
[ 4672.682262] LustreError: 22622:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup
[ 4672.684276] LustreError: 22622:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages
[ 4672.799542] Lustre: server umount lustre-MDT0000 complete
[ 4674.533487] LustreError: 1681:0:(ldlm_lockd.c:2549:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1746147987 with bad export cookie 4302482246226415211
[ 4674.538698] LustreError: MGC192.168.203.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 4684.589622] Lustre: server umount lustre-OST0000 complete
[ 4696.641452] LustreError: 23297:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup
[ 4696.644371] LustreError: 23297:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages
[ 4696.726293] Lustre: server umount lustre-OST0001 complete
[ 4703.643824] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing load_modules_local
[ 4707.140797] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 4707.143089] Lustre: Skipped 2 previous similar messages
[ 4708.850082] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4710.314912] Lustre: Modifying parameter general.debug_raw_pointers in log params
[ 4713.187335] Lustre: 25573:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.203.105@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 4713.192237] Lustre: 25573:0:(mgc_request_server.c:550:mgc_llog_local_copy()) Skipped 1 previous similar message
[ 4713.401739] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 4715.753030] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4717.376375] LustreError: 25577:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4717.393373] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:5867 to 0x240000400:5889)
[ 4718.845597] Lustre: 26625:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.203.105@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 4720.819268] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:5867 to 0x280000400:5889)
[ 4721.192956] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4725.194511] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 4727.030944] Lustre: Modifying parameter general.lod.*.mdt_hash in log params
[ 4754.455261] Lustre: DEBUG MARKER: == sanity-quota test 40a: Hard link across different project ID ========================================================== 21:07:46 (1746148066)
[ 4782.922394] Lustre: DEBUG MARKER: == sanity-quota test 40b: Mv across different project ID ========================================================== 21:08:14 (1746148094)
[ 4810.420505] Lustre: DEBUG MARKER: == sanity-quota test 40c: Remote child Dir inherit project quota properly ========================================================== 21:08:42 (1746148122)
[ 4811.183230] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40c needs >= 2 MDTs
[ 4812.072031] Lustre: DEBUG MARKER: == sanity-quota test 40d: Stripe Directory inherit project quota properly ========================================================== 21:08:44 (1746148124)
[ 4812.942246] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40d needs >= 2 MDTs
[ 4814.023050] Lustre: DEBUG MARKER: == sanity-quota test 41: df should return projid-specific values ========================================================== 21:08:45 (1746148125)
[ 4823.524986] LustreError: 31612:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 4823.529147] LustreError: 31612:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 3 previous similar messages
[ 4855.056526] Lustre: DEBUG MARKER: == sanity-quota test 42: lfs quota should include default quota info ========================================================== 21:09:27 (1746148167)
[ 4884.334550] Lustre: DEBUG MARKER: == sanity-quota test 48: lfs quota --delete should delete quota project ID ========================================================== 21:09:56 (1746148196)
[ 4955.326154] Lustre: DEBUG MARKER: == sanity-quota test 49: lfs quota -a prints the quota usage for all quota IDs ========================================================== 21:11:07 (1746148267)
[ 4962.729007] Lustre: *** cfs_fail_loc=a09, val=0***
[ 4962.731268] Lustre: Skipped 1 previous similar message
[ 4964.752765] Lustre: *** cfs_fail_loc=a09, val=0***
[ 4964.756175] Lustre: Skipped 167 previous similar messages
[ 4968.780643] Lustre: *** cfs_fail_loc=a09, val=0***
[ 4968.783713] Lustre: Skipped 311 previous similar messages
[ 4976.790774] Lustre: *** cfs_fail_loc=a09, val=0***
[ 4976.792839] Lustre: Skipped 783 previous similar messages
[ 4992.808717] Lustre: *** cfs_fail_loc=a09, val=0***
[ 4992.820596] Lustre: Skipped 1299 previous similar messages
[ 5024.815989] Lustre: *** cfs_fail_loc=a09, val=0***
[ 5024.817954] Lustre: Skipped 2941 previous similar messages
[ 5370.054827] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 5370.055909] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 5370.055910] Lustre: Skipped 1 previous similar message
[ 5370.070432] Lustre: Skipped 1 previous similar message
[ 5375.064326] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 5375.069095] Lustre: Skipped 2 previous similar messages
[ 5376.010526] LustreError: 18882:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup
[ 5376.013777] LustreError: 18882:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages
[ 5376.150707] Lustre: server umount lustre-MDT0000 complete
[ 5378.782533] LustreError: 24565:0:(ldlm_lockd.c:2549:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1746148691 with bad export cookie 4302482246228168424
[ 5378.792746] LustreError: MGC192.168.203.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 5379.022796] Lustre: server umount lustre-OST0000 complete
[ 5381.564999] LustreError: 19563:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup
[ 5381.571726] LustreError: 19563:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages
[ 5381.709036] Lustre: server umount lustre-OST0001 complete
[ 5385.640655] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_hostid
[ 5390.373081] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing load_modules_local
[ 5396.214489]  vdc: vdc1 vdc9
[ 5402.263791]  vde: vde1 vde9
[ 5408.321158]  vdf: vdf1 vdf9
[ 5417.985982] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing load_modules_local
[ 5422.757968] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall in log lustre-MDT0000
[ 5422.934153] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space.
[ 5422.983523] Lustre: lustre-MDT0000: new disk, initializing
[ 5423.253755] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 5423.256745] Lustre: Skipped 1 previous similar message
[ 5423.305969] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt
[ 5425.237230] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5428.463643] Lustre: Modifying parameter general.debug_raw_pointers in log params
[ 5431.941259] Lustre: 25044:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.203.105@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 5431.965824] Lustre: lustre-OST0000: new disk, initializing
[ 5431.969203] Lustre: srv-lustre-OST0000: No data found on store. Initialize space.
[ 5431.974493] Lustre: Skipped 1 previous similar message
[ 5432.055270] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 5434.073095] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost
[ 5434.081510] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost]
[ 5434.185150] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400
[ 5435.395514] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5441.546800] Lustre: 26380:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.203.105@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 5441.563813] Lustre: lustre-OST0001: new disk, initializing
[ 5441.567832] Lustre: srv-lustre-OST0001: No data found on store. Initialize space.
[ 5441.617999] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 5443.269565] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost
[ 5443.272728] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost]
[ 5443.364542] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400
[ 5444.518431] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5450.913576] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 5453.022789] Lustre: Setting parameter general.lod.*.mdt_hash in log params
[ 5481.582691] Lustre: DEBUG MARKER: == sanity-quota test 50: Test if lfs find --projid works ========================================================== 21:19:53 (1746148793)
[ 5513.368860] Lustre: DEBUG MARKER: == sanity-quota test 51: Test project accounting with mv/cp ========================================================== 21:20:25 (1746148825)
[ 5547.621929] Lustre: DEBUG MARKER: == sanity-quota test 52: Rename normal file across project ID ========================================================== 21:20:59 (1746148859)
[ 5563.186784] Lustre: DEBUG MARKER: rename directory return 255
[ 5587.774181] Lustre: DEBUG MARKER: == sanity-quota test 53: Project inherit attribute could be cleared ========================================================== 21:21:39 (1746148899)
[ 5607.977327] Lustre: DEBUG MARKER: == sanity-quota test 54: basic lfs project interface test ========================================================== 21:22:00 (1746148920)
[ 5637.794191] Lustre: DEBUG MARKER: == sanity-quota test 55: Chgrp should be affected by group quota ========================================================== 21:22:29 (1746148949)
[ 5677.072695] LustreError: 3600:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:dt-0x0 id:60001 enforced:1 hard:51200 soft:0 granted:51200 time:0 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 5698.498076] Lustre: DEBUG MARKER: == sanity-quota test 56: lfs quota -t should work well === 21:23:30 (1746149010)
[ 5721.635050] Lustre: DEBUG MARKER: == sanity-quota test 57: lfs project could tolerate errors ========================================================== 21:23:53 (1746149033)
[ 5754.007927] Lustre: DEBUG MARKER: == sanity-quota test 58: project ID should be kept for new mirrors created by FID ========================================================== 21:24:25 (1746149065)
[ 5860.488970] Lustre: DEBUG MARKER: == sanity-quota test 59: lfs project dosen't crash kernel with project disabled ========================================================== 21:26:12 (1746149172)
[ 5861.338821] Lustre: DEBUG MARKER: SKIP: sanity-quota test_59 ldiskfs only test
[ 5862.293006] Lustre: DEBUG MARKER: == sanity-quota test 60: Test quota for root with setgid ========================================================== 21:26:14 (1746149174)
[ 5871.163588] LustreError: 20309:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 5871.168130] LustreError: 20309:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 4 previous similar messages
[ 5904.112448] Lustre: DEBUG MARKER: SKIP: sanity-quota test_61 skipping SLOW test 61
[ 5905.011137] Lustre: DEBUG MARKER: == sanity-quota test 62: Project inherit should be only changed by root ========================================================== 21:26:57 (1746149217)
[ 5925.859332] Lustre: DEBUG MARKER: SKIP: sanity-quota test_63 skipping excluded test 63
[ 5926.855308] Lustre: DEBUG MARKER: == sanity-quota test 64: lfs project on non dir/files should succeed ========================================================== 21:27:18 (1746149238)
[ 5959.619793] Lustre: DEBUG MARKER: SKIP: sanity-quota test_65 skipping excluded test 65
[ 5960.501862] Lustre: DEBUG MARKER: == sanity-quota test 66: nonroot user can not change project state in default ========================================================== 21:27:52 (1746149272)
[ 5993.370666] Lustre: DEBUG MARKER: == sanity-quota test 67: quota pools recalculation ======= 21:28:25 (1746149305)
[ 5994.141457] Lustre: DEBUG MARKER: SKIP: sanity-quota test_67 ZFS grants some block space together with inode
[ 5994.877693] Lustre: DEBUG MARKER: == sanity-quota test 68: slave number in quota pool changed after each add/remove OST ========================================================== 21:28:27 (1746149307)
[ 6011.924445] LustreError: 27208:0:(mgs_handler.c:848:mgs_iocontrol_pool()) OBD_IOC_POOL err -17, cmd CE021 for pool lustre.qpool1
[ 6039.186431] Lustre: DEBUG MARKER: == sanity-quota test 69: EDQUOT at one of pools shouldn't affect DOM ========================================================== 21:29:11 (1746149351)
[ 6049.022090] LustreError: 29647:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:2 until pending updates are flushed.
[ 6049.025937] LustreError: 29647:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 5 previous similar messages
[ 6055.873441] Lustre: DEBUG MARKER: User quota (block hardlimit:200 MB)
[ 6056.588622] Lustre: DEBUG MARKER: User quota (block hardlimit:10 MB)
[ 6163.776890] Lustre: DEBUG MARKER: == sanity-quota test 70a: check lfs setquota/quota with a pool option ========================================================== 21:31:15 (1746149475)
[ 6197.987923] Lustre: DEBUG MARKER: == sanity-quota test 70b: lfs setquota pool works properly ========================================================== 21:31:50 (1746149510)
[ 6215.256681] Lustre: DEBUG MARKER: == sanity-quota test 71a: Check PFL with quota pools ===== 21:32:07 (1746149527)
[ 6215.991954] Lustre: DEBUG MARKER: SKIP: sanity-quota test_71a ZFS grants some block space together with inode
[ 6216.968545] Lustre: DEBUG MARKER: == sanity-quota test 71b: Check SEL with quota pools ===== 21:32:08 (1746149528)
[ 6217.722068] Lustre: DEBUG MARKER: SKIP: sanity-quota test_71b ZFS grants some block space together with inode
[ 6218.532723] Lustre: DEBUG MARKER: == sanity-quota test 72: lfs quota --pool prints only pool's OSTs ========================================================== 21:32:10 (1746149530)
[ 6228.620064] Lustre: DEBUG MARKER: User quota (block hardlimit:50 MB)
[ 6237.216009] Lustre: DEBUG MARKER: Write...
[ 6238.323869] Lustre: DEBUG MARKER: Write out of block quota ...
[ 6274.522717] Lustre: DEBUG MARKER: == sanity-quota test 73a: default limits at OST Pool Quotas ========================================================== 21:33:06 (1746149586)
[ 6293.104962] Lustre: DEBUG MARKER: set to use default quota
[ 6294.214830] Lustre: DEBUG MARKER: set default quota
[ 6295.177106] Lustre: DEBUG MARKER: get default quota
[ 6297.852135] Lustre: DEBUG MARKER: Test not out of quota
[ 6299.877244] Lustre: DEBUG MARKER: Test out of quota
[ 6305.116727] Lustre: DEBUG MARKER: Increase default quota
[ 6318.815734] Lustre: DEBUG MARKER: Set quota to override default quota
[ 6318.850054] LustreError: 23828:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:dt-qpool1 id:60000 enforced:1 hard:20480 soft:20480 granted:45063 time:1746754431 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 6325.042578] Lustre: DEBUG MARKER: Set to use default quota again
[ 6339.080684] Lustre: DEBUG MARKER: Cleanup
[ 6389.013427] Lustre: DEBUG MARKER: == sanity-quota test 73b: default OST Pool Quotas limit for new user ========================================================== 21:35:00 (1746149700)
[ 6406.008188] Lustre: DEBUG MARKER: set default quota for qpool1
[ 6406.754029] Lustre: DEBUG MARKER: Write from user that hasn't lqe
[ 6439.879909] Lustre: DEBUG MARKER: == sanity-quota test 74: check quota pools per user ====== 21:35:52 (1746149752)
[ 6489.867299] Lustre: DEBUG MARKER: == sanity-quota test 75: nodemap squashed root respects quota enforcement ========================================================== 21:36:42 (1746149802)
[ 6577.608436] Lustre: DEBUG MARKER: Write...
[ 6578.877544] Lustre: DEBUG MARKER: Write out of block quota ...
[ 6685.520243] Lustre: DEBUG MARKER: == sanity-quota test 76: project ID 4294967295 should be not allowed ========================================================== 21:39:57 (1746149997)
[ 6715.056881] Lustre: DEBUG MARKER: == sanity-quota test 77: lfs setquota should fail in Lustre mount with 'ro' ========================================================== 21:40:27 (1746150027)
[ 6719.398734] Lustre: DEBUG MARKER: == sanity-quota test 78A: Check fallocate increase quota usage ========================================================== 21:40:31 (1746150031)
[ 6720.328418] Lustre: DEBUG MARKER: SKIP: sanity-quota test_78A need >= 2.13.57 and ldiskfs for fallocate
[ 6721.510814] Lustre: DEBUG MARKER: == sanity-quota test 78a: Check fallocate increase projectid usage ========================================================== 21:40:33 (1746150033)
[ 6722.384076] Lustre: DEBUG MARKER: SKIP: sanity-quota test_78a need >= 2.13.57 and ldiskfs for fallocate
[ 6723.482737] Lustre: DEBUG MARKER: == sanity-quota test 79: access to non-existed dt-pool/info doesn't cause a panic ========================================================== 21:40:35 (1746150035)
[ 6736.704005] Lustre: DEBUG MARKER: == sanity-quota test 80: check for EDQUOT after OST failover ========================================================== 21:40:48 (1746150048)
[ 6737.460689] Lustre: DEBUG MARKER: SKIP: sanity-quota test_80 ZFS grants some block space together with inode
[ 6738.489967] Lustre: DEBUG MARKER: == sanity-quota test 81: Race qmt_start_pool_recalc with qmt_pool_free ========================================================== 21:40:50 (1746150050)
[ 6748.686532] Lustre: DEBUG MARKER: User quota (block hardlimit:20 MB)
[ 6753.685441] LustreError: 31848:0:(qmt_pool.c:1295:qmt_pool_recalc()) cfs_fail_timeout id a07 sleeping for 10000ms
[ 6759.413148] Lustre: lustre-MDT0000: Not available for connect from 192.168.203.5@tcp (stopping)
[ 6760.406886] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 6760.414299] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 6760.424265] Lustre: Skipped 1 previous similar message
[ 6763.687470] LustreError: 31848:0:(qmt_pool.c:1295:qmt_pool_recalc()) cfs_fail_timeout id a07 awake
[ 6763.806872] LustreError: 31979:0:(obd_class.h:479:obd_check_dev()) Device 17 not setup
[ 6763.809881] LustreError: 31979:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages
[ 6763.917315] Lustre: server umount lustre-MDT0000 complete
[ 6767.963319] LustreError: MGC192.168.203.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 6768.305581] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 6768.399938] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:27 to 0x240000400:65)
[ 6768.400473] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:27 to 0x280000400:65)
[ 6770.063023] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6781.278017] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to  (at 0@lo)
[ 6781.283515] Lustre: Skipped 3 previous similar messages
[ 6799.891923] Lustre: DEBUG MARKER: == sanity-quota test 82: verify more than 8 qids for single operation ========================================================== 21:41:51 (1746150111)
[ 6821.360468] Lustre: DEBUG MARKER: == sanity-quota test 83: Setting default quota shouldn't affect grace time ========================================================== 21:42:13 (1746150133)
[ 6842.386504] Lustre: DEBUG MARKER: == sanity-quota test 84: Reset quota should fix the insane granted quota ========================================================== 21:42:34 (1746150154)
[ 6861.595338] LustreError: 25199:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-OST0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 6861.608183] LustreError: 25199:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 2 previous similar messages
[ 6877.068620] Lustre: *** cfs_fail_loc=a08, val=0***
[ 6877.069893] Lustre: Skipped 2493 previous similar messages
[ 6877.077092] Lustre: *** cfs_fail_loc=a08, val=0***
[ 6941.206306] Lustre: DEBUG MARKER: == sanity-quota test 85: do not hung at write with the least_qunit ========================================================== 21:44:13 (1746150253)
[ 6999.133335] Lustre: DEBUG MARKER: == sanity-quota test 86: Pre-acquired quota should be released if quota is over limit ========================================================== 21:45:11 (1746150311)
[ 7133.971916] LustreError: 32678:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:60000 enforced:1 hard:2048 soft:2048 granted:65536 time:1746755246 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 7314.610213] LustreError: 19791:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:60000 enforced:1 hard:2048 soft:2048 granted:65536 time:1746755427 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 7498.023554] LustreError: 32678:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:1000 enforced:1 hard:2048 soft:2048 granted:65536 time:1746755610 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 7572.632823] Lustre: DEBUG MARKER: == sanity-quota test 87: lfs quota -a should print default quota setting ========================================================== 21:54:44 (1746150884)
[ 7580.830241] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7581.838229] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7581.839716] Lustre: Skipped 83 previous similar messages
[ 7583.855994] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7583.857883] Lustre: Skipped 189 previous similar messages
[ 7587.862803] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7587.864905] Lustre: Skipped 365 previous similar messages
[ 7630.934020] Lustre: lustre-MDT0000: Not available for connect from 192.168.203.5@tcp (stopping)
[ 7630.945381] Lustre: Skipped 1 previous similar message
[ 7632.740219] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 7632.740944] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 7632.752641] Lustre: Skipped 1 previous similar message
[ 7635.929000] Lustre: lustre-MDT0000: Not available for connect from 192.168.203.5@tcp (stopping)
[ 7635.932913] Lustre: Skipped 1 previous similar message
[ 7636.451483] LustreError: 578:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 7636.458461] LustreError: 578:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages
[ 7636.632105] Lustre: server umount lustre-MDT0000 complete
[ 7641.788618] LustreError: MGC192.168.203.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 7642.124088] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 7642.240266] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:68 to 0x240000400:97)
[ 7642.257573] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:27 to 0x280000400:97)
[ 7644.046811] Lustre: DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7653.095886] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to  (at 0@lo)
[ 7653.098384] Lustre: Skipped 1 previous similar message
[ 7670.961416] Lustre: DEBUG MARKER: == sanity-quota test 88: Writing over quota should not hang ========================================================== 21:56:23 (1746150983)
[ 7671.709326] Lustre: DEBUG MARKER: SKIP: sanity-quota test_88 require client with >4k pages
[ 7672.579489] Lustre: DEBUG MARKER: == sanity-quota test 89: Show default quota with squash_uid ========================================================== 21:56:24 (1746150984)
[ 7714.006880] Lustre: DEBUG MARKER: == sanity-quota test 90a: lfs quota should work without mount point ========================================================== 21:57:06 (1746151026)
[ 7743.444655] Lustre: DEBUG MARKER: == sanity-quota test 90b: lfs quota should work with multiple mount points ========================================================== 21:57:35 (1746151055)
[ 7752.476304] Lustre: DEBUG MARKER: sanity-quota test_90b: @@@@@@ FAIL: quota info from /mnt/lustre not ' /mnt/lustre root 11737 0 0 - 376 0 0 -