[ 4262.201461] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 4264.789806] Lustre: DEBUG MARKER: Write 100M (buffered) ...
[ 4266.393102] LustreError: 97105:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 4266.940824] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 4267.850214] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 4268.957925] Lustre: Failing over lustre-MDT0000
[ 4269.316421] LustreError: 97298:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 4269.321399] LustreError: 97298:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message
[ 4269.573944] Lustre: server umount lustre-MDT0000 complete
[ 4285.576718] LustreError: MGC192.168.204.136@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 4285.792404] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 4285.804337] Lustre: Skipped 1 previous similar message
[ 4285.972588] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 4286.030804] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 4286.879157] Lustre: 3311:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1761241714/real 1761241714]  req@ffff9e130bdaed80 x1846791381532288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1761241730 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 4286.896319] Lustre: 3311:0:(client.c:2468:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[ 4287.905087] Lustre: 3310:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1761241714/real 1761241714]  req@ffff9e130bdadf80 x1846791381532416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1761241730 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 4288.857078] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4289.358211] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 4289.469700] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 4289.503205] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:816 to 0x280000400:833)
[ 4289.504587] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:819 to 0x240000400:865)
[ 4291.048411] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo)
[ 4292.048096] LustreError: 32992:0:(qsd_reint.c:618:qqi_reint_delayed()) lustre-OST0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 4292.060060] LustreError: 32992:0:(qsd_reint.c:618:qqi_reint_delayed()) Skipped 6 previous similar messages
[ 4292.072791] Lustre: 3311:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1761241719/real 1761241719]  req@ffff9e130db5c000 x1846791381532672/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1761241735 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 4294.381305] Lustre: DEBUG MARKER: oleg436-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 4295.807209] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 4297.183157] Lustre: 3309:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1761241724/real 1761241724]  req@ffff9e14103f8380 x1846791381533056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1761241740 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 4297.204014] Lustre: 3309:0:(client.c:2468:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[ 4303.366322] Lustre: DEBUG MARKER: (dd_pid=93689, time=2, timeout=600)
[ 4344.548094] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 4347.686254] Lustre: DEBUG MARKER: Write 100M (directio) ...
[ 4349.814660] LustreError: 99639:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 4350.440442] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 4351.536530] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 4353.008574] Lustre: Failing over lustre-MDT0000
[ 4353.217896] LustreError: 99833:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 4353.226384] LustreError: 99833:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages
[ 4353.333658] Lustre: server umount lustre-MDT0000 complete
[ 4369.146479] LustreError: MGC192.168.204.136@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 4369.519052] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 4369.577104] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 4370.527114] Lustre: 3311:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1761241797/real 1761241797]  req@ffff9e130dc44e00 x1846791381565568/t0(0) o601->lustre-MDT0000-lwp-OST0000@0@lo:23/10 lens 336/336 e 0 to 1 dl 1761241813 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'lquota_wb_lustr.0' uid:0 gid:0 projid:4294967295
[ 4371.278474] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 4371.448168] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 4371.492170] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:867 to 0x240000400:897)
[ 4371.492698] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:816 to 0x280000400:865)
[ 4372.387871] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4375.685227] LustreError: 32992:0:(qsd_reint.c:618:qqi_reint_delayed()) lustre-OST0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 4377.599709] Lustre: DEBUG MARKER: oleg436-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 4378.650619] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 4383.204916] Lustre: DEBUG MARKER: (dd_pid=95954, time=1, timeout=600)
[ 4430.688432] Lustre: DEBUG MARKER: == sanity-quota test 19: Updating admin limits doesn't zero operational limits(b14790) ========================================================== 13:51:12 (1761241872)
[ 4441.076183] LustreError: 102316:0:(qsd_reint.c:618:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:1 until pending updates are flushed.
[ 4446.840379] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 4448.357639] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 4451.856235] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 4453.103985] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 4478.608568] Lustre: DEBUG MARKER: == sanity-quota test 20: Test if setquota specifiers work properly (b15754) ========================================================== 13:52:00 (1761241920)
[ 4494.007214] Lustre: DEBUG MARKER: == sanity-quota test 21: Setquota while writing
[ 4504.658806] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for user: quota_usr
[ 4505.383986] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for group: quota_usr
[ 4506.208900] Lustre: DEBUG MARKER: Set limit(block:10G; file:) for project: 1000
[ 4507.276834] Lustre: DEBUG MARKER: Set quota for 1 times
[ 4509.503232] Lustre: DEBUG MARKER: Set quota for 2 times
[ 4511.862376] Lustre: DEBUG MARKER: Set quota for 3 times
[ 4514.303589] Lustre: DEBUG MARKER: Set quota for 4 times
[ 4517.080327] Lustre: DEBUG MARKER: Set quota for 5 times
[ 4519.994585] Lustre: DEBUG MARKER: Set quota for 6 times
[ 4523.124044] Lustre: DEBUG MARKER: Set quota for 7 times
[ 4525.562515] Lustre: DEBUG MARKER: Set quota for 8 times
[ 4527.793164] Lustre: DEBUG MARKER: Set quota for 9 times
[ 4530.099291] Lustre: DEBUG MARKER: Set quota for 10 times
[ 4532.458837] Lustre: DEBUG MARKER: Set quota for 11 times
[ 4535.132965] Lustre: DEBUG MARKER: Set quota for 12 times
[ 4570.784118] Lustre: DEBUG MARKER: == sanity-quota test 22: enable/disable quota by 'lctl conf_param/set_param -P' ========================================================== 13:53:32 (1761242012)
[ 4572.907881] LustreError: 106071:0:(qsd_reint.c:618:qqi_reint_delayed()) lustre-OST0001: Delaying reintegration for qtype:2 until pending updates are flushed.
[ 4584.420710] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 4584.425984] Lustre: Skipped 2 previous similar messages
[ 4584.428671] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 4584.434459] Lustre: Skipped 1 previous similar message
[ 4586.371107] LustreError: 106464:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 4586.373513] LustreError: 106464:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages
[ 4586.513684] Lustre: server umount lustre-MDT0000 complete
[ 4589.247835] LustreError: 5751:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1761242032 with bad export cookie 6115856940314043174
[ 4589.250398] LustreError: MGC192.168.204.136@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 4589.252848] LustreError: 5751:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 4589.309273] Lustre: server umount lustre-OST0000 complete
[ 4592.576524] Lustre: server umount lustre-OST0001 complete
[ 4603.728418] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing load_modules_local
[ 4609.104060] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 4611.184887] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4612.620330] Lustre: 108339:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 4615.328429] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 4618.198371] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4619.425107] LustreError: 108665:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4619.441083] LustreError: 108665:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message
[ 4619.445272] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:899 to 0x240000400:929)
[ 4622.537126] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 4623.757538] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:868 to 0x280000400:897)
[ 4626.465192] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4631.838329] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 4634.179856] Lustre: 110134:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 4650.372284] Lustre: server umount lustre-MDT0000 complete
[ 4652.913294] LustreError: 107904:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1761242096 with bad export cookie 6115856940314052113
[ 4652.918950] LustreError: MGC192.168.204.136@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 4663.309196] LustreError: 111044:0:(obd_class.h:479:obd_check_dev()) Device 14 not setup
[ 4663.312817] LustreError: 111044:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages
[ 4663.337349] Lustre: server umount lustre-OST0000 complete
[ 4675.056756] Lustre: server umount lustre-OST0001 complete
[ 4684.520209] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing load_modules_local
[ 4691.157887] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 4693.575621] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4695.385952] Lustre: 112691:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 4700.833952] LustreError: 113013:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4700.849622] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:899 to 0x240000400:961)
[ 4702.281267] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4706.275487] LustreError: 113201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4708.696280] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:868 to 0x280000400:929)
[ 4710.864044] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4716.760368] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 4719.878333] Lustre: 114465:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 4731.512987] Lustre: DEBUG MARKER: == sanity-quota test 23: Quota should be honored with directIO (b16125) ========================================================== 13:56:13 (1761242173)
[ 4732.452961] Lustre: DEBUG MARKER: SKIP: sanity-quota test_23 Overwrite in place is not guaranteed to be space neutral on ZFS
[ 4733.769294] Lustre: DEBUG MARKER: == sanity-quota test 24: lfs draws an asterix when limit is reached (b16646) ========================================================== 13:56:15 (1761242175)
[ 4770.978652] Lustre: DEBUG MARKER: == sanity-quota test 25: check indexes versions ========== 13:56:53 (1761242213)
[ 4807.041607] Lustre: DEBUG MARKER: Write...
[ 4808.948617] Lustre: DEBUG MARKER: Write out of block quota ...
[ 4851.833886] Lustre: DEBUG MARKER: == sanity-quota test 27a: lfs quota/setquota should handle wrong arguments (b19612) ========================================================== 13:58:13 (1761242293)
[ 4858.183092] Lustre: DEBUG MARKER: == sanity-quota test 27b: lfs quota/setquota should handle user/group/project ID (b20200) ========================================================== 13:58:20 (1761242300)
[ 4867.002508] Lustre: DEBUG MARKER: == sanity-quota test 27c: lfs quota should support human-readable output ========================================================== 13:58:29 (1761242309)
[ 4873.502637] Lustre: DEBUG MARKER: == sanity-quota test 27d: lfs setquota should support fraction block limit ========================================================== 13:58:35 (1761242315)
[ 4879.505478] Lustre: DEBUG MARKER: == sanity-quota test 30: Hard limit updates should not reset grace times ========================================================== 13:58:41 (1761242321)
[ 4933.751352] Lustre: DEBUG MARKER: == sanity-quota test 33: Basic usage tracking for user
[ 5042.964759] Lustre: DEBUG MARKER: == sanity-quota test 34: Usage transfer for user
[ 5191.317442] Lustre: DEBUG MARKER: == sanity-quota test 35: Usage is still accessible across reboot ========================================================== 14:03:53 (1761242633)
[ 5233.899390] Lustre: DEBUG MARKER: Restart...
[ 5238.230592] LustreError: 127559:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup
[ 5238.233268] LustreError: 127559:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages
[ 5238.392187] Lustre: server umount lustre-MDT0000 complete
[ 5241.539701] LustreError: 115107:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1761242684 with bad export cookie 6115856940314053646
[ 5241.550373] LustreError: MGC192.168.204.136@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 5251.132923] Lustre: server umount lustre-OST0000 complete
[ 5264.865663] Lustre: server umount lustre-OST0001 complete
[ 5276.314906] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing load_modules_local
[ 5283.804679] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 5283.808220] Lustre: Skipped 2 previous similar messages
[ 5286.887351] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5289.002891] Lustre: 129427:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 5293.027932] LustreError: 129751:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 5294.750146] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:970 to 0x240000400:993)
[ 5297.753536] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5298.143696] LustreError: 129751:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 5304.669232] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:938 to 0x280000400:961)
[ 5306.631933] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5312.229429] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 5314.857350] Lustre: 131199:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 5360.261626] Lustre: DEBUG MARKER: == sanity-quota test 37: Quota accounted properly for file created by 'lfs setstripe' ========================================================== 14:06:42 (1761242802)
[ 5417.767504] Lustre: DEBUG MARKER: == sanity-quota test 38: Quota accounting iterator doesn't skip id entries ========================================================== 14:07:40 (1761242860)
[ 6868.583072] Lustre: DEBUG MARKER: == sanity-quota test 39: Project ID interface works correctly ========================================================== 14:31:50 (1761244310)
[ 6883.534233] LustreError: 136095:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup
[ 6883.536692] LustreError: 136095:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages
[ 6883.709209] Lustre: server umount lustre-MDT0000 complete
[ 6887.424208] LustreError: 128998:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1761244330 with bad export cookie 6115856940314060072
[ 6887.437104] LustreError: MGC192.168.204.136@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 6897.772967] Lustre: server umount lustre-OST0000 complete
[ 6911.659595] Lustre: server umount lustre-OST0001 complete
[ 6923.941313] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing load_modules_local
[ 6934.855112] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 6934.857933] Lustre: Skipped 2 previous similar messages
[ 6939.336193] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6942.512562] Lustre: 137959:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 6947.935573] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 6953.926117] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6959.137740] LustreError: 138279:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 6959.184375] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:5996 to 0x240000400:6017)
[ 6962.323586] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 6964.138742] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:5962 to 0x280000400:5985)
[ 6968.485898] Lustre: DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 6975.626534] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 6978.915701] Lustre: 139729:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 7016.441672] Lustre: DEBUG MARKER: == sanity-quota test 40a: Hard link across different project ID ========================================================== 14:34:18 (1761244458)
[ 7057.259619] Lustre: DEBUG MARKER: == sanity-quota test 40b: Mv across different project ID ========================================================== 14:34:59 (1761244499)
[ 7098.308809] Lustre: DEBUG MARKER: == sanity-quota test 40c: Remote child Dir inherit project quota properly ========================================================== 14:35:39 (1761244539)
[ 7100.161825] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40c needs >= 2 MDTs
[ 7102.194465] Lustre: DEBUG MARKER: == sanity-quota test 40d: Stripe Directory inherit project quota properly ========================================================== 14:35:43 (1761244543)
[ 7104.049519] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40d needs >= 2 MDTs
[ 7106.716820] Lustre: DEBUG MARKER: == sanity-quota test 41: df should return projid-specific values ========================================================== 14:35:47 (1761244547)
[ 7119.492714] LustreError: 142491:0:(qsd_reint.c:618:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 7119.504262] LustreError: 142491:0:(qsd_reint.c:618:qqi_reint_delayed()) Skipped 2 previous similar messages
[ 7178.943891] Lustre: DEBUG MARKER: == sanity-quota test 42: lfs quota should include default quota info ========================================================== 14:37:01 (1761244621)
[ 7221.480383] Lustre: DEBUG MARKER: == sanity-quota test 48: lfs quota --delete should delete quota project ID ========================================================== 14:37:43 (1761244663)
[ 7343.178614] Lustre: DEBUG MARKER: sanity-quota test_48: @@@@@@ FAIL: QMT: mds1 qid 60000 is not deleted