[ 4524.612412] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 4528.869835] Lustre: DEBUG MARKER: Write 100M (buffered) ...
[ 4538.296654] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 4540.193680] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 4542.749430] Lustre: Failing over lustre-MDT0000
[ 4543.066678] LustreError: 126541:0:(obd_class.h:479:obd_check_dev()) Device 25 not setup
[ 4543.073963] LustreError: 126541:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages
[ 4543.339592] Lustre: server umount lustre-MDT0000 complete
[ 4544.992968] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 4544.996411] LustreError: 106964:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4545.013706] Lustre: Skipped 3 previous similar messages
[ 4545.042785] LustreError: 106964:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 13 previous similar messages
[ 4560.359767] Lustre: 7019:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319294/real 1767319294]  req@ffff9864cf8eb800 x1853163981146112/t0(0) o400->MGC192.168.204.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1767319310 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 4560.383943] LustreError: MGC192.168.204.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 4569.546571] LDISKFS-fs (dm-0): 7 truncates cleaned up
[ 4569.549150] LDISKFS-fs (dm-0): recovery complete
[ 4569.562621] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc
[ 4570.594773] LustreError: 7015:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight  req@ffff9863cb056a00 x1853163981153664/t0(0) o250->MGC192.168.204.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 4570.895871] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 4570.939482] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 4573.191737] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect
[ 4574.841718] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4576.241018] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo)
[ 4576.246493] Lustre: Skipped 1 previous similar message
[ 4576.303847] Lustre: lustre-MDT0000: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted.
[ 4576.354378] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:680 to 0x280000400:705)
[ 4576.359768] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000400:678 to 0x2c0000400:705)
[ 4581.436743] Lustre: DEBUG MARKER: oleg448-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 4582.768184] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 4587.449714] Lustre: DEBUG MARKER: (dd_pid=108593, time=0, timeout=600)
[ 4607.180701] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 4611.442666] Lustre: DEBUG MARKER: Write 100M (directio) ...
[ 4618.468368] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 4620.158190] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 4622.191903] Lustre: Failing over lustre-MDT0000
[ 4622.305822] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107
[ 4622.310446] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 4622.318408] Lustre: Skipped 2 previous similar messages
[ 4622.404681] LustreError: 129536:0:(obd_class.h:479:obd_check_dev()) Device 25 not setup
[ 4622.412583] LustreError: 129536:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages
[ 4624.543442] Lustre: server umount lustre-MDT0000 complete
[ 4643.808059] Lustre: 7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319377/real 1767319377]  req@ffff9863ca87e680 x1853163981200512/t0(0) o400->MGC192.168.204.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1767319393 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 4643.845996] LustreError: MGC192.168.204.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 4650.363479] LDISKFS-fs (dm-0): 2 truncates cleaned up
[ 4650.366670] LDISKFS-fs (dm-0): recovery complete
[ 4650.371486] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc
[ 4653.101755] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x8527c9124a1e988b
[ 4653.401291] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 4653.458565] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 4655.104573] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect
[ 4657.412603] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4658.658659] LustreError: 7015:0:(ldlm_resource.c:981:ldlm_resource_complain()) lustre-MDT0000-lwp-OST0001: namespace resource [0x200000006:0x20000:0x0].0x0 (ffff9864c5490b00) refcount nonzero (1) after lock cleanup; forcing cleanup.
[ 4658.678917] LustreError: 7015:0:(ldlm_resource.c:981:ldlm_resource_complain()) Skipped 5 previous similar messages
[ 4658.725439] Lustre: lustre-MDT0000: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted.
[ 4658.779469] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:707 to 0x280000400:737)
[ 4658.779473] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000400:678 to 0x2c0000400:737)
[ 4663.481874] Lustre: DEBUG MARKER: oleg448-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 4665.080957] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 4669.878719] Lustre: DEBUG MARKER: (dd_pid=110823, time=0, timeout=600)
[ 4696.383602] Lustre: DEBUG MARKER: == sanity-quota test 19: Updating admin limits doesn't zero operational limits(b14790) ========================================================== 21:04:04 (1767319444)
[ 4720.590772] Lustre: DEBUG MARKER: == sanity-quota test 20: Test if setquota specifiers work properly (b15754) ========================================================== 21:04:28 (1767319468)
[ 4739.102613] Lustre: DEBUG MARKER: == sanity-quota test 21: Setquota while writing
[ 4748.966275] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for user: quota_usr
[ 4750.592471] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for group: quota_usr
[ 4752.523962] Lustre: DEBUG MARKER: Set limit(block:10G; file:) for project: 1000
[ 4754.766849] Lustre: DEBUG MARKER: Set quota for 1 times
[ 4758.217766] Lustre: DEBUG MARKER: Set quota for 2 times
[ 4762.157429] Lustre: DEBUG MARKER: Set quota for 3 times
[ 4766.356729] Lustre: DEBUG MARKER: Set quota for 4 times
[ 4770.166336] Lustre: DEBUG MARKER: Set quota for 5 times
[ 4773.455308] Lustre: DEBUG MARKER: Set quota for 6 times
[ 4776.865976] Lustre: DEBUG MARKER: Set quota for 7 times
[ 4779.960253] Lustre: DEBUG MARKER: Set quota for 8 times
[ 4783.435365] Lustre: DEBUG MARKER: Set quota for 9 times
[ 4814.954264] Lustre: DEBUG MARKER: == sanity-quota test 22: enable/disable quota by 'lctl conf_param/set_param -P' ========================================================== 21:06:02 (1767319562)
[ 4827.620243] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 4827.627587] Lustre: Skipped 3 previous similar messages
[ 4832.736478] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping)
[ 4832.744043] Lustre: Skipped 3 previous similar messages
[ 4832.885198] LustreError: 136093:0:(obd_class.h:479:obd_check_dev()) Device 25 not setup
[ 4832.891496] LustreError: 136093:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages
[ 4833.016183] Lustre: server umount lustre-MDT0000 complete
[ 4833.358866] Lustre: server umount lustre-MDT0001 complete
[ 4836.393131] LustreError: 15467:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1767319586 with bad export cookie 9594858611526244491
[ 4836.396028] LustreError: MGC192.168.204.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 4836.404128] LustreError: 15467:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message
[ 4836.499384] Lustre: server umount lustre-OST0001 complete
[ 4836.716429] Lustre: server umount lustre-OST0000 complete
[ 4855.083263] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing load_modules_local
[ 4870.269173] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc
[ 4870.350237] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
[ 4870.782957] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 4874.371658] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4875.060845] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4880.315622] Lustre: 140122:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 4891.335322] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
[ 4891.538202] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
[ 4891.696104] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 4891.698895] Lustre: Skipped 1 previous similar message
[ 4896.067856] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000400:740 to 0x2c0000400:769)
[ 4896.076418] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:739 to 0x280000400:769)
[ 4897.074682] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97)
[ 4898.010635] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4898.064226] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4906.720612] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 4909.634215] Lustre: 142494:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 4909.637300] Lustre: 142494:0:(mgs_llog.c:1348:mgs_modify_param()) Skipped 1 previous similar message
[ 4933.090993] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 4933.097572] Lustre: Skipped 3 previous similar messages
[ 4938.210268] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 4938.216059] Lustre: Skipped 3 previous similar messages
[ 4938.915432] LustreError: 143525:0:(obd_class.h:479:obd_check_dev()) Device 11 not setup
[ 4938.921243] LustreError: 143525:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages
[ 4939.014402] Lustre: server umount lustre-MDT0000 complete
[ 4939.321821] Lustre: server umount lustre-MDT0001 complete
[ 4942.276078] LustreError: 139022:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1767319692 with bad export cookie 9594858611526251589
[ 4942.279607] LustreError: MGC192.168.204.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 4942.284170] LustreError: 139022:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 4942.398929] Lustre: server umount lustre-OST0000 complete
[ 4942.576459] Lustre: server umount lustre-OST0001 complete
[ 4959.113596] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing load_modules_local
[ 4973.074067] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc
[ 4973.238989] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
[ 4973.635179] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180
[ 4973.641483] Lustre: Skipped 1 previous similar message
[ 4977.664264] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4977.955758] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4982.689164] Lustre: 147533:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 4992.918872] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
[ 4992.975510] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
[ 4993.264520] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 4993.270823] Lustre: Skipped 1 previous similar message
[ 4998.721342] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:739 to 0x280000400:801)
[ 4998.745227] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:129)
[ 4998.831835] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000400:740 to 0x2c0000400:801)
[ 4999.473035] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5000.075490] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5008.394834] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 5011.730626] Lustre: 149894:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 5011.739292] Lustre: 149894:0:(mgs_llog.c:1348:mgs_modify_param()) Skipped 1 previous similar message
[ 5025.151629] Lustre: DEBUG MARKER: == sanity-quota test 23: Quota should be honored with directIO (b16125) ========================================================== 21:09:33 (1767319773)
[ 5026.567494] Lustre: DEBUG MARKER: OST0_SIZE: 3605396 required: 6144
[ 5027.509077] Lustre: DEBUG MARKER: run for 4MB test file
[ 5035.543681] Lustre: DEBUG MARKER: User quota (limit: 4 MB)
[ 5039.927724] Lustre: DEBUG MARKER: Step1: trigger EDQUOT with O_DIRECT
[ 5041.713598] Lustre: DEBUG MARKER: Write half of file
[ 5043.861185] Lustre: DEBUG MARKER: Write out of block quota ...
[ 5045.742756] Lustre: DEBUG MARKER: Step1: done
[ 5047.410174] Lustre: DEBUG MARKER: Step2: rewrite should succeed
[ 5048.965124] Lustre: DEBUG MARKER: Step2: done
[ 5071.744892] Lustre: DEBUG MARKER: OST0_SIZE: 3605396 required: 61440
[ 5073.554730] Lustre: DEBUG MARKER: run for 40MB test file
[ 5083.331625] Lustre: DEBUG MARKER: User quota (limit: 40 MB)
[ 5088.114775] Lustre: DEBUG MARKER: Step1: trigger EDQUOT with O_DIRECT
[ 5089.450637] Lustre: DEBUG MARKER: Write half of file
[ 5091.734422] Lustre: DEBUG MARKER: Write out of block quota ...
[ 5094.178307] Lustre: DEBUG MARKER: Step1: done
[ 5095.471342] Lustre: DEBUG MARKER: Step2: rewrite should succeed
[ 5097.048654] Lustre: DEBUG MARKER: Step2: done
[ 5132.507730] Lustre: DEBUG MARKER: == sanity-quota test 24: lfs draws an asterix when limit is reached (b16646) ========================================================== 21:11:20 (1767319880)
[ 5166.176599] Lustre: DEBUG MARKER: == sanity-quota test 25: check indexes versions ========== 21:11:53 (1767319913)
[ 5199.912420] Lustre: DEBUG MARKER: Write...
[ 5202.336424] Lustre: DEBUG MARKER: Write out of block quota ...
[ 5246.089570] Lustre: DEBUG MARKER: == sanity-quota test 27a: lfs quota/setquota should handle wrong arguments (b19612) ========================================================== 21:13:14 (1767319994)
[ 5251.208311] Lustre: DEBUG MARKER: == sanity-quota test 27b: lfs quota/setquota should handle user/group/project ID (b20200) ========================================================== 21:13:19 (1767319999)
[ 5259.782633] Lustre: DEBUG MARKER: == sanity-quota test 27c: lfs quota should support human-readable output ========================================================== 21:13:27 (1767320007)
[ 5266.505366] Lustre: DEBUG MARKER: == sanity-quota test 27d: lfs setquota should support fraction block limit ========================================================== 21:13:34 (1767320014)
[ 5273.155839] Lustre: DEBUG MARKER: == sanity-quota test 30: Hard limit updates should not reset grace times ========================================================== 21:13:41 (1767320021)
[ 5319.938780] Lustre: DEBUG MARKER: == sanity-quota test 33: Basic usage tracking for user
[ 5405.061550] Lustre: DEBUG MARKER: == sanity-quota test 34: Usage transfer for user
[ 5518.231732] Lustre: DEBUG MARKER: == sanity-quota test 35: Usage is still accessible across reboot ========================================================== 21:17:46 (1767320266)
[ 5551.878896] Lustre: DEBUG MARKER: Restart...
[ 5556.704991] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 5556.717794] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 5556.725724] Lustre: Skipped 15 previous similar messages
[ 5556.738506] Lustre: Skipped 3 previous similar messages
[ 5561.830271] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping)
[ 5561.838320] Lustre: Skipped 3 previous similar messages
[ 5562.652304] LustreError: 166692:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup
[ 5562.670198] LustreError: 166692:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages
[ 5563.193858] Lustre: server umount lustre-MDT0001 complete
[ 5563.340931] Lustre: server umount lustre-MDT0000 complete
[ 5566.766522] LustreError: 146442:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1767320316 with bad export cookie 9594858611526253857
[ 5566.772302] LustreError: MGC192.168.204.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 5566.780794] LustreError: 146442:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 5566.860655] Lustre: server umount lustre-OST0000 complete
[ 5567.065907] Lustre: server umount lustre-OST0001 complete
[ 5586.496147] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing load_modules_local
[ 5605.325659] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc
[ 5605.565790] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
[ 5605.782272] LustreError: 169598:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 5605.803127] LustreError: 169598:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 62 previous similar messages
[ 5605.892799] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 5605.899539] Lustre: Skipped 1 previous similar message
[ 5610.564055] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5610.676716] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5617.578026] Lustre: 170680:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 5629.976028] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
[ 5630.101549] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
[ 5631.529434] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000400:809 to 0x2c0000400:833)
[ 5631.533144] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:813 to 0x280000400:833)
[ 5631.542900] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:161)
[ 5638.050374] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5638.709020] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5647.095550] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 5650.690773] Lustre: 173035:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 5650.696558] Lustre: 173035:0:(mgs_llog.c:1348:mgs_modify_param()) Skipped 1 previous similar message
[ 5700.001802] Lustre: DEBUG MARKER: == sanity-quota test 37: Quota accounted properly for file created by 'lfs setstripe' ========================================================== 21:20:48 (1767320448)
[ 5740.424637] Lustre: DEBUG MARKER: == sanity-quota test 38: Quota accounting iterator doesn't skip id entries ========================================================== 21:21:28 (1767320488)
[ 7274.352392] Lustre: DEBUG MARKER: == sanity-quota test 39: Project ID interface works correctly ========================================================== 21:47:01 (1767322021)
[ 7285.221081] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 7285.231526] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 7285.248589] Lustre: Skipped 2 previous similar messages
[ 7285.261214] Lustre: Skipped 3 previous similar messages
[ 7290.340452] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping)
[ 7290.352688] Lustre: Skipped 3 previous similar messages
[ 7291.346609] LustreError: 177579:0:(obd_class.h:479:obd_check_dev()) Device 11 not setup
[ 7291.355471] LustreError: 177579:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages
[ 7291.556199] Lustre: server umount lustre-MDT0000 complete
[ 7291.980417] Lustre: server umount lustre-MDT0001 complete
[ 7296.694338] LustreError: 169565:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1767322046 with bad export cookie 9594858611526262817
[ 7296.704098] LustreError: MGC192.168.204.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 7296.708153] LustreError: 169565:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message
[ 7297.213386] Lustre: server umount lustre-OST0000 complete
[ 7297.427972] Lustre: server umount lustre-OST0001 complete
[ 7321.649216] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing load_modules_local
[ 7339.342177] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
[ 7339.639879] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc
[ 7339.777741] LustreError: 7015:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight  req@ffff9863c6eea680 x1853163985161984/t0(0) o250->MGC192.168.204.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 7339.985242] LustreError: 180502:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7340.142499] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180
[ 7340.153650] Lustre: Skipped 3 previous similar messages
[ 7344.226855] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7344.653844] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7350.956514] Lustre: 181597:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 7361.657787] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
[ 7361.909405] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
[ 7361.959353] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 7361.961593] Lustre: Skipped 1 previous similar message
[ 7364.339317] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:193)
[ 7365.353122] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000400:5834 to 0x2c0000400:5857)
[ 7365.356778] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:5836 to 0x280000400:5857)
[ 7368.057141] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7368.103426] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7377.841566] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 7381.928794] Lustre: 183944:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 7381.947433] Lustre: 183944:0:(mgs_llog.c:1348:mgs_modify_param()) Skipped 1 previous similar message
[ 7410.328919] Lustre: DEBUG MARKER: == sanity-quota test 40a: Hard link across different project ID ========================================================== 21:49:18 (1767322158)
[ 7441.805696] Lustre: DEBUG MARKER: == sanity-quota test 40b: Mv across different project ID ========================================================== 21:49:49 (1767322189)
[ 7466.809916] Lustre: DEBUG MARKER: == sanity-quota test 40c: Remote child Dir inherit project quota properly ========================================================== 21:50:14 (1767322214)
[ 7503.906599] Lustre: DEBUG MARKER: == sanity-quota test 40d: Stripe Directory inherit project quota properly ========================================================== 21:50:51 (1767322251)
[ 7538.300124] Lustre: DEBUG MARKER: == sanity-quota test 41: df should return projid-specific values ========================================================== 21:51:25 (1767322285)
[ 7609.198233] Lustre: DEBUG MARKER: == sanity-quota test 42: lfs quota should include default quota info ========================================================== 21:52:36 (1767322356)
[ 7640.043925] Lustre: DEBUG MARKER: == sanity-quota test 48: lfs quota --delete should delete quota project ID ========================================================== 21:53:07 (1767322387)
[ 7658.581411] LustreError: 182679:0:(qsd_handler.c:337:qsd_req_completion()) $$$ DQACQ failed with -3, flags:0x1  qsd:lustre-OST0000 qtype:usr id:60000 enforced:1 granted: 0 pending:0 waiting:1032 req:1 usage: 0 qunit:0 qtune:0 edquot:0 default:no revoke:0 truncated:0
[ 7658.600977] LustreError: 182679:0:(qsd_handler.c:794:qsd_op_begin0()) $$$ ID isn't enforced on master, it probably due to a legeal race, if this message is showing up constantly, there could be some inconsistence between master & slave, and quota reintegration needs be re-triggered.  qsd:lustre-OST0000 qtype:usr id:60000 enforced:1 granted: 0 pending:0 waiting:0 req:0 usage: 0 qunit:0 qtune:0 edquot:0 default:no revoke:0 truncated:0
[ 7703.844994] Lustre: DEBUG MARKER: == sanity-quota test 49a: lfs quota -a prints the quota usage for all quota IDs ========================================================== 21:54:11 (1767322451)
[ 7708.959715] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7708.964080] Lustre: Skipped 2 previous similar messages
[ 7710.990609] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7710.994381] Lustre: Skipped 75 previous similar messages
[ 7714.996790] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7714.998610] Lustre: Skipped 165 previous similar messages
[ 7723.009271] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7723.011054] Lustre: Skipped 273 previous similar messages
[ 7739.024886] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7739.029309] Lustre: Skipped 791 previous similar messages
[ 7771.025056] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7771.029497] Lustre: Skipped 1367 previous similar messages
[ 7835.028642] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7835.034142] Lustre: Skipped 2709 previous similar messages
[ 8157.729465] Lustre: *** cfs_fail_loc=a08, val=0***
[ 8157.733774] Lustre: Skipped 2615 previous similar messages
[ 8157.740371] Lustre: *** cfs_fail_loc=a08, val=0***
[ 8157.744688] Lustre: Skipped 2 previous similar messages
[ 8190.504566] Lustre: *** cfs_fail_loc=a08, val=0***
[ 8190.508890] Lustre: Skipped 10 previous similar messages
[ 8223.713128] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 8223.715785] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 8223.736118] Lustre: Skipped 4 previous similar messages
[ 8223.752986] Lustre: Skipped 3 previous similar messages
[ 8228.339425] LustreError: 194450:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup
[ 8228.348273] LustreError: 194450:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages
[ 8228.568896] Lustre: server umount lustre-MDT0001 complete
[ 8228.837591] LustreError: 180496:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 8228.837966] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 8228.853033] LustreError: 180496:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages
[ 8228.879428] Lustre: Skipped 1 previous similar message
[ 8229.623545] Lustre: server umount lustre-MDT0000 complete
[ 8239.811099] LustreError: 187346:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1767322989 with bad export cookie 9594858611528038402
[ 8239.824684] LustreError: MGC192.168.204.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 8240.170275] LustreError: 195462:0:(obd_class.h:479:obd_check_dev()) Device 27 not setup
[ 8240.174965] LustreError: 195462:0:(obd_class.h:479:obd_check_dev()) Skipped 15 previous similar messages
[ 8240.231908] Lustre: server umount lustre-OST0000 complete
[ 8240.483513] Lustre: server umount lustre-OST0001 complete
[ 8255.879735] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_hostid
[ 8264.008733] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing load_modules_local
[ 8281.727800] LDISKFS-fs (vdf): mounted filesystem with ordered data mode. Opts: errors=remount-ro
[ 8281.910275] LDISKFS-fs (vde): mounted filesystem with ordered data mode. Opts: errors=remount-ro
[ 8283.344730] LDISKFS-fs (vdd): mounted filesystem with ordered data mode. Opts: errors=remount-ro
[ 8285.233634] LDISKFS-fs (vdc): mounted filesystem with ordered data mode. Opts: errors=remount-ro
[ 8300.052712] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing load_modules_local
[ 8319.004394] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro
[ 8319.069345] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro
[ 8319.072385] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc
[ 8319.110233] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
[ 8319.231252] Lustre: Setting parameter lustre-MDT0001.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0001
[ 8319.282478] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space.
[ 8319.287301] Lustre: Skipped 1 previous similar message
[ 8319.355420] Lustre: lustre-MDT0001: new disk, initializing
[ 8319.357784] Lustre: Skipped 1 previous similar message
[ 8319.402410] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180
[ 8319.408905] Lustre: Skipped 1 previous similar message
[ 8319.424468] Lustre: 201909:0:(lod_sub_object.c:951:lod_sub_prep_llog()) lustre-MDT0001-mdtlov: can't create new llog: rc = -115
[ 8319.438375] LustreError: 201909:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osd: get update log duration 0, retries 0, failed: rc = -115
[ 8319.495386] Lustre: 201872:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17
[ 8319.759652] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt
[ 8319.766069] Lustre: Skipped 1 previous similar message
[ 8320.808681] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt
[ 8320.818270] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt]
[ 8320.827856] Lustre: Skipped 1 previous similar message
[ 8322.874905] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 8323.371468] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 8329.537645] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params
[ 8330.005836] Lustre: 203100:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 8342.905936] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro
[ 8342.935430] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro
[ 8343.003618] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
[ 8343.038471] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
[ 8343.193343] Lustre: lustre-OST0001: new disk, initializing
[ 8343.196241] Lustre: Skipped 1 previous similar message
[ 8343.204906] Lustre: srv-lustre-OST0001: No data found on store. Initialize space.
[ 8343.214232] Lustre: Skipped 2 previous similar messages
[ 8343.261891] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 8343.264733] Lustre: Skipped 1 previous similar message
[ 8345.100245] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost
[ 8345.117293] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost]
[ 8345.157734] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400
[ 8345.188059] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x2c0000400
[ 8349.448880] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 8349.467245] Lustre: DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 8359.705343] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 8363.516663] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params
[ 8392.823133] Lustre: DEBUG MARKER: == sanity-quota test 49b: lfs quota -a --blocks has a delimiter ========================================================== 22:05:40 (1767323140)
[ 8399.112684] Lustre: DEBUG MARKER: == sanity-quota test 50: Test if lfs find --projid works ========================================================== 22:05:46 (1767323146)
[ 8425.161988] Lustre: DEBUG MARKER: == sanity-quota test 51: Test project accounting with mv/cp ========================================================== 22:06:13 (1767323173)
[ 8461.147917] Lustre: DEBUG MARKER: == sanity-quota test 52: Rename normal file across project ID ========================================================== 22:06:49 (1767323209)
[ 8475.544167] Lustre: DEBUG MARKER: rename directory return 255
[ 8506.790974] Lustre: DEBUG MARKER: == sanity-quota test 53: Project inherit attribute could be cleared ========================================================== 22:07:35 (1767323255)
[ 8521.917740] Lustre: DEBUG MARKER: == sanity-quota test 54: basic lfs project interface test ========================================================== 22:07:50 (1767323270)
[ 8550.397598] Lustre: DEBUG MARKER: == sanity-quota test 55: Chgrp should be affected by group quota ========================================================== 22:08:18 (1767323298)
[ 8639.699525] Lustre: DEBUG MARKER: == sanity-quota test 56: lfs quota -t should work well === 22:09:47 (1767323387)
[ 8661.377484] Lustre: DEBUG MARKER: == sanity-quota test 57: lfs project could tolerate errors ========================================================== 22:10:09 (1767323409)
[ 8692.322376] Lustre: DEBUG MARKER: == sanity-quota test 58: project ID should be kept for new mirrors created by FID ========================================================== 22:10:40 (1767323440)
[ 8797.228635] Lustre: DEBUG MARKER: == sanity-quota test 59: lfs project dosen't crash kernel with project disabled ========================================================== 22:12:25 (1767323545)
[ 8800.738104] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 8800.745842] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 8800.758182] Lustre: Skipped 3 previous similar messages
[ 8800.771501] Lustre: Skipped 1 previous similar message
[ 8805.858845] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping)
[ 8805.865165] Lustre: Skipped 5 previous similar messages
[ 8806.534552] LustreError: 217111:0:(obd_class.h:479:obd_check_dev()) Device 25 not setup
[ 8806.540838] LustreError: 217111:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages
[ 8806.650607] Lustre: server umount lustre-MDT0000 complete
[ 8806.948633] Lustre: server umount lustre-MDT0001 complete
[ 8810.144503] LustreError: 201866:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1767323560 with bad export cookie 9594858611528410585
[ 8810.148646] LustreError: MGC192.168.204.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 8810.157747] LustreError: 201866:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 8810.326691] Lustre: server umount lustre-OST0001 complete
[ 8810.494709] Lustre: server umount lustre-OST0000 complete
[ 8818.313382] Lustre: DEBUG MARKER: sanity-quota test_59: @@@@@@ FAIL: tune2fs /dev/vdc failed
[ 8824.547711] Lustre: DEBUG MARKER: == sanity-quota test 60: Test quota for root with setgid ========================================================== 22:12:52 (1767323572)
[ 8827.337765] Lustre: DEBUG MARKER: sanity-quota test_60: @@@@@@ FAIL: setup quota failed with 1
[ 8831.128728] Lustre: DEBUG MARKER: SKIP: sanity-quota test_61 skipping SLOW test 61
[ 8832.463407] Lustre: DEBUG MARKER: == sanity-quota test 62: Project inherit should be only changed by root ========================================================== 22:13:00 (1767323580)
[ 8835.612529] Lustre: DEBUG MARKER: sanity-quota test_62: @@@@@@ FAIL: setup quota failed with 1
[ 8838.919610] Lustre: DEBUG MARKER: SKIP: sanity-quota test_63 skipping excluded test 63
[ 8840.109976] Lustre: DEBUG MARKER: == sanity-quota test 64: lfs project on non-dir/files should succeed ========================================================== 22:13:08 (1767323588)
[ 8843.512120] Lustre: DEBUG MARKER: sanity-quota test_64: @@@@@@ FAIL: setup quota failed with 1