[ 4644.455839] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 4648.695489] Lustre: DEBUG MARKER: Write 100M (buffered) ...
[ 4652.619810] LustreError: 96950:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 4653.527665] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 4655.388779] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 4657.585600] Lustre: Failing over lustre-MDT0000
[ 4657.897846] LustreError: 97143:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 4657.912065] LustreError: 97143:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message
[ 4657.999950] Lustre: server umount lustre-MDT0000 complete
[ 4675.551332] Lustre: 3306:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1768255430/real 1768255430]  req@ffff903ecebc6300 x1854145419979904/t0(0) o601->lustre-MDT0000-lwp-OST0000@0@lo:23/10 lens 336/336 e 0 to 1 dl 1768255446 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'lquota_wb_lustr.0' uid:0 gid:0 projid:4294967295
[ 4675.575453] Lustre: 3306:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 4675.579994] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 4675.650990] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 4676.209571] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 4676.258697] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 4676.298632] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 4676.532420] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 4676.573521] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1043 to 0x240000400:1089)
[ 4676.574455] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1041 to 0x280000400:1057)
[ 4678.031937] Lustre: 3309:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1768255433/real 1768255433]  req@ffff903ec57a7100 x1854145419980288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1768255449 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 4680.163338] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo)
[ 4680.911263] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4683.236029] Lustre: 3307:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1768255438/real 1768255438]  req@ffff903fe71ce680 x1854145419980544/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1768255454 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 4683.262705] Lustre: 3307:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 4688.351501] Lustre: 3306:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1768255443/real 1768255443]  req@ffff903ec57a6d80 x1854145419981056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1768255459 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 4688.417236] Lustre: 3306:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 4689.658585] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 4691.536359] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 4703.990795] Lustre: DEBUG MARKER: (dd_pid=93170, time=6, timeout=600)
[ 4746.689061] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 4751.228932] Lustre: DEBUG MARKER: Write 100M (directio) ...
[ 4753.863196] LustreError: 99344:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 4754.678619] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 4756.342424] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 4758.027517] Lustre: Failing over lustre-MDT0000
[ 4758.239688] Lustre: lustre-MDT0000: Not available for connect from 192.168.203.48@tcp (stopping)
[ 4758.370914] LustreError: 99537:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 4758.380056] LustreError: 99537:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages
[ 4758.492558] Lustre: server umount lustre-MDT0000 complete
[ 4776.108659] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 4776.218445] Lustre: 3306:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1768255531/real 1768255531]  req@ffff903fc5485f80 x1854145420018432/t0(0) o601->lustre-MDT0000-lwp-OST0000@0@lo:23/10 lens 336/336 e 0 to 1 dl 1768255547 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'lquota_wb_lustr.0' uid:0 gid:0 projid:4294967295
[ 4776.248375] Lustre: 3306:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[ 4776.268688] LustreError: 99951:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4776.295139] LustreError: 99951:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages
[ 4777.098801] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 4777.263634] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 4777.647930] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 4777.825159] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 4777.887371] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1091 to 0x240000400:1121)
[ 4777.889548] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1041 to 0x280000400:1089)
[ 4781.564059] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4782.056078] LustreError: 3305:0:(ldlm_resource.c:981:ldlm_resource_complain()) lustre-MDT0000-lwp-OST0001: namespace resource [0x200000006:0x20000:0x0].0x0 (ffff903ff6b3af00) refcount nonzero (1) after lock cleanup; forcing cleanup.
[ 4782.085846] LustreError: 3305:0:(ldlm_resource.c:981:ldlm_resource_complain()) Skipped 5 previous similar messages
[ 4786.143205] Lustre: 3307:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1768255541/real 1768255541]  req@ffff903ec6570a80 x1854145420019200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1768255557 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
[ 4786.167690] Lustre: 3307:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 4 previous similar messages
[ 4789.831453] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 4791.899522] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 4798.751059] Lustre: DEBUG MARKER: (dd_pid=95335, time=1, timeout=600)
[ 4848.452978] Lustre: DEBUG MARKER: == sanity-quota test 19: Updating admin limits doesn't zero operational limits(b14790) ========================================================== 17:06:57 (1768255617)
[ 4865.356455] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 4866.753936] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 4871.255515] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 4872.839826] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 4906.773913] Lustre: DEBUG MARKER: == sanity-quota test 20: Test if setquota specifiers work properly (b15754) ========================================================== 17:07:56 (1768255676)
[ 4924.152192] Lustre: DEBUG MARKER: == sanity-quota test 21: Setquota while writing
[ 4939.216975] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for user: quota_usr
[ 4941.034369] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for group: quota_usr
[ 4942.545937] Lustre: DEBUG MARKER: Set limit(block:10G; file:) for project: 1000
[ 4944.345342] Lustre: DEBUG MARKER: Set quota for 1 times
[ 4947.924903] Lustre: DEBUG MARKER: Set quota for 2 times
[ 4951.587354] Lustre: DEBUG MARKER: Set quota for 3 times
[ 4955.345759] Lustre: DEBUG MARKER: Set quota for 4 times
[ 4959.365866] Lustre: DEBUG MARKER: Set quota for 5 times
[ 4963.352647] Lustre: DEBUG MARKER: Set quota for 6 times
[ 4966.748129] Lustre: DEBUG MARKER: Set quota for 7 times
[ 4970.427699] Lustre: DEBUG MARKER: Set quota for 8 times
[ 4973.587395] Lustre: DEBUG MARKER: Set quota for 9 times
[ 5013.656435] Lustre: DEBUG MARKER: == sanity-quota test 22: enable/disable quota by 'lctl conf_param/set_param -P' ========================================================== 17:09:43 (1768255783)
[ 5027.809920] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 5027.814143] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 5027.820051] Lustre: Skipped 4 previous similar messages
[ 5027.834047] Lustre: Skipped 1 previous similar message
[ 5029.803162] LustreError: 105811:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup
[ 5029.810209] LustreError: 105811:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages
[ 5029.875629] Lustre: server umount lustre-MDT0000 complete
[ 5032.740810] LustreError: 13300:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768255803 with bad export cookie 6712204268829121861
[ 5032.741461] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 5032.747657] LustreError: 13300:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 5032.813136] Lustre: server umount lustre-OST0000 complete
[ 5035.747272] Lustre: server umount lustre-OST0001 complete
[ 5046.198374] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local
[ 5053.671827] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 5057.124814] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5059.556211] Lustre: 107688:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 5064.134232] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 5069.110406] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5075.027863] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 5078.087261] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1091 to 0x280000400:1121)
[ 5078.094103] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1124 to 0x240000400:1153)
[ 5080.171148] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5086.445937] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 5089.107773] Lustre: 109466:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 5108.717578] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 5108.959525] LustreError: 110264:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup
[ 5108.963278] LustreError: 110264:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages
[ 5109.054480] Lustre: server umount lustre-MDT0000 complete
[ 5112.310179] LustreError: 109919:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768255883 with bad export cookie 6712204268829129288
[ 5112.316609] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 5112.328316] LustreError: 109919:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 5112.431662] Lustre: server umount lustre-OST0000 complete
[ 5115.792465] Lustre: server umount lustre-OST0001 complete
[ 5128.108803] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local
[ 5135.391901] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 5138.596617] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5140.643319] Lustre: 112131:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 5145.569223] LustreError: 112449:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 5145.587751] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1124 to 0x240000400:1185)
[ 5149.405630] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5154.416612] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 5154.420385] Lustre: Skipped 1 previous similar message
[ 5156.174728] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1091 to 0x280000400:1153)
[ 5158.725301] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5164.044680] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 5166.419069] Lustre: 113913:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 5178.262806] Lustre: DEBUG MARKER: == sanity-quota test 23: Quota should be honored with directIO (b16125) ========================================================== 17:12:27 (1768255947)
[ 5179.349691] Lustre: DEBUG MARKER: SKIP: sanity-quota test_23 Overwrite in place is not guaranteed to be space neutral on ZFS
[ 5180.741858] Lustre: DEBUG MARKER: == sanity-quota test 24: lfs draws an asterix when limit is reached (b16646) ========================================================== 17:12:30 (1768255950)
[ 5218.749861] Lustre: DEBUG MARKER: == sanity-quota test 25: check indexes versions ========== 17:13:08 (1768255988)
[ 5258.345227] Lustre: DEBUG MARKER: Write...
[ 5260.431983] Lustre: DEBUG MARKER: Write out of block quota ...
[ 5303.552716] Lustre: DEBUG MARKER: == sanity-quota test 27a: lfs quota/setquota should handle wrong arguments (b19612) ========================================================== 17:14:32 (1768256072)
[ 5308.015202] Lustre: DEBUG MARKER: == sanity-quota test 27b: lfs quota/setquota should handle user/group/project ID (b20200) ========================================================== 17:14:37 (1768256077)
[ 5315.276449] Lustre: DEBUG MARKER: == sanity-quota test 27c: lfs quota should support human-readable output ========================================================== 17:14:44 (1768256084)
[ 5321.637769] Lustre: DEBUG MARKER: == sanity-quota test 27d: lfs setquota should support fraction block limit ========================================================== 17:14:51 (1768256091)
[ 5327.355329] Lustre: DEBUG MARKER: == sanity-quota test 30: Hard limit updates should not reset grace times ========================================================== 17:14:56 (1768256096)
[ 5381.607856] Lustre: DEBUG MARKER: == sanity-quota test 33: Basic usage tracking for user
[ 5480.854362] Lustre: DEBUG MARKER: == sanity-quota test 34: Usage transfer for user
[ 5631.325759] Lustre: DEBUG MARKER: == sanity-quota test 35: Usage is still accessible across reboot ========================================================== 17:20:00 (1768256400)
[ 5679.965701] Lustre: DEBUG MARKER: Restart...
[ 5684.711776] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 5684.714704] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 5684.716074] Lustre: Skipped 3 previous similar messages
[ 5684.723680] Lustre: Skipped 2 previous similar messages
[ 5689.826918] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 5689.831234] Lustre: Skipped 1 previous similar message
[ 5690.729654] LustreError: 126602:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup
[ 5690.737075] LustreError: 126602:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages
[ 5690.835260] Lustre: server umount lustre-MDT0000 complete
[ 5694.151721] LustreError: 114552:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768256465 with bad export cookie 6712204268829130814
[ 5694.159880] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 5694.162861] LustreError: 114552:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message
[ 5694.235560] Lustre: server umount lustre-OST0000 complete
[ 5697.628341] Lustre: server umount lustre-OST0001 complete
[ 5709.426508] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local
[ 5716.765539] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 5720.168419] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5722.543544] Lustre: 128464:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 5731.669487] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5741.102111] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1162 to 0x280000400:1185)
[ 5741.107830] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1194 to 0x240000400:1217)
[ 5743.104225] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 5749.739949] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 5753.540511] Lustre: 130260:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 5805.645711] Lustre: DEBUG MARKER: == sanity-quota test 37: Quota accounted properly for file created by 'lfs setstripe' ========================================================== 17:22:54 (1768256574)
[ 5877.000890] Lustre: DEBUG MARKER: == sanity-quota test 38: Quota accounting iterator doesn't skip id entries ========================================================== 17:24:06 (1768256646)
[ 7385.386734] Lustre: DEBUG MARKER: == sanity-quota test 39: Project ID interface works correctly ========================================================== 17:49:13 (1768258153)
[ 7402.976734] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 7402.980278] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 7403.000722] Lustre: Skipped 1 previous similar message
[ 7403.015301] Lustre: Skipped 1 previous similar message
[ 7404.489039] LustreError: 135418:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup
[ 7404.491648] LustreError: 135418:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages
[ 7404.699611] Lustre: server umount lustre-MDT0000 complete
[ 7409.940258] LustreError: 128035:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768258180 with bad export cookie 6712204268829137240
[ 7409.956535] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 7409.963689] LustreError: 128035:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 7410.112779] Lustre: server umount lustre-OST0000 complete
[ 7415.528769] Lustre: server umount lustre-OST0001 complete
[ 7435.531545] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local
[ 7449.072807] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 7449.079135] Lustre: Skipped 2 previous similar messages
[ 7456.405801] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7460.657364] Lustre: 137285:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17
[ 7468.127395] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 7473.190852] LustreError: 137607:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7473.206740] LustreError: 137607:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message
[ 7473.222341] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6219 to 0x240000400:6241)
[ 7477.156883] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7478.241569] LustreError: 137606:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7483.361591] LustreError: 137606:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7488.491398] LustreError: 137606:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7490.087193] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 7491.665047] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6187 to 0x280000400:6209)
[ 7499.314043] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 7508.196335] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 7513.923604] Lustre: 139079:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17
[ 7558.068942] Lustre: DEBUG MARKER: == sanity-quota test 40a: Hard link across different project ID ========================================================== 17:52:07 (1768258327)
[ 7600.274896] Lustre: DEBUG MARKER: == sanity-quota test 40b: Mv across different project ID ========================================================== 17:52:48 (1768258368)
[ 7642.261265] Lustre: DEBUG MARKER: == sanity-quota test 40c: Remote child Dir inherit project quota properly ========================================================== 17:53:30 (1768258410)
[ 7644.231148] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40c needs >= 2 MDTs
[ 7646.356738] Lustre: DEBUG MARKER: == sanity-quota test 40d: Stripe Directory inherit project quota properly ========================================================== 17:53:35 (1768258415)
[ 7648.022597] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40d needs >= 2 MDTs
[ 7650.392958] Lustre: DEBUG MARKER: == sanity-quota test 41: df should return projid-specific values ========================================================== 17:53:38 (1768258418)
[ 7735.213298] Lustre: DEBUG MARKER: == sanity-quota test 42: lfs quota should include default quota info ========================================================== 17:55:03 (1768258503)
[ 7780.903387] Lustre: DEBUG MARKER: == sanity-quota test 48: lfs quota --delete should delete quota project ID ========================================================== 17:55:49 (1768258549)
[ 7868.522960] Lustre: DEBUG MARKER: == sanity-quota test 49a: lfs quota -a prints the quota usage for all quota IDs ========================================================== 17:57:17 (1768258637)
[ 7879.474702] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7879.490535] Lustre: Skipped 3 previous similar messages
[ 7881.528294] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7881.531819] Lustre: Skipped 75 previous similar messages
[ 7885.547307] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7885.552632] Lustre: Skipped 181 previous similar messages
[ 7893.574943] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7893.584725] Lustre: Skipped 339 previous similar messages
[ 7909.577636] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7909.579395] Lustre: Skipped 733 previous similar messages
[ 7941.676437] Lustre: *** cfs_fail_loc=a09, val=0***
[ 7941.683191] Lustre: Skipped 1575 previous similar messages
[ 8005.692836] Lustre: *** cfs_fail_loc=a09, val=0***
[ 8005.696653] Lustre: Skipped 3035 previous similar messages
[ 8427.435948] Lustre: *** cfs_fail_loc=a08, val=0***
[ 8427.449641] Lustre: Skipped 2060 previous similar messages
[ 8427.452089] Lustre: *** cfs_fail_loc=a08, val=0***
[ 8427.467754] Lustre: Skipped 5 previous similar messages
[ 8642.016907] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 8642.019566] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 8642.030877] Lustre: Skipped 1 previous similar message
[ 8642.054414] Lustre: Skipped 1 previous similar message
[ 8645.771203] LustreError: 148021:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup
[ 8645.779415] LustreError: 148021:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages
[ 8646.022126] Lustre: server umount lustre-MDT0000 complete
[ 8650.807456] LustreError: 136858:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768259421 with bad export cookie 6712204268830909171
[ 8650.820503] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 8651.167111] LustreError: 148228:0:(obd_class.h:479:obd_check_dev()) Device 14 not setup
[ 8651.177355] LustreError: 148228:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages
[ 8651.202116] Lustre: server umount lustre-OST0000 complete
[ 8656.300400] Lustre: server umount lustre-OST0001 complete
[ 8663.801236] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid
[ 8671.614552] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local
[ 8681.867670]  vdc: vdc1 vdc9
[ 8694.413098]  vde: vde1 vde9
[ 8694.448589]  vde: vde1 vde9
[ 8694.512923]  vde: vde1 vde9
[ 8708.066911]  vdf: vdf1 vdf9
[ 8729.773879] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local
[ 8740.653600] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000
[ 8741.068941] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space.
[ 8741.244122] Lustre: lustre-MDT0000: new disk, initializing
[ 8741.882960] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 8741.979428] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt
[ 8747.360938] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 8753.206478] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params
[ 8759.548535] Lustre: lustre-OST0000: new disk, initializing
[ 8759.552278] Lustre: srv-lustre-OST0000: No data found on store. Initialize space.
[ 8759.564923] Lustre: Skipped 1 previous similar message
[ 8759.684489] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 8761.626237] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost
[ 8761.634408] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost]
[ 8761.820439] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400
[ 8767.758219] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 8777.493647] Lustre: lustre-OST0001: new disk, initializing
[ 8777.507669] Lustre: srv-lustre-OST0001: No data found on store. Initialize space.
[ 8777.631935] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 8778.644698] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost
[ 8778.653087] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost]
[ 8778.788928] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400
[ 8785.056094] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 8796.107226] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 8800.023317] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params
[ 8838.118763] Lustre: DEBUG MARKER: == sanity-quota test 49b: lfs quota -a --blocks has a delimiter ========================================================== 18:13:27 (1768259607)
[ 8845.036494] Lustre: DEBUG MARKER: == sanity-quota test 50: Test if lfs find --projid works ========================================================== 18:13:33 (1768259613)
[ 8891.011459] Lustre: DEBUG MARKER: == sanity-quota test 51: Test project accounting with mv/cp ========================================================== 18:14:20 (1768259660)
[ 8946.994117] Lustre: DEBUG MARKER: == sanity-quota test 52: Rename normal file across project ID ========================================================== 18:15:15 (1768259715)
[ 8972.134735] Lustre: DEBUG MARKER: rename directory return 255
[ 9011.153088] Lustre: DEBUG MARKER: == sanity-quota test 53: Project inherit attribute could be cleared ========================================================== 18:16:19 (1768259779)
[ 9039.309762] Lustre: DEBUG MARKER: == sanity-quota test 54: basic lfs project interface test ========================================================== 18:16:48 (1768259808)
[ 9085.079264] Lustre: DEBUG MARKER: == sanity-quota test 55: Chgrp should be affected by group quota ========================================================== 18:17:33 (1768259853)
[ 9185.852640] LustreError: 159181:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:dt-0x0 id:60001 enforced:1 hard:51200 soft:0 granted:51200 time:0 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 9224.734044] Lustre: DEBUG MARKER: == sanity-quota test 56: lfs quota -t should work well === 18:19:53 (1768259993)
[ 9260.834382] Lustre: DEBUG MARKER: == sanity-quota test 57: lfs project could tolerate errors ========================================================== 18:20:30 (1768260030)
[ 9304.782341] Lustre: DEBUG MARKER: == sanity-quota test 58: project ID should be kept for new mirrors created by FID ========================================================== 18:21:13 (1768260073)
[ 9486.000249] Lustre: DEBUG MARKER: == sanity-quota test 59: lfs project dosen't crash kernel with project disabled ========================================================== 18:24:14 (1768260254)
[ 9488.599543] Lustre: DEBUG MARKER: SKIP: sanity-quota test_59 ldiskfs only test
[ 9490.887726] Lustre: DEBUG MARKER: == sanity-quota test 60: Test quota for root with setgid ========================================================== 18:24:19 (1768260259)
[ 9547.879733] Lustre: DEBUG MARKER: SKIP: sanity-quota test_61 skipping SLOW test 61
[ 9549.355795] Lustre: DEBUG MARKER: == sanity-quota test 62: Project inherit should be only changed by root ========================================================== 18:25:18 (1768260318)
[ 9577.818332] Lustre: DEBUG MARKER: SKIP: sanity-quota test_63 skipping excluded test 63
[ 9579.472569] Lustre: DEBUG MARKER: == sanity-quota test 64: lfs project on non-dir/files should succeed ========================================================== 18:25:48 (1768260348)
[ 9624.543611] Lustre: DEBUG MARKER: SKIP: sanity-quota test_65 skipping excluded test 65
[ 9626.265343] Lustre: DEBUG MARKER: == sanity-quota test 66: nonroot user can not change project state in default ========================================================== 18:26:35 (1768260395)
[ 9670.809445] Lustre: DEBUG MARKER: == sanity-quota test 67: quota pools recalculation ======= 18:27:19 (1768260439)
[ 9672.297730] Lustre: DEBUG MARKER: SKIP: sanity-quota test_67 ZFS grants some block space together with inode
[ 9673.681372] Lustre: DEBUG MARKER: == sanity-quota test 68: slave number in quota pool changed after each add/remove OST ========================================================== 18:27:23 (1768260443)
[ 9705.115570] LustreError: 169451:0:(mgs_handler.c:1064:mgs_iocontrol_pool()) OBD_IOC_POOL err -17, cmd CE021 for pool lustre.qpool1
[ 9752.028928] Lustre: DEBUG MARKER: == sanity-quota test 69: EDQUOT at one of pools shouldn't affect DOM ========================================================== 18:28:40 (1768260520)
[ 9779.878752] Lustre: DEBUG MARKER: User quota (block hardlimit:200 MB)
[ 9782.543205] Lustre: DEBUG MARKER: User quota (block hardlimit:10 MB)
[ 9991.806522] Lustre: DEBUG MARKER: == sanity-quota test 70a: check lfs setquota/quota with a pool option ========================================================== 18:32:40 (1768260760)
[10041.000669] Lustre: DEBUG MARKER: == sanity-quota test 70b: lfs setquota pool works properly ========================================================== 18:33:30 (1768260810)
[10071.287716] Lustre: DEBUG MARKER: == sanity-quota test 71a: Check PFL with quota pools ===== 18:34:00 (1768260840)
[10072.691908] Lustre: DEBUG MARKER: SKIP: sanity-quota test_71a ZFS grants some block space together with inode
[10074.308339] Lustre: DEBUG MARKER: == sanity-quota test 71b: Check SEL with quota pools ===== 18:34:03 (1768260843)
[10075.537536] Lustre: DEBUG MARKER: SKIP: sanity-quota test_71b ZFS grants some block space together with inode
[10076.818992] Lustre: DEBUG MARKER: == sanity-quota test 72: lfs quota --pool prints only pool's OSTs ========================================================== 18:34:06 (1768260846)
[10094.260939] Lustre: DEBUG MARKER: User quota (block hardlimit:50 MB)
[10108.415611] Lustre: DEBUG MARKER: Write...
[10110.676944] Lustre: DEBUG MARKER: Write out of block quota ...
[10160.915485] Lustre: DEBUG MARKER: == sanity-quota test 73a: default limits at OST Pool Quotas ========================================================== 18:35:29 (1768260929)
[10187.374540] Lustre: DEBUG MARKER: set to use default quota
[10189.343854] Lustre: DEBUG MARKER: set default quota
[10191.332837] Lustre: DEBUG MARKER: get default quota
[10196.000984] Lustre: DEBUG MARKER: Test not out of quota
[10200.097792] Lustre: DEBUG MARKER: Test out of quota
[10211.095120] Lustre: DEBUG MARKER: Increase default quota
[10228.994823] Lustre: DEBUG MARKER: Set quota to override default quota
[10229.045937] LustreError: 151327:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:dt-qpool1 id:60000 enforced:1 hard:20480 soft:20480 granted:45063 time:1768865800 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[10239.344498] Lustre: DEBUG MARKER: Set to use default quota again
[10261.560807] Lustre: DEBUG MARKER: Cleanup
[10330.639543] Lustre: DEBUG MARKER: == sanity-quota test 73b: default OST Pool Quotas limit for new user ========================================================== 18:38:19 (1768261099)
[10356.045366] Lustre: DEBUG MARKER: set default quota for qpool1
[10357.782282] Lustre: DEBUG MARKER: Write from user that hasn't lqe
[10404.028309] Lustre: DEBUG MARKER: == sanity-quota test 74: check quota pools per user ====== 18:39:33 (1768261173)
[10485.705891] Lustre: DEBUG MARKER: == sanity-quota test 75: nodemap squashed root respects quota enforcement ========================================================== 18:40:54 (1768261254)
[10558.854762] Lustre: DEBUG MARKER: Write...
[10562.684468] Lustre: DEBUG MARKER: Write out of block quota ...
[10678.316968] Lustre: DEBUG MARKER: == sanity-quota test 76: project ID 4294967295 should be not allowed ========================================================== 18:44:07 (1768261447)
[10719.012257] Lustre: DEBUG MARKER: == sanity-quota test 77: lfs setquota should fail in Lustre mount with 'ro' ========================================================== 18:44:47 (1768261487)
[10726.937112] Lustre: DEBUG MARKER: == sanity-quota test 78A: Check fallocate increase quota usage ========================================================== 18:44:55 (1768261495)
[10728.929555] Lustre: DEBUG MARKER: SKIP: sanity-quota test_78A need >= 2.13.57 and ldiskfs for fallocate
[10730.692775] Lustre: DEBUG MARKER: == sanity-quota test 78a: Check fallocate increase projectid usage ========================================================== 18:44:59 (1768261499)
[10733.053551] Lustre: DEBUG MARKER: SKIP: sanity-quota test_78a need >= 2.13.57 and ldiskfs for fallocate
[10735.252721] Lustre: DEBUG MARKER: == sanity-quota test 79: access to non-existed dt-pool/info doesn't cause a panic ========================================================== 18:45:03 (1768261503)
[10763.928709] Lustre: DEBUG MARKER: == sanity-quota test 80: check for EDQUOT after OST failover ========================================================== 18:45:32 (1768261532)
[10765.510679] Lustre: DEBUG MARKER: SKIP: sanity-quota test_80 ZFS grants some block space together with inode
[10767.116785] Lustre: DEBUG MARKER: == sanity-quota test 81: Race qmt_start_pool_recalc with qmt_pool_free ========================================================== 18:45:36 (1768261536)
[10784.979822] Lustre: DEBUG MARKER: User quota (block hardlimit:20 MB)
[10792.113288] LustreError: 190146:0:(qmt_pool.c:1295:qmt_pool_recalc()) cfs_fail_timeout id a07 sleeping for 10000ms
[10792.124796] LustreError: 190146:0:(qmt_pool.c:1295:qmt_pool_recalc()) Skipped 4 previous similar messages
[10796.741038] Lustre: lustre-MDT0000: Not available for connect from 192.168.203.48@tcp (stopping)
[10797.025232] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[10801.839718] Lustre: lustre-MDT0000: Not available for connect from 192.168.203.48@tcp (stopping)
[10801.849371] Lustre: Skipped 2 previous similar messages
[10802.191100] LustreError: 190146:0:(qmt_pool.c:1295:qmt_pool_recalc()) cfs_fail_timeout id a07 awake
[10802.493233] LustreError: 190245:0:(obd_class.h:479:obd_check_dev()) Device 17 not setup
[10802.502303] LustreError: 190245:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages
[10802.622214] Lustre: server umount lustre-MDT0000 complete
[10811.042882] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[10811.693439] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[10811.803473] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:27 to 0x280000400:65)
[10811.826891] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:27 to 0x240000400:65)
[10815.987323] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[10828.001541] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo)
[10828.012477] Lustre: Skipped 3 previous similar messages
[10852.906471] Lustre: DEBUG MARKER: == sanity-quota test 82: verify more than 8 qids for single operation ========================================================== 18:47:01 (1768261621)
[10881.948822] Lustre: DEBUG MARKER: == sanity-quota test 83: Setting default quota shouldn't affect grace time ========================================================== 18:47:30 (1768261650)
[10911.305650] Lustre: DEBUG MARKER: == sanity-quota test 84: Reset quota should fix the insane granted quota ========================================================== 18:48:00 (1768261680)
[10955.797987] Lustre: *** cfs_fail_loc=a08, val=0***
[10955.803606] Lustre: Skipped 7 previous similar messages
[10955.817662] Lustre: *** cfs_fail_loc=a08, val=0***
[10955.820063] Lustre: Skipped 10 previous similar messages
[11059.603927] Lustre: DEBUG MARKER: == sanity-quota test 85: do not hung at write with the least_qunit ========================================================== 18:50:28 (1768261828)
[11144.598851] Lustre: DEBUG MARKER: == sanity-quota test 86: Pre-acquired quota should be released if quota is over limit ========================================================== 18:51:53 (1768261913)
[11209.830598] LustreError: 190685:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:60000 enforced:1 hard:2048 soft:2048 granted:65536 time:1768866780 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[11352.315915] LustreError: 190684:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:md-0x0 id:60000 enforced:1 hard:2048 soft:2048 granted:65536 time:1768866923 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[11361.046959] Lustre: DEBUG MARKER: sanity-quota test_86: @@@@@@ FAIL: succeed to create files, expect failed