[ 2916.615949] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 2918.209683] Lustre: DEBUG MARKER: Write 100M (buffered) ...
[ 2919.169454] LustreError: 20042:0:(osd_handler.c:698:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 2919.470798] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 2919.905079] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 2920.546664] Lustre: Failing over lustre-MDT0000
[ 2920.673599] LustreError: lustre-MDT0000-lwp-OST0000: operation quota_acquire to node 0@lo failed: rc = -107
[ 2920.676134] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 2920.716548] Lustre: server umount lustre-MDT0000 complete
[ 2933.139596] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 2933.339437] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 2933.369350] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 2934.465637] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 2935.329095] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to  (at 0@lo)
[ 2936.486295] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 2936.527371] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 2936.555383] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1249 to 0x280000400:1281)
[ 2936.555419] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1253 to 0x240000400:1281)
[ 2937.674226] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 2938.222192] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 2941.334885] Lustre: 3297:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1738969365/real 1738969365]  req@ffff8800a46c5500 x1823438511349248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1738969381 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0
[ 2941.348490] Lustre: 3297:0:(client.c:2346:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 2946.332894] Lustre: 3295:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1738969371/real 1738969371]  req@ffff8800a46c7800 x1823438511350272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1738969387 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0
[ 2948.582614] LustreError: 20516:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-OST0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 2948.589027] LustreError: 20516:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 6 previous similar messages
[ 2959.020837] Lustre: DEBUG MARKER: (dd_pid=4572, time=18, timeout=600)
[ 2986.237470] Lustre: DEBUG MARKER: User quota (limit: 200)
[ 2987.634844] Lustre: DEBUG MARKER: Write 100M (directio) ...
[ 2988.694591] LustreError: 24463:0:(osd_handler.c:698:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only ***
[ 2989.024638] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
[ 2989.550971] Lustre: DEBUG MARKER: Fail mds for 40 seconds
[ 2990.243393] Lustre: Failing over lustre-MDT0000
[ 2990.420323] Lustre: server umount lustre-MDT0000 complete
[ 3002.858497] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3003.058948] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3003.084411] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect
[ 3004.053175] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3006.024860] Lustre: 3297:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1738969431/real 1738969431]  req@ffff880131a90a80 x1823438511381632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1738969447 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0
[ 3006.066253] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects
[ 3006.108904] Lustre: lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted.
[ 3006.135601] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1249 to 0x280000400:1313)
[ 3006.135625] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1283 to 0x240000400:1313)
[ 3007.267718] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
[ 3007.843070] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
[ 3011.030881] Lustre: 3296:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1738969436/real 1738969436]  req@ffff880131a93b80 x1823438511382016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1738969452 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0
[ 3011.045138] Lustre: 3296:0:(client.c:2346:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 3015.405766] Lustre: DEBUG MARKER: (dd_pid=6981, time=5, timeout=600)
[ 3016.070864] Lustre: 3297:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1738969441/real 1738969441]  req@ffff880131a93480 x1823438511382528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1738969457 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0
[ 3016.085149] Lustre: 3297:0:(client.c:2346:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 3054.062384] Lustre: DEBUG MARKER: == sanity-quota test 19: Updating admin limits doesn't zero operational limits(b14790) ========================================================== 18:04:53 (1738969493)
[ 3062.103432] LustreError: 30151:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:1 until pending updates are flushed.
[ 3062.118243] LustreError: 30151:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 1 previous similar message
[ 3064.884163] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 3065.443196] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 3066.738824] Lustre: DEBUG MARKER: Files for user (quota_usr), count=1:
[ 3067.305236] Lustre: DEBUG MARKER: Block quota isn't 0 (u:quota_usr:2).
[ 3086.020091] Lustre: DEBUG MARKER: == sanity-quota test 20: Test if setquota specifiers work properly (b15754) ========================================================== 18:05:25 (1738969525)
[ 3094.129122] Lustre: DEBUG MARKER: == sanity-quota test 21: Setquota while writing
[ 3102.593986] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for user: quota_usr
[ 3103.138868] Lustre: DEBUG MARKER: Set limit(block:10G; file:1000000) for group: quota_usr
[ 3103.653526] Lustre: DEBUG MARKER: Set limit(block:10G; file:) for project: 1000
[ 3104.133008] Lustre: DEBUG MARKER: Set quota for 1 times
[ 3105.627169] Lustre: DEBUG MARKER: Set quota for 2 times
[ 3107.113216] Lustre: DEBUG MARKER: Set quota for 3 times
[ 3108.606269] Lustre: DEBUG MARKER: Set quota for 4 times
[ 3110.097940] Lustre: DEBUG MARKER: Set quota for 5 times
[ 3111.595593] Lustre: DEBUG MARKER: Set quota for 6 times
[ 3113.085444] Lustre: DEBUG MARKER: Set quota for 7 times
[ 3114.579190] Lustre: DEBUG MARKER: Set quota for 8 times
[ 3116.055003] Lustre: DEBUG MARKER: Set quota for 9 times
[ 3117.503975] Lustre: DEBUG MARKER: Set quota for 10 times
[ 3118.990560] Lustre: DEBUG MARKER: Set quota for 11 times
[ 3120.434473] Lustre: DEBUG MARKER: Set quota for 12 times
[ 3121.800236] Lustre: DEBUG MARKER: Set quota for 13 times
[ 3123.175273] Lustre: DEBUG MARKER: Set quota for 14 times
[ 3124.558390] Lustre: DEBUG MARKER: Set quota for 15 times
[ 3125.951850] Lustre: DEBUG MARKER: Set quota for 16 times
[ 3127.317032] Lustre: DEBUG MARKER: Set quota for 17 times
[ 3128.721524] Lustre: DEBUG MARKER: Set quota for 18 times
[ 3130.110246] Lustre: DEBUG MARKER: Set quota for 19 times
[ 3131.493801] Lustre: DEBUG MARKER: Set quota for 20 times
[ 3132.907756] Lustre: DEBUG MARKER: Set quota for 21 times
[ 3157.510765] Lustre: DEBUG MARKER: == sanity-quota test 22: enable/disable quota by 'lctl conf_param/set_param -P' ========================================================== 18:06:37 (1738969597)
[ 3163.311277] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 3163.311550] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 3163.321784] Lustre: Skipped 4 previous similar messages
[ 3168.319563] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 3168.325863] Lustre: Skipped 2 previous similar messages
[ 3168.388986] Lustre: server umount lustre-MDT0000 complete
[ 3169.696656] LustreError: 7052:0:(ldlm_lockd.c:2591:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1738969611 with bad export cookie 3027581365945214901
[ 3169.698281] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3169.711579] LustreError: 7052:0:(ldlm_lockd.c:2591:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 3169.735369] Lustre: server umount lustre-OST0000 complete
[ 3171.205668] Lustre: server umount lustre-OST0001 complete
[ 3175.409794] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local
[ 3178.219906] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3179.360069] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3180.449057] Lustre: Modifying parameter general.debug_raw_pointers in log params
[ 3182.350445] Lustre: 10077:0:(mgc_request_server.c:553:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 3182.471414] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180
[ 3184.194353] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3186.689259] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180
[ 3188.379424] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3188.679042] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1315 to 0x280000400:1345)
[ 3188.679061] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1316 to 0x240000400:1345)
[ 3191.377027] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 3192.621852] Lustre: Modifying parameter general.lod.*.mdt_hash in log params
[ 3208.719508] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 3208.725760] Lustre: Skipped 1 previous similar message
[ 3210.876769] Lustre: server umount lustre-MDT0000 complete
[ 3212.342658] LustreError: 9068:0:(ldlm_lockd.c:2591:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1738969653 with bad export cookie 3027581365945239310
[ 3212.344009] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3212.353615] LustreError: 9068:0:(ldlm_lockd.c:2591:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 3212.377456] Lustre: server umount lustre-OST0000 complete
[ 3213.866234] Lustre: server umount lustre-OST0001 complete
[ 3218.028890] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local
[ 3220.743802] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3221.847338] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3222.916784] Lustre: Modifying parameter general.debug_raw_pointers in log params
[ 3224.731322] Lustre: 16201:0:(mgc_request_server.c:553:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 3224.737756] Lustre: 16201:0:(mgc_request_server.c:553:mgc_llog_local_copy()) Skipped 1 previous similar message
[ 3226.653263] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3231.012638] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3231.241811] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1316 to 0x240000400:1377)
[ 3231.242556] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1315 to 0x280000400:1377)
[ 3234.232521] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 3235.515695] Lustre: Modifying parameter general.lod.*.mdt_hash in log params
[ 3243.811621] Lustre: DEBUG MARKER: == sanity-quota test 23: Quota should be honored with directIO (b16125) ========================================================== 18:08:03 (1738969683)
[ 3244.289263] Lustre: DEBUG MARKER: SKIP: sanity-quota test_23 Overwrite in place is not guaranteed to be space neutral on ZFS
[ 3244.804694] Lustre: DEBUG MARKER: == sanity-quota test 24: lfs draws an asterix when limit is reached (b16646) ========================================================== 18:08:04 (1738969684)
[ 3275.333082] Lustre: DEBUG MARKER: == sanity-quota test 25: check indexes versions ========== 18:08:35 (1738969715)
[ 3295.554587] Lustre: DEBUG MARKER: Write...
[ 3296.391211] Lustre: DEBUG MARKER: Write out of block quota ...
[ 3335.128153] Lustre: DEBUG MARKER: == sanity-quota test 27a: lfs quota/setquota should handle wrong arguments (b19612) ========================================================== 18:09:34 (1738969774)
[ 3337.270274] Lustre: DEBUG MARKER: == sanity-quota test 27b: lfs quota/setquota should handle user/group/project ID (b20200) ========================================================== 18:09:37 (1738969777)
[ 3341.740939] Lustre: DEBUG MARKER: == sanity-quota test 27c: lfs quota should support human-readable output ========================================================== 18:09:41 (1738969781)
[ 3345.252403] Lustre: DEBUG MARKER: == sanity-quota test 27d: lfs setquota should support fraction block limit ========================================================== 18:09:45 (1738969785)
[ 3348.529764] Lustre: DEBUG MARKER: == sanity-quota test 30: Hard limit updates should not reset grace times ========================================================== 18:09:48 (1738969788)
[ 3390.579024] Lustre: DEBUG MARKER: == sanity-quota test 33: Basic usage tracking for user
[ 3460.539375] Lustre: DEBUG MARKER: == sanity-quota test 34: Usage transfer for user
[ 3570.105438] Lustre: DEBUG MARKER: == sanity-quota test 35: Usage is still accessible across reboot ========================================================== 18:13:29 (1738970009)
[ 3598.957486] Lustre: DEBUG MARKER: Restart...
[ 3601.839459] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
[ 3601.840044] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
[ 3601.849240] Lustre: Skipped 3 previous similar messages
[ 3606.013412] Lustre: server umount lustre-MDT0000 complete
[ 3607.423884] LustreError: 21055:0:(ldlm_lockd.c:2591:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1738970048 with bad export cookie 3027581365945240843
[ 3607.425988] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 3607.438015] LustreError: 21055:0:(ldlm_lockd.c:2591:ldlm_cancel_handler()) Skipped 2 previous similar messages
[ 3607.461598] Lustre: server umount lustre-OST0000 complete
[ 3609.018183] Lustre: server umount lustre-OST0001 complete
[ 3613.169893] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local
[ 3615.905421] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 3615.909286] Lustre: Skipped 2 previous similar messages
[ 3617.054941] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3618.105854] Lustre: Modifying parameter general.debug_raw_pointers in log params
[ 3619.938340] Lustre: 12791:0:(mgc_request_server.c:553:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 3619.944557] Lustre: 12791:0:(mgc_request_server.c:553:mgc_llog_local_copy()) Skipped 1 previous similar message
[ 3621.849708] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3626.217326] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 3626.444800] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1387 to 0x240000400:1409)
[ 3626.446381] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1385 to 0x280000400:1409)
[ 3629.353210] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 3630.554030] Lustre: Modifying parameter general.lod.*.mdt_hash in log params
[ 3665.730193] Lustre: DEBUG MARKER: == sanity-quota test 37: Quota accounted properly for file created by 'lfs setstripe' ========================================================== 18:15:05 (1738970105)
[ 3715.581228] Lustre: DEBUG MARKER: == sanity-quota test 38: Quota accounting iterator doesn't skip id entries ========================================================== 18:15:55 (1738970155)
[ 4196.915813] Lustre: DEBUG MARKER: == sanity-quota test 39: Project ID interface works correctly ========================================================== 18:23:56 (1738970636)
[ 4206.401094] Lustre: server umount lustre-MDT0000 complete
[ 4207.866897] LustreError: 14876:0:(ldlm_lockd.c:2591:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1738970649 with bad export cookie 3027581365945247136
[ 4207.874024] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail
[ 4217.909172] Lustre: server umount lustre-OST0000 complete
[ 4229.427553] Lustre: server umount lustre-OST0001 complete
[ 4233.610152] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local
[ 4236.320353] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
[ 4236.324751] Lustre: Skipped 2 previous similar messages
[ 4237.449793] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4238.478150] Lustre: Modifying parameter general.debug_raw_pointers in log params
[ 4240.305585] Lustre: 32291:0:(mgc_request_server.c:553:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config
[ 4240.311904] Lustre: 32291:0:(mgc_request_server.c:553:mgc_llog_local_copy()) Skipped 1 previous similar message
[ 4242.175235] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4245.797021] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6412 to 0x240000400:6433)
[ 4245.797889] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6410 to 0x280000400:6433)
[ 4246.599970] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
[ 4249.760038] Lustre: DEBUG MARKER: Using TIMEOUT=20
[ 4274.660706] Lustre: DEBUG MARKER: == sanity-quota test 40a: Hard link across different project ID ========================================================== 18:25:14 (1738970714)
[ 4305.282838] Lustre: DEBUG MARKER: == sanity-quota test 40b: Mv across different project ID ========================================================== 18:25:45 (1738970745)
[ 4334.466330] Lustre: DEBUG MARKER: == sanity-quota test 40c: Remote child Dir inherit project quota properly ========================================================== 18:26:14 (1738970774)
[ 4334.975137] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40c needs >= 2 MDTs
[ 4335.560761] Lustre: DEBUG MARKER: == sanity-quota test 40d: Stripe Directory inherit project quota properly ========================================================== 18:26:15 (1738970775)
[ 4336.081772] Lustre: DEBUG MARKER: SKIP: sanity-quota test_40d needs >= 2 MDTs
[ 4336.671072] Lustre: DEBUG MARKER: == sanity-quota test 41: df should return projid-specific values ========================================================== 18:26:16 (1738970776)
[ 4345.140123] LustreError: 6301:0:(qsd_reint.c:617:qqi_reint_delayed()) lustre-MDT0000: Delaying reintegration for qtype:0 until pending updates are flushed.
[ 4345.147930] LustreError: 6301:0:(qsd_reint.c:617:qqi_reint_delayed()) Skipped 3 previous similar messages
[ 4371.942695] Lustre: DEBUG MARKER: == sanity-quota test 42: lfs quota should include default quota info ========================================================== 18:26:51 (1738970811)
[ 4396.585360] Lustre: DEBUG MARKER: == sanity-quota test 48: lfs quota --delete should delete quota project ID ========================================================== 18:27:16 (1738970836)
[ 4454.301764] Lustre: DEBUG MARKER: SKIP: sanity-quota test_49 skipping ALWAYS excluded test 49
[ 4454.870552] Lustre: DEBUG MARKER: == sanity-quota test 50: Test if lfs find --projid works ========================================================== 18:28:14 (1738970894)
[ 4484.912167] Lustre: DEBUG MARKER: == sanity-quota test 51: Test project accounting with mv/cp ========================================================== 18:28:44 (1738970924)
[ 4514.879052] Lustre: DEBUG MARKER: == sanity-quota test 52: Rename normal file across project ID ========================================================== 18:29:14 (1738970954)
[ 4528.313381] Lustre: DEBUG MARKER: rename directory return 255
[ 4528.818656] LustreError: 32355:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:dt-0x0 id:1001 enforced:1 hard:81920 soft:0 granted:81920 time:0 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 4554.576140] Lustre: DEBUG MARKER: == sanity-quota test 53: Project inherit attribute could be cleared ========================================================== 18:29:54 (1738970994)
[ 4570.872485] Lustre: DEBUG MARKER: == sanity-quota test 54: basic lfs project interface test ========================================================== 18:30:10 (1738971010)
[ 4594.659308] Lustre: DEBUG MARKER: == sanity-quota test 55: Chgrp should be affected by group quota ========================================================== 18:30:34 (1738971034)
[ 4617.953517] LustreError: 32355:0:(qmt_entry.c:552:qmt_adjust_edquot()) $$$ set revoke_time explicitly  qmt:lustre-QMT0000 pool:dt-0x0 id:60001 enforced:1 hard:51200 soft:0 granted:51200 time:0 qunit: 1024 edquot:0 may_rel:0 revoke:0 default:no
[ 4639.405813] Lustre: DEBUG MARKER: == sanity-quota test 56: lfs quota -t should work well === 18:31:19 (1738971079)
[ 4657.240069] Lustre: DEBUG MARKER: == sanity-quota test 57: lfs project could tolerate errors ========================================================== 18:31:37 (1738971097)
[ 4684.882889] Lustre: DEBUG MARKER: == sanity-quota test 58: project ID should be kept for new mirrors created by FID ========================================================== 18:32:04 (1738971124)
[ 4755.157492] Lustre: DEBUG MARKER: == sanity-quota test 59: lfs project dosen't crash kernel with project disabled ========================================================== 18:33:14 (1738971194)
[ 4755.689133] Lustre: DEBUG MARKER: SKIP: sanity-quota test_59 ldiskfs only test
[ 4756.283558] Lustre: DEBUG MARKER: == sanity-quota test 60: Test quota for root with setgid ========================================================== 18:33:16 (1738971196)
[ 4790.562053] Lustre: DEBUG MARKER: SKIP: sanity-quota test_61 skipping SLOW test 61
[ 4791.088891] Lustre: DEBUG MARKER: == sanity-quota test 62: Project inherit should be only changed by root ========================================================== 18:33:50 (1738971230)
[ 4807.541439] Lustre: DEBUG MARKER: SKIP: sanity-quota test_63 skipping excluded test 63
[ 4808.106621] Lustre: DEBUG MARKER: == sanity-quota test 64: lfs project on non dir/files should succeed ========================================================== 18:34:07 (1738971247)
[ 4835.103969] Lustre: DEBUG MARKER: SKIP: sanity-quota test_65 skipping excluded test 65
[ 4835.672888] Lustre: DEBUG MARKER: == sanity-quota test 66: nonroot user can not change project state in default ========================================================== 18:34:35 (1738971275)
[ 4865.269001] Lustre: DEBUG MARKER: == sanity-quota test 67: quota pools recalculation ======= 18:35:05 (1738971305)
[ 4865.793973] Lustre: DEBUG MARKER: SKIP: sanity-quota test_67 ZFS grants some block space together with inode
[ 4866.402613] Lustre: DEBUG MARKER: == sanity-quota test 68: slave number in quota pool changed after each add/remove OST ========================================================== 18:35:06 (1738971306)
[ 4881.398357] LustreError: 11930:0:(mgs_handler.c:844:mgs_iocontrol_pool()) OBD_IOC_POOL err -17, cmd CE021 for pool lustre.qpool1
[ 4883.659942] Lustre: DEBUG MARKER: sanity-quota test_68: @@@@@@ FAIL: Slave number 1 for qpool1 != 2