== sanity-quota test 7e: Quota reintegration (inode limits) ========================================================== 09:16:05 (1747401365)
Waiting for MDT destroys to complete
Creating test directory
fail_val=0
fail_loc=0
Waiting 90s for 'none'
Stop mds2...
Stopping /mnt/lustre-mds2 (opts:) on oleg324-server
Enable quota & set quota limit for quota_usr
Waiting 90s for 'ugp'
Updated after 3s: want 'ugp' got 'ugp'
Start mds2...
Starting mds2: -o localrecov  /dev/mapper/mds2_flakey /mnt/lustre-mds2
oleg324-server: oleg324-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8
pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1
Started lustre-MDT0001
affected facets: mds1
oleg324-server: oleg324-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475
oleg324-server: *.lustre-MDT0000.recovery_status status: COMPLETE
affected facets: mds2
oleg324-server: oleg324-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475
oleg324-server: *.lustre-MDT0001.recovery_status status: RECOVERING
oleg324-server: Waiting 1470 secs for *.lustre-MDT0001.recovery_status recovery done. status: RECOVERING
oleg324-server: *.lustre-MDT0001.recovery_status status: COMPLETE
affected facets: mds1
oleg324-server: oleg324-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475
oleg324-server: *.lustre-MDT0000.recovery_status status: COMPLETE
affected facets: mds2
oleg324-server: oleg324-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475
oleg324-server: *.lustre-MDT0001.recovery_status status: COMPLETE
affected facets: mds1
oleg324-server: oleg324-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475
oleg324-server: *.lustre-MDT0000.recovery_status status: COMPLETE
affected facets: mds2
oleg324-server: oleg324-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475
oleg324-server: *.lustre-MDT0001.recovery_status status: COMPLETE
create remote dir
running as uid/gid/euid/egid 60000/60000/60000/60000, groups:
 [createmany] [-m] [/mnt/lustre/d7e.sanity-quota-1/f7e.sanity-quota] [2049]
 - create 1782 (time 1747401405.37 total 10.00 last 178.15)
mknod(/mnt/lustre/d7e.sanity-quota-1/f7e.sanity-quota2048) error: Disk quota exceeded
total: 2048 create in 11.25 seconds: 182.10 ops/second
running as uid/gid/euid/egid 60000/60000/60000/60000, groups:
 [unlinkmany] [/mnt/lustre/d7e.sanity-quota-1/f7e.sanity-quota] [2048]
 - unlinked 0 (time 1747401406 ; total 0 ; last 0)
total: 2048 unlinks in 13 seconds: 157.538467 unlinks/second
Waiting for MDT destroys to complete
Stop mds2...
Stopping /mnt/lustre-mds2 (opts:) on oleg324-server
Start mds2...
Starting mds2: -o localrecov  /dev/mapper/mds2_flakey /mnt/lustre-mds2
oleg324-server: oleg324-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8
pdsh@oleg324-client: oleg324-server: ssh exited with exit code 1
Started lustre-MDT0001
affected facets: mds1
oleg324-server: oleg324-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475
oleg324-server: *.lustre-MDT0000.recovery_status status: COMPLETE
affected facets: mds2
oleg324-server: oleg324-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475
oleg324-server: *.lustre-MDT0001.recovery_status status: RECOVERING
oleg324-server: Waiting 1470 secs for *.lustre-MDT0001.recovery_status recovery done. status: RECOVERING
oleg324-server: *.lustre-MDT0001.recovery_status status: COMPLETE
affected facets: mds1
oleg324-server: oleg324-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475
oleg324-server: *.lustre-MDT0000.recovery_status status: COMPLETE
affected facets: mds2
oleg324-server: oleg324-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475
oleg324-server: *.lustre-MDT0001.recovery_status status: COMPLETE
affected facets: mds1
oleg324-server: oleg324-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475
oleg324-server: *.lustre-MDT0000.recovery_status status: COMPLETE
affected facets: mds2
oleg324-server: oleg324-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475
oleg324-server: *.lustre-MDT0001.recovery_status status: COMPLETE
running as uid/gid/euid/egid 60000/60000/60000/60000, groups:
 [createmany] [-m] [/mnt/lustre/d7e.sanity-quota-1/f7e.sanity-quota] [2049]
 - create 1789 (time 1747401448.99 total 10.00 last 178.82)
total: 2049 create in 11.37 seconds: 180.17 ops/second
running as uid/gid/euid/egid 60000/60000/60000/60000, groups:
 [unlinkmany] [/mnt/lustre/d7e.sanity-quota-1/f7e.sanity-quota] [2049]
 - unlinked 0 (time 1747401450 ; total 0 ; last 0)
total: 2049 unlinks in 13 seconds: 157.615387 unlinks/second
Delete files...
Wait for unlink objects finished...
Waiting for MDT destroys to complete