== sanity-quota test 7a: Quota reintegration (global index) ========================================================== 09:28:56 (1761312536)
Waiting for MDT destroys to complete
Creating test directory
fail_val=0
fail_loc=0
Stop ost1...
Stopping /mnt/lustre-ost1 (opts:) on oleg360-server
Enable quota & set quota limit for quota_usr
Start ost1...
Starting ost1: -o localrecov  /dev/mapper/ost1_flakey /mnt/lustre-ost1
oleg360-server: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8
pdsh@oleg360-client: oleg360-server: ssh exited with exit code 1
Started lustre-OST0000
affected facets: ost1
oleg360-server: oleg360-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg360-server: *.lustre-OST0000.recovery_status status: COMPLETE
affected facets: ost2
oleg360-server: oleg360-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg360-server: *.lustre-OST0001.recovery_status status: INACTIVE
affected facets: ost1
oleg360-server: oleg360-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg360-server: *.lustre-OST0000.recovery_status status: COMPLETE
affected facets: ost2
oleg360-server: oleg360-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg360-server: *.lustre-OST0001.recovery_status status: INACTIVE
affected facets: ost1
oleg360-server: oleg360-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg360-server: *.lustre-OST0000.recovery_status status: COMPLETE
affected facets: ost2
oleg360-server: oleg360-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg360-server: *.lustre-OST0001.recovery_status status: INACTIVE
running as uid/gid/euid/egid 60000/60000/60000/60000, groups:
 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d7a.sanity-quota/f7a.sanity-quota] [count=6] [oflag=sync]
dd: error writing '/mnt/lustre/d7a.sanity-quota/f7a.sanity-quota': Disk quota exceeded
5+0 records in
4+0 records out
5234688 bytes (5.2 MB, 5.0 MiB) copied, 3.93737 s, 1.3 MB/s
Waiting for MDT destroys to complete
Stop ost1...
Stopping /mnt/lustre-ost1 (opts:) on oleg360-server
Start ost1...
Starting ost1: -o localrecov  /dev/mapper/ost1_flakey /mnt/lustre-ost1
oleg360-server: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8
pdsh@oleg360-client: oleg360-server: ssh exited with exit code 1
Started lustre-OST0000
affected facets: ost1
oleg360-server: oleg360-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg360-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg360-server: Waiting 1470 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg360-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg360-server: Waiting 1465 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg360-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg360-server: Waiting 1460 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg360-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg360-server: Waiting 1455 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg360-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg360-server: Waiting 1450 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg360-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg360-server: Waiting 1445 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg360-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg360-server: Waiting 1440 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg360-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg360-server: Waiting 1435 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg360-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg360-server: Waiting 1430 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg360-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg360-server: Waiting 1425 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg360-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg360-server: Waiting 1420 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg360-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg360-server: Waiting 1415 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg360-server: *.lustre-OST0000.recovery_status status: COMPLETE
affected facets: ost2
oleg360-server: oleg360-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg360-server: *.lustre-OST0001.recovery_status status: INACTIVE
affected facets: ost1
oleg360-server: oleg360-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg360-server: *.lustre-OST0000.recovery_status status: COMPLETE
affected facets: ost2
oleg360-server: oleg360-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg360-server: *.lustre-OST0001.recovery_status status: INACTIVE
affected facets: ost1
oleg360-server: oleg360-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg360-server: *.lustre-OST0000.recovery_status status: COMPLETE
affected facets: ost2
oleg360-server: oleg360-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg360-server: *.lustre-OST0001.recovery_status status: INACTIVE
running as uid/gid/euid/egid 60000/60000/60000/60000, groups:
 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d7a.sanity-quota/f7a.sanity-quota] [count=6] [oflag=sync]
6+0 records in
6+0 records out
6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.787839 s, 8.0 MB/s
Delete files...
Wait for unlink objects finished...
Waiting for MDT destroys to complete