== sanity-quota test 7e: Quota reintegration (inode limits) ========================================================== 15:49:08 (1776196148) Waiting for MDT destroys to complete Creating test directory fail_val=0 fail_loc=0 Stop mds2... Stopping /mnt/lustre-mds2 (opts:) on oleg253-server Enable quota & set quota limit for quota_usr Start mds2... Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg253-server: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg253-client: oleg253-server: ssh exited with exit code 1 Started lustre-MDT0001 affected facets: mds1 oleg253-server: oleg253-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 oleg253-server: *.lustre-MDT0000.recovery_status status: COMPLETE affected facets: mds2 oleg253-server: oleg253-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 oleg253-server: *.lustre-MDT0001.recovery_status status: COMPLETE affected facets: mds1 oleg253-server: oleg253-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 oleg253-server: *.lustre-MDT0000.recovery_status status: COMPLETE affected facets: mds2 oleg253-server: oleg253-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 oleg253-server: *.lustre-MDT0001.recovery_status status: COMPLETE affected facets: mds1 oleg253-server: oleg253-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 oleg253-server: *.lustre-MDT0000.recovery_status status: COMPLETE affected facets: mds2 oleg253-server: oleg253-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 oleg253-server: *.lustre-MDT0001.recovery_status status: COMPLETE create remote dir running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [createmany] [-m] [/mnt/lustre/d7e.sanity-quota-1/f7e.sanity-quota] [2049] - create 1041 (time 1776196254.62 total 10.01 last 103.96) mknod(/mnt/lustre/d7e.sanity-quota-1/f7e.sanity-quota2048) error: Disk quota exceeded total: 2048 create in 19.58 seconds: 104.57 ops/second running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [unlinkmany] [/mnt/lustre/d7e.sanity-quota-1/f7e.sanity-quota] [2048] - unlinked 0 (time 1776196264 ; total 0 ; last 0) total: 2048 unlinks in 35 seconds: 58.514286 unlinks/second Waiting for MDT destroys to complete Stop mds2... Stopping /mnt/lustre-mds2 (opts:) on oleg253-server Start mds2... Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg253-server: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg253-client: oleg253-server: ssh exited with exit code 1 Started lustre-MDT0001 affected facets: mds1 oleg253-server: oleg253-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 oleg253-server: *.lustre-MDT0000.recovery_status status: COMPLETE affected facets: mds2 oleg253-server: oleg253-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 oleg253-server: *.lustre-MDT0001.recovery_status status: COMPLETE affected facets: mds1 oleg253-server: oleg253-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 oleg253-server: *.lustre-MDT0000.recovery_status status: COMPLETE affected facets: mds2 oleg253-server: oleg253-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 oleg253-server: *.lustre-MDT0001.recovery_status status: COMPLETE affected facets: mds1 oleg253-server: oleg253-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 oleg253-server: *.lustre-MDT0000.recovery_status status: COMPLETE affected facets: mds2 oleg253-server: oleg253-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 oleg253-server: *.lustre-MDT0001.recovery_status status: COMPLETE running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [createmany] [-m] [/mnt/lustre/d7e.sanity-quota-1/f7e.sanity-quota] [2049] - create 1089 (time 1776196376.32 total 10.00 last 108.85) - create 1983 (time 1776196386.33 total 20.01 last 89.35) total: 2049 create in 20.93 seconds: 97.88 ops/second running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [unlinkmany] [/mnt/lustre/d7e.sanity-quota-1/f7e.sanity-quota] [2049] - unlinked 0 (time 1776196387 ; total 0 ; last 0) total: 2049 unlinks in 41 seconds: 49.975609 unlinks/second Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete