== sanity-quota test 7e: Quota reintegration (inode limits) ========================================================== 18:23:56 (1787869436) Waiting for MDT destroys to complete Creating test directory fail_val=0 fail_loc=0 -u quota_usr inodes:0 Waiting 90s for 'none' Updated after 2s: want 'none' got 'none' -u quota_usr ihardlimit:0 Stop mds2... Stopping /mnt/lustre-mds2 (opts:) on oleg645-server Enable quota & set quota limit for quota_usr Start mds2... Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg645-server: oleg645-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg645-client: oleg645-server: ssh exited with exit code 1 Started lustre-MDT0001 affected facets: mds1 oleg645-server: oleg645-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 oleg645-server: *.lustre-MDT0000.recovery_status status: COMPLETE affected facets: mds2 oleg645-server: oleg645-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 oleg645-server: *.lustre-MDT0001.recovery_status status: COMPLETE affected facets: mds1 oleg645-server: oleg645-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 oleg645-server: *.lustre-MDT0000.recovery_status status: COMPLETE affected facets: mds2 oleg645-server: oleg645-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 oleg645-server: *.lustre-MDT0001.recovery_status status: COMPLETE affected facets: mds1 oleg645-server: oleg645-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 oleg645-server: *.lustre-MDT0000.recovery_status status: COMPLETE affected facets: mds2 oleg645-server: oleg645-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 oleg645-server: *.lustre-MDT0001.recovery_status status: COMPLETE create remote dir running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [createmany] [-m] [/mnt/lustre/d7e.sanity-quota-1/f7e.sanity-quota] [2049] - create 1008 (time 1787869528.00 total 10.00 last 100.76) - create 2039 (time 1787869538.02 total 20.02 last 102.97) mknod(/mnt/lustre/d7e.sanity-quota-1/f7e.sanity-quota2048) error: Disk quota exceeded total: 2048 create in 20.11 seconds: 101.82 ops/second running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [unlinkmany] [/mnt/lustre/d7e.sanity-quota-1/f7e.sanity-quota] [2048] - unlinked 0 (time 1787869538 ; total 0 ; last 0) total: 2048 unlinks in 42 seconds: 48.761906 unlinks/second Waiting for MDT destroys to complete Stop mds2... Stopping /mnt/lustre-mds2 (opts:) on oleg645-server Start mds2... Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg645-server: oleg645-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg645-client: oleg645-server: ssh exited with exit code 1 Started lustre-MDT0001 affected facets: mds1 oleg645-server: oleg645-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 oleg645-server: *.lustre-MDT0000.recovery_status status: COMPLETE affected facets: mds2 oleg645-server: oleg645-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 oleg645-server: *.lustre-MDT0001.recovery_status status: COMPLETE affected facets: mds1 oleg645-server: oleg645-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 oleg645-server: *.lustre-MDT0000.recovery_status status: COMPLETE affected facets: mds2 oleg645-server: oleg645-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 oleg645-server: *.lustre-MDT0001.recovery_status status: COMPLETE affected facets: mds1 oleg645-server: oleg645-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 oleg645-server: *.lustre-MDT0000.recovery_status status: COMPLETE affected facets: mds2 oleg645-server: oleg645-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 1475 oleg645-server: *.lustre-MDT0001.recovery_status status: COMPLETE running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [createmany] [-m] [/mnt/lustre/d7e.sanity-quota-1/f7e.sanity-quota] [2049] - create 779 (time 1787869649.82 total 10.01 last 77.86) - create 1464 (time 1787869659.87 total 20.06 last 68.15) total: 2049 create in 27.00 seconds: 75.89 ops/second running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [unlinkmany] [/mnt/lustre/d7e.sanity-quota-1/f7e.sanity-quota] [2049] - unlinked 0 (time 1787869666 ; total 0 ; last 0) total: 2049 unlinks in 44 seconds: 46.568180 unlinks/second Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete