== sanity test 51f: check many open files limit ========== 22:34:31 (1789526071)
MDT0 numfree=540093, max=100000
changed ulimit from 1024 to 100020
 - open/keep 7742 (time 1789526082.41 total 10.00 last 774.14)
 - open/keep 10000 (time 1789526085.21 total 12.80 last 807.02)
 - open/keep 18388 (time 1789526095.21 total 22.80 last 838.76)
 - open/keep 20000 (time 1789526097.36 total 24.95 last 749.55)
 - open/keep 27594 (time 1789526107.36 total 34.95 last 759.38)
 - open/keep 30000 (time 1789526110.41 total 37.99 last 790.90)
 - open/keep 37569 (time 1789526120.41 total 47.99 last 756.85)
 - open/keep 40000 (time 1789526123.74 total 51.33 last 729.21)
 - open/keep 46794 (time 1789526133.74 total 61.33 last 679.39)
 - open/keep 50000 (time 1789526138.10 total 65.69 last 735.11)
 - open/keep 56286 (time 1789526148.10 total 75.69 last 628.50)
 - open/keep 58556 (time 1789526158.11 total 85.69 last 226.92)
 - open/keep 60000 (time 1789526164.92 total 92.50 last 212.06)
 - open/keep 61898 (time 1789526174.92 total 102.50 last 189.79)
 - open/keep 63828 (time 1789526184.92 total 112.50 last 192.97)
total: 65316 open/keep in 120.00 seconds: 544.28 ops/second
 - closed 3631 (time 1789526202.42 total 10.00 last -6016.74)
 - closed 7378 (time 1789526212.42 total 20.01 last 374.68)
 - closed 10000 (time 1789526219.30 total 26.88 last 381.38)
 - closed 14299 (time 1789526229.30 total 36.88 last 429.84)
 - closed 18936 (time 1789526239.30 total 46.89 last 463.46)
 - closed 20000 (time 1789526241.59 total 49.17 last 466.16)
 - closed 25678 (time 1789526251.59 total 59.17 last 567.74)
 - closed 30000 (time 1789526260.69 total 68.28 last 474.59)
 - closed 34820 (time 1789526270.70 total 78.28 last 481.96)
 - closed 39737 (time 1789526280.70 total 88.28 last 491.70)
 - closed 40000 (time 1789526281.34 total 88.92 last 409.18)
 - closed 44179 (time 1789526291.34 total 98.92 last 417.81)
 - closed 48390 (time 1789526301.34 total 108.92 last 421.05)
 - closed 50000 (time 1789526306.43 total 114.02 last 316.22)
 - closed 53797 (time 1789526316.43 total 124.02 last 379.68)
 - closed 57650 (time 1789526326.43 total 134.02 last 385.30)
 - closed 60000 (time 1789526333.49 total 141.08 last 332.89)
 - closed 64075 (time 1789526343.49 total 151.08 last 407.46)
total: 65316 close in 154.50 seconds: 422.75 close/second
 - unlinked 0 (time 1789526349 ; total 0 ; last 0)
 - unlinked 10000 (time 1789526392 ; total 43 ; last 43)
 - unlinked 20000 (time 1789526432 ; total 83 ; last 40)
 - unlinked 30000 (time 1789526474 ; total 125 ; last 42)
 - unlinked 40000 (time 1789526521 ; total 172 ; last 47)
 - unlinked 50000 (time 1789526568 ; total 219 ; last 47)
 - unlinked 60000 (time 1789526607 ; total 258 ; last 39)
unlink(/mnt/lustre/d51f.sanity/f65316) error: No such file or directory
total: 65316 unlinks in 272 seconds: 240.132355 unlinks/second