== sanity test 51f: check many open files limit ========== 12:31:55 (1777912315)
MDT0 numfree=     532991, max=100000
changed ulimit from 1024 to 100020
 - open/keep 7043 (time 1777912327.28 total 10.00 last 704.27)
 - open/keep 10000 (time 1777912331.16 total 13.88 last 761.51)
 - open/keep 17862 (time 1777912341.16 total 23.88 last 786.17)
 - open/keep 20000 (time 1777912343.94 total 26.67 last 768.39)
 - open/keep 27657 (time 1777912353.94 total 36.67 last 765.69)
 - open/keep 30000 (time 1777912357.01 total 39.73 last 764.30)
 - open/keep 37897 (time 1777912367.01 total 49.73 last 789.65)
 - open/keep 40000 (time 1777912369.65 total 52.37 last 795.92)
 - open/keep 47897 (time 1777912379.65 total 62.38 last 789.61)
 - open/keep 50000 (time 1777912382.43 total 65.16 last 756.16)
 - open/keep 57693 (time 1777912392.43 total 75.16 last 769.24)
 - open/keep 60000 (time 1777912395.50 total 78.23 last 751.20)
 - open/keep 67159 (time 1777912405.50 total 88.23 last 715.88)
 - open/keep 70000 (time 1777912409.34 total 92.07 last 740.46)
 - open/keep 77408 (time 1777912419.34 total 102.07 last 740.71)
 - open/keep 80000 (time 1777912422.87 total 105.59 last 735.62)
 - open/keep 87363 (time 1777912432.87 total 115.59 last 736.25)
 - open/keep 90000 (time 1777912436.17 total 118.89 last 799.20)
total: 90929 open/keep in 120.00 seconds: 757.74 ops/second
 - closed 10000 (time 1777912444.68 total 7.41 last -10796.65)
 - closed 20000 (time 1777912452.00 total 14.73 last 1366.67)
 - closed 30000 (time 1777912459.10 total 21.83 last 1408.10)
 - closed 40000 (time 1777912466.48 total 29.20 last 1356.60)
 - closed 50000 (time 1777912474.13 total 36.86 last 1305.89)
 - closed 60000 (time 1777912481.69 total 44.42 last 1323.06)
 - closed 70000 (time 1777912489.66 total 52.38 last 1254.97)
 - closed 80000 (time 1777912497.36 total 60.08 last 1298.70)
 - closed 90000 (time 1777912505.24 total 67.97 last 1268.52)
total: 90929 close in 68.62 seconds: 1325.15 close/second
 - unlinked 0 (time 1777912507 ; total 0 ; last 0)
 - unlinked 10000 (time 1777912528 ; total 21 ; last 21)
 - unlinked 20000 (time 1777912551 ; total 44 ; last 23)
 - unlinked 30000 (time 1777912573 ; total 66 ; last 22)
 - unlinked 40000 (time 1777912597 ; total 90 ; last 24)
 - unlinked 50000 (time 1777912612 ; total 105 ; last 15)
 - unlinked 60000 (time 1777912625 ; total 118 ; last 13)
 - unlinked 70000 (time 1777912639 ; total 132 ; last 14)
 - unlinked 80000 (time 1777912653 ; total 146 ; last 14)
 - unlinked 90000 (time 1777912668 ; total 161 ; last 15)
unlink(/mnt/lustre/d51f.sanity/f90929) error: No such file or directory
total: 90929 unlinks in 162 seconds: 561.290100 unlinks/second