== sanity test 51f: check many open files limit ========== 10:05:49 (1788876349)
MDT0 numfree=538778, max=100000
changed ulimit from 1024 to 100020
 - open/keep 8530 (time 1788876360.83 total 10.00 last 852.91)
 - open/keep 16631 (time 1788876370.83 total 20.01 last 809.72)
 - open/keep 20000 (time 1788876374.97 total 24.14 last 814.12)
 - open/keep 28319 (time 1788876384.97 total 34.14 last 831.86)
 - open/keep 30000 (time 1788876387.15 total 36.32 last 771.85)
 - open/keep 37754 (time 1788876397.15 total 46.32 last 775.37)
 - open/keep 40000 (time 1788876399.89 total 49.07 last 817.89)
 - open/keep 47422 (time 1788876409.90 total 59.07 last 742.18)
 - open/keep 50000 (time 1788876413.04 total 62.22 last 818.83)
 - open/keep 57388 (time 1788876423.04 total 72.22 last 738.80)
 - open/keep 60000 (time 1788876426.83 total 76.00 last 690.17)
 - open/keep 66983 (time 1788876436.83 total 86.00 last 698.20)
 - open/keep 70000 (time 1788876441.22 total 90.40 last 686.51)
 - open/keep 76620 (time 1788876451.23 total 100.40 last 661.92)
 - open/keep 80000 (time 1788876456.33 total 105.50 last 662.26)
 - open/keep 86685 (time 1788876466.33 total 115.50 last 668.44)
 - open/keep 90000 (time 1788876470.54 total 119.71 last 788.03)
total: 90088 open/keep in 120.01 seconds: 750.65 ops/second
 - closed 10000 (time 1788876478.16 total 7.32 last -10928.17)
 - closed 20000 (time 1788876485.55 total 14.71 last 1353.56)
 - closed 30000 (time 1788876492.88 total 22.04 last 1363.90)
 - closed 40000 (time 1788876500.32 total 29.48 last 1344.31)
 - closed 50000 (time 1788876507.86 total 37.02 last 1326.72)
 - closed 60000 (time 1788876514.96 total 44.12 last 1408.24)
 - closed 70000 (time 1788876522.21 total 51.37 last 1378.51)
 - closed 80000 (time 1788876530.34 total 59.50 last 1231.03)
 - closed 90000 (time 1788876538.72 total 67.88 last 1192.93)
total: 90088 close in 67.94 seconds: 1325.92 close/second
 - unlinked 0 (time 1788876540 ; total 1 ; last 1)
 - unlinked 10000 (time 1788876562 ; total 23 ; last 22)
 - unlinked 20000 (time 1788876584 ; total 45 ; last 22)
 - unlinked 30000 (time 1788876606 ; total 67 ; last 22)
 - unlinked 40000 (time 1788876627 ; total 88 ; last 21)
 - unlinked 50000 (time 1788876640 ; total 101 ; last 13)
 - unlinked 60000 (time 1788876652 ; total 113 ; last 12)
 - unlinked 70000 (time 1788876666 ; total 127 ; last 14)
 - unlinked 80000 (time 1788876679 ; total 140 ; last 13)
 - unlinked 90000 (time 1788876692 ; total 153 ; last 13)
unlink(/mnt/lustre/d51f.sanity/f90088) error: No such file or directory
total: 90088 unlinks in 153 seconds: 588.810486 unlinks/second