== sanity test 51f: check many open files limit ========== 23:59:54 (1721879994) MDT0 numfree=493019, max=100000 changed ulimit from 1024 to 100020 - open/keep 5311 (time 1721880005.76 total 10.00 last 531.10) - open/keep 10000 (time 1721880013.16 total 17.40 last 633.46) - open/keep 16887 (time 1721880023.16 total 27.40 last 688.61) - open/keep 20000 (time 1721880028.48 total 32.72 last 585.55) - open/keep 26191 (time 1721880038.48 total 42.72 last 619.06) - open/keep 30000 (time 1721880045.24 total 49.48 last 563.38) - open/keep 35410 (time 1721880055.24 total 59.48 last 540.93) - open/keep 40000 (time 1721880065.10 total 69.34 last 465.68) - open/keep 45103 (time 1721880075.10 total 79.34 last 510.26) - open/keep 50000 (time 1721880084.59 total 88.83 last 516.01) - open/keep 55045 (time 1721880094.59 total 98.83 last 504.46) - open/keep 60000 (time 1721880103.92 total 108.16 last 531.34) - open/keep 64739 (time 1721880113.92 total 118.16 last 473.84) total: 65779 open/keep in 120.00 seconds: 548.16 ops/second - closed 9071 (time 1721880125.76 total 10.00 last -5566.38) - closed 10000 (time 1721880126.64 total 10.88 last 1053.85) - closed 19137 (time 1721880136.64 total 20.88 last 913.68) - closed 20000 (time 1721880137.64 total 21.88 last 862.23) - closed 30000 (time 1721880147.44 total 31.68 last 1020.67) - closed 38276 (time 1721880157.44 total 41.68 last 827.43) - closed 40000 (time 1721880159.44 total 43.68 last 863.41) - closed 47195 (time 1721880169.44 total 53.68 last 719.45) - closed 50000 (time 1721880172.45 total 56.69 last 930.57) - closed 58145 (time 1721880182.45 total 66.70 last 814.45) - closed 60000 (time 1721880184.29 total 68.53 last 1010.34) total: 65779 close in 75.22 seconds: 874.51 close/second - unlinked 0 (time 1721880191 ; total 0 ; last 0) - unlinked 10000 (time 1721880209 ; total 18 ; last 18) - unlinked 20000 (time 1721880227 ; total 36 ; last 18) - unlinked 30000 (time 1721880246 ; total 55 ; last 19) - unlinked 40000 (time 1721880261 ; total 70 ; last 15) - unlinked 50000 (time 1721880278 ; total 87 ; last 17) - unlinked 60000 (time 1721880294 ; total 103 ; last 16) unlink(/mnt/lustre/d51f.sanity/f65779) error: No such file or directory total: 65779 unlinks in 111 seconds: 592.603577 unlinks/second