== sanity test 51f: check many open files limit ========== 05:21:36 (1715332896) MDT0 numfree=489523, max=100000 changed ulimit from 1024 to 100020 - open/keep 3591 (time 1715332908.22 total 10.00 last 359.02) - open/keep 6635 (time 1715332918.22 total 20.00 last 304.40) - open/keep 10000 (time 1715332927.43 total 29.21 last 365.29) - open/keep 13841 (time 1715332937.44 total 39.22 last 383.96) - open/keep 17386 (time 1715332947.44 total 49.22 last 354.43) - open/keep 20000 (time 1715332955.70 total 57.48 last 316.61) - open/keep 22564 (time 1715332965.70 total 67.48 last 256.33) - open/keep 25261 (time 1715332975.70 total 77.48 last 269.55) - open/keep 28142 (time 1715332985.70 total 87.49 last 288.05) - open/keep 30000 (time 1715332990.32 total 92.10 last 402.33) - open/keep 33882 (time 1715333000.32 total 102.11 last 388.14) - open/keep 38134 (time 1715333010.33 total 112.11 last 425.13) - open/keep 40000 (time 1715333014.66 total 116.44 last 430.35) total: 41370 open/keep in 120.00 seconds: 344.75 ops/second - closed 4815 (time 1715333028.22 total 10.00 last -3518.31) - closed 9366 (time 1715333038.22 total 20.00 last 454.92) - closed 10000 (time 1715333039.62 total 21.40 last 455.87) - closed 14412 (time 1715333049.62 total 31.40 last 441.17) - closed 19212 (time 1715333059.62 total 41.40 last 479.97) - closed 20000 (time 1715333061.34 total 43.12 last 457.88) - closed 24186 (time 1715333071.34 total 53.12 last 418.56) - closed 28556 (time 1715333081.34 total 63.12 last 436.87) - closed 30000 (time 1715333084.47 total 66.25 last 462.06) - closed 34385 (time 1715333094.47 total 76.25 last 438.50) - closed 39497 (time 1715333104.47 total 86.25 last 511.16) - closed 40000 (time 1715333105.20 total 86.98 last 687.93) total: 41370 close in 89.04 seconds: 464.61 close/second - unlinked 0 (time 1715333108 ; total 0 ; last 0) - unlinked 10000 (time 1715333130 ; total 22 ; last 22) - unlinked 20000 (time 1715333156 ; total 48 ; last 26) - unlinked 30000 (time 1715333178 ; total 70 ; last 22) - unlinked 40000 (time 1715333201 ; total 93 ; last 23) unlink(/mnt/lustre/d51f.sanity/f41370) error: No such file or directory total: 41370 unlinks in 96 seconds: 430.937500 unlinks/second