== sanity test 123ad: Verify batching statahead works correctly ========================================================== 22:26:24 (1786674384) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff892977608000.batch_stats=0 llite.lustre-ffff892977608000.statahead_max=32 llite.lustre-ffff892977608000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff892977608000.batch_stats=0 total: 100 open/close in 3.68 seconds: 27.18 ops/second llite.lustre-ffff892977608000.statahead_max=0 101 real 0m2.582s user 0m0.008s sys 0m0.350s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff892977608000.statahead_max=32 llite.lustre-ffff892977608000.statahead_max=32 101 real 0m1.586s user 0m0.005s sys 0m0.186s 'ls -l' 100 files with statahead: 2 sec statahead total: 148 statahead wrong: 2 agl total: 141 list_total: 30 fname_total: 98 hit_total: 4428 miss_total: 1283 swrong=2 ewrong=2 - open/close 521 (time 1786674416.55 total 10.01 last 52.05) total: 900 open/close in 16.53 seconds: 54.45 ops/second llite.lustre-ffff892977608000.statahead_max=0 1001 real 0m25.934s user 0m0.035s sys 0m3.259s 'ls -l' 1000 files without statahead: 26 sec llite.lustre-ffff892977608000.statahead_max=32 llite.lustre-ffff892977608000.statahead_max=32 1001 real 0m13.858s user 0m0.036s sys 0m1.619s 'ls -l' 1000 files with statahead: 14 sec statahead total: 149 statahead wrong: 2 agl total: 142 list_total: 31 fname_total: 98 hit_total: 5425 miss_total: 1286 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 26 seconds llite.lustre-ffff892977608000.statahead_stats= statahead total: 149 statahead wrong: 2 agl total: 142 list_total: 31 fname_total: 98 hit_total: 5425 miss_total: 1286 mdc.lustre-MDT0000-mdc-ffff892977608000.batch_stats= snapshot_time: 1786674505.150527787 secs.nsecs start_time: 1786674390.509207114 secs.nsecs elapsed_time: 114.641320673 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 579 (time 1786674518.48 total 10.03 last 57.70) - open/close 1040 (time 1786674528.48 total 20.04 last 46.07) - open/close 1557 (time 1786674538.50 total 30.06 last 51.62) - open/close 2078 (time 1786674548.51 total 40.06 last 52.06) - open/close 2590 (time 1786674558.53 total 50.09 last 51.08) - open/close 3172 (time 1786674568.54 total 60.10 last 58.13) - open/close 3721 (time 1786674578.55 total 70.11 last 54.85) - open/close 4321 (time 1786674588.56 total 80.12 last 59.93) - open/close 4849 (time 1786674598.59 total 90.15 last 52.64) - open/close 5376 (time 1786674608.62 total 100.18 last 52.56) - open/close 5861 (time 1786674618.63 total 110.18 last 48.48) - open/close 6477 (time 1786674628.64 total 120.19 last 61.54) - open/close 7105 (time 1786674638.64 total 130.20 last 62.78) - open/close 7704 (time 1786674648.65 total 140.21 last 59.84) - open/close 8354 (time 1786674658.65 total 150.21 last 64.99) - open/close 8987 (time 1786674668.67 total 160.22 last 63.20) - open/close 9616 (time 1786674678.68 total 170.23 last 62.83) total: 10000 open/close in 176.70 seconds: 56.59 ops/second llite.lustre-ffff892977608000.statahead_batch_max=0 llite.lustre-ffff892977608000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff892977608000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.574s user 0m0.342s sys 0m17.874s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff892977608000.statahead_batch_max=32 llite.lustre-ffff892977608000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff892977608000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff892977608000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m53.056s user 0m0.319s sys 0m15.651s batched statahead RPC= hit count=9982 mdc.lustre-MDT0000-mdc-ffff892977608000.batch_stats= snapshot_time: 1786674876.851148479 secs.nsecs start_time: 1786674751.393944801 secs.nsecs elapsed_time: 125.457203678 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff892977608000.batch_stats=0 llite.lustre-ffff892977608000.statahead_max=2048 llite.lustre-ffff892977608000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff892977608000.batch_stats=0 total: 100 open/close in 3.71 seconds: 26.96 ops/second llite.lustre-ffff892977608000.statahead_max=0 101 real 0m2.428s user 0m0.006s sys 0m0.360s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff892977608000.statahead_max=2048 llite.lustre-ffff892977608000.statahead_max=2048 101 real 0m1.134s user 0m0.008s sys 0m0.226s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10081 miss_total: 19 swrong=0 ewrong=0 - open/close 485 (time 1786675264.11 total 10.01 last 48.46) total: 900 open/close in 18.35 seconds: 49.04 ops/second llite.lustre-ffff892977608000.statahead_max=0 1001 real 0m32.590s user 0m0.053s sys 0m3.818s 'ls -l' 1000 files without statahead: 32 sec llite.lustre-ffff892977608000.statahead_max=2048 llite.lustre-ffff892977608000.statahead_max=2048 1001 real 0m9.342s user 0m0.037s sys 0m1.679s 'ls -l' 1000 files with statahead: 9 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 28 seconds llite.lustre-ffff892977608000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 mdc.lustre-MDT0000-mdc-ffff892977608000.batch_stats= snapshot_time: 1786675359.095050131 secs.nsecs start_time: 1786674880.076498792 secs.nsecs elapsed_time: 479.018551339 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 489 (time 1786675372.64 total 10.00 last 48.88) - open/close 1005 (time 1786675382.67 total 20.03 last 51.46) - open/close 1482 (time 1786675392.69 total 30.05 last 47.62) - open/close 2032 (time 1786675402.69 total 40.05 last 55.00) - open/close 2646 (time 1786675412.71 total 50.07 last 61.26) - open/close 3204 (time 1786675422.72 total 60.08 last 55.77) - open/close 3687 (time 1786675432.75 total 70.10 last 48.17) - open/close 4217 (time 1786675442.76 total 80.12 last 52.94) - open/close 4781 (time 1786675452.76 total 90.12 last 56.39) - open/close 5310 (time 1786675462.76 total 100.12 last 52.88) - open/close 5738 (time 1786675472.77 total 110.13 last 42.78) - open/close 6335 (time 1786675482.78 total 120.14 last 59.62) - open/close 6904 (time 1786675492.79 total 130.15 last 56.82) - open/close 7398 (time 1786675502.82 total 140.18 last 49.27) - open/close 7966 (time 1786675512.83 total 150.18 last 56.77) - open/close 8521 (time 1786675522.84 total 160.20 last 55.41) - open/close 9069 (time 1786675532.84 total 170.20 last 54.79) - open/close 9600 (time 1786675542.85 total 180.21 last 53.05) total: 10000 open/close in 187.43 seconds: 53.35 ops/second llite.lustre-ffff892977608000.statahead_batch_max=0 llite.lustre-ffff892977608000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff892977608000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m18.718s user 0m0.375s sys 0m17.180s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff892977608000.statahead_batch_max=256 llite.lustre-ffff892977608000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff892977608000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff892977608000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m3.320s user 0m0.388s sys 0m17.103s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff892977608000.batch_stats= snapshot_time: 1786675721.445747072 secs.nsecs start_time: 1786675641.050931438 secs.nsecs elapsed_time: 80.394815634 secs.nsecs subreqs per batch batches %% cum %% 1: 293 56 56 2: 81 15 72 4: 46 8 81 8: 25 4 86 16: 23 4 90 32: 11 2 92 64: 3 0 93 128: 0 0 93 256: 34 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff892977608000.statahead_batch_max=64 llite.lustre-ffff892977608000.statahead_max=128