== sanity test 123ad: Verify batching statahead works correctly ========================================================== 19:24:04 (1786836244) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8a199846e800.batch_stats=0 llite.lustre-ffff8a199846e800.statahead_max=32 llite.lustre-ffff8a199846e800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8a199846e800.batch_stats=0 total: 100 open/close in 1.88 seconds: 53.11 ops/second llite.lustre-ffff8a199846e800.statahead_max=0 101 real 0m1.908s user 0m0.004s sys 0m0.377s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8a199846e800.statahead_max=32 llite.lustre-ffff8a199846e800.statahead_max=32 101 real 0m0.778s user 0m0.006s sys 0m0.177s 'ls -l' 100 files with statahead: 1 sec statahead total: 125 statahead wrong: 2 agl total: 119 list_total: 30 fname_total: 81 hit_total: 3635 miss_total: 1586 swrong=2 ewrong=2 total: 900 open/close in 8.77 seconds: 102.64 ops/second llite.lustre-ffff8a199846e800.statahead_max=0 1001 real 0m15.542s user 0m0.025s sys 0m3.025s 'ls -l' 1000 files without statahead: 15 sec llite.lustre-ffff8a199846e800.statahead_max=32 llite.lustre-ffff8a199846e800.statahead_max=32 1001 real 0m5.880s user 0m0.026s sys 0m1.716s 'ls -l' 1000 files with statahead: 6 sec statahead total: 126 statahead wrong: 2 agl total: 120 list_total: 31 fname_total: 81 hit_total: 4632 miss_total: 1589 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 12 seconds llite.lustre-ffff8a199846e800.statahead_stats= statahead total: 126 statahead wrong: 2 agl total: 120 list_total: 31 fname_total: 81 hit_total: 4632 miss_total: 1589 mdc.lustre-MDT0000-mdc-ffff8a199846e800.batch_stats= snapshot_time: 1786836305.881244261 secs.nsecs start_time: 1786836247.523650539 secs.nsecs elapsed_time: 58.357593722 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 1182 (time 1786836317.37 total 10.01 last 118.11) - open/close 2193 (time 1786836327.37 total 20.01 last 101.07) - open/close 3378 (time 1786836337.38 total 30.02 last 118.45) - open/close 4657 (time 1786836347.38 total 40.02 last 127.84) - open/close 5904 (time 1786836357.38 total 50.02 last 124.69) - open/close 7215 (time 1786836367.39 total 60.03 last 131.00) - open/close 8587 (time 1786836377.40 total 70.03 last 137.13) total: 10000 open/close in 79.84 seconds: 125.25 ops/second llite.lustre-ffff8a199846e800.statahead_batch_max=0 llite.lustre-ffff8a199846e800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a199846e800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.747s user 0m0.225s sys 0m26.415s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a199846e800.statahead_batch_max=32 llite.lustre-ffff8a199846e800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a199846e800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a199846e800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m43.292s user 0m0.231s sys 0m18.748s batched statahead RPC= hit count=9994 mdc.lustre-MDT0000-mdc-ffff8a199846e800.batch_stats= snapshot_time: 1786836474.024744616 secs.nsecs start_time: 1786836423.787466268 secs.nsecs elapsed_time: 50.237278348 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8a199846e800.batch_stats=0 llite.lustre-ffff8a199846e800.statahead_max=2048 llite.lustre-ffff8a199846e800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8a199846e800.batch_stats=0 total: 100 open/close in 1.31 seconds: 76.33 ops/second llite.lustre-ffff8a199846e800.statahead_max=0 101 real 0m1.160s user 0m0.003s sys 0m0.308s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8a199846e800.statahead_max=2048 llite.lustre-ffff8a199846e800.statahead_max=2048 101 real 0m0.453s user 0m0.003s sys 0m0.202s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10093 miss_total: 7 swrong=0 ewrong=0 total: 900 open/close in 5.99 seconds: 150.24 ops/second llite.lustre-ffff8a199846e800.statahead_max=0 1001 real 0m12.620s user 0m0.026s sys 0m2.980s 'ls -l' 1000 files without statahead: 12 sec llite.lustre-ffff8a199846e800.statahead_max=2048 llite.lustre-ffff8a199846e800.statahead_max=2048 1001 real 0m4.087s user 0m0.026s sys 0m1.643s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11092 miss_total: 8 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 10 seconds llite.lustre-ffff8a199846e800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11092 miss_total: 8 mdc.lustre-MDT0000-mdc-ffff8a199846e800.batch_stats= snapshot_time: 1786836652.590633207 secs.nsecs start_time: 1786836475.045319972 secs.nsecs elapsed_time: 177.545313235 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 1261 (time 1786836663.80 total 10.00 last 126.07) - open/close 2535 (time 1786836673.80 total 20.01 last 127.35) - open/close 3870 (time 1786836683.80 total 30.01 last 133.49) - open/close 5276 (time 1786836693.80 total 40.01 last 140.56) - open/close 6571 (time 1786836703.81 total 50.02 last 129.43) - open/close 7971 (time 1786836713.81 total 60.02 last 139.98) - open/close 9648 (time 1786836723.81 total 70.02 last 167.62) total: 10000 open/close in 71.55 seconds: 139.76 ops/second llite.lustre-ffff8a199846e800.statahead_batch_max=0 llite.lustre-ffff8a199846e800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a199846e800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m35.170s user 0m0.247s sys 0m24.043s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a199846e800.statahead_batch_max=256 llite.lustre-ffff8a199846e800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a199846e800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a199846e800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m29.170s user 0m0.214s sys 0m20.015s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8a199846e800.batch_stats= snapshot_time: 1786836800.677204368 secs.nsecs start_time: 1786836764.311869130 secs.nsecs elapsed_time: 36.365335238 secs.nsecs subreqs per batch batches %% cum %% 1: 261 65 65 2: 33 8 73 4: 37 9 82 8: 5 1 84 16: 6 1 85 32: 21 5 90 64: 1 0 91 128: 0 0 91 256: 35 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8a199846e800.statahead_batch_max=64 llite.lustre-ffff8a199846e800.statahead_max=128