== sanity test 123ad: Verify batching statahead works correctly ========================================================== 12:48:49 (1781628529) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8e358988c800.batch_stats=0 llite.lustre-ffff8e358988c800.statahead_max=32 llite.lustre-ffff8e358988c800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8e358988c800.batch_stats=0 total: 100 open/close in 1.34 seconds: 74.68 ops/second llite.lustre-ffff8e358988c800.statahead_max=0 101 real 0m1.095s user 0m0.006s sys 0m0.292s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8e358988c800.statahead_max=32 llite.lustre-ffff8e358988c800.statahead_max=32 101 real 0m0.448s user 0m0.003s sys 0m0.194s 'ls -l' 100 files with statahead: 0 sec statahead total: 110 statahead wrong: 2 agl total: 101 list_total: 29 fname_total: 80 hit_total: 3674 miss_total: 1553 swrong=2 ewrong=2 total: 900 open/close in 5.59 seconds: 161.14 ops/second llite.lustre-ffff8e358988c800.statahead_max=0 1001 real 0m11.366s user 0m0.028s sys 0m2.810s 'ls -l' 1000 files without statahead: 11 sec llite.lustre-ffff8e358988c800.statahead_max=32 llite.lustre-ffff8e358988c800.statahead_max=32 1001 real 0m4.523s user 0m0.019s sys 0m1.770s 'ls -l' 1000 files with statahead: 4 sec statahead total: 111 statahead wrong: 2 agl total: 102 list_total: 30 fname_total: 80 hit_total: 4671 miss_total: 1556 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 10 seconds llite.lustre-ffff8e358988c800.statahead_stats= statahead total: 111 statahead wrong: 2 agl total: 102 list_total: 30 fname_total: 80 hit_total: 4671 miss_total: 1556 mdc.lustre-MDT0000-mdc-ffff8e358988c800.batch_stats= snapshot_time: 1781628574.111285959 secs.nsecs start_time: 1781628531.922186500 secs.nsecs elapsed_time: 42.189099459 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 1574 (time 1781628585.10 total 10.01 last 157.29) - open/close 3248 (time 1781628595.11 total 20.01 last 167.36) - open/close 4885 (time 1781628605.11 total 30.01 last 163.67) - open/close 6621 (time 1781628615.11 total 40.01 last 173.55) - open/close 8342 (time 1781628625.11 total 50.02 last 172.06) - open/close 9935 (time 1781628635.11 total 60.02 last 159.29) total: 10000 open/close in 60.45 seconds: 165.43 ops/second llite.lustre-ffff8e358988c800.statahead_batch_max=0 llite.lustre-ffff8e358988c800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e358988c800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.557s user 0m0.206s sys 0m27.970s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8e358988c800.statahead_batch_max=32 llite.lustre-ffff8e358988c800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e358988c800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8e358988c800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.967s user 0m0.216s sys 0m20.512s batched statahead RPC= hit count=9998 mdc.lustre-MDT0000-mdc-ffff8e358988c800.batch_stats= snapshot_time: 1781628717.068223360 secs.nsecs start_time: 1781628672.072415994 secs.nsecs elapsed_time: 44.995807366 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 1 32: 312 98 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8e358988c800.batch_stats=0 llite.lustre-ffff8e358988c800.statahead_max=2048 llite.lustre-ffff8e358988c800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8e358988c800.batch_stats=0 total: 100 open/close in 0.71 seconds: 141.66 ops/second llite.lustre-ffff8e358988c800.statahead_max=0 101 real 0m0.782s user 0m0.004s sys 0m0.265s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8e358988c800.statahead_max=2048 llite.lustre-ffff8e358988c800.statahead_max=2048 101 real 0m0.411s user 0m0.002s sys 0m0.235s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10097 miss_total: 3 swrong=0 ewrong=0 total: 900 open/close in 2.79 seconds: 322.74 ops/second llite.lustre-ffff8e358988c800.statahead_max=0 1001 real 0m6.763s user 0m0.031s sys 0m2.451s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff8e358988c800.statahead_max=2048 llite.lustre-ffff8e358988c800.statahead_max=2048 1001 real 0m3.145s user 0m0.015s sys 0m1.427s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11096 miss_total: 4 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff8e358988c800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11096 miss_total: 4 mdc.lustre-MDT0000-mdc-ffff8e358988c800.batch_stats= snapshot_time: 1781628850.782291812 secs.nsecs start_time: 1781628717.969978055 secs.nsecs elapsed_time: 132.812313757 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 3225 (time 1781628861.55 total 10.00 last 322.46) - open/close 6331 (time 1781628871.55 total 20.00 last 310.59) - open/close 9936 (time 1781628881.55 total 30.00 last 360.43) total: 10000 open/close in 30.16 seconds: 331.61 ops/second llite.lustre-ffff8e358988c800.statahead_batch_max=0 llite.lustre-ffff8e358988c800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e358988c800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.400s user 0m0.201s sys 0m27.242s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8e358988c800.statahead_batch_max=256 llite.lustre-ffff8e358988c800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e358988c800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8e358988c800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m27.570s user 0m0.187s sys 0m19.513s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8e358988c800.batch_stats= snapshot_time: 1781628950.625988181 secs.nsecs start_time: 1781628916.525458588 secs.nsecs elapsed_time: 34.100529593 secs.nsecs subreqs per batch batches %% cum %% 1: 261 65 65 2: 38 9 75 4: 28 7 82 8: 8 2 84 16: 3 0 84 32: 24 6 90 64: 1 0 91 128: 0 0 91 256: 35 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8e358988c800.statahead_batch_max=64 llite.lustre-ffff8e358988c800.statahead_max=128