== sanity test 123ad: Verify batching statahead works correctly ========================================================== 13:27:50 (1789320470) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff891448c16000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff891448c16000.batch_stats=0 llite.lustre-ffff891448c16000.statahead_max=32 llite.lustre-ffff891448c16000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff891448c16000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff891448c16000.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.71 seconds: 140.61 ops/second llite.lustre-ffff891448c16000.statahead_max=0 101 real 0m0.980s user 0m0.004s sys 0m0.344s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff891448c16000.statahead_max=32 llite.lustre-ffff891448c16000.statahead_max=32 101 real 0m0.423s user 0m0.002s sys 0m0.221s 'ls -l' 100 files with statahead: 0 sec statahead total: 59 statahead wrong: 1 agl total: 53 list_total: 27 fname_total: 30 hit_total: 13862 miss_total: 201 swrong=1 ewrong=1 total: 900 open/close in 2.76 seconds: 326.05 ops/second llite.lustre-ffff891448c16000.statahead_max=0 1001 real 0m7.575s user 0m0.034s sys 0m2.621s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff891448c16000.statahead_max=32 llite.lustre-ffff891448c16000.statahead_max=32 1001 real 0m3.863s user 0m0.014s sys 0m1.694s 'ls -l' 1000 files with statahead: 3 sec statahead total: 60 statahead wrong: 1 agl total: 54 list_total: 28 fname_total: 30 hit_total: 14861 miss_total: 202 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff891448c16000.statahead_stats= statahead total: 60 statahead wrong: 1 agl total: 54 list_total: 28 fname_total: 30 hit_total: 14861 miss_total: 202 mdc.lustre-MDT0000-mdc-ffff891448c16000.batch_stats= snapshot_time: 1789320499.925108144 secs.nsecs start_time: 1789320471.609196534 secs.nsecs elapsed_time: 28.315911610 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 2 2 4: 4 10 12 8: 0 0 12 16: 18 46 58 32: 16 41 100 mdc.lustre-MDT0001-mdc-ffff891448c16000.batch_stats= snapshot_time: 1789320499.925155471 secs.nsecs start_time: 1789320471.609284067 secs.nsecs elapsed_time: 28.315871404 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 1 2 5 8: 5 12 17 16: 22 56 74 32: 10 25 100 - open/close 3075 (time 1789320511.36 total 10.00 last 307.45) - open/close 8001 (time 1789320521.37 total 20.00 last 492.53) total: 10000 open/close in 24.33 seconds: 411.07 ops/second llite.lustre-ffff891448c16000.statahead_batch_max=0 llite.lustre-ffff891448c16000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff891448c16000.stats=clear mdc.lustre-MDT0001-mdc-ffff891448c16000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.306s user 0m0.167s sys 0m28.914s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff891448c16000.statahead_batch_max=32 llite.lustre-ffff891448c16000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff891448c16000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff891448c16000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff891448c16000.stats=clear mdc.lustre-MDT0001-mdc-ffff891448c16000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m39.488s user 0m0.154s sys 0m21.533s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff891448c16000.batch_stats= snapshot_time: 1789320604.314334204 secs.nsecs start_time: 1789320560.619071976 secs.nsecs elapsed_time: 43.695262228 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff891448c16000.batch_stats= snapshot_time: 1789320604.314371979 secs.nsecs start_time: 1789320560.619128406 secs.nsecs elapsed_time: 43.695243573 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff891448c16000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff891448c16000.batch_stats=0 llite.lustre-ffff891448c16000.statahead_max=2048 llite.lustre-ffff891448c16000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff891448c16000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff891448c16000.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.62 seconds: 161.33 ops/second llite.lustre-ffff891448c16000.statahead_max=0 101 real 0m0.692s user 0m0.003s sys 0m0.241s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff891448c16000.statahead_max=2048 llite.lustre-ffff891448c16000.statahead_max=2048 101 real 0m0.380s user 0m0.002s sys 0m0.174s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 2.81 seconds: 320.72 ops/second llite.lustre-ffff891448c16000.statahead_max=0 1001 real 0m8.919s user 0m0.026s sys 0m2.935s 'ls -l' 1000 files without statahead: 9 sec llite.lustre-ffff891448c16000.statahead_max=2048 llite.lustre-ffff891448c16000.statahead_max=2048 1001 real 0m3.058s user 0m0.012s sys 0m1.297s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 8 seconds llite.lustre-ffff891448c16000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff891448c16000.batch_stats= snapshot_time: 1789320736.666763816 secs.nsecs start_time: 1789320605.236542908 secs.nsecs elapsed_time: 131.430220908 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 14 14 4: 1 14 28 8: 2 28 57 16: 0 0 57 32: 0 0 57 64: 1 14 71 128: 0 0 71 256: 2 28 100 mdc.lustre-MDT0001-mdc-ffff891448c16000.batch_stats= snapshot_time: 1789320736.666822131 secs.nsecs start_time: 1789320605.236656960 secs.nsecs elapsed_time: 131.430165171 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 3 42 42 8: 1 14 57 16: 0 0 57 32: 0 0 57 64: 1 14 71 128: 0 0 71 256: 2 28 100 - open/close 3234 (time 1789320747.67 total 10.00 last 323.40) - open/close 6392 (time 1789320757.67 total 20.00 last 315.67) - open/close 9475 (time 1789320767.67 total 30.00 last 308.30) total: 10000 open/close in 31.64 seconds: 316.09 ops/second llite.lustre-ffff891448c16000.statahead_batch_max=0 llite.lustre-ffff891448c16000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff891448c16000.stats=clear mdc.lustre-MDT0001-mdc-ffff891448c16000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.995s user 0m0.137s sys 0m25.717s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff891448c16000.statahead_batch_max=256 llite.lustre-ffff891448c16000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff891448c16000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff891448c16000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff891448c16000.stats=clear mdc.lustre-MDT0001-mdc-ffff891448c16000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m26.201s user 0m0.134s sys 0m19.420s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff891448c16000.batch_stats= snapshot_time: 1789320836.064370645 secs.nsecs start_time: 1789320804.340727484 secs.nsecs elapsed_time: 31.723643161 secs.nsecs subreqs per batch batches %% cum %% 1: 166 62 62 2: 22 8 70 4: 13 4 75 8: 2 0 76 16: 4 1 77 32: 20 7 85 64: 4 1 86 128: 1 0 86 256: 35 13 100 mdc.lustre-MDT0001-mdc-ffff891448c16000.batch_stats= snapshot_time: 1789320836.064419038 secs.nsecs start_time: 1789320804.340874299 secs.nsecs elapsed_time: 31.723544739 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff891448c16000.statahead_batch_max=64 llite.lustre-ffff891448c16000.statahead_max=128