== sanity test 123ad: Verify batching statahead works correctly ========================================================== 18:58:51 (1780527531) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8cd618e7f800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8cd618e7f800.batch_stats=0 llite.lustre-ffff8cd618e7f800.statahead_max=32 llite.lustre-ffff8cd618e7f800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8cd618e7f800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8cd618e7f800.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.68 seconds: 147.56 ops/second llite.lustre-ffff8cd618e7f800.statahead_max=0 101 real 0m0.650s user 0m0.002s sys 0m0.258s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff8cd618e7f800.statahead_max=32 llite.lustre-ffff8cd618e7f800.statahead_max=32 101 real 0m0.409s user 0m0.003s sys 0m0.227s 'ls -l' 100 files with statahead: 0 sec statahead total: 55 statahead wrong: 2 agl total: 51 list_total: 25 fname_total: 30 hit_total: 13654 miss_total: 1425 swrong=2 ewrong=2 total: 900 open/close in 1.89 seconds: 476.21 ops/second llite.lustre-ffff8cd618e7f800.statahead_max=0 1001 real 0m6.267s user 0m0.015s sys 0m2.470s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff8cd618e7f800.statahead_max=32 llite.lustre-ffff8cd618e7f800.statahead_max=32 1001 real 0m4.211s user 0m0.015s sys 0m2.074s 'ls -l' 1000 files with statahead: 4 sec statahead total: 56 statahead wrong: 2 agl total: 52 list_total: 26 fname_total: 30 hit_total: 14653 miss_total: 1426 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff8cd618e7f800.statahead_stats= statahead total: 56 statahead wrong: 2 agl total: 52 list_total: 26 fname_total: 30 hit_total: 14653 miss_total: 1426 mdc.lustre-MDT0000-mdc-ffff8cd618e7f800.batch_stats= snapshot_time: 1780527559.315940850 secs.nsecs start_time: 1780527533.240292683 secs.nsecs elapsed_time: 26.075648167 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 3 7 7 8: 2 5 12 16: 20 51 64 32: 14 35 100 mdc.lustre-MDT0001-mdc-ffff8cd618e7f800.batch_stats= snapshot_time: 1780527559.315995070 secs.nsecs start_time: 1780527533.240377201 secs.nsecs elapsed_time: 26.075617869 secs.nsecs subreqs per batch batches % cum % 1: 1 2 2 2: 0 0 2 4: 2 5 7 8: 2 5 13 16: 19 50 63 32: 14 36 100 - open/close 4667 (time 1780527570.21 total 10.00 last 466.68) - open/close 9294 (time 1780527580.22 total 20.00 last 462.62) total: 10000 open/close in 21.52 seconds: 464.65 ops/second llite.lustre-ffff8cd618e7f800.statahead_batch_max=0 llite.lustre-ffff8cd618e7f800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8cd618e7f800.stats=clear mdc.lustre-MDT0001-mdc-ffff8cd618e7f800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.678s user 0m0.160s sys 0m29.861s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8cd618e7f800.statahead_batch_max=32 llite.lustre-ffff8cd618e7f800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8cd618e7f800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8cd618e7f800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8cd618e7f800.stats=clear mdc.lustre-MDT0001-mdc-ffff8cd618e7f800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.452s user 0m0.145s sys 0m19.926s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8cd618e7f800.batch_stats= snapshot_time: 1780527658.224360729 secs.nsecs start_time: 1780527617.678507008 secs.nsecs elapsed_time: 40.545853721 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff8cd618e7f800.batch_stats= snapshot_time: 1780527658.224400020 secs.nsecs start_time: 1780527617.678555348 secs.nsecs elapsed_time: 40.545844672 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8cd618e7f800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8cd618e7f800.batch_stats=0 llite.lustre-ffff8cd618e7f800.statahead_max=2048 llite.lustre-ffff8cd618e7f800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8cd618e7f800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8cd618e7f800.batch_stats=0 striped dir -i1 -c2 -H crush2 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.79 seconds: 125.85 ops/second llite.lustre-ffff8cd618e7f800.statahead_max=0 101 real 0m0.629s user 0m0.002s sys 0m0.253s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff8cd618e7f800.statahead_max=2048 llite.lustre-ffff8cd618e7f800.statahead_max=2048 101 real 0m0.430s user 0m0.002s sys 0m0.262s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.89 seconds: 475.48 ops/second llite.lustre-ffff8cd618e7f800.statahead_max=0 1001 real 0m6.010s user 0m0.018s sys 0m2.395s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff8cd618e7f800.statahead_max=2048 llite.lustre-ffff8cd618e7f800.statahead_max=2048 1001 real 0m3.615s user 0m0.017s sys 0m1.771s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff8cd618e7f800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff8cd618e7f800.batch_stats= snapshot_time: 1780527767.002253584 secs.nsecs start_time: 1780527658.967022441 secs.nsecs elapsed_time: 108.035231143 secs.nsecs subreqs per batch batches % cum % 1: 1 14 14 2: 3 42 57 4: 1 14 71 8: 0 0 71 16: 0 0 71 32: 0 0 71 64: 0 0 71 128: 0 0 71 256: 2 28 100 mdc.lustre-MDT0001-mdc-ffff8cd618e7f800.batch_stats= snapshot_time: 1780527767.002313214 secs.nsecs start_time: 1780527658.967131571 secs.nsecs elapsed_time: 108.035181643 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 4 50 50 16: 0 0 50 32: 0 0 50 64: 1 12 62 128: 1 12 75 256: 2 25 100 - open/close 5781 (time 1780527777.78 total 10.00 last 578.04) total: 10000 open/close in 17.60 seconds: 568.10 ops/second llite.lustre-ffff8cd618e7f800.statahead_batch_max=0 llite.lustre-ffff8cd618e7f800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8cd618e7f800.stats=clear mdc.lustre-MDT0001-mdc-ffff8cd618e7f800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.361s user 0m0.149s sys 0m30.559s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8cd618e7f800.statahead_batch_max=256 llite.lustre-ffff8cd618e7f800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8cd618e7f800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8cd618e7f800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8cd618e7f800.stats=clear mdc.lustre-MDT0001-mdc-ffff8cd618e7f800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m29.561s user 0m0.140s sys 0m21.224s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8cd618e7f800.batch_stats= snapshot_time: 1780527861.762111532 secs.nsecs start_time: 1780527825.277932938 secs.nsecs elapsed_time: 36.484178594 secs.nsecs subreqs per batch batches % cum % 1: 358 67 67 2: 71 13 81 4: 31 5 86 8: 7 1 88 16: 3 0 88 32: 22 4 93 64: 3 0 93 128: 0 0 93 256: 34 6 100 mdc.lustre-MDT0001-mdc-ffff8cd618e7f800.batch_stats= snapshot_time: 1780527861.762156714 secs.nsecs start_time: 1780527825.277990555 secs.nsecs elapsed_time: 36.484166159 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8cd618e7f800.statahead_batch_max=64 llite.lustre-ffff8cd618e7f800.statahead_max=128