== sanity test 123ad: Verify batching statahead works correctly ========================================================== 12:22:02 (1788884522) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8c22033ec000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8c22033ec000.batch_stats=0 llite.lustre-ffff8c22033ec000.statahead_max=32 llite.lustre-ffff8c22033ec000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8c22033ec000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8c22033ec000.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 0.58 seconds: 173.02 ops/second llite.lustre-ffff8c22033ec000.statahead_max=0 101 real 0m0.547s user 0m0.004s sys 0m0.201s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8c22033ec000.statahead_max=32 llite.lustre-ffff8c22033ec000.statahead_max=32 101 real 0m0.413s user 0m0.001s sys 0m0.203s 'ls -l' 100 files with statahead: 1 sec statahead total: 56 statahead wrong: 2 agl total: 51 list_total: 26 fname_total: 30 hit_total: 13759 miss_total: 1574 swrong=2 ewrong=2 total: 900 open/close in 1.75 seconds: 513.76 ops/second llite.lustre-ffff8c22033ec000.statahead_max=0 1001 real 0m5.433s user 0m0.019s sys 0m1.988s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff8c22033ec000.statahead_max=32 llite.lustre-ffff8c22033ec000.statahead_max=32 1001 real 0m3.806s user 0m0.013s sys 0m1.826s 'ls -l' 1000 files with statahead: 3 sec statahead total: 57 statahead wrong: 2 agl total: 52 list_total: 27 fname_total: 30 hit_total: 14758 miss_total: 1575 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff8c22033ec000.statahead_stats= statahead total: 57 statahead wrong: 2 agl total: 52 list_total: 27 fname_total: 30 hit_total: 14758 miss_total: 1575 mdc.lustre-MDT0000-mdc-ffff8c22033ec000.batch_stats= snapshot_time: 1788884546.504038444 secs.nsecs start_time: 1788884523.824934350 secs.nsecs elapsed_time: 22.679104094 secs.nsecs subreqs per batch batches %% cum %% 1: 2 5 5 2: 3 8 13 4: 1 2 16 8: 1 2 18 16: 27 72 91 32: 3 8 100 mdc.lustre-MDT0001-mdc-ffff8c22033ec000.batch_stats= snapshot_time: 1788884546.504115294 secs.nsecs start_time: 1788884523.825002222 secs.nsecs elapsed_time: 22.679113072 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 1 2 5 4: 0 0 5 8: 3 7 12 16: 11 27 40 32: 24 60 100 - open/close 4761 (time 1788884557.89 total 10.00 last 476.01) - open/close 9504 (time 1788884567.89 total 20.00 last 474.25) total: 10000 open/close in 21.02 seconds: 475.72 ops/second llite.lustre-ffff8c22033ec000.statahead_batch_max=0 llite.lustre-ffff8c22033ec000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c22033ec000.stats=clear mdc.lustre-MDT0001-mdc-ffff8c22033ec000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.440s user 0m0.161s sys 0m30.626s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c22033ec000.statahead_batch_max=32 llite.lustre-ffff8c22033ec000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c22033ec000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8c22033ec000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c22033ec000.stats=clear mdc.lustre-MDT0001-mdc-ffff8c22033ec000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m35.071s user 0m0.158s sys 0m19.986s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8c22033ec000.batch_stats= snapshot_time: 1788884644.540724170 secs.nsecs start_time: 1788884604.882893633 secs.nsecs elapsed_time: 39.657830537 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff8c22033ec000.batch_stats= snapshot_time: 1788884644.540767883 secs.nsecs start_time: 1788884604.882963435 secs.nsecs elapsed_time: 39.657804448 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8c22033ec000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8c22033ec000.batch_stats=0 llite.lustre-ffff8c22033ec000.statahead_max=2048 llite.lustre-ffff8c22033ec000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8c22033ec000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8c22033ec000.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 0.95 seconds: 104.98 ops/second llite.lustre-ffff8c22033ec000.statahead_max=0 101 real 0m0.600s user 0m0.006s sys 0m0.221s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8c22033ec000.statahead_max=2048 llite.lustre-ffff8c22033ec000.statahead_max=2048 101 real 0m0.368s user 0m0.002s sys 0m0.242s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.88 seconds: 478.29 ops/second llite.lustre-ffff8c22033ec000.statahead_max=0 1001 real 0m5.865s user 0m0.019s sys 0m2.137s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff8c22033ec000.statahead_max=2048 llite.lustre-ffff8c22033ec000.statahead_max=2048 1001 real 0m3.078s user 0m0.021s sys 0m1.528s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff8c22033ec000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff8c22033ec000.batch_stats= snapshot_time: 1788884748.510595924 secs.nsecs start_time: 1788884645.350929519 secs.nsecs elapsed_time: 103.159666405 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 16 16 4: 1 16 33 8: 2 33 66 16: 0 0 66 32: 0 0 66 64: 0 0 66 128: 0 0 66 256: 2 33 100 mdc.lustre-MDT0001-mdc-ffff8c22033ec000.batch_stats= snapshot_time: 1788884748.510639357 secs.nsecs start_time: 1788884645.351036711 secs.nsecs elapsed_time: 103.159602646 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 33 33 16: 2 22 55 32: 1 11 66 64: 0 0 66 128: 1 11 77 256: 2 22 100 - open/close 4886 (time 1788884759.36 total 10.00 last 488.55) - open/close 9680 (time 1788884769.36 total 20.00 last 479.38) total: 10000 open/close in 20.66 seconds: 484.02 ops/second llite.lustre-ffff8c22033ec000.statahead_batch_max=0 llite.lustre-ffff8c22033ec000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c22033ec000.stats=clear mdc.lustre-MDT0001-mdc-ffff8c22033ec000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m41.045s user 0m0.167s sys 0m33.650s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c22033ec000.statahead_batch_max=256 llite.lustre-ffff8c22033ec000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c22033ec000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8c22033ec000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c22033ec000.stats=clear mdc.lustre-MDT0001-mdc-ffff8c22033ec000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m25.819s user 0m0.151s sys 0m19.433s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8c22033ec000.batch_stats= snapshot_time: 1788884843.779837204 secs.nsecs start_time: 1788884813.530530295 secs.nsecs elapsed_time: 30.249306909 secs.nsecs subreqs per batch batches %% cum %% 1: 218 58 58 2: 53 14 73 4: 34 9 82 8: 3 0 83 16: 1 0 83 32: 26 7 90 64: 1 0 90 128: 1 0 90 256: 34 9 100 mdc.lustre-MDT0001-mdc-ffff8c22033ec000.batch_stats= snapshot_time: 1788884843.779881162 secs.nsecs start_time: 1788884813.530621045 secs.nsecs elapsed_time: 30.249260117 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8c22033ec000.statahead_batch_max=64 llite.lustre-ffff8c22033ec000.statahead_max=128