== sanity test 123ad: Verify batching statahead works correctly ========================================================== 23:12:41 (1789355561) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff898a60c65000.batch_stats=0 llite.lustre-ffff898a60c65000.statahead_max=32 llite.lustre-ffff898a60c65000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff898a60c65000.batch_stats=0 total: 100 open/close in 0.60 seconds: 167.78 ops/second llite.lustre-ffff898a60c65000.statahead_max=0 101 real 0m0.577s user 0m0.001s sys 0m0.227s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff898a60c65000.statahead_max=32 llite.lustre-ffff898a60c65000.statahead_max=32 101 real 0m0.374s user 0m0.002s sys 0m0.170s 'ls -l' 100 files with statahead: 0 sec statahead total: 91 statahead wrong: 2 agl total: 86 list_total: 30 fname_total: 54 hit_total: 13907 miss_total: 1650 swrong=2 ewrong=2 total: 900 open/close in 1.84 seconds: 488.55 ops/second llite.lustre-ffff898a60c65000.statahead_max=0 1001 real 0m5.368s user 0m0.021s sys 0m2.100s 'ls -l' 1000 files without statahead: 5 sec llite.lustre-ffff898a60c65000.statahead_max=32 llite.lustre-ffff898a60c65000.statahead_max=32 1001 real 0m3.463s user 0m0.016s sys 0m1.983s 'ls -l' 1000 files with statahead: 4 sec statahead total: 92 statahead wrong: 2 agl total: 87 list_total: 31 fname_total: 54 hit_total: 14906 miss_total: 1651 swrong=2 ewrong=2 - open/close 4498 (time 1789355590.37 total 10.00 last 449.77) total: 9000 open/close in 18.85 seconds: 477.48 ops/second llite.lustre-ffff898a60c65000.statahead_max=0 10001 real 1m1.017s user 0m0.213s sys 0m23.400s 'ls -l' 10000 files without statahead: 61 sec llite.lustre-ffff898a60c65000.statahead_max=32 llite.lustre-ffff898a60c65000.statahead_max=32 10001 real 0m39.712s user 0m0.167s sys 0m22.684s 'ls -l' 10000 files with statahead: 39 sec statahead total: 93 statahead wrong: 2 agl total: 88 list_total: 32 fname_total: 54 hit_total: 24905 miss_total: 1652 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 68 seconds llite.lustre-ffff898a60c65000.statahead_stats= statahead total: 93 statahead wrong: 2 agl total: 88 list_total: 32 fname_total: 54 hit_total: 24905 miss_total: 1652 mdc.lustre-MDT0000-mdc-ffff898a60c65000.batch_stats= snapshot_time: 1789355781.132894687 secs.nsecs start_time: 1789355563.253354251 secs.nsecs elapsed_time: 217.879540436 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 0 0 8: 3 0 1 16: 4 1 2 32: 346 97 100 - open/close 5178 (time 1789355792.25 total 10.00 last 517.79) total: 10000 open/close in 19.63 seconds: 509.36 ops/second llite.lustre-ffff898a60c65000.statahead_batch_max=0 llite.lustre-ffff898a60c65000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff898a60c65000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m42.049s user 0m0.202s sys 0m38.307s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff898a60c65000.statahead_batch_max=32 llite.lustre-ffff898a60c65000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff898a60c65000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff898a60c65000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m43.600s user 0m0.175s sys 0m25.763s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff898a60c65000.batch_stats= snapshot_time: 1789355897.878009773 secs.nsecs start_time: 1789355846.809783557 secs.nsecs elapsed_time: 51.068226216 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff898a60c65000.batch_stats=0 llite.lustre-ffff898a60c65000.statahead_max=2048 llite.lustre-ffff898a60c65000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff898a60c65000.batch_stats=0 total: 100 open/close in 0.69 seconds: 144.68 ops/second llite.lustre-ffff898a60c65000.statahead_max=0 101 real 0m0.633s user 0m0.004s sys 0m0.234s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff898a60c65000.statahead_max=2048 llite.lustre-ffff898a60c65000.statahead_max=2048 101 real 0m0.388s user 0m0.003s sys 0m0.241s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 2.07 seconds: 434.94 ops/second llite.lustre-ffff898a60c65000.statahead_max=0 1001 real 0m6.251s user 0m0.024s sys 0m2.420s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff898a60c65000.statahead_max=2048 llite.lustre-ffff898a60c65000.statahead_max=2048 1001 real 0m4.771s user 0m0.013s sys 0m1.383s 'ls -l' 1000 files with statahead: 5 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff898a60c65000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff898a60c65000.batch_stats= snapshot_time: 1789356019.065561321 secs.nsecs start_time: 1789355898.759009317 secs.nsecs elapsed_time: 120.306552004 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 4084 (time 1789356029.89 total 10.00 last 408.34) - open/close 8040 (time 1789356039.89 total 20.00 last 395.58) total: 10000 open/close in 24.97 seconds: 400.53 ops/second llite.lustre-ffff898a60c65000.statahead_batch_max=0 llite.lustre-ffff898a60c65000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff898a60c65000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m49.839s user 0m0.159s sys 0m41.120s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff898a60c65000.statahead_batch_max=256 llite.lustre-ffff898a60c65000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff898a60c65000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff898a60c65000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m41.768s user 0m0.171s sys 0m28.412s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff898a60c65000.batch_stats= snapshot_time: 1789356146.479071682 secs.nsecs start_time: 1789356097.946415246 secs.nsecs elapsed_time: 48.532656436 secs.nsecs subreqs per batch batches %% cum %% 1: 288 65 65 2: 69 15 81 4: 13 2 84 8: 5 1 85 16: 8 1 87 32: 19 4 91 64: 0 0 91 128: 0 0 91 256: 35 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff898a60c65000.statahead_batch_max=64 llite.lustre-ffff898a60c65000.statahead_max=128