== sanity test 123ad: Verify batching statahead works correctly ========================================================== 11:54:08 (1788364448) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9780eefc6000.batch_stats=0 llite.lustre-ffff9780eefc6000.statahead_max=32 llite.lustre-ffff9780eefc6000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9780eefc6000.batch_stats=0 total: 100 open/close in 1.24 seconds: 80.61 ops/second llite.lustre-ffff9780eefc6000.statahead_max=0 101 real 0m1.027s user 0m0.003s sys 0m0.341s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9780eefc6000.statahead_max=32 llite.lustre-ffff9780eefc6000.statahead_max=32 101 real 0m0.507s user 0m0.004s sys 0m0.333s 'ls -l' 100 files with statahead: 0 sec statahead total: 94 statahead wrong: 2 agl total: 90 list_total: 29 fname_total: 59 hit_total: 3896 miss_total: 1203 swrong=2 ewrong=2 total: 900 open/close in 3.79 seconds: 237.69 ops/second llite.lustre-ffff9780eefc6000.statahead_max=0 1001 real 0m8.037s user 0m0.024s sys 0m2.766s 'ls -l' 1000 files without statahead: 8 sec llite.lustre-ffff9780eefc6000.statahead_max=32 llite.lustre-ffff9780eefc6000.statahead_max=32 1001 real 0m4.295s user 0m0.034s sys 0m2.343s 'ls -l' 1000 files with statahead: 4 sec statahead total: 95 statahead wrong: 2 agl total: 91 list_total: 30 fname_total: 59 hit_total: 4895 miss_total: 1204 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 8 seconds llite.lustre-ffff9780eefc6000.statahead_stats= statahead total: 95 statahead wrong: 2 agl total: 91 list_total: 30 fname_total: 59 hit_total: 4895 miss_total: 1204 mdc.lustre-MDT0000-mdc-ffff9780eefc6000.batch_stats= snapshot_time: 1788364482.765829672 secs.nsecs start_time: 1788364450.001216385 secs.nsecs elapsed_time: 32.764613287 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 2580 (time 1788364493.58 total 10.02 last 257.57) - open/close 5644 (time 1788364503.58 total 20.02 last 306.32) - open/close 8096 (time 1788364513.58 total 30.02 last 245.16) total: 10000 open/close in 37.35 seconds: 267.72 ops/second llite.lustre-ffff9780eefc6000.statahead_batch_max=0 llite.lustre-ffff9780eefc6000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9780eefc6000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.980s user 0m0.238s sys 0m34.533s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9780eefc6000.statahead_batch_max=32 llite.lustre-ffff9780eefc6000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9780eefc6000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9780eefc6000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m42.622s user 0m0.194s sys 0m23.307s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9780eefc6000.batch_stats= snapshot_time: 1788364610.639632370 secs.nsecs start_time: 1788364561.307298564 secs.nsecs elapsed_time: 49.332333806 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9780eefc6000.batch_stats=0 llite.lustre-ffff9780eefc6000.statahead_max=2048 llite.lustre-ffff9780eefc6000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9780eefc6000.batch_stats=0 total: 100 open/close in 0.78 seconds: 127.58 ops/second llite.lustre-ffff9780eefc6000.statahead_max=0 101 real 0m0.892s user 0m0.007s sys 0m0.286s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9780eefc6000.statahead_max=2048 llite.lustre-ffff9780eefc6000.statahead_max=2048 101 real 0m0.322s user 0m0.002s sys 0m0.235s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 2.93 seconds: 307.34 ops/second llite.lustre-ffff9780eefc6000.statahead_max=0 1001 real 0m7.309s user 0m0.032s sys 0m2.612s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff9780eefc6000.statahead_max=2048 llite.lustre-ffff9780eefc6000.statahead_max=2048 1001 real 0m3.320s user 0m0.014s sys 0m1.185s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff9780eefc6000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff9780eefc6000.batch_stats= snapshot_time: 1788364739.637491166 secs.nsecs start_time: 1788364611.549106825 secs.nsecs elapsed_time: 128.088384341 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 3579 (time 1788364750.35 total 10.00 last 357.79) - open/close 6562 (time 1788364760.36 total 20.01 last 298.20) - open/close 9437 (time 1788364770.36 total 30.01 last 287.44) total: 10000 open/close in 31.74 seconds: 315.03 ops/second llite.lustre-ffff9780eefc6000.statahead_batch_max=0 llite.lustre-ffff9780eefc6000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9780eefc6000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.884s user 0m0.248s sys 0m30.214s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9780eefc6000.statahead_batch_max=256 llite.lustre-ffff9780eefc6000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9780eefc6000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9780eefc6000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m30.074s user 0m0.211s sys 0m21.392s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9780eefc6000.batch_stats= snapshot_time: 1788364848.876125463 secs.nsecs start_time: 1788364812.133714757 secs.nsecs elapsed_time: 36.742410706 secs.nsecs subreqs per batch batches %% cum %% 1: 502 69 69 2: 95 13 82 4: 52 7 89 8: 13 1 91 16: 3 0 92 32: 23 3 95 64: 0 0 95 128: 1 0 95 256: 33 4 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9780eefc6000.statahead_batch_max=64 llite.lustre-ffff9780eefc6000.statahead_max=128