== sanity test 123ad: Verify batching statahead works correctly ========================================================== 00:22:39 (1789359759) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8c1989088000.batch_stats=0 llite.lustre-ffff8c1989088000.statahead_max=32 llite.lustre-ffff8c1989088000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8c1989088000.batch_stats=0 total: 100 open/close in 0.72 seconds: 139.66 ops/second llite.lustre-ffff8c1989088000.statahead_max=0 101 real 0m0.595s user 0m0.002s sys 0m0.217s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8c1989088000.statahead_max=32 llite.lustre-ffff8c1989088000.statahead_max=32 101 real 0m0.383s user 0m0.004s sys 0m0.202s 'ls -l' 100 files with statahead: 1 sec statahead total: 62 statahead wrong: 2 agl total: 58 list_total: 26 fname_total: 36 hit_total: 23540 miss_total: 305 swrong=2 ewrong=2 total: 900 open/close in 2.11 seconds: 426.43 ops/second llite.lustre-ffff8c1989088000.statahead_max=0 1001 real 0m6.897s user 0m0.020s sys 0m2.275s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff8c1989088000.statahead_max=32 llite.lustre-ffff8c1989088000.statahead_max=32 1001 real 0m4.133s user 0m0.014s sys 0m2.237s 'ls -l' 1000 files with statahead: 4 sec statahead total: 63 statahead wrong: 2 agl total: 59 list_total: 27 fname_total: 36 hit_total: 24539 miss_total: 306 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 9 seconds llite.lustre-ffff8c1989088000.statahead_stats= statahead total: 63 statahead wrong: 2 agl total: 59 list_total: 27 fname_total: 36 hit_total: 24539 miss_total: 306 mdc.lustre-MDT0000-mdc-ffff8c1989088000.batch_stats= snapshot_time: 1789359789.775216327 secs.nsecs start_time: 1789359760.826694402 secs.nsecs elapsed_time: 28.948521925 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 2834 (time 1789359801.01 total 10.00 last 283.32) - open/close 5980 (time 1789359811.01 total 20.00 last 314.60) - open/close 9456 (time 1789359821.01 total 30.01 last 347.50) total: 10000 open/close in 32.03 seconds: 312.18 ops/second llite.lustre-ffff8c1989088000.statahead_batch_max=0 llite.lustre-ffff8c1989088000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c1989088000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m49.286s user 0m0.159s sys 0m44.777s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c1989088000.statahead_batch_max=32 llite.lustre-ffff8c1989088000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c1989088000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c1989088000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m49.351s user 0m0.163s sys 0m30.868s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8c1989088000.batch_stats= snapshot_time: 1789359931.415774171 secs.nsecs start_time: 1789359875.340753093 secs.nsecs elapsed_time: 56.075021078 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8c1989088000.batch_stats=0 llite.lustre-ffff8c1989088000.statahead_max=2048 llite.lustre-ffff8c1989088000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8c1989088000.batch_stats=0 total: 100 open/close in 0.94 seconds: 106.20 ops/second llite.lustre-ffff8c1989088000.statahead_max=0 101 real 0m1.006s user 0m0.008s sys 0m0.354s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8c1989088000.statahead_max=2048 llite.lustre-ffff8c1989088000.statahead_max=2048 101 real 0m0.369s user 0m0.003s sys 0m0.237s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 3.01 seconds: 299.36 ops/second llite.lustre-ffff8c1989088000.statahead_max=0 1001 real 0m7.253s user 0m0.025s sys 0m2.899s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff8c1989088000.statahead_max=2048 llite.lustre-ffff8c1989088000.statahead_max=2048 1001 real 0m3.107s user 0m0.012s sys 0m1.112s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff8c1989088000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff8c1989088000.batch_stats= snapshot_time: 1789360074.576331106 secs.nsecs start_time: 1789359932.348402165 secs.nsecs elapsed_time: 142.227928941 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 2967 (time 1789360086.31 total 10.00 last 296.62) - open/close 6593 (time 1789360096.31 total 20.00 last 362.58) - open/close 9595 (time 1789360106.31 total 30.00 last 300.18) total: 10000 open/close in 31.60 seconds: 316.47 ops/second llite.lustre-ffff8c1989088000.statahead_batch_max=0 llite.lustre-ffff8c1989088000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c1989088000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.416s user 0m0.142s sys 0m30.930s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c1989088000.statahead_batch_max=256 llite.lustre-ffff8c1989088000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c1989088000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c1989088000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.501s user 0m0.135s sys 0m23.003s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8c1989088000.batch_stats= snapshot_time: 1789360186.008307432 secs.nsecs start_time: 1789360147.445787159 secs.nsecs elapsed_time: 38.562520273 secs.nsecs subreqs per batch batches %% cum %% 1: 374 69 69 2: 75 13 83 4: 21 3 87 8: 6 1 88 16: 1 0 88 32: 26 4 93 64: 1 0 93 128: 0 0 93 256: 34 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8c1989088000.statahead_batch_max=64 llite.lustre-ffff8c1989088000.statahead_max=128