== sanity test 123ad: Verify batching statahead works correctly ========================================================== 15:31:43 (1788809503) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9145c5f08800.batch_stats=0 llite.lustre-ffff9145c5f08800.statahead_max=32 llite.lustre-ffff9145c5f08800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9145c5f08800.batch_stats=0 total: 100 open/close in 1.45 seconds: 69.05 ops/second llite.lustre-ffff9145c5f08800.statahead_max=0 101 real 0m1.262s user 0m0.010s sys 0m0.314s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9145c5f08800.statahead_max=32 llite.lustre-ffff9145c5f08800.statahead_max=32 101 real 0m0.570s user 0m0.006s sys 0m0.257s 'ls -l' 100 files with statahead: 1 sec statahead total: 95 statahead wrong: 2 agl total: 90 list_total: 29 fname_total: 64 hit_total: 4560 miss_total: 1277 swrong=2 ewrong=2 total: 900 open/close in 6.15 seconds: 146.31 ops/second llite.lustre-ffff9145c5f08800.statahead_max=0 1001 real 0m11.639s user 0m0.041s sys 0m2.955s 'ls -l' 1000 files without statahead: 11 sec llite.lustre-ffff9145c5f08800.statahead_max=32 llite.lustre-ffff9145c5f08800.statahead_max=32 1001 real 0m4.378s user 0m0.030s sys 0m1.706s 'ls -l' 1000 files with statahead: 4 sec statahead total: 96 statahead wrong: 2 agl total: 91 list_total: 30 fname_total: 64 hit_total: 5558 miss_total: 1279 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 9 seconds llite.lustre-ffff9145c5f08800.statahead_stats= statahead total: 96 statahead wrong: 2 agl total: 91 list_total: 30 fname_total: 64 hit_total: 5558 miss_total: 1279 mdc.lustre-MDT0000-mdc-ffff9145c5f08800.batch_stats= snapshot_time: 1788809547.986497126 secs.nsecs start_time: 1788809505.730221134 secs.nsecs elapsed_time: 42.256275992 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 1428 (time 1788809559.05 total 10.00 last 142.79) - open/close 2856 (time 1788809569.06 total 20.00 last 142.74) - open/close 4368 (time 1788809579.06 total 30.01 last 151.19) - open/close 5745 (time 1788809589.06 total 40.01 last 137.64) - open/close 7126 (time 1788809599.07 total 50.01 last 138.06) - open/close 8542 (time 1788809609.07 total 60.02 last 141.56) total: 10000 open/close in 69.88 seconds: 143.09 ops/second llite.lustre-ffff9145c5f08800.statahead_batch_max=0 llite.lustre-ffff9145c5f08800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9145c5f08800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m39.520s user 0m0.311s sys 0m32.672s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9145c5f08800.statahead_batch_max=32 llite.lustre-ffff9145c5f08800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9145c5f08800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9145c5f08800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m43.535s user 0m0.249s sys 0m18.263s batched statahead RPC= hit count=9988 mdc.lustre-MDT0000-mdc-ffff9145c5f08800.batch_stats= snapshot_time: 1788809711.014891139 secs.nsecs start_time: 1788809662.276765689 secs.nsecs elapsed_time: 48.738125450 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9145c5f08800.batch_stats=0 llite.lustre-ffff9145c5f08800.statahead_max=2048 llite.lustre-ffff9145c5f08800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9145c5f08800.batch_stats=0 total: 100 open/close in 1.15 seconds: 86.79 ops/second llite.lustre-ffff9145c5f08800.statahead_max=0 101 real 0m1.274s user 0m0.009s sys 0m0.293s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9145c5f08800.statahead_max=2048 llite.lustre-ffff9145c5f08800.statahead_max=2048 101 real 0m0.384s user 0m0.003s sys 0m0.219s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10087 miss_total: 13 swrong=0 ewrong=0 total: 900 open/close in 4.99 seconds: 180.29 ops/second llite.lustre-ffff9145c5f08800.statahead_max=0 1001 real 0m7.909s user 0m0.028s sys 0m2.564s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff9145c5f08800.statahead_max=2048 llite.lustre-ffff9145c5f08800.statahead_max=2048 1001 real 0m3.268s user 0m0.019s sys 0m1.688s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11086 miss_total: 14 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff9145c5f08800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11086 miss_total: 14 mdc.lustre-MDT0000-mdc-ffff9145c5f08800.batch_stats= snapshot_time: 1788809878.608143738 secs.nsecs start_time: 1788809712.179411044 secs.nsecs elapsed_time: 166.428732694 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 1 11 33 32: 1 11 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 1950 (time 1788809890.02 total 10.00 last 194.96) - open/close 4264 (time 1788809900.03 total 20.00 last 231.37) - open/close 6889 (time 1788809910.03 total 30.00 last 262.49) - open/close 9664 (time 1788809920.03 total 40.00 last 277.49) total: 10000 open/close in 41.36 seconds: 241.76 ops/second llite.lustre-ffff9145c5f08800.statahead_batch_max=0 llite.lustre-ffff9145c5f08800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9145c5f08800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.384s user 0m0.230s sys 0m26.780s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9145c5f08800.statahead_batch_max=256 llite.lustre-ffff9145c5f08800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9145c5f08800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9145c5f08800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m26.765s user 0m0.201s sys 0m19.462s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9145c5f08800.batch_stats= snapshot_time: 1788809988.456751545 secs.nsecs start_time: 1788809956.663490834 secs.nsecs elapsed_time: 31.793260711 secs.nsecs subreqs per batch batches %% cum %% 1: 245 63 63 2: 36 9 72 4: 33 8 81 8: 10 2 83 16: 4 1 84 32: 18 4 89 64: 5 1 90 128: 1 0 91 256: 34 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9145c5f08800.statahead_batch_max=64 llite.lustre-ffff9145c5f08800.statahead_max=128