== sanity test 123ad: Verify batching statahead works correctly ========================================================== 15:26:16 (1788204376) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9a96b5ff7800.batch_stats=0 llite.lustre-ffff9a96b5ff7800.statahead_max=32 llite.lustre-ffff9a96b5ff7800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9a96b5ff7800.batch_stats=0 total: 100 open/close in 2.48 seconds: 40.31 ops/second llite.lustre-ffff9a96b5ff7800.statahead_max=0 101 real 0m2.610s user 0m0.012s sys 0m0.347s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9a96b5ff7800.statahead_max=32 llite.lustre-ffff9a96b5ff7800.statahead_max=32 101 real 0m1.106s user 0m0.008s sys 0m0.188s 'ls -l' 100 files with statahead: 1 sec statahead total: 130 statahead wrong: 2 agl total: 124 list_total: 29 fname_total: 101 hit_total: 4025 miss_total: 1550 swrong=2 ewrong=2 - open/close 743 (time 1788204405.31 total 10.02 last 74.12) total: 900 open/close in 12.40 seconds: 72.57 ops/second llite.lustre-ffff9a96b5ff7800.statahead_max=0 1001 real 0m22.216s user 0m0.036s sys 0m3.193s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff9a96b5ff7800.statahead_max=32 llite.lustre-ffff9a96b5ff7800.statahead_max=32 1001 real 0m11.482s user 0m0.029s sys 0m1.440s 'ls -l' 1000 files with statahead: 11 sec statahead total: 131 statahead wrong: 2 agl total: 125 list_total: 30 fname_total: 101 hit_total: 5022 miss_total: 1553 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff9a96b5ff7800.statahead_stats= statahead total: 131 statahead wrong: 2 agl total: 125 list_total: 30 fname_total: 101 hit_total: 5022 miss_total: 1553 mdc.lustre-MDT0000-mdc-ffff9a96b5ff7800.batch_stats= snapshot_time: 1788204478.640347116 secs.nsecs start_time: 1788204381.659552214 secs.nsecs elapsed_time: 96.980794902 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 664 (time 1788204491.27 total 10.01 last 66.34) - open/close 1393 (time 1788204501.29 total 20.02 last 72.79) - open/close 2011 (time 1788204511.30 total 30.03 last 61.76) - open/close 2689 (time 1788204521.32 total 40.05 last 67.66) - open/close 3377 (time 1788204531.32 total 50.06 last 68.76) - open/close 4046 (time 1788204541.32 total 60.06 last 66.89) - open/close 4696 (time 1788204551.33 total 70.06 last 64.99) - open/close 5367 (time 1788204561.33 total 80.06 last 67.08) - open/close 6031 (time 1788204571.33 total 90.07 last 66.39) - open/close 6575 (time 1788204581.35 total 100.09 last 54.28) - open/close 7089 (time 1788204591.36 total 110.09 last 51.37) - open/close 7802 (time 1788204601.37 total 120.10 last 71.26) - open/close 8588 (time 1788204611.37 total 130.11 last 78.55) - open/close 9264 (time 1788204621.39 total 140.12 last 67.48) total: 10000 open/close in 149.92 seconds: 66.70 ops/second llite.lustre-ffff9a96b5ff7800.statahead_batch_max=0 llite.lustre-ffff9a96b5ff7800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a96b5ff7800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.421s user 0m0.399s sys 0m16.436s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a96b5ff7800.statahead_batch_max=32 llite.lustre-ffff9a96b5ff7800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a96b5ff7800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a96b5ff7800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m45.788s user 0m0.347s sys 0m14.358s batched statahead RPC= hit count=9980 mdc.lustre-MDT0000-mdc-ffff9a96b5ff7800.batch_stats= snapshot_time: 1788204813.740474024 secs.nsecs start_time: 1788204697.129513759 secs.nsecs elapsed_time: 116.610960265 secs.nsecs subreqs per batch batches %% cum %% 1: 2 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 1 32: 313 98 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9a96b5ff7800.batch_stats=0 llite.lustre-ffff9a96b5ff7800.statahead_max=2048 llite.lustre-ffff9a96b5ff7800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9a96b5ff7800.batch_stats=0 total: 100 open/close in 2.58 seconds: 38.82 ops/second llite.lustre-ffff9a96b5ff7800.statahead_max=0 101 real 0m2.661s user 0m0.004s sys 0m0.344s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9a96b5ff7800.statahead_max=2048 llite.lustre-ffff9a96b5ff7800.statahead_max=2048 101 real 0m0.853s user 0m0.003s sys 0m0.160s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10079 miss_total: 21 swrong=0 ewrong=0 - open/close 858 (time 1788205105.25 total 10.01 last 85.68) total: 900 open/close in 10.57 seconds: 85.15 ops/second llite.lustre-ffff9a96b5ff7800.statahead_max=0 1001 real 0m19.183s user 0m0.027s sys 0m2.798s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff9a96b5ff7800.statahead_max=2048 llite.lustre-ffff9a96b5ff7800.statahead_max=2048 1001 real 0m6.752s user 0m0.024s sys 0m1.311s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11078 miss_total: 22 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff9a96b5ff7800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11078 miss_total: 22 mdc.lustre-MDT0000-mdc-ffff9a96b5ff7800.batch_stats= snapshot_time: 1788205163.029516657 secs.nsecs start_time: 1788204816.247456740 secs.nsecs elapsed_time: 346.782059917 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 785 (time 1788205175.34 total 10.02 last 78.37) - open/close 1655 (time 1788205185.36 total 20.03 last 86.84) - open/close 2494 (time 1788205195.36 total 30.04 last 83.88) - open/close 3359 (time 1788205205.37 total 40.04 last 86.45) - open/close 4328 (time 1788205215.37 total 50.05 last 96.87) - open/close 5193 (time 1788205225.38 total 60.05 last 86.45) - open/close 6031 (time 1788205235.38 total 70.05 last 83.78) - open/close 6771 (time 1788205245.40 total 80.07 last 73.90) - open/close 8200 (time 1788205255.41 total 90.08 last 142.75) - open/close 9163 (time 1788205265.41 total 100.08 last 96.26) total: 10000 open/close in 107.69 seconds: 92.86 ops/second llite.lustre-ffff9a96b5ff7800.statahead_batch_max=0 llite.lustre-ffff9a96b5ff7800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a96b5ff7800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m51.462s user 0m0.307s sys 0m15.658s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a96b5ff7800.statahead_batch_max=256 llite.lustre-ffff9a96b5ff7800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a96b5ff7800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a96b5ff7800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.640s user 0m0.270s sys 0m14.309s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9a96b5ff7800.batch_stats= snapshot_time: 1788205388.772349474 secs.nsecs start_time: 1788205335.838445155 secs.nsecs elapsed_time: 52.933904319 secs.nsecs subreqs per batch batches %% cum %% 1: 82 35 35 2: 31 13 48 4: 34 14 63 8: 20 8 71 16: 12 5 76 32: 13 5 82 64: 5 2 84 128: 1 0 84 256: 35 15 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9a96b5ff7800.statahead_batch_max=64 llite.lustre-ffff9a96b5ff7800.statahead_max=128