== sanity test 123ad: Verify batching statahead works correctly ========================================================== 15:24:54 (1780341894) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9a89133dd800.batch_stats=0 llite.lustre-ffff9a89133dd800.statahead_max=32 llite.lustre-ffff9a89133dd800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9a89133dd800.batch_stats=0 total: 100 open/close in 2.08 seconds: 48.16 ops/second llite.lustre-ffff9a89133dd800.statahead_max=0 101 real 0m1.829s user 0m0.004s sys 0m0.311s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9a89133dd800.statahead_max=32 llite.lustre-ffff9a89133dd800.statahead_max=32 101 real 0m0.894s user 0m0.005s sys 0m0.170s 'ls -l' 100 files with statahead: 1 sec statahead total: 147 statahead wrong: 2 agl total: 141 list_total: 29 fname_total: 107 hit_total: 3778 miss_total: 1643 swrong=2 ewrong=2 total: 900 open/close in 9.10 seconds: 98.92 ops/second llite.lustre-ffff9a89133dd800.statahead_max=0 1001 real 0m15.771s user 0m0.030s sys 0m2.820s 'ls -l' 1000 files without statahead: 15 sec llite.lustre-ffff9a89133dd800.statahead_max=32 llite.lustre-ffff9a89133dd800.statahead_max=32 1001 real 0m6.898s user 0m0.022s sys 0m1.429s 'ls -l' 1000 files with statahead: 7 sec statahead total: 148 statahead wrong: 2 agl total: 142 list_total: 30 fname_total: 107 hit_total: 4777 miss_total: 1644 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 15 seconds llite.lustre-ffff9a89133dd800.statahead_stats= statahead total: 148 statahead wrong: 2 agl total: 142 list_total: 30 fname_total: 107 hit_total: 4777 miss_total: 1644 mdc.lustre-MDT0000-mdc-ffff9a89133dd800.batch_stats= snapshot_time: 1780341964.291358270 secs.nsecs start_time: 1780341898.415189473 secs.nsecs elapsed_time: 65.876168797 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 2 5 7 16: 1 2 10 32: 34 89 100 - open/close 1083 (time 1780341975.73 total 10.00 last 108.27) - open/close 2085 (time 1780341985.73 total 20.00 last 100.20) - open/close 2934 (time 1780341995.74 total 30.01 last 84.86) - open/close 3718 (time 1780342005.74 total 40.01 last 78.39) - open/close 4597 (time 1780342015.74 total 50.02 last 87.83) - open/close 5526 (time 1780342025.75 total 60.02 last 92.89) - open/close 6478 (time 1780342035.75 total 70.02 last 95.14) - open/close 7420 (time 1780342045.75 total 80.03 last 94.18) - open/close 8332 (time 1780342055.75 total 90.03 last 91.19) - open/close 9270 (time 1780342065.76 total 100.03 last 93.76) total: 10000 open/close in 108.01 seconds: 92.58 ops/second llite.lustre-ffff9a89133dd800.statahead_batch_max=0 llite.lustre-ffff9a89133dd800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a89133dd800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m40.645s user 0m0.258s sys 0m16.679s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a89133dd800.statahead_batch_max=32 llite.lustre-ffff9a89133dd800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a89133dd800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a89133dd800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m7.203s user 0m0.250s sys 0m13.980s batched statahead RPC= hit count=9985 mdc.lustre-MDT0000-mdc-ffff9a89133dd800.batch_stats= snapshot_time: 1780342196.362083872 secs.nsecs start_time: 1780342120.593574734 secs.nsecs elapsed_time: 75.768509138 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9a89133dd800.batch_stats=0 llite.lustre-ffff9a89133dd800.statahead_max=2048 llite.lustre-ffff9a89133dd800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9a89133dd800.batch_stats=0 total: 100 open/close in 1.70 seconds: 58.94 ops/second llite.lustre-ffff9a89133dd800.statahead_max=0 101 real 0m1.443s user 0m0.002s sys 0m0.295s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9a89133dd800.statahead_max=2048 llite.lustre-ffff9a89133dd800.statahead_max=2048 101 real 0m0.403s user 0m0.001s sys 0m0.179s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10084 miss_total: 16 swrong=0 ewrong=0 total: 900 open/close in 7.35 seconds: 122.40 ops/second llite.lustre-ffff9a89133dd800.statahead_max=0 1001 real 0m13.838s user 0m0.032s sys 0m2.805s 'ls -l' 1000 files without statahead: 14 sec llite.lustre-ffff9a89133dd800.statahead_max=2048 llite.lustre-ffff9a89133dd800.statahead_max=2048 1001 real 0m4.466s user 0m0.026s sys 0m1.617s 'ls -l' 1000 files with statahead: 5 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 11 seconds llite.lustre-ffff9a89133dd800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 mdc.lustre-MDT0000-mdc-ffff9a89133dd800.batch_stats= snapshot_time: 1780342436.664145010 secs.nsecs start_time: 1780342198.002043951 secs.nsecs elapsed_time: 238.662101059 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 1131 (time 1780342448.32 total 10.01 last 113.02) - open/close 2340 (time 1780342458.32 total 20.01 last 120.89) - open/close 3529 (time 1780342468.32 total 30.01 last 118.83) - open/close 4891 (time 1780342478.32 total 40.02 last 136.16) - open/close 6059 (time 1780342488.34 total 50.03 last 116.66) - open/close 7436 (time 1780342498.34 total 60.03 last 137.63) - open/close 8877 (time 1780342508.34 total 70.04 last 144.06) total: 10000 open/close in 77.58 seconds: 128.89 ops/second llite.lustre-ffff9a89133dd800.statahead_batch_max=0 llite.lustre-ffff9a89133dd800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a89133dd800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.939s user 0m0.232s sys 0m18.742s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a89133dd800.statahead_batch_max=256 llite.lustre-ffff9a89133dd800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a89133dd800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a89133dd800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m28.294s user 0m0.224s sys 0m17.078s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9a89133dd800.batch_stats= snapshot_time: 1780342590.473782175 secs.nsecs start_time: 1780342555.197491957 secs.nsecs elapsed_time: 35.276290218 secs.nsecs subreqs per batch batches % cum % 1: 357 64 64 2: 56 10 74 4: 52 9 83 8: 22 3 87 16: 16 2 90 32: 13 2 93 64: 4 0 93 128: 1 0 94 256: 33 5 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9a89133dd800.statahead_batch_max=64 llite.lustre-ffff9a89133dd800.statahead_max=128