== sanity test 123ad: Verify batching statahead works correctly ========================================================== 00:06:55 (1789186015) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9a66fecab800.batch_stats=0 llite.lustre-ffff9a66fecab800.statahead_max=32 llite.lustre-ffff9a66fecab800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9a66fecab800.batch_stats=0 total: 100 open/close in 2.64 seconds: 37.91 ops/second llite.lustre-ffff9a66fecab800.statahead_max=0 101 real 0m2.028s user 0m0.002s sys 0m0.292s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9a66fecab800.statahead_max=32 llite.lustre-ffff9a66fecab800.statahead_max=32 101 real 0m0.883s user 0m0.005s sys 0m0.155s 'ls -l' 100 files with statahead: 1 sec statahead total: 94 statahead wrong: 2 agl total: 88 list_total: 29 fname_total: 61 hit_total: 3887 miss_total: 1310 swrong=2 ewrong=2 - open/close 785 (time 1789186040.97 total 10.01 last 78.44) total: 900 open/close in 12.04 seconds: 74.76 ops/second llite.lustre-ffff9a66fecab800.statahead_max=0 1001 real 0m20.577s user 0m0.041s sys 0m2.795s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff9a66fecab800.statahead_max=32 llite.lustre-ffff9a66fecab800.statahead_max=32 1001 real 0m7.365s user 0m0.026s sys 0m1.361s 'ls -l' 1000 files with statahead: 8 sec statahead total: 95 statahead wrong: 2 agl total: 89 list_total: 30 fname_total: 61 hit_total: 4886 miss_total: 1311 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 16 seconds llite.lustre-ffff9a66fecab800.statahead_stats= statahead total: 95 statahead wrong: 2 agl total: 89 list_total: 30 fname_total: 61 hit_total: 4886 miss_total: 1311 mdc.lustre-MDT0000-mdc-ffff9a66fecab800.batch_stats= snapshot_time: 1789186096.310455205 secs.nsecs start_time: 1789186019.821214578 secs.nsecs elapsed_time: 76.489240627 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 1 2 5 8: 2 5 10 16: 2 5 15 32: 34 85 100 - open/close 820 (time 1789186108.28 total 10.00 last 81.97) - open/close 1587 (time 1789186118.28 total 20.01 last 76.66) - open/close 2376 (time 1789186128.29 total 30.02 last 78.81) - open/close 3167 (time 1789186138.29 total 40.02 last 79.09) - open/close 4021 (time 1789186148.30 total 50.02 last 85.38) - open/close 4873 (time 1789186158.30 total 60.03 last 85.13) - open/close 5664 (time 1789186168.31 total 70.04 last 79.07) - open/close 6548 (time 1789186178.31 total 80.04 last 88.40) - open/close 7442 (time 1789186188.31 total 90.04 last 89.39) - open/close 8287 (time 1789186198.31 total 100.04 last 84.46) - open/close 9145 (time 1789186208.31 total 110.04 last 85.79) total: 10000 open/close in 119.47 seconds: 83.70 ops/second llite.lustre-ffff9a66fecab800.statahead_batch_max=0 llite.lustre-ffff9a66fecab800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a66fecab800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m41.437s user 0m0.266s sys 0m17.908s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a66fecab800.statahead_batch_max=32 llite.lustre-ffff9a66fecab800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a66fecab800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a66fecab800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m4.374s user 0m0.250s sys 0m14.343s batched statahead RPC= hit count=9983 mdc.lustre-MDT0000-mdc-ffff9a66fecab800.batch_stats= snapshot_time: 1789186336.236108207 secs.nsecs start_time: 1789186264.394151150 secs.nsecs elapsed_time: 71.841957057 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9a66fecab800.batch_stats=0 llite.lustre-ffff9a66fecab800.statahead_max=2048 llite.lustre-ffff9a66fecab800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9a66fecab800.batch_stats=0 total: 100 open/close in 1.72 seconds: 58.10 ops/second llite.lustre-ffff9a66fecab800.statahead_max=0 101 real 0m1.593s user 0m0.003s sys 0m0.280s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9a66fecab800.statahead_max=2048 llite.lustre-ffff9a66fecab800.statahead_max=2048 101 real 0m0.563s user 0m0.004s sys 0m0.205s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10082 miss_total: 18 swrong=0 ewrong=0 total: 900 open/close in 8.09 seconds: 111.22 ops/second llite.lustre-ffff9a66fecab800.statahead_max=0 1001 real 0m17.008s user 0m0.028s sys 0m2.766s 'ls -l' 1000 files without statahead: 17 sec llite.lustre-ffff9a66fecab800.statahead_max=2048 llite.lustre-ffff9a66fecab800.statahead_max=2048 1001 real 0m4.289s user 0m0.022s sys 0m1.461s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 12 seconds llite.lustre-ffff9a66fecab800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 mdc.lustre-MDT0000-mdc-ffff9a66fecab800.batch_stats= snapshot_time: 1789186601.944653969 secs.nsecs start_time: 1789186337.956662305 secs.nsecs elapsed_time: 263.987991664 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 941 (time 1789186613.49 total 10.01 last 94.04) - open/close 1921 (time 1789186623.50 total 20.01 last 97.97) - open/close 3089 (time 1789186633.50 total 30.01 last 116.79) - open/close 4025 (time 1789186643.50 total 40.02 last 93.55) - open/close 4923 (time 1789186653.51 total 50.02 last 89.77) - open/close 5948 (time 1789186663.51 total 60.02 last 102.49) - open/close 6946 (time 1789186673.51 total 70.02 last 99.77) - open/close 7933 (time 1789186683.52 total 80.03 last 98.65) - open/close 8924 (time 1789186693.52 total 90.03 last 99.05) - open/close 9853 (time 1789186703.52 total 100.04 last 92.87) total: 10000 open/close in 101.51 seconds: 98.51 ops/second llite.lustre-ffff9a66fecab800.statahead_batch_max=0 llite.lustre-ffff9a66fecab800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a66fecab800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.400s user 0m0.276s sys 0m19.856s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a66fecab800.statahead_batch_max=256 llite.lustre-ffff9a66fecab800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a66fecab800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a66fecab800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.637s user 0m0.233s sys 0m16.783s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9a66fecab800.batch_stats= snapshot_time: 1789186783.956017923 secs.nsecs start_time: 1789186746.283970716 secs.nsecs elapsed_time: 37.672047207 secs.nsecs subreqs per batch batches %% cum %% 1: 153 53 53 2: 29 10 63 4: 28 9 73 8: 11 3 77 16: 7 2 80 32: 12 4 84 64: 10 3 87 128: 0 0 87 256: 35 12 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9a66fecab800.statahead_batch_max=64 llite.lustre-ffff9a66fecab800.statahead_max=128