== sanity test 123ad: Verify batching statahead works correctly ========================================================== 00:07:47 (1787371667) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9dc042ca1800.batch_stats=0 llite.lustre-ffff9dc042ca1800.statahead_max=32 llite.lustre-ffff9dc042ca1800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9dc042ca1800.batch_stats=0 total: 100 open/close in 2.22 seconds: 44.95 ops/second llite.lustre-ffff9dc042ca1800.statahead_max=0 101 real 0m1.863s user 0m0.004s sys 0m0.286s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9dc042ca1800.statahead_max=32 llite.lustre-ffff9dc042ca1800.statahead_max=32 101 real 0m0.857s user 0m0.003s sys 0m0.161s 'ls -l' 100 files with statahead: 1 sec statahead total: 110 statahead wrong: 2 agl total: 105 list_total: 29 fname_total: 81 hit_total: 4114 miss_total: 1274 swrong=2 ewrong=2 - open/close 835 (time 1787371693.58 total 10.02 last 83.37) total: 900 open/close in 11.38 seconds: 79.08 ops/second llite.lustre-ffff9dc042ca1800.statahead_max=0 1001 real 0m21.605s user 0m0.039s sys 0m2.884s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff9dc042ca1800.statahead_max=32 llite.lustre-ffff9dc042ca1800.statahead_max=32 1001 real 0m7.978s user 0m0.024s sys 0m1.312s 'ls -l' 1000 files with statahead: 8 sec statahead total: 111 statahead wrong: 2 agl total: 106 list_total: 30 fname_total: 81 hit_total: 5111 miss_total: 1277 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff9dc042ca1800.statahead_stats= statahead total: 111 statahead wrong: 2 agl total: 106 list_total: 30 fname_total: 81 hit_total: 5111 miss_total: 1277 mdc.lustre-MDT0000-mdc-ffff9dc042ca1800.batch_stats= snapshot_time: 1787371756.720576203 secs.nsecs start_time: 1787371672.768526484 secs.nsecs elapsed_time: 83.952049719 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 769 (time 1787371768.99 total 10.00 last 76.87) - open/close 1519 (time 1787371778.99 total 20.01 last 74.99) - open/close 2315 (time 1787371789.00 total 30.01 last 79.55) - open/close 3200 (time 1787371799.01 total 40.02 last 88.41) - open/close 3983 (time 1787371809.01 total 50.03 last 78.27) - open/close 4741 (time 1787371819.03 total 60.04 last 75.68) - open/close 5579 (time 1787371829.03 total 70.04 last 83.79) - open/close 6393 (time 1787371839.04 total 80.05 last 81.31) - open/close 7289 (time 1787371849.05 total 90.06 last 89.54) - open/close 8117 (time 1787371859.05 total 100.06 last 82.78) - open/close 8842 (time 1787371869.06 total 110.07 last 72.48) - open/close 9485 (time 1787371879.06 total 120.07 last 64.27) total: 10000 open/close in 128.37 seconds: 77.90 ops/second llite.lustre-ffff9dc042ca1800.statahead_batch_max=0 llite.lustre-ffff9dc042ca1800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9dc042ca1800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.211s user 0m0.303s sys 0m13.161s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9dc042ca1800.statahead_batch_max=32 llite.lustre-ffff9dc042ca1800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9dc042ca1800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9dc042ca1800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m41.951s user 0m0.281s sys 0m12.647s batched statahead RPC= hit count=9971 mdc.lustre-MDT0000-mdc-ffff9dc042ca1800.batch_stats= snapshot_time: 1787372065.086637258 secs.nsecs start_time: 1787371954.655634114 secs.nsecs elapsed_time: 110.431003144 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9dc042ca1800.batch_stats=0 llite.lustre-ffff9dc042ca1800.statahead_max=2048 llite.lustre-ffff9dc042ca1800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9dc042ca1800.batch_stats=0 total: 100 open/close in 3.37 seconds: 29.69 ops/second llite.lustre-ffff9dc042ca1800.statahead_max=0 101 real 0m1.637s user 0m0.006s sys 0m0.298s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9dc042ca1800.statahead_max=2048 llite.lustre-ffff9dc042ca1800.statahead_max=2048 101 real 0m0.832s user 0m0.004s sys 0m0.164s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10070 miss_total: 30 swrong=0 ewrong=0 - open/close 777 (time 1787372345.58 total 10.00 last 77.67) total: 900 open/close in 12.44 seconds: 72.34 ops/second llite.lustre-ffff9dc042ca1800.statahead_max=0 1001 real 0m18.285s user 0m0.033s sys 0m2.708s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff9dc042ca1800.statahead_max=2048 llite.lustre-ffff9dc042ca1800.statahead_max=2048 1001 real 0m8.506s user 0m0.027s sys 0m1.349s 'ls -l' 1000 files with statahead: 9 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11069 miss_total: 31 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 18 seconds llite.lustre-ffff9dc042ca1800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11069 miss_total: 31 mdc.lustre-MDT0000-mdc-ffff9dc042ca1800.batch_stats= snapshot_time: 1787372407.306235124 secs.nsecs start_time: 1787372067.733311796 secs.nsecs elapsed_time: 339.572923328 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 1 10 30 32: 2 20 50 64: 1 10 60 128: 0 0 60 256: 4 40 100 - open/close 816 (time 1787372419.69 total 10.00 last 81.57) - open/close 1598 (time 1787372429.69 total 20.01 last 78.18) - open/close 2446 (time 1787372439.70 total 30.01 last 84.76) - open/close 3206 (time 1787372449.71 total 40.03 last 75.89) - open/close 3870 (time 1787372459.71 total 50.03 last 66.39) - open/close 4682 (time 1787372469.72 total 60.03 last 81.15) - open/close 5462 (time 1787372479.72 total 70.04 last 77.98) - open/close 6272 (time 1787372489.73 total 80.04 last 80.93) - open/close 7136 (time 1787372499.74 total 90.05 last 86.37) - open/close 7945 (time 1787372509.74 total 100.06 last 80.83) - open/close 8738 (time 1787372519.75 total 110.06 last 79.29) - open/close 9500 (time 1787372529.75 total 120.06 last 76.15) total: 10000 open/close in 128.50 seconds: 77.82 ops/second llite.lustre-ffff9dc042ca1800.statahead_batch_max=0 llite.lustre-ffff9dc042ca1800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9dc042ca1800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.493s user 0m0.292s sys 0m12.996s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9dc042ca1800.statahead_batch_max=256 llite.lustre-ffff9dc042ca1800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9dc042ca1800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9dc042ca1800.stats=clear ls -l files in d123ad.sanity: