== sanity test 123ad: Verify batching statahead works correctly ========================================================== 19:10:42 (1746141042) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8800b60f6800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8800b60f6800.batch_stats=0 llite.lustre-ffff8800b60f6800.statahead_max=32 llite.lustre-ffff8800b60f6800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8800b60f6800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8800b60f6800.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 1.87 seconds: 53.52 ops/second llite.lustre-ffff8800b60f6800.statahead_max=0 101 real 0m1.597s user 0m0.004s sys 0m0.395s ls -l 100 files without statahead: 2 sec llite.lustre-ffff8800b60f6800.statahead_max=32 32 101 real 0m0.537s user 0m0.011s sys 0m0.152s ls -l 100 files with statahead: 0 sec statahead total: 124 statahead wrong: 2 agl total: 124 list_total: 29 fname_total: 95 hit_total: 4666 miss_total: 1238 total: 900 open/close in 7.64 seconds: 117.79 ops/second llite.lustre-ffff8800b60f6800.statahead_max=0 1001 real 0m13.801s user 0m0.091s sys 0m3.288s ls -l 1000 files without statahead: 14 sec llite.lustre-ffff8800b60f6800.statahead_max=32 32 1001 real 0m4.800s user 0m0.034s sys 0m1.370s ls -l 1000 files with statahead: 5 sec statahead total: 125 statahead wrong: 2 agl total: 125 list_total: 30 fname_total: 95 hit_total: 5665 miss_total: 1240 - open/close 1148 (time 1746141093.37 total 10.00 last 114.75) total: 2000 open/close in 17.78 seconds: 112.50 ops/second llite.lustre-ffff8800b60f6800.statahead_max=0 3001 real 0m44.297s user 0m0.260s sys 0m10.339s ls -l 3000 files without statahead: 44 sec llite.lustre-ffff8800b60f6800.statahead_max=32 32 3001 real 0m12.343s user 0m0.099s sys 0m3.804s ls -l 3000 files with statahead: 12 sec statahead total: 126 statahead wrong: 2 agl total: 126 list_total: 31 fname_total: 95 hit_total: 8664 miss_total: 1263 ls -l done rm -r /mnt/lustre/d123ad.sanity: 35 seconds llite.lustre-ffff8800b60f6800.statahead_stats= statahead total: 126 statahead wrong: 2 agl total: 126 list_total: 31 fname_total: 95 hit_total: 8664 miss_total: 1263 mdc.lustre-MDT0000-mdc-ffff8800b60f6800.batch_stats= snapshot_time: 1746141199.653591533 secs.nsecs start_time: 1746141045.264607425 secs.nsecs elapsed_time: 154.388984108 secs.nsecs subreqs per batch batches % cum % 1: 2 1 1 2: 1 0 2 4: 1 0 2 8: 5 3 6 16: 76 55 62 32: 51 37 100 mdc.lustre-MDT0001-mdc-ffff8800b60f6800.batch_stats= snapshot_time: 1746141199.653732121 secs.nsecs start_time: 1746141045.266517896 secs.nsecs elapsed_time: 154.387214225 secs.nsecs subreqs per batch batches % cum % 1: 1 0 0 2: 0 0 0 4: 5 3 4 8: 2 1 5 16: 69 51 57 32: 58 42 100 - open/close 982 (time 1746141211.42 total 10.01 last 98.08) - open/close 1991 (time 1746141221.43 total 20.02 last 100.83) - open/close 3048 (time 1746141231.44 total 30.03 last 105.63) - open/close 4146 (time 1746141241.45 total 40.04 last 109.69) - open/close 5329 (time 1746141251.46 total 50.04 last 118.21) - open/close 6533 (time 1746141261.46 total 60.05 last 120.36) - open/close 7691 (time 1746141271.47 total 70.06 last 115.69) - open/close 8872 (time 1746141281.47 total 80.06 last 118.09) total: 10000 open/close in 88.28 seconds: 113.28 ops/second llite.lustre-ffff8800b60f6800.statahead_batch_max=0 llite.lustre-ffff8800b60f6800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8800b60f6800.stats=clear mdc.lustre-MDT0001-mdc-ffff8800b60f6800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m24.135s user 0m0.310s sys 0m10.001s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8800b60f6800.statahead_batch_max=32 llite.lustre-ffff8800b60f6800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8800b60f6800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8800b60f6800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8800b60f6800.stats=clear mdc.lustre-MDT0001-mdc-ffff8800b60f6800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m41.495s user 0m0.339s sys 0m11.620s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8800b60f6800.batch_stats= snapshot_time: 1746141362.451047176 secs.nsecs start_time: 1746141316.801500099 secs.nsecs elapsed_time: 45.649547077 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff8800b60f6800.batch_stats= snapshot_time: 1746141362.451121459 secs.nsecs start_time: 1746141316.801558959 secs.nsecs elapsed_time: 45.649562500 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8800b60f6800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8800b60f6800.batch_stats=0 llite.lustre-ffff8800b60f6800.statahead_max=2048 llite.lustre-ffff8800b60f6800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8800b60f6800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8800b60f6800.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 1.48 seconds: 67.35 ops/second llite.lustre-ffff8800b60f6800.statahead_max=0 101 real 0m1.482s user 0m0.004s sys 0m0.378s ls -l 100 files without statahead: 1 sec llite.lustre-ffff8800b60f6800.statahead_max=2048 2048 101 real 0m0.352s user 0m0.008s sys 0m0.159s ls -l 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 56 total: 900 open/close in 6.43 seconds: 140.06 ops/second llite.lustre-ffff8800b60f6800.statahead_max=0 1001 real 0m10.145s user 0m0.111s sys 0m2.748s ls -l 1000 files without statahead: 10 sec llite.lustre-ffff8800b60f6800.statahead_max=2048 2048 1001 real 0m2.123s user 0m0.035s sys 0m1.161s ls -l 1000 files with statahead: 2 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 57 - open/close 1435 (time 1746141555.87 total 10.01 last 143.36) - open/close 2751 (time 1746141565.88 total 20.02 last 131.50) total: 4000 open/close in 29.62 seconds: 135.05 ops/second llite.lustre-ffff8800b60f6800.statahead_max=0 5001 real 1m1.401s user 0m0.614s sys 0m15.000s ls -l 5000 files without statahead: 62 sec llite.lustre-ffff8800b60f6800.statahead_max=2048 2048 5001 real 0m8.476s user 0m0.157s sys 0m5.605s ls -l 5000 files with statahead: 8 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 16096 miss_total: 58 ls -l done rm -r /mnt/lustre/d123ad.sanity: 45 seconds llite.lustre-ffff8800b60f6800.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 16096 miss_total: 58 mdc.lustre-MDT0000-mdc-ffff8800b60f6800.batch_stats= snapshot_time: 1746141696.584146671 secs.nsecs start_time: 1746141363.059839917 secs.nsecs elapsed_time: 333.524306754 secs.nsecs subreqs per batch batches % cum % 1: 1 3 3 2: 1 3 7 4: 1 3 10 8: 5 17 28 16: 2 7 35 32: 1 3 39 64: 0 0 39 128: 1 3 42 256: 16 57 100 mdc.lustre-MDT0001-mdc-ffff8800b60f6800.batch_stats= snapshot_time: 1746141696.584250248 secs.nsecs start_time: 1746141363.059940803 secs.nsecs elapsed_time: 333.524309445 secs.nsecs subreqs per batch batches % cum % 1: 3 10 10 2: 0 0 10 4: 4 14 25 8: 3 10 35 16: 0 0 35 32: 0 0 35 64: 1 3 39 128: 2 7 46 256: 15 53 100 - open/close 1333 (time 1746141707.71 total 10.00 last 133.29) - open/close 2733 (time 1746141717.71 total 20.00 last 139.95) - open/close 4089 (time 1746141727.71 total 30.00 last 135.59) - open/close 5352 (time 1746141737.72 total 40.01 last 126.29) - open/close 6563 (time 1746141747.73 total 50.02 last 120.93) - open/close 7884 (time 1746141757.73 total 60.02 last 132.07) - open/close 9110 (time 1746141767.74 total 70.03 last 122.51) total: 10000 open/close in 77.72 seconds: 128.66 ops/second llite.lustre-ffff8800b60f6800.statahead_batch_max=0 llite.lustre-ffff8800b60f6800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8800b60f6800.stats=clear mdc.lustre-MDT0001-mdc-ffff8800b60f6800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m24.805s user 0m0.347s sys 0m10.402s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8800b60f6800.statahead_batch_max=256 llite.lustre-ffff8800b60f6800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8800b60f6800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8800b60f6800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8800b60f6800.stats=clear mdc.lustre-MDT0001-mdc-ffff8800b60f6800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m22.294s user 0m0.380s sys 0m11.596s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8800b60f6800.batch_stats= snapshot_time: 1746141831.137908343 secs.nsecs start_time: 1746141803.844394734 secs.nsecs elapsed_time: 27.293513609 secs.nsecs subreqs per batch batches % cum % 1: 61 40 40 2: 11 7 47 4: 6 3 51 8: 11 7 58 16: 12 7 66 32: 10 6 73 64: 5 3 76 128: 0 0 76 256: 36 23 100 mdc.lustre-MDT0001-mdc-ffff8800b60f6800.batch_stats= snapshot_time: 1746141831.138557112 secs.nsecs start_time: 1746141803.844461721 secs.nsecs elapsed_time: 27.294095391 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8800b60f6800.statahead_batch_max=64 llite.lustre-ffff8800b60f6800.statahead_max=128