== sanity test 123ad: Verify batching statahead works correctly ========================================================== 21:59:18 (1786067958) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8c1a1f483000.batch_stats=0 llite.lustre-ffff8c1a1f483000.statahead_max=32 llite.lustre-ffff8c1a1f483000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8c1a1f483000.batch_stats=0 total: 100 open/close in 2.59 seconds: 38.61 ops/second llite.lustre-ffff8c1a1f483000.statahead_max=0 101 real 0m2.262s user 0m0.003s sys 0m0.330s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8c1a1f483000.statahead_max=32 llite.lustre-ffff8c1a1f483000.statahead_max=32 101 real 0m1.047s user 0m0.003s sys 0m0.157s 'ls -l' 100 files with statahead: 1 sec statahead total: 128 statahead wrong: 2 agl total: 123 list_total: 30 fname_total: 98 hit_total: 4365 miss_total: 1287 swrong=2 ewrong=2 - open/close 747 (time 1786067984.95 total 10.01 last 74.64) total: 900 open/close in 12.70 seconds: 70.86 ops/second llite.lustre-ffff8c1a1f483000.statahead_max=0 1001 real 0m24.883s user 0m0.031s sys 0m3.114s 'ls -l' 1000 files without statahead: 25 sec llite.lustre-ffff8c1a1f483000.statahead_max=32 llite.lustre-ffff8c1a1f483000.statahead_max=32 1001 real 0m11.192s user 0m0.024s sys 0m1.479s 'ls -l' 1000 files with statahead: 12 sec statahead total: 129 statahead wrong: 2 agl total: 124 list_total: 31 fname_total: 98 hit_total: 5361 miss_total: 1291 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff8c1a1f483000.statahead_stats= statahead total: 129 statahead wrong: 2 agl total: 124 list_total: 31 fname_total: 98 hit_total: 5361 miss_total: 1291 mdc.lustre-MDT0000-mdc-ffff8c1a1f483000.batch_stats= snapshot_time: 1786068061.371770979 secs.nsecs start_time: 1786067962.170655598 secs.nsecs elapsed_time: 99.201115381 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 2 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 735 (time 1786068074.27 total 10.01 last 73.44) - open/close 1473 (time 1786068084.30 total 20.04 last 73.57) - open/close 2198 (time 1786068094.30 total 30.04 last 72.46) - open/close 2855 (time 1786068104.32 total 40.05 last 65.63) - open/close 3361 (time 1786068114.32 total 50.06 last 50.60) - open/close 3846 (time 1786068124.32 total 60.06 last 48.48) - open/close 4608 (time 1786068134.32 total 70.06 last 76.17) - open/close 5263 (time 1786068144.32 total 80.06 last 65.50) - open/close 6102 (time 1786068154.34 total 90.08 last 83.76) - open/close 6772 (time 1786068164.35 total 100.09 last 66.94) - open/close 7530 (time 1786068174.36 total 110.09 last 75.76) - open/close 8303 (time 1786068184.36 total 120.10 last 77.23) - open/close 9123 (time 1786068194.37 total 130.11 last 81.98) - open/close 9963 (time 1786068204.38 total 140.12 last 83.92) total: 10000 open/close in 140.53 seconds: 71.16 ops/second llite.lustre-ffff8c1a1f483000.statahead_batch_max=0 llite.lustre-ffff8c1a1f483000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c1a1f483000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m52.361s user 0m0.296s sys 0m18.628s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c1a1f483000.statahead_batch_max=32 llite.lustre-ffff8c1a1f483000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c1a1f483000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c1a1f483000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m34.351s user 0m0.291s sys 0m15.522s batched statahead RPC= hit count=9984 mdc.lustre-MDT0000-mdc-ffff8c1a1f483000.batch_stats= snapshot_time: 1786068370.149008401 secs.nsecs start_time: 1786068264.773656704 secs.nsecs elapsed_time: 105.375351697 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8c1a1f483000.batch_stats=0 llite.lustre-ffff8c1a1f483000.statahead_max=2048 llite.lustre-ffff8c1a1f483000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8c1a1f483000.batch_stats=0 total: 100 open/close in 2.75 seconds: 36.38 ops/second llite.lustre-ffff8c1a1f483000.statahead_max=0 101 real 0m3.192s user 0m0.006s sys 0m0.338s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8c1a1f483000.statahead_max=2048 llite.lustre-ffff8c1a1f483000.statahead_max=2048 101 real 0m0.982s user 0m0.006s sys 0m0.184s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10083 miss_total: 17 swrong=0 ewrong=0 - open/close 744 (time 1786068698.78 total 10.01 last 74.33) total: 900 open/close in 12.46 seconds: 72.25 ops/second llite.lustre-ffff8c1a1f483000.statahead_max=0 1001 real 0m28.001s user 0m0.033s sys 0m3.287s 'ls -l' 1000 files without statahead: 28 sec llite.lustre-ffff8c1a1f483000.statahead_max=2048 llite.lustre-ffff8c1a1f483000.statahead_max=2048 1001 real 0m6.574s user 0m0.034s sys 0m1.611s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffff8c1a1f483000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 mdc.lustre-MDT0000-mdc-ffff8c1a1f483000.batch_stats= snapshot_time: 1786068773.314908936 secs.nsecs start_time: 1786068372.289634193 secs.nsecs elapsed_time: 401.025274743 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 1 9 54 128: 1 9 63 256: 4 36 100 - open/close 591 (time 1786068785.97 total 10.00 last 59.09) - open/close 1315 (time 1786068795.99 total 20.01 last 72.31) - open/close 2099 (time 1786068805.99 total 30.02 last 78.34) - open/close 2925 (time 1786068816.01 total 40.04 last 82.45) - open/close 3680 (time 1786068826.04 total 50.07 last 75.28) - open/close 4419 (time 1786068836.05 total 60.08 last 73.83) - open/close 5204 (time 1786068846.06 total 70.09 last 78.41) - open/close 6036 (time 1786068856.08 total 80.11 last 83.05) - open/close 6826 (time 1786068866.08 total 90.11 last 78.99) - open/close 7653 (time 1786068876.09 total 100.12 last 82.65) - open/close 8406 (time 1786068886.09 total 110.12 last 75.28) - open/close 9241 (time 1786068896.09 total 120.12 last 83.48) total: 10000 open/close in 129.63 seconds: 77.14 ops/second llite.lustre-ffff8c1a1f483000.statahead_batch_max=0 llite.lustre-ffff8c1a1f483000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c1a1f483000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m56.294s user 0m0.327s sys 0m17.534s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c1a1f483000.statahead_batch_max=256 llite.lustre-ffff8c1a1f483000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c1a1f483000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c1a1f483000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m53.114s user 0m0.280s sys 0m15.969s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8c1a1f483000.batch_stats= snapshot_time: 1786069037.974776976 secs.nsecs start_time: 1786068970.721467251 secs.nsecs elapsed_time: 67.253309725 secs.nsecs subreqs per batch batches %% cum %% 1: 244 55 55 2: 73 16 71 4: 35 7 79 8: 22 4 84 16: 17 3 88 32: 14 3 91 64: 3 0 92 128: 1 0 92 256: 34 7 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8c1a1f483000.statahead_batch_max=64 llite.lustre-ffff8c1a1f483000.statahead_max=128