== sanity test 123ad: Verify batching statahead works correctly ========================================================== 17:02:44 (1786568564) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8bb491658000.batch_stats=0 llite.lustre-ffff8bb491658000.statahead_max=32 llite.lustre-ffff8bb491658000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8bb491658000.batch_stats=0 total: 100 open/close in 2.03 seconds: 49.36 ops/second llite.lustre-ffff8bb491658000.statahead_max=0 101 real 0m2.166s user 0m0.002s sys 0m0.331s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8bb491658000.statahead_max=32 llite.lustre-ffff8bb491658000.statahead_max=32 101 real 0m0.859s user 0m0.007s sys 0m0.188s 'ls -l' 100 files with statahead: 0 sec statahead total: 122 statahead wrong: 2 agl total: 117 list_total: 30 fname_total: 84 hit_total: 3812 miss_total: 1414 swrong=2 ewrong=2 total: 900 open/close in 8.75 seconds: 102.83 ops/second llite.lustre-ffff8bb491658000.statahead_max=0 1001 real 0m16.321s user 0m0.031s sys 0m2.997s 'ls -l' 1000 files without statahead: 16 sec llite.lustre-ffff8bb491658000.statahead_max=32 llite.lustre-ffff8bb491658000.statahead_max=32 1001 real 0m7.011s user 0m0.020s sys 0m1.504s 'ls -l' 1000 files with statahead: 7 sec statahead total: 123 statahead wrong: 2 agl total: 118 list_total: 31 fname_total: 84 hit_total: 4810 miss_total: 1416 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 15 seconds llite.lustre-ffff8bb491658000.statahead_stats= statahead total: 123 statahead wrong: 2 agl total: 118 list_total: 31 fname_total: 84 hit_total: 4810 miss_total: 1416 mdc.lustre-MDT0000-mdc-ffff8bb491658000.batch_stats= snapshot_time: 1786568635.355751184 secs.nsecs start_time: 1786568568.788833708 secs.nsecs elapsed_time: 66.566917476 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 926 (time 1786568647.12 total 10.00 last 92.58) - open/close 1750 (time 1786568657.13 total 20.01 last 82.35) - open/close 2658 (time 1786568667.13 total 30.01 last 90.79) - open/close 3586 (time 1786568677.14 total 40.02 last 92.72) - open/close 4510 (time 1786568687.15 total 50.03 last 92.34) - open/close 5397 (time 1786568697.15 total 60.03 last 88.70) - open/close 6363 (time 1786568707.15 total 70.03 last 96.54) - open/close 7327 (time 1786568717.16 total 80.04 last 96.33) - open/close 8431 (time 1786568727.17 total 90.05 last 110.30) - open/close 9347 (time 1786568737.18 total 100.06 last 91.53) total: 10000 open/close in 107.29 seconds: 93.21 ops/second llite.lustre-ffff8bb491658000.statahead_batch_max=0 llite.lustre-ffff8bb491658000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8bb491658000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m47.863s user 0m0.316s sys 0m16.753s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8bb491658000.statahead_batch_max=32 llite.lustre-ffff8bb491658000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8bb491658000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8bb491658000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m15.195s user 0m0.288s sys 0m14.798s batched statahead RPC= hit count=9988 mdc.lustre-MDT0000-mdc-ffff8bb491658000.batch_stats= snapshot_time: 1786568884.339092687 secs.nsecs start_time: 1786568799.720015674 secs.nsecs elapsed_time: 84.619077013 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 0 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8bb491658000.batch_stats=0 llite.lustre-ffff8bb491658000.statahead_max=2048 llite.lustre-ffff8bb491658000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8bb491658000.batch_stats=0 total: 100 open/close in 1.88 seconds: 53.29 ops/second llite.lustre-ffff8bb491658000.statahead_max=0 101 real 0m1.954s user 0m0.004s sys 0m0.326s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8bb491658000.statahead_max=2048 llite.lustre-ffff8bb491658000.statahead_max=2048 101 real 0m0.537s user 0m0.004s sys 0m0.188s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10087 miss_total: 13 swrong=0 ewrong=0 total: 900 open/close in 8.63 seconds: 104.25 ops/second llite.lustre-ffff8bb491658000.statahead_max=0 1001 real 0m16.084s user 0m0.025s sys 0m2.944s 'ls -l' 1000 files without statahead: 16 sec llite.lustre-ffff8bb491658000.statahead_max=2048 llite.lustre-ffff8bb491658000.statahead_max=2048 1001 real 0m4.881s user 0m0.021s sys 0m1.642s 'ls -l' 1000 files with statahead: 5 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11086 miss_total: 14 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 11 seconds llite.lustre-ffff8bb491658000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11086 miss_total: 14 mdc.lustre-MDT0000-mdc-ffff8bb491658000.batch_stats= snapshot_time: 1786569153.822665712 secs.nsecs start_time: 1786568886.008365727 secs.nsecs elapsed_time: 267.814299985 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 1 9 63 128: 0 0 63 256: 4 36 100 - open/close 1267 (time 1786569165.25 total 10.01 last 126.56) - open/close 2259 (time 1786569175.26 total 20.01 last 99.17) - open/close 3359 (time 1786569185.27 total 30.02 last 109.91) - open/close 4422 (time 1786569195.27 total 40.03 last 106.22) - open/close 5445 (time 1786569205.27 total 50.03 last 102.29) - open/close 6577 (time 1786569215.27 total 60.03 last 113.19) - open/close 7783 (time 1786569225.28 total 70.04 last 120.53) - open/close 8974 (time 1786569235.28 total 80.04 last 119.06) total: 10000 open/close in 88.44 seconds: 113.07 ops/second llite.lustre-ffff8bb491658000.statahead_batch_max=0 llite.lustre-ffff8bb491658000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8bb491658000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.213s user 0m0.258s sys 0m17.975s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8bb491658000.statahead_batch_max=256 llite.lustre-ffff8bb491658000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8bb491658000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8bb491658000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.782s user 0m0.261s sys 0m17.307s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8bb491658000.batch_stats= snapshot_time: 1786569331.225317297 secs.nsecs start_time: 1786569287.000775319 secs.nsecs elapsed_time: 44.224541978 secs.nsecs subreqs per batch batches %% cum %% 1: 219 57 57 2: 43 11 68 4: 36 9 78 8: 17 4 82 16: 11 2 85 32: 17 4 90 64: 3 0 90 128: 1 0 91 256: 34 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8bb491658000.statahead_batch_max=64 llite.lustre-ffff8bb491658000.statahead_max=128