== sanity test 123ad: Verify batching statahead works correctly ========================================================== 17:54:38 (1786571678) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8f3fed246800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8f3fed246800.batch_stats=0 llite.lustre-ffff8f3fed246800.statahead_max=32 llite.lustre-ffff8f3fed246800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8f3fed246800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8f3fed246800.batch_stats=0 striped dir -i1 -c2 -H crush2 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.86 seconds: 116.39 ops/second llite.lustre-ffff8f3fed246800.statahead_max=0 101 real 0m0.740s user 0m0.005s sys 0m0.281s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8f3fed246800.statahead_max=32 llite.lustre-ffff8f3fed246800.statahead_max=32 101 real 0m0.496s user 0m0.007s sys 0m0.318s 'ls -l' 100 files with statahead: 0 sec statahead total: 122 statahead wrong: 2 agl total: 117 list_total: 31 fname_total: 91 hit_total: 3888 miss_total: 1739 swrong=2 ewrong=2 total: 900 open/close in 2.91 seconds: 309.30 ops/second llite.lustre-ffff8f3fed246800.statahead_max=0 1001 real 0m7.292s user 0m0.022s sys 0m2.723s 'ls -l' 1000 files without statahead: 8 sec llite.lustre-ffff8f3fed246800.statahead_max=32 llite.lustre-ffff8f3fed246800.statahead_max=32 1001 real 0m4.348s user 0m0.016s sys 0m2.173s 'ls -l' 1000 files with statahead: 4 sec statahead total: 123 statahead wrong: 2 agl total: 118 list_total: 32 fname_total: 91 hit_total: 4887 miss_total: 1740 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff8f3fed246800.statahead_stats= statahead total: 123 statahead wrong: 2 agl total: 118 list_total: 32 fname_total: 91 hit_total: 4887 miss_total: 1740 mdc.lustre-MDT0000-mdc-ffff8f3fed246800.batch_stats= snapshot_time: 1786571708.889999428 secs.nsecs start_time: 1786571679.731083548 secs.nsecs elapsed_time: 29.158915880 secs.nsecs subreqs per batch batches %% cum %% 1: 3 7 7 2: 2 5 13 4: 2 5 18 8: 1 2 21 16: 23 60 81 32: 7 18 100 mdc.lustre-MDT0001-mdc-ffff8f3fed246800.batch_stats= snapshot_time: 1786571708.890044178 secs.nsecs start_time: 1786571679.731157327 secs.nsecs elapsed_time: 29.158886851 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 4 10 12 16: 10 25 38 32: 24 61 100 - open/close 3243 (time 1786571720.25 total 10.00 last 324.27) - open/close 6249 (time 1786571730.25 total 20.00 last 300.51) - open/close 9280 (time 1786571740.25 total 30.01 last 303.04) total: 10000 open/close in 31.91 seconds: 313.39 ops/second llite.lustre-ffff8f3fed246800.statahead_batch_max=0 llite.lustre-ffff8f3fed246800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f3fed246800.stats=clear mdc.lustre-MDT0001-mdc-ffff8f3fed246800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.345s user 0m0.271s sys 0m35.869s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8f3fed246800.statahead_batch_max=32 llite.lustre-ffff8f3fed246800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f3fed246800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8f3fed246800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8f3fed246800.stats=clear mdc.lustre-MDT0001-mdc-ffff8f3fed246800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m43.013s user 0m0.212s sys 0m24.900s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8f3fed246800.batch_stats= snapshot_time: 1786571832.938392113 secs.nsecs start_time: 1786571783.073071966 secs.nsecs elapsed_time: 49.865320147 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff8f3fed246800.batch_stats= snapshot_time: 1786571832.938444693 secs.nsecs start_time: 1786571783.073137496 secs.nsecs elapsed_time: 49.865307197 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8f3fed246800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8f3fed246800.batch_stats=0 llite.lustre-ffff8f3fed246800.statahead_max=2048 llite.lustre-ffff8f3fed246800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8f3fed246800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8f3fed246800.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.87 seconds: 115.37 ops/second llite.lustre-ffff8f3fed246800.statahead_max=0 101 real 0m0.799s user 0m0.002s sys 0m0.302s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8f3fed246800.statahead_max=2048 llite.lustre-ffff8f3fed246800.statahead_max=2048 101 real 0m0.442s user 0m0.004s sys 0m0.230s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 2.25 seconds: 400.20 ops/second llite.lustre-ffff8f3fed246800.statahead_max=0 1001 real 0m6.344s user 0m0.033s sys 0m2.455s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff8f3fed246800.statahead_max=2048 llite.lustre-ffff8f3fed246800.statahead_max=2048 1001 real 0m3.385s user 0m0.013s sys 0m1.304s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff8f3fed246800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff8f3fed246800.batch_stats= snapshot_time: 1786571958.946497751 secs.nsecs start_time: 1786571833.731249251 secs.nsecs elapsed_time: 125.215248500 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 3 37 37 8: 2 25 62 16: 0 0 62 32: 0 0 62 64: 1 12 75 128: 0 0 75 256: 2 25 100 mdc.lustre-MDT0001-mdc-ffff8f3fed246800.batch_stats= snapshot_time: 1786571958.946583109 secs.nsecs start_time: 1786571833.731382163 secs.nsecs elapsed_time: 125.215200946 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 3 37 37 8: 1 12 50 16: 1 12 62 32: 1 12 75 64: 0 0 75 128: 0 0 75 256: 2 25 100 - open/close 3148 (time 1786571969.89 total 10.00 last 314.71) - open/close 6009 (time 1786571979.89 total 20.00 last 286.07) - open/close 9287 (time 1786571989.89 total 30.01 last 327.70) total: 10000 open/close in 32.51 seconds: 307.56 ops/second llite.lustre-ffff8f3fed246800.statahead_batch_max=0 llite.lustre-ffff8f3fed246800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f3fed246800.stats=clear mdc.lustre-MDT0001-mdc-ffff8f3fed246800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.610s user 0m0.251s sys 0m32.804s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8f3fed246800.statahead_batch_max=256 llite.lustre-ffff8f3fed246800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f3fed246800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8f3fed246800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8f3fed246800.stats=clear mdc.lustre-MDT0001-mdc-ffff8f3fed246800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.001s user 0m0.231s sys 0m22.814s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8f3fed246800.batch_stats= snapshot_time: 1786572072.329488181 secs.nsecs start_time: 1786572033.658055027 secs.nsecs elapsed_time: 38.671433154 secs.nsecs subreqs per batch batches %% cum %% 1: 325 64 64 2: 68 13 78 4: 38 7 85 8: 9 1 87 16: 4 0 88 32: 22 4 92 64: 2 0 93 128: 0 0 93 256: 34 6 100 mdc.lustre-MDT0001-mdc-ffff8f3fed246800.batch_stats= snapshot_time: 1786572072.329555311 secs.nsecs start_time: 1786572033.658131160 secs.nsecs elapsed_time: 38.671424151 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8f3fed246800.statahead_batch_max=64 llite.lustre-ffff8f3fed246800.statahead_max=128