== sanity test 123ad: Verify batching statahead works correctly ========================================================== 22:19:55 (1786760395) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff986b064f3000.batch_stats=0 llite.lustre-ffff986b064f3000.statahead_max=32 llite.lustre-ffff986b064f3000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff986b064f3000.batch_stats=0 total: 100 open/close in 2.91 seconds: 34.31 ops/second llite.lustre-ffff986b064f3000.statahead_max=0 101 real 0m2.034s user 0m0.005s sys 0m0.352s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff986b064f3000.statahead_max=32 llite.lustre-ffff986b064f3000.statahead_max=32 101 real 0m1.209s user 0m0.002s sys 0m0.176s 'ls -l' 100 files with statahead: 1 sec statahead total: 129 statahead wrong: 2 agl total: 123 list_total: 30 fname_total: 78 hit_total: 3742 miss_total: 1715 swrong=2 ewrong=2 - open/close 807 (time 1786760424.69 total 10.01 last 80.62) total: 900 open/close in 11.69 seconds: 76.96 ops/second llite.lustre-ffff986b064f3000.statahead_max=0 1001 real 0m35.836s user 0m0.032s sys 0m3.331s 'ls -l' 1000 files without statahead: 36 sec llite.lustre-ffff986b064f3000.statahead_max=32 llite.lustre-ffff986b064f3000.statahead_max=32 1001 real 0m12.061s user 0m0.031s sys 0m1.614s 'ls -l' 1000 files with statahead: 13 sec statahead total: 130 statahead wrong: 2 agl total: 124 list_total: 31 fname_total: 78 hit_total: 4739 miss_total: 1718 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffff986b064f3000.statahead_stats= statahead total: 130 statahead wrong: 2 agl total: 124 list_total: 31 fname_total: 78 hit_total: 4739 miss_total: 1718 mdc.lustre-MDT0000-mdc-ffff986b064f3000.batch_stats= snapshot_time: 1786760512.856576973 secs.nsecs start_time: 1786760401.121518736 secs.nsecs elapsed_time: 111.735058237 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 607 (time 1786760525.91 total 10.00 last 60.69) - open/close 1238 (time 1786760535.92 total 20.02 last 63.01) - open/close 2084 (time 1786760545.93 total 30.02 last 84.56) - open/close 2739 (time 1786760555.93 total 40.03 last 65.45) - open/close 3432 (time 1786760565.93 total 50.03 last 69.30) - open/close 4179 (time 1786760575.95 total 60.05 last 74.56) - open/close 4940 (time 1786760585.97 total 70.06 last 75.97) - open/close 5663 (time 1786760595.98 total 80.07 last 72.23) - open/close 6445 (time 1786760606.00 total 90.10 last 78.02) - open/close 7224 (time 1786760616.02 total 100.12 last 77.72) - open/close 7974 (time 1786760626.03 total 110.13 last 74.96) - open/close 8744 (time 1786760636.06 total 120.15 last 76.79) - open/close 9272 (time 1786760646.06 total 130.16 last 52.80) - open/close 9745 (time 1786760656.08 total 140.18 last 47.21) total: 10000 open/close in 144.48 seconds: 69.21 ops/second llite.lustre-ffff986b064f3000.statahead_batch_max=0 llite.lustre-ffff986b064f3000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff986b064f3000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m8.946s user 0m0.323s sys 0m15.891s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff986b064f3000.statahead_batch_max=32 llite.lustre-ffff986b064f3000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff986b064f3000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff986b064f3000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m40.051s user 0m0.290s sys 0m14.913s batched statahead RPC= hit count=9981 mdc.lustre-MDT0000-mdc-ffff986b064f3000.batch_stats= snapshot_time: 1786760856.231384119 secs.nsecs start_time: 1786760739.899274159 secs.nsecs elapsed_time: 116.332109960 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff986b064f3000.batch_stats=0 llite.lustre-ffff986b064f3000.statahead_max=2048 llite.lustre-ffff986b064f3000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff986b064f3000.batch_stats=0 total: 100 open/close in 2.93 seconds: 34.07 ops/second llite.lustre-ffff986b064f3000.statahead_max=0 101 real 0m2.282s user 0m0.002s sys 0m0.362s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff986b064f3000.statahead_max=2048 llite.lustre-ffff986b064f3000.statahead_max=2048 101 real 0m0.681s user 0m0.003s sys 0m0.165s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10080 miss_total: 20 swrong=0 ewrong=0 - open/close 766 (time 1786761187.62 total 10.00 last 76.59) total: 900 open/close in 11.76 seconds: 76.52 ops/second llite.lustre-ffff986b064f3000.statahead_max=0 1001 real 0m20.284s user 0m0.040s sys 0m3.215s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff986b064f3000.statahead_max=2048 llite.lustre-ffff986b064f3000.statahead_max=2048 1001 real 0m6.776s user 0m0.020s sys 0m1.578s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11079 miss_total: 21 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff986b064f3000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11079 miss_total: 21 mdc.lustre-MDT0000-mdc-ffff986b064f3000.batch_stats= snapshot_time: 1786761253.303363428 secs.nsecs start_time: 1786760858.811267331 secs.nsecs elapsed_time: 394.492096097 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 700 (time 1786761266.17 total 10.06 last 69.62) - open/close 1359 (time 1786761276.18 total 20.07 last 65.83) - open/close 1951 (time 1786761286.18 total 30.07 last 59.17) - open/close 2628 (time 1786761296.19 total 40.08 last 67.66) - open/close 3305 (time 1786761306.19 total 50.08 last 67.69) - open/close 4022 (time 1786761316.19 total 60.08 last 71.69) - open/close 4672 (time 1786761326.22 total 70.10 last 64.83) - open/close 5356 (time 1786761336.23 total 80.12 last 68.31) - open/close 6027 (time 1786761346.23 total 90.12 last 67.09) - open/close 6838 (time 1786761356.25 total 100.14 last 80.92) - open/close 7610 (time 1786761366.26 total 110.15 last 77.16) - open/close 8342 (time 1786761376.27 total 120.16 last 73.10) - open/close 9088 (time 1786761386.30 total 130.19 last 74.38) - open/close 9779 (time 1786761396.31 total 140.20 last 69.03) total: 10000 open/close in 143.30 seconds: 69.79 ops/second llite.lustre-ffff986b064f3000.statahead_batch_max=0 llite.lustre-ffff986b064f3000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff986b064f3000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m9.412s user 0m0.349s sys 0m16.487s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff986b064f3000.statahead_batch_max=256 llite.lustre-ffff986b064f3000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff986b064f3000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff986b064f3000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m58.525s user 0m0.303s sys 0m15.498s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff986b064f3000.batch_stats= snapshot_time: 1786761555.839182095 secs.nsecs start_time: 1786761480.337236672 secs.nsecs elapsed_time: 75.501945423 secs.nsecs subreqs per batch batches %% cum %% 1: 152 48 48 2: 48 15 63 4: 18 5 69 8: 29 9 78 16: 15 4 83 32: 15 4 87 64: 3 0 88 128: 0 0 88 256: 35 11 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff986b064f3000.statahead_batch_max=64 llite.lustre-ffff986b064f3000.statahead_max=128