== sanity test 123ad: Verify batching statahead works correctly ========================================================== 17:10:20 (1786309820) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff921a11748800.batch_stats=0 llite.lustre-ffff921a11748800.statahead_max=32 llite.lustre-ffff921a11748800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff921a11748800.batch_stats=0 total: 100 open/close in 2.48 seconds: 40.36 ops/second llite.lustre-ffff921a11748800.statahead_max=0 101 real 0m1.607s user 0m0.005s sys 0m0.320s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff921a11748800.statahead_max=32 llite.lustre-ffff921a11748800.statahead_max=32 101 real 0m0.894s user 0m0.005s sys 0m0.176s 'ls -l' 100 files with statahead: 1 sec statahead total: 126 statahead wrong: 2 agl total: 120 list_total: 30 fname_total: 82 hit_total: 3550 miss_total: 1385 swrong=2 ewrong=2 - open/close 736 (time 1786309846.47 total 10.00 last 73.58) total: 900 open/close in 12.73 seconds: 70.69 ops/second llite.lustre-ffff921a11748800.statahead_max=0 1001 real 0m18.905s user 0m0.028s sys 0m2.974s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff921a11748800.statahead_max=32 llite.lustre-ffff921a11748800.statahead_max=32 1001 real 0m9.804s user 0m0.030s sys 0m1.441s 'ls -l' 1000 files with statahead: 9 sec statahead total: 127 statahead wrong: 2 agl total: 121 list_total: 31 fname_total: 82 hit_total: 4548 miss_total: 1387 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff921a11748800.statahead_stats= statahead total: 127 statahead wrong: 2 agl total: 121 list_total: 31 fname_total: 82 hit_total: 4548 miss_total: 1387 mdc.lustre-MDT0000-mdc-ffff921a11748800.batch_stats= snapshot_time: 1786309913.523487909 secs.nsecs start_time: 1786309824.664871442 secs.nsecs elapsed_time: 88.858616467 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 800 (time 1786309925.91 total 10.01 last 79.92) - open/close 1554 (time 1786309935.92 total 20.03 last 75.27) - open/close 2066 (time 1786309945.92 total 30.03 last 51.20) - open/close 2907 (time 1786309955.93 total 40.04 last 84.01) - open/close 3556 (time 1786309965.94 total 50.04 last 64.86) - open/close 4395 (time 1786309975.95 total 60.05 last 83.81) - open/close 5282 (time 1786309985.95 total 70.06 last 88.68) - open/close 6042 (time 1786309995.95 total 80.06 last 75.99) - open/close 6828 (time 1786310005.95 total 90.06 last 78.60) - open/close 7381 (time 1786310015.96 total 100.07 last 55.24) - open/close 8151 (time 1786310025.97 total 110.08 last 76.92) - open/close 8855 (time 1786310035.98 total 120.08 last 70.38) - open/close 9634 (time 1786310045.98 total 130.08 last 77.89) total: 10000 open/close in 134.54 seconds: 74.33 ops/second llite.lustre-ffff921a11748800.statahead_batch_max=0 llite.lustre-ffff921a11748800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff921a11748800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m0.422s user 0m0.333s sys 0m15.575s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff921a11748800.statahead_batch_max=32 llite.lustre-ffff921a11748800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff921a11748800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff921a11748800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m45.077s user 0m0.300s sys 0m14.323s batched statahead RPC= hit count=9982 mdc.lustre-MDT0000-mdc-ffff921a11748800.batch_stats= snapshot_time: 1786310239.982902425 secs.nsecs start_time: 1786310120.801162109 secs.nsecs elapsed_time: 119.181740316 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff921a11748800.batch_stats=0 llite.lustre-ffff921a11748800.statahead_max=2048 llite.lustre-ffff921a11748800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff921a11748800.batch_stats=0 total: 100 open/close in 2.09 seconds: 47.79 ops/second llite.lustre-ffff921a11748800.statahead_max=0 101 real 0m2.364s user 0m0.006s sys 0m0.325s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff921a11748800.statahead_max=2048 llite.lustre-ffff921a11748800.statahead_max=2048 101 real 0m0.754s user 0m0.004s sys 0m0.151s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10081 miss_total: 19 swrong=0 ewrong=0 - open/close 701 (time 1786310549.01 total 10.01 last 70.03) total: 900 open/close in 12.71 seconds: 70.80 ops/second llite.lustre-ffff921a11748800.statahead_max=0 1001 real 0m17.212s user 0m0.031s sys 0m2.998s 'ls -l' 1000 files without statahead: 17 sec llite.lustre-ffff921a11748800.statahead_max=2048 llite.lustre-ffff921a11748800.statahead_max=2048 1001 real 0m4.817s user 0m0.026s sys 0m1.417s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 18 seconds llite.lustre-ffff921a11748800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 mdc.lustre-MDT0000-mdc-ffff921a11748800.batch_stats= snapshot_time: 1786310603.883123524 secs.nsecs start_time: 1786310242.366877296 secs.nsecs elapsed_time: 361.516246228 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 1 10 30 32: 2 20 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 835 (time 1786310615.98 total 10.00 last 83.48) - open/close 1583 (time 1786310625.99 total 20.01 last 74.75) - open/close 2422 (time 1786310635.99 total 30.02 last 83.85) - open/close 3207 (time 1786310646.00 total 40.02 last 78.43) - open/close 3984 (time 1786310656.02 total 50.04 last 77.57) - open/close 4662 (time 1786310666.02 total 60.04 last 67.80) - open/close 5470 (time 1786310676.03 total 70.05 last 80.71) - open/close 6351 (time 1786310686.04 total 80.06 last 88.03) - open/close 7228 (time 1786310696.04 total 90.07 last 87.65) - open/close 7997 (time 1786310706.04 total 100.07 last 76.88) - open/close 8777 (time 1786310716.06 total 110.09 last 77.86) - open/close 9650 (time 1786310726.07 total 120.09 last 87.28) total: 10000 open/close in 124.06 seconds: 80.61 ops/second llite.lustre-ffff921a11748800.statahead_batch_max=0 llite.lustre-ffff921a11748800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff921a11748800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m3.120s user 0m0.263s sys 0m14.903s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff921a11748800.statahead_batch_max=256 llite.lustre-ffff921a11748800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff921a11748800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff921a11748800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.559s user 0m0.283s sys 0m15.537s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff921a11748800.batch_stats= snapshot_time: 1786310874.003993214 secs.nsecs start_time: 1786310803.632954443 secs.nsecs elapsed_time: 70.371038771 secs.nsecs subreqs per batch batches %% cum %% 1: 205 48 48 2: 64 15 63 4: 50 11 75 8: 30 7 82 16: 17 4 86 32: 19 4 91 64: 3 0 91 128: 1 0 92 256: 33 7 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff921a11748800.statahead_batch_max=64 llite.lustre-ffff921a11748800.statahead_max=128