== sanity test 123ad: Verify batching statahead works correctly ========================================================== 09:56:22 (1787838982) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8c6906dc0800.batch_stats=0 llite.lustre-ffff8c6906dc0800.statahead_max=32 llite.lustre-ffff8c6906dc0800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8c6906dc0800.batch_stats=0 total: 100 open/close in 2.39 seconds: 41.79 ops/second llite.lustre-ffff8c6906dc0800.statahead_max=0 101 real 0m2.190s user 0m0.006s sys 0m0.318s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8c6906dc0800.statahead_max=32 llite.lustre-ffff8c6906dc0800.statahead_max=32 101 real 0m1.412s user 0m0.007s sys 0m0.145s 'ls -l' 100 files with statahead: 2 sec statahead total: 108 statahead wrong: 2 agl total: 103 list_total: 29 fname_total: 74 hit_total: 4584 miss_total: 1273 swrong=2 ewrong=2 - open/close 785 (time 1787839009.31 total 10.00 last 78.48) total: 900 open/close in 11.48 seconds: 78.41 ops/second llite.lustre-ffff8c6906dc0800.statahead_max=0 1001 real 0m20.534s user 0m0.033s sys 0m2.720s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff8c6906dc0800.statahead_max=32 llite.lustre-ffff8c6906dc0800.statahead_max=32 1001 real 0m9.907s user 0m0.023s sys 0m1.304s 'ls -l' 1000 files with statahead: 10 sec statahead total: 109 statahead wrong: 2 agl total: 104 list_total: 30 fname_total: 74 hit_total: 5581 miss_total: 1276 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 17 seconds llite.lustre-ffff8c6906dc0800.statahead_stats= statahead total: 109 statahead wrong: 2 agl total: 104 list_total: 30 fname_total: 74 hit_total: 5581 miss_total: 1276 mdc.lustre-MDT0000-mdc-ffff8c6906dc0800.batch_stats= snapshot_time: 1787839070.208391078 secs.nsecs start_time: 1787838987.136546718 secs.nsecs elapsed_time: 83.071844360 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 862 (time 1787839082.25 total 10.01 last 86.14) - open/close 1749 (time 1787839092.26 total 20.01 last 88.67) - open/close 2663 (time 1787839102.26 total 30.01 last 91.40) - open/close 3558 (time 1787839112.26 total 40.01 last 89.49) - open/close 4429 (time 1787839122.26 total 50.02 last 87.03) - open/close 5232 (time 1787839132.27 total 60.02 last 80.27) - open/close 6098 (time 1787839142.28 total 70.04 last 86.46) - open/close 6989 (time 1787839152.29 total 80.04 last 89.07) - open/close 7852 (time 1787839162.29 total 90.05 last 86.25) - open/close 8721 (time 1787839172.30 total 100.06 last 86.82) - open/close 9612 (time 1787839182.30 total 110.06 last 89.08) total: 10000 open/close in 114.47 seconds: 87.36 ops/second llite.lustre-ffff8c6906dc0800.statahead_batch_max=0 llite.lustre-ffff8c6906dc0800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c6906dc0800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m49.297s user 0m0.295s sys 0m16.757s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c6906dc0800.statahead_batch_max=32 llite.lustre-ffff8c6906dc0800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c6906dc0800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c6906dc0800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m19.385s user 0m0.262s sys 0m13.563s batched statahead RPC= hit count=9977 mdc.lustre-MDT0000-mdc-ffff8c6906dc0800.batch_stats= snapshot_time: 1787839332.199586876 secs.nsecs start_time: 1787839242.797095551 secs.nsecs elapsed_time: 89.402491325 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8c6906dc0800.batch_stats=0 llite.lustre-ffff8c6906dc0800.statahead_max=2048 llite.lustre-ffff8c6906dc0800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8c6906dc0800.batch_stats=0 total: 100 open/close in 2.36 seconds: 42.45 ops/second llite.lustre-ffff8c6906dc0800.statahead_max=0 101 real 0m2.023s user 0m0.005s sys 0m0.278s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8c6906dc0800.statahead_max=2048 llite.lustre-ffff8c6906dc0800.statahead_max=2048 101 real 0m0.742s user 0m0.003s sys 0m0.152s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10076 miss_total: 24 swrong=0 ewrong=0 - open/close 763 (time 1787839610.12 total 10.00 last 76.28) total: 900 open/close in 11.75 seconds: 76.59 ops/second llite.lustre-ffff8c6906dc0800.statahead_max=0 1001 real 0m18.187s user 0m0.025s sys 0m2.735s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff8c6906dc0800.statahead_max=2048 llite.lustre-ffff8c6906dc0800.statahead_max=2048 1001 real 0m6.012s user 0m0.022s sys 0m1.503s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11075 miss_total: 25 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 18 seconds llite.lustre-ffff8c6906dc0800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11075 miss_total: 25 mdc.lustre-MDT0000-mdc-ffff8c6906dc0800.batch_stats= snapshot_time: 1787839664.060887927 secs.nsecs start_time: 1787839334.572430259 secs.nsecs elapsed_time: 329.488457668 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 1 10 60 128: 0 0 60 256: 4 40 100 - open/close 875 (time 1787839676.17 total 10.01 last 87.44) - open/close 1783 (time 1787839686.18 total 20.01 last 90.77) - open/close 2577 (time 1787839696.18 total 30.01 last 79.37) - open/close 3461 (time 1787839706.19 total 40.02 last 88.36) - open/close 4372 (time 1787839716.19 total 50.02 last 91.06) - open/close 5269 (time 1787839726.20 total 60.04 last 89.57) - open/close 6103 (time 1787839736.21 total 70.04 last 83.39) - open/close 7002 (time 1787839746.21 total 80.04 last 89.88) - open/close 7878 (time 1787839756.22 total 90.05 last 87.52) - open/close 8756 (time 1787839766.22 total 100.05 last 87.79) - open/close 9594 (time 1787839776.22 total 110.05 last 83.79) total: 10000 open/close in 114.60 seconds: 87.26 ops/second llite.lustre-ffff8c6906dc0800.statahead_batch_max=0 llite.lustre-ffff8c6906dc0800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c6906dc0800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m52.367s user 0m0.284s sys 0m15.468s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c6906dc0800.statahead_batch_max=256 llite.lustre-ffff8c6906dc0800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c6906dc0800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c6906dc0800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m41.814s user 0m0.263s sys 0m15.834s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8c6906dc0800.batch_stats= snapshot_time: 1787839891.526019819 secs.nsecs start_time: 1787839839.755624639 secs.nsecs elapsed_time: 51.770395180 secs.nsecs subreqs per batch batches %% cum %% 1: 171 54 54 2: 30 9 64 4: 27 8 73 8: 17 5 78 16: 15 4 83 32: 13 4 87 64: 4 1 88 128: 0 0 88 256: 35 11 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8c6906dc0800.statahead_batch_max=64 llite.lustre-ffff8c6906dc0800.statahead_max=128