== sanity test 123ad: Verify batching statahead works correctly ========================================================== 12:12:20 (1787847140) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8c6e7d0eb000.batch_stats=0 llite.lustre-ffff8c6e7d0eb000.statahead_max=32 llite.lustre-ffff8c6e7d0eb000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8c6e7d0eb000.batch_stats=0 total: 100 open/close in 4.17 seconds: 23.97 ops/second llite.lustre-ffff8c6e7d0eb000.statahead_max=0 101 real 0m4.137s user 0m0.003s sys 0m0.357s 'ls -l' 100 files without statahead: 4 sec llite.lustre-ffff8c6e7d0eb000.statahead_max=32 llite.lustre-ffff8c6e7d0eb000.statahead_max=32 101 real 0m1.693s user 0m0.002s sys 0m0.174s 'ls -l' 100 files with statahead: 2 sec statahead total: 142 statahead wrong: 2 agl total: 136 list_total: 30 fname_total: 100 hit_total: 3552 miss_total: 1561 swrong=2 ewrong=2 - open/close 465 (time 1787847180.59 total 10.01 last 46.46) total: 900 open/close in 17.41 seconds: 51.69 ops/second llite.lustre-ffff8c6e7d0eb000.statahead_max=0 1001 real 0m21.821s user 0m0.037s sys 0m2.967s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff8c6e7d0eb000.statahead_max=32 llite.lustre-ffff8c6e7d0eb000.statahead_max=32 1001 real 0m10.368s user 0m0.042s sys 0m1.499s 'ls -l' 1000 files with statahead: 10 sec statahead total: 143 statahead wrong: 2 agl total: 137 list_total: 31 fname_total: 100 hit_total: 4549 miss_total: 1564 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 25 seconds llite.lustre-ffff8c6e7d0eb000.statahead_stats= statahead total: 143 statahead wrong: 2 agl total: 137 list_total: 31 fname_total: 100 hit_total: 4549 miss_total: 1564 mdc.lustre-MDT0000-mdc-ffff8c6e7d0eb000.batch_stats= snapshot_time: 1787847257.797090181 secs.nsecs start_time: 1787847148.080351258 secs.nsecs elapsed_time: 109.716738923 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 626 (time 1787847271.11 total 10.00 last 62.59) - open/close 1270 (time 1787847281.12 total 20.00 last 64.39) - open/close 1909 (time 1787847291.12 total 30.01 last 63.85) - open/close 2488 (time 1787847301.15 total 40.03 last 57.77) - open/close 3146 (time 1787847311.15 total 50.04 last 65.75) - open/close 3731 (time 1787847321.16 total 60.05 last 58.47) - open/close 4407 (time 1787847331.17 total 70.05 last 67.55) - open/close 5032 (time 1787847341.17 total 80.06 last 62.46) - open/close 5676 (time 1787847351.20 total 90.09 last 64.23) - open/close 6251 (time 1787847361.20 total 100.09 last 57.47) - open/close 6900 (time 1787847371.21 total 110.09 last 64.89) - open/close 7543 (time 1787847381.22 total 120.10 last 64.23) - open/close 8173 (time 1787847391.22 total 130.11 last 62.97) - open/close 8712 (time 1787847401.24 total 140.13 last 53.77) - open/close 9314 (time 1787847411.31 total 150.19 last 59.83) - open/close 9879 (time 1787847421.33 total 160.22 last 56.37) total: 10000 open/close in 162.53 seconds: 61.53 ops/second llite.lustre-ffff8c6e7d0eb000.statahead_batch_max=0 llite.lustre-ffff8c6e7d0eb000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c6e7d0eb000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m7.005s user 0m0.341s sys 0m14.437s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c6e7d0eb000.statahead_batch_max=32 llite.lustre-ffff8c6e7d0eb000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c6e7d0eb000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c6e7d0eb000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m46.538s user 0m0.321s sys 0m13.838s batched statahead RPC= hit count=9982 mdc.lustre-MDT0000-mdc-ffff8c6e7d0eb000.batch_stats= snapshot_time: 1787847620.852609505 secs.nsecs start_time: 1787847500.898884928 secs.nsecs elapsed_time: 119.953724577 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8c6e7d0eb000.batch_stats=0 llite.lustre-ffff8c6e7d0eb000.statahead_max=2048 llite.lustre-ffff8c6e7d0eb000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8c6e7d0eb000.batch_stats=0 total: 100 open/close in 2.88 seconds: 34.70 ops/second llite.lustre-ffff8c6e7d0eb000.statahead_max=0 101 real 0m2.862s user 0m0.006s sys 0m0.322s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8c6e7d0eb000.statahead_max=2048 llite.lustre-ffff8c6e7d0eb000.statahead_max=2048 101 real 0m1.126s user 0m0.005s sys 0m0.153s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10081 miss_total: 19 swrong=0 ewrong=0 - open/close 699 (time 1787847986.66 total 10.02 last 69.77) total: 900 open/close in 13.93 seconds: 64.60 ops/second llite.lustre-ffff8c6e7d0eb000.statahead_max=0 1001 real 0m26.891s user 0m0.044s sys 0m3.285s 'ls -l' 1000 files without statahead: 27 sec llite.lustre-ffff8c6e7d0eb000.statahead_max=2048 llite.lustre-ffff8c6e7d0eb000.statahead_max=2048 1001 real 0m6.896s user 0m0.027s sys 0m1.386s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff8c6e7d0eb000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 mdc.lustre-MDT0000-mdc-ffff8c6e7d0eb000.batch_stats= snapshot_time: 1787848060.527863630 secs.nsecs start_time: 1787847623.631900292 secs.nsecs elapsed_time: 436.895963338 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 615 (time 1787848073.74 total 10.00 last 61.48) - open/close 1248 (time 1787848083.74 total 20.01 last 63.28) - open/close 1862 (time 1787848093.75 total 30.02 last 61.31) - open/close 2425 (time 1787848103.77 total 40.03 last 56.23) - open/close 2994 (time 1787848113.78 total 50.05 last 56.83) - open/close 3588 (time 1787848123.78 total 60.05 last 59.39) - open/close 4182 (time 1787848133.79 total 70.06 last 59.36) - open/close 4741 (time 1787848143.79 total 80.06 last 55.86) - open/close 5328 (time 1787848153.80 total 90.07 last 58.64) - open/close 5898 (time 1787848163.82 total 100.08 last 56.94) - open/close 6467 (time 1787848173.83 total 110.09 last 56.84) - open/close 7111 (time 1787848183.84 total 120.11 last 64.32) - open/close 7795 (time 1787848193.85 total 130.12 last 68.33) - open/close 8371 (time 1787848203.86 total 140.12 last 57.56) - open/close 8926 (time 1787848213.87 total 150.14 last 55.42) - open/close 9601 (time 1787848223.89 total 160.16 last 67.38) total: 10000 open/close in 166.52 seconds: 60.05 ops/second llite.lustre-ffff8c6e7d0eb000.statahead_batch_max=0 llite.lustre-ffff8c6e7d0eb000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c6e7d0eb000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m3.377s user 0m0.333s sys 0m15.206s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c6e7d0eb000.statahead_batch_max=256 llite.lustre-ffff8c6e7d0eb000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c6e7d0eb000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c6e7d0eb000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.755s user 0m0.289s sys 0m14.924s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8c6e7d0eb000.batch_stats= snapshot_time: 1787848361.305443769 secs.nsecs start_time: 1787848304.640466090 secs.nsecs elapsed_time: 56.664977679 secs.nsecs subreqs per batch batches %% cum %% 1: 111 43 43 2: 43 16 59 4: 19 7 67 8: 20 7 74 16: 9 3 78 32: 19 7 85 64: 1 0 86 128: 1 0 86 256: 35 13 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8c6e7d0eb000.statahead_batch_max=64 llite.lustre-ffff8c6e7d0eb000.statahead_max=128