== sanity test 123ad: Verify batching statahead works correctly ========================================================== 00:59:07 (1788670747) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8a86d3982800.batch_stats=0 llite.lustre-ffff8a86d3982800.statahead_max=32 llite.lustre-ffff8a86d3982800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8a86d3982800.batch_stats=0 total: 100 open/close in 1.93 seconds: 51.88 ops/second llite.lustre-ffff8a86d3982800.statahead_max=0 101 real 0m1.550s user 0m0.006s sys 0m0.274s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8a86d3982800.statahead_max=32 llite.lustre-ffff8a86d3982800.statahead_max=32 101 real 0m1.163s user 0m0.005s sys 0m0.163s 'ls -l' 100 files with statahead: 2 sec statahead total: 118 statahead wrong: 2 agl total: 113 list_total: 29 fname_total: 89 hit_total: 4349 miss_total: 1275 swrong=2 ewrong=2 total: 900 open/close in 9.94 seconds: 90.57 ops/second llite.lustre-ffff8a86d3982800.statahead_max=0 1001 real 0m14.501s user 0m0.027s sys 0m2.531s 'ls -l' 1000 files without statahead: 14 sec llite.lustre-ffff8a86d3982800.statahead_max=32 llite.lustre-ffff8a86d3982800.statahead_max=32 1001 real 0m7.985s user 0m0.033s sys 0m1.206s 'ls -l' 1000 files with statahead: 8 sec statahead total: 119 statahead wrong: 2 agl total: 114 list_total: 30 fname_total: 89 hit_total: 5345 miss_total: 1279 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff8a86d3982800.statahead_stats= statahead total: 119 statahead wrong: 2 agl total: 114 list_total: 30 fname_total: 89 hit_total: 5345 miss_total: 1279 mdc.lustre-MDT0000-mdc-ffff8a86d3982800.batch_stats= snapshot_time: 1788670825.125229950 secs.nsecs start_time: 1788670751.299083760 secs.nsecs elapsed_time: 73.826146190 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 685 (time 1788670837.59 total 10.00 last 68.49) - open/close 1468 (time 1788670847.59 total 20.01 last 78.26) - open/close 2197 (time 1788670857.60 total 30.01 last 72.86) - open/close 2931 (time 1788670867.61 total 40.03 last 73.29) - open/close 3621 (time 1788670877.62 total 50.03 last 68.97) - open/close 4372 (time 1788670887.63 total 60.05 last 75.00) - open/close 5151 (time 1788670897.64 total 70.05 last 77.86) - open/close 6047 (time 1788670907.64 total 80.06 last 89.56) - open/close 6933 (time 1788670917.64 total 90.06 last 88.58) - open/close 7783 (time 1788670927.66 total 100.07 last 84.88) - open/close 8727 (time 1788670937.66 total 110.08 last 94.34) - open/close 9715 (time 1788670947.67 total 120.08 last 98.74) total: 10000 open/close in 122.87 seconds: 81.39 ops/second llite.lustre-ffff8a86d3982800.statahead_batch_max=0 llite.lustre-ffff8a86d3982800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a86d3982800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m59.608s user 0m0.297s sys 0m13.124s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a86d3982800.statahead_batch_max=32 llite.lustre-ffff8a86d3982800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a86d3982800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a86d3982800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m31.248s user 0m0.285s sys 0m12.102s batched statahead RPC= hit count=9981 mdc.lustre-MDT0000-mdc-ffff8a86d3982800.batch_stats= snapshot_time: 1788671124.053627345 secs.nsecs start_time: 1788671017.537561427 secs.nsecs elapsed_time: 106.516065918 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8a86d3982800.batch_stats=0 llite.lustre-ffff8a86d3982800.statahead_max=2048 llite.lustre-ffff8a86d3982800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8a86d3982800.batch_stats=0 total: 100 open/close in 2.15 seconds: 46.55 ops/second llite.lustre-ffff8a86d3982800.statahead_max=0 101 real 0m2.645s user 0m0.003s sys 0m0.305s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8a86d3982800.statahead_max=2048 llite.lustre-ffff8a86d3982800.statahead_max=2048 101 real 0m0.812s user 0m0.003s sys 0m0.108s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10080 miss_total: 20 swrong=0 ewrong=0 total: 900 open/close in 9.48 seconds: 94.96 ops/second llite.lustre-ffff8a86d3982800.statahead_max=0 1001 real 0m19.066s user 0m0.031s sys 0m2.808s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff8a86d3982800.statahead_max=2048 llite.lustre-ffff8a86d3982800.statahead_max=2048 1001 real 0m7.004s user 0m0.028s sys 0m1.306s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11079 miss_total: 21 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff8a86d3982800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11079 miss_total: 21 mdc.lustre-MDT0000-mdc-ffff8a86d3982800.batch_stats= snapshot_time: 1788671441.182270980 secs.nsecs start_time: 1788671125.979777828 secs.nsecs elapsed_time: 315.202493152 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 1 9 54 128: 1 9 63 256: 4 36 100 - open/close 792 (time 1788671454.01 total 10.01 last 79.12) - open/close 1601 (time 1788671464.03 total 20.02 last 80.80) - open/close 2528 (time 1788671474.07 total 30.07 last 92.28) - open/close 3385 (time 1788671484.07 total 40.07 last 85.68) - open/close 4238 (time 1788671494.08 total 50.07 last 85.28) - open/close 5104 (time 1788671504.08 total 60.08 last 86.56) - open/close 5819 (time 1788671514.09 total 70.09 last 71.40) - open/close 6495 (time 1788671524.10 total 80.10 last 67.54) - open/close 7348 (time 1788671534.11 total 90.11 last 85.24) - open/close 8264 (time 1788671544.11 total 100.11 last 91.59) - open/close 9209 (time 1788671554.12 total 110.11 last 94.46) total: 10000 open/close in 120.07 seconds: 83.28 ops/second llite.lustre-ffff8a86d3982800.statahead_batch_max=0 llite.lustre-ffff8a86d3982800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a86d3982800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.399s user 0m0.293s sys 0m13.176s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a86d3982800.statahead_batch_max=256 llite.lustre-ffff8a86d3982800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a86d3982800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a86d3982800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m53.873s user 0m0.310s sys 0m13.136s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8a86d3982800.batch_stats= snapshot_time: 1788671695.040401138 secs.nsecs start_time: 1788671630.633913004 secs.nsecs elapsed_time: 64.406488134 secs.nsecs subreqs per batch batches %% cum %% 1: 108 38 38 2: 53 19 58 4: 30 10 68 8: 17 6 75 16: 11 3 79 32: 15 5 84 64: 8 2 87 128: 1 0 87 256: 34 12 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 1 seconds: 0.000000 unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8a86d3982800.statahead_batch_max=64 llite.lustre-ffff8a86d3982800.statahead_max=128