== sanity test 123ad: Verify batching statahead works correctly ========================================================== 16:36:11 (1782246971) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff914290bee800.batch_stats=0 llite.lustre-ffff914290bee800.statahead_max=32 llite.lustre-ffff914290bee800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff914290bee800.batch_stats=0 total: 100 open/close in 3.12 seconds: 32.03 ops/second llite.lustre-ffff914290bee800.statahead_max=0 101 real 0m2.345s user 0m0.004s sys 0m0.339s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff914290bee800.statahead_max=32 llite.lustre-ffff914290bee800.statahead_max=32 101 real 0m1.132s user 0m0.005s sys 0m0.192s 'ls -l' 100 files with statahead: 1 sec statahead total: 134 statahead wrong: 2 agl total: 128 list_total: 29 fname_total: 99 hit_total: 4234 miss_total: 1273 swrong=2 ewrong=2 - open/close 711 (time 1782246999.25 total 10.00 last 71.07) total: 900 open/close in 13.14 seconds: 68.51 ops/second llite.lustre-ffff914290bee800.statahead_max=0 1001 real 0m23.294s user 0m0.036s sys 0m3.116s 'ls -l' 1000 files without statahead: 23 sec llite.lustre-ffff914290bee800.statahead_max=32 llite.lustre-ffff914290bee800.statahead_max=32 1001 real 0m10.915s user 0m0.032s sys 0m1.522s 'ls -l' 1000 files with statahead: 11 sec statahead total: 135 statahead wrong: 2 agl total: 129 list_total: 30 fname_total: 99 hit_total: 5232 miss_total: 1275 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff914290bee800.statahead_stats= statahead total: 135 statahead wrong: 2 agl total: 129 list_total: 30 fname_total: 99 hit_total: 5232 miss_total: 1275 mdc.lustre-MDT0000-mdc-ffff914290bee800.batch_stats= snapshot_time: 1782247070.471449863 secs.nsecs start_time: 1782246976.471523654 secs.nsecs elapsed_time: 93.999926209 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 1 2 5 8: 2 5 10 16: 2 5 15 32: 34 85 100 - open/close 739 (time 1782247082.88 total 10.01 last 73.85) - open/close 1415 (time 1782247092.89 total 20.01 last 67.56) - open/close 2142 (time 1782247102.92 total 30.05 last 72.47) - open/close 2723 (time 1782247112.94 total 40.06 last 58.01) - open/close 3484 (time 1782247122.94 total 50.06 last 76.07) - open/close 4242 (time 1782247132.94 total 60.07 last 75.79) - open/close 5065 (time 1782247142.95 total 70.07 last 82.25) - open/close 5805 (time 1782247152.96 total 80.08 last 73.93) - open/close 6502 (time 1782247162.97 total 90.09 last 69.62) - open/close 7158 (time 1782247172.98 total 100.11 last 65.50) - open/close 7885 (time 1782247182.99 total 110.11 last 72.69) - open/close 8618 (time 1782247192.99 total 120.12 last 73.24) - open/close 9359 (time 1782247203.00 total 130.13 last 74.03) total: 10000 open/close in 138.01 seconds: 72.46 ops/second llite.lustre-ffff914290bee800.statahead_batch_max=0 llite.lustre-ffff914290bee800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff914290bee800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m0.909s user 0m0.345s sys 0m17.304s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff914290bee800.statahead_batch_max=32 llite.lustre-ffff914290bee800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff914290bee800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff914290bee800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m43.795s user 0m0.277s sys 0m15.191s batched statahead RPC= hit count=9982 mdc.lustre-MDT0000-mdc-ffff914290bee800.batch_stats= snapshot_time: 1782247399.190764458 secs.nsecs start_time: 1782247281.192653717 secs.nsecs elapsed_time: 117.998110741 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff914290bee800.batch_stats=0 llite.lustre-ffff914290bee800.statahead_max=2048 llite.lustre-ffff914290bee800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff914290bee800.batch_stats=0 total: 100 open/close in 2.58 seconds: 38.69 ops/second llite.lustre-ffff914290bee800.statahead_max=0 101 real 0m2.584s user 0m0.004s sys 0m0.350s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff914290bee800.statahead_max=2048 llite.lustre-ffff914290bee800.statahead_max=2048 101 real 0m0.801s user 0m0.004s sys 0m0.179s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10081 miss_total: 19 swrong=0 ewrong=0 - open/close 746 (time 1782247741.15 total 10.00 last 74.57) total: 900 open/close in 12.15 seconds: 74.05 ops/second llite.lustre-ffff914290bee800.statahead_max=0 1001 real 0m22.984s user 0m0.029s sys 0m3.124s 'ls -l' 1000 files without statahead: 23 sec llite.lustre-ffff914290bee800.statahead_max=2048 llite.lustre-ffff914290bee800.statahead_max=2048 1001 real 0m7.325s user 0m0.027s sys 0m1.578s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff914290bee800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 mdc.lustre-MDT0000-mdc-ffff914290bee800.batch_stats= snapshot_time: 1782247810.286869884 secs.nsecs start_time: 1782247401.615419558 secs.nsecs elapsed_time: 408.671450326 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 1 9 54 128: 1 9 63 256: 4 36 100 - open/close 720 (time 1782247823.41 total 10.02 last 71.89) - open/close 1406 (time 1782247833.42 total 20.02 last 68.54) - open/close 2099 (time 1782247843.43 total 30.04 last 69.22) - open/close 2800 (time 1782247853.43 total 40.04 last 70.08) - open/close 3436 (time 1782247863.45 total 50.05 last 63.52) - open/close 4151 (time 1782247873.46 total 60.06 last 71.42) - open/close 4858 (time 1782247883.46 total 70.06 last 70.70) - open/close 5481 (time 1782247893.46 total 80.07 last 62.25) - open/close 6167 (time 1782247903.47 total 90.07 last 68.59) - open/close 6890 (time 1782247913.47 total 100.08 last 72.28) - open/close 7568 (time 1782247923.50 total 110.10 last 67.62) - open/close 8202 (time 1782247933.51 total 120.12 last 63.32) - open/close 8906 (time 1782247943.53 total 130.14 last 70.25) - open/close 9600 (time 1782247953.54 total 140.15 last 69.34) total: 10000 open/close in 146.00 seconds: 68.49 ops/second llite.lustre-ffff914290bee800.statahead_batch_max=0 llite.lustre-ffff914290bee800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff914290bee800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m5.102s user 0m0.332s sys 0m16.160s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff914290bee800.statahead_batch_max=256 llite.lustre-ffff914290bee800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff914290bee800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff914290bee800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m1.680s user 0m0.288s sys 0m15.921s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff914290bee800.batch_stats= snapshot_time: 1782248113.729671404 secs.nsecs start_time: 1782248036.509887466 secs.nsecs elapsed_time: 77.219783938 secs.nsecs subreqs per batch batches %% cum %% 1: 286 56 56 2: 75 14 71 4: 52 10 81 8: 27 5 87 16: 14 2 89 32: 14 2 92 64: 3 0 93 128: 0 0 93 256: 34 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff914290bee800.statahead_batch_max=64 llite.lustre-ffff914290bee800.statahead_max=128