== sanity test 123ad: Verify batching statahead works correctly ========================================================== 20:47:26 (1789433246) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9cc0869e9000.batch_stats=0 llite.lustre-ffff9cc0869e9000.statahead_max=32 llite.lustre-ffff9cc0869e9000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9cc0869e9000.batch_stats=0 total: 100 open/close in 3.00 seconds: 33.33 ops/second llite.lustre-ffff9cc0869e9000.statahead_max=0 101 real 0m2.568s user 0m0.009s sys 0m0.308s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9cc0869e9000.statahead_max=32 llite.lustre-ffff9cc0869e9000.statahead_max=32 101 real 0m1.078s user 0m0.003s sys 0m0.147s 'ls -l' 100 files with statahead: 1 sec statahead total: 130 statahead wrong: 2 agl total: 124 list_total: 30 fname_total: 92 hit_total: 4060 miss_total: 770 swrong=2 ewrong=2 - open/close 745 (time 1789433273.68 total 10.00 last 74.47) total: 900 open/close in 12.18 seconds: 73.91 ops/second llite.lustre-ffff9cc0869e9000.statahead_max=0 1001 real 0m18.654s user 0m0.028s sys 0m2.736s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff9cc0869e9000.statahead_max=32 llite.lustre-ffff9cc0869e9000.statahead_max=32 1001 real 0m8.754s user 0m0.026s sys 0m1.339s 'ls -l' 1000 files with statahead: 9 sec statahead total: 131 statahead wrong: 2 agl total: 125 list_total: 31 fname_total: 92 hit_total: 5058 miss_total: 772 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 18 seconds llite.lustre-ffff9cc0869e9000.statahead_stats= statahead total: 131 statahead wrong: 2 agl total: 125 list_total: 31 fname_total: 92 hit_total: 5058 miss_total: 772 mdc.lustre-MDT0000-mdc-ffff9cc0869e9000.batch_stats= snapshot_time: 1789433332.195746294 secs.nsecs start_time: 1789433250.495212226 secs.nsecs elapsed_time: 81.700534068 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 1 2 10 32: 34 89 100 - open/close 864 (time 1789433344.53 total 10.01 last 86.32) - open/close 1721 (time 1789433354.53 total 20.01 last 85.68) - open/close 2654 (time 1789433364.53 total 30.01 last 93.28) - open/close 3544 (time 1789433374.54 total 40.02 last 88.96) - open/close 4345 (time 1789433384.54 total 50.02 last 80.10) - open/close 5126 (time 1789433394.55 total 60.03 last 78.02) - open/close 5963 (time 1789433404.55 total 70.03 last 83.68) - open/close 6779 (time 1789433414.55 total 80.03 last 81.60) - open/close 7458 (time 1789433424.56 total 90.04 last 67.83) - open/close 8190 (time 1789433434.56 total 100.04 last 73.17) - open/close 8974 (time 1789433444.57 total 110.05 last 78.37) - open/close 9819 (time 1789433454.58 total 120.06 last 84.43) total: 10000 open/close in 122.38 seconds: 81.72 ops/second llite.lustre-ffff9cc0869e9000.statahead_batch_max=0 llite.lustre-ffff9cc0869e9000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cc0869e9000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m53.582s user 0m0.285s sys 0m14.017s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9cc0869e9000.statahead_batch_max=32 llite.lustre-ffff9cc0869e9000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cc0869e9000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9cc0869e9000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m32.866s user 0m0.275s sys 0m12.760s batched statahead RPC= hit count=9975 mdc.lustre-MDT0000-mdc-ffff9cc0869e9000.batch_stats= snapshot_time: 1789433619.479869422 secs.nsecs start_time: 1789433517.953197922 secs.nsecs elapsed_time: 101.526671500 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 1 0 0 8: 1 0 0 16: 1 0 1 32: 313 98 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9cc0869e9000.batch_stats=0 llite.lustre-ffff9cc0869e9000.statahead_max=2048 llite.lustre-ffff9cc0869e9000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9cc0869e9000.batch_stats=0 total: 100 open/close in 2.85 seconds: 35.06 ops/second llite.lustre-ffff9cc0869e9000.statahead_max=0 101 real 0m2.802s user 0m0.004s sys 0m0.314s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9cc0869e9000.statahead_max=2048 llite.lustre-ffff9cc0869e9000.statahead_max=2048 101 real 0m0.968s user 0m0.005s sys 0m0.170s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10074 miss_total: 26 swrong=0 ewrong=0 - open/close 820 (time 1789433901.90 total 10.01 last 81.94) total: 900 open/close in 11.27 seconds: 79.87 ops/second llite.lustre-ffff9cc0869e9000.statahead_max=0 1001 real 0m16.843s user 0m0.031s sys 0m2.746s 'ls -l' 1000 files without statahead: 16 sec llite.lustre-ffff9cc0869e9000.statahead_max=2048 llite.lustre-ffff9cc0869e9000.statahead_max=2048 1001 real 0m5.980s user 0m0.028s sys 0m1.205s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11073 miss_total: 27 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff9cc0869e9000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11073 miss_total: 27 mdc.lustre-MDT0000-mdc-ffff9cc0869e9000.batch_stats= snapshot_time: 1789433956.714660340 secs.nsecs start_time: 1789433621.878188931 secs.nsecs elapsed_time: 334.836471409 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 651 (time 1789433969.44 total 10.00 last 65.09) - open/close 1387 (time 1789433979.45 total 20.01 last 73.53) - open/close 2150 (time 1789433989.46 total 30.02 last 76.19) - open/close 2933 (time 1789433999.47 total 40.03 last 78.23) - open/close 3671 (time 1789434009.47 total 50.03 last 73.79) - open/close 4419 (time 1789434019.48 total 60.04 last 74.76) - open/close 4977 (time 1789434029.48 total 70.04 last 55.77) - open/close 5609 (time 1789434039.50 total 80.06 last 63.10) - open/close 6095 (time 1789434049.51 total 90.07 last 48.56) - open/close 6823 (time 1789434059.52 total 100.08 last 72.70) - open/close 7522 (time 1789434069.53 total 110.09 last 69.87) - open/close 8160 (time 1789434079.53 total 120.09 last 63.77) - open/close 8760 (time 1789434089.54 total 130.10 last 59.95) - open/close 9605 (time 1789434099.54 total 140.10 last 84.47) total: 10000 open/close in 144.60 seconds: 69.16 ops/second llite.lustre-ffff9cc0869e9000.statahead_batch_max=0 llite.lustre-ffff9cc0869e9000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cc0869e9000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.235s user 0m0.294s sys 0m13.318s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9cc0869e9000.statahead_batch_max=256 llite.lustre-ffff9cc0869e9000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cc0869e9000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9cc0869e9000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m51.653s user 0m0.311s sys 0m13.772s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9cc0869e9000.batch_stats= snapshot_time: 1789434231.730236883 secs.nsecs start_time: 1789434169.034563016 secs.nsecs elapsed_time: 62.695673867 secs.nsecs subreqs per batch batches %% cum %% 1: 169 48 48 2: 52 14 63 4: 40 11 74 8: 18 5 79 16: 15 4 84 32: 18 5 89 64: 1 0 89 128: 2 0 90 256: 34 9 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9cc0869e9000.statahead_batch_max=64 llite.lustre-ffff9cc0869e9000.statahead_max=128