== sanity test 123ad: Verify batching statahead works correctly ========================================================== 00:54:30 (1783140870) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8f2290d34800.batch_stats=0 llite.lustre-ffff8f2290d34800.statahead_max=32 llite.lustre-ffff8f2290d34800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8f2290d34800.batch_stats=0 total: 100 open/close in 2.04 seconds: 49.13 ops/second llite.lustre-ffff8f2290d34800.statahead_max=0 101 real 0m1.532s user 0m0.004s sys 0m0.326s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8f2290d34800.statahead_max=32 llite.lustre-ffff8f2290d34800.statahead_max=32 101 real 0m1.171s user 0m0.005s sys 0m0.197s 'ls -l' 100 files with statahead: 1 sec statahead total: 120 statahead wrong: 2 agl total: 115 list_total: 30 fname_total: 70 hit_total: 4171 miss_total: 1284 swrong=2 ewrong=2 - open/close 805 (time 1783140896.87 total 10.00 last 80.46) total: 900 open/close in 11.29 seconds: 79.69 ops/second llite.lustre-ffff8f2290d34800.statahead_max=0 1001 real 0m18.345s user 0m0.033s sys 0m3.086s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff8f2290d34800.statahead_max=32 llite.lustre-ffff8f2290d34800.statahead_max=32 1001 real 0m8.841s user 0m0.035s sys 0m1.531s 'ls -l' 1000 files with statahead: 9 sec statahead total: 121 statahead wrong: 2 agl total: 116 list_total: 31 fname_total: 70 hit_total: 5168 miss_total: 1287 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 18 seconds llite.lustre-ffff8f2290d34800.statahead_stats= statahead total: 121 statahead wrong: 2 agl total: 116 list_total: 31 fname_total: 70 hit_total: 5168 miss_total: 1287 mdc.lustre-MDT0000-mdc-ffff8f2290d34800.batch_stats= snapshot_time: 1783140954.926326902 secs.nsecs start_time: 1783140874.817279732 secs.nsecs elapsed_time: 80.109047170 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 856 (time 1783140967.40 total 10.01 last 85.55) - open/close 1701 (time 1783140977.41 total 20.01 last 84.44) - open/close 2651 (time 1783140987.42 total 30.02 last 94.93) - open/close 3569 (time 1783140997.42 total 40.03 last 91.74) - open/close 4445 (time 1783141007.43 total 50.03 last 87.57) - open/close 5291 (time 1783141017.44 total 60.05 last 84.47) - open/close 6178 (time 1783141027.45 total 70.06 last 88.60) - open/close 7023 (time 1783141037.50 total 80.10 last 84.11) - open/close 7849 (time 1783141047.51 total 90.12 last 82.48) - open/close 8632 (time 1783141057.52 total 100.12 last 78.29) - open/close 9559 (time 1783141067.52 total 110.13 last 92.65) total: 10000 open/close in 114.70 seconds: 87.18 ops/second llite.lustre-ffff8f2290d34800.statahead_batch_max=0 llite.lustre-ffff8f2290d34800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f2290d34800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m49.745s user 0m0.314s sys 0m16.668s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8f2290d34800.statahead_batch_max=32 llite.lustre-ffff8f2290d34800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f2290d34800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8f2290d34800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m22.210s user 0m0.289s sys 0m14.665s batched statahead RPC= hit count=9982 mdc.lustre-MDT0000-mdc-ffff8f2290d34800.batch_stats= snapshot_time: 1783141222.370963793 secs.nsecs start_time: 1783141128.858584000 secs.nsecs elapsed_time: 93.512379793 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8f2290d34800.batch_stats=0 llite.lustre-ffff8f2290d34800.statahead_max=2048 llite.lustre-ffff8f2290d34800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8f2290d34800.batch_stats=0 total: 100 open/close in 1.52 seconds: 65.92 ops/second llite.lustre-ffff8f2290d34800.statahead_max=0 101 real 0m1.387s user 0m0.006s sys 0m0.291s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8f2290d34800.statahead_max=2048 llite.lustre-ffff8f2290d34800.statahead_max=2048 101 real 0m0.621s user 0m0.001s sys 0m0.204s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10081 miss_total: 19 swrong=0 ewrong=0 total: 900 open/close in 8.09 seconds: 111.27 ops/second llite.lustre-ffff8f2290d34800.statahead_max=0 1001 real 0m14.967s user 0m0.027s sys 0m2.806s 'ls -l' 1000 files without statahead: 15 sec llite.lustre-ffff8f2290d34800.statahead_max=2048 llite.lustre-ffff8f2290d34800.statahead_max=2048 1001 real 0m8.830s user 0m0.031s sys 0m1.587s 'ls -l' 1000 files with statahead: 9 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 31 seconds llite.lustre-ffff8f2290d34800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 mdc.lustre-MDT0000-mdc-ffff8f2290d34800.batch_stats= snapshot_time: 1783141513.483223217 secs.nsecs start_time: 1783141224.270101939 secs.nsecs elapsed_time: 289.213121278 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 16 16 16: 2 16 33 32: 3 25 58 64: 1 8 66 128: 0 0 66 256: 4 33 100 - open/close 659 (time 1783141526.63 total 10.01 last 65.85) - open/close 1295 (time 1783141536.64 total 20.01 last 63.60) - open/close 1841 (time 1783141546.64 total 30.02 last 54.55) - open/close 2493 (time 1783141556.68 total 40.05 last 64.98) - open/close 3367 (time 1783141566.68 total 50.05 last 87.38) - open/close 4207 (time 1783141576.68 total 60.06 last 83.98) - open/close 5135 (time 1783141586.69 total 70.06 last 92.77) - open/close 6027 (time 1783141596.70 total 80.07 last 89.12) - open/close 6845 (time 1783141606.70 total 90.07 last 81.79) - open/close 7711 (time 1783141616.70 total 100.08 last 86.54) - open/close 8610 (time 1783141626.71 total 110.08 last 89.86) - open/close 9397 (time 1783141636.71 total 120.08 last 78.69) total: 10000 open/close in 128.32 seconds: 77.93 ops/second llite.lustre-ffff8f2290d34800.statahead_batch_max=0 llite.lustre-ffff8f2290d34800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f2290d34800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.705s user 0m0.311s sys 0m15.339s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8f2290d34800.statahead_batch_max=256 llite.lustre-ffff8f2290d34800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f2290d34800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8f2290d34800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m51.084s user 0m0.301s sys 0m15.285s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8f2290d34800.batch_stats= snapshot_time: 1783141773.715325585 secs.nsecs start_time: 1783141710.115550015 secs.nsecs elapsed_time: 63.599775570 secs.nsecs subreqs per batch batches %% cum %% 1: 143 42 42 2: 55 16 58 4: 49 14 72 8: 25 7 80 16: 13 3 83 32: 17 5 88 64: 3 0 89 128: 1 0 90 256: 34 10 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8f2290d34800.statahead_batch_max=64 llite.lustre-ffff8f2290d34800.statahead_max=128