== sanity test 123ad: Verify batching statahead works correctly ========================================================== 21:55:55 (1789523755) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9266927b3800.batch_stats=0 llite.lustre-ffff9266927b3800.statahead_max=32 llite.lustre-ffff9266927b3800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9266927b3800.batch_stats=0 total: 100 open/close in 1.94 seconds: 51.42 ops/second llite.lustre-ffff9266927b3800.statahead_max=0 101 real 0m1.842s user 0m0.004s sys 0m0.290s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9266927b3800.statahead_max=32 llite.lustre-ffff9266927b3800.statahead_max=32 101 real 0m0.667s user 0m0.004s sys 0m0.176s 'ls -l' 100 files with statahead: 0 sec statahead total: 122 statahead wrong: 2 agl total: 117 list_total: 29 fname_total: 93 hit_total: 4055 miss_total: 1273 swrong=2 ewrong=2 total: 900 open/close in 9.37 seconds: 96.06 ops/second llite.lustre-ffff9266927b3800.statahead_max=0 1001 real 0m16.507s user 0m0.036s sys 0m2.716s 'ls -l' 1000 files without statahead: 16 sec llite.lustre-ffff9266927b3800.statahead_max=32 llite.lustre-ffff9266927b3800.statahead_max=32 1001 real 0m5.970s user 0m0.025s sys 0m1.444s 'ls -l' 1000 files with statahead: 6 sec statahead total: 123 statahead wrong: 2 agl total: 118 list_total: 30 fname_total: 93 hit_total: 5052 miss_total: 1276 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 14 seconds llite.lustre-ffff9266927b3800.statahead_stats= statahead total: 123 statahead wrong: 2 agl total: 118 list_total: 30 fname_total: 93 hit_total: 5052 miss_total: 1276 mdc.lustre-MDT0000-mdc-ffff9266927b3800.batch_stats= snapshot_time: 1789523820.212291337 secs.nsecs start_time: 1789523758.771055266 secs.nsecs elapsed_time: 61.441236071 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 1 2 12 32: 34 87 100 - open/close 1040 (time 1789523831.97 total 10.01 last 103.91) - open/close 2068 (time 1789523841.97 total 20.01 last 102.76) - open/close 3097 (time 1789523851.99 total 30.03 last 102.77) - open/close 4099 (time 1789523861.99 total 40.03 last 100.20) - open/close 4993 (time 1789523871.99 total 50.03 last 89.40) - open/close 5959 (time 1789523882.00 total 60.03 last 96.52) - open/close 6995 (time 1789523892.00 total 70.04 last 103.57) - open/close 8128 (time 1789523902.00 total 80.04 last 113.29) - open/close 9246 (time 1789523912.01 total 90.05 last 111.68) total: 10000 open/close in 97.31 seconds: 102.77 ops/second llite.lustre-ffff9266927b3800.statahead_batch_max=0 llite.lustre-ffff9266927b3800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9266927b3800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m35.499s user 0m0.304s sys 0m20.807s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9266927b3800.statahead_batch_max=32 llite.lustre-ffff9266927b3800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9266927b3800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9266927b3800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.308s user 0m0.278s sys 0m14.719s batched statahead RPC= hit count=9985 mdc.lustre-MDT0000-mdc-ffff9266927b3800.batch_stats= snapshot_time: 1789524022.443920202 secs.nsecs start_time: 1789523960.287096121 secs.nsecs elapsed_time: 62.156824081 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9266927b3800.batch_stats=0 llite.lustre-ffff9266927b3800.statahead_max=2048 llite.lustre-ffff9266927b3800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9266927b3800.batch_stats=0 total: 100 open/close in 1.61 seconds: 61.99 ops/second llite.lustre-ffff9266927b3800.statahead_max=0 101 real 0m1.422s user 0m0.008s sys 0m0.282s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9266927b3800.statahead_max=2048 llite.lustre-ffff9266927b3800.statahead_max=2048 101 real 0m0.601s user 0m0.005s sys 0m0.184s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10084 miss_total: 16 swrong=0 ewrong=0 total: 900 open/close in 7.68 seconds: 117.13 ops/second llite.lustre-ffff9266927b3800.statahead_max=0 1001 real 0m15.308s user 0m0.027s sys 0m2.689s 'ls -l' 1000 files without statahead: 16 sec llite.lustre-ffff9266927b3800.statahead_max=2048 llite.lustre-ffff9266927b3800.statahead_max=2048 1001 real 0m3.959s user 0m0.021s sys 0m1.610s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 11 seconds llite.lustre-ffff9266927b3800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 mdc.lustre-MDT0000-mdc-ffff9266927b3800.batch_stats= snapshot_time: 1789524266.298182612 secs.nsecs start_time: 1789524023.913240638 secs.nsecs elapsed_time: 242.384941974 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 1095 (time 1789524277.52 total 10.00 last 109.48) - open/close 2369 (time 1789524287.53 total 20.00 last 127.38) - open/close 3674 (time 1789524297.53 total 30.01 last 130.45) - open/close 5054 (time 1789524307.54 total 40.01 last 137.91) - open/close 6490 (time 1789524317.54 total 50.02 last 143.53) - open/close 7827 (time 1789524327.55 total 60.02 last 133.62) - open/close 9155 (time 1789524337.55 total 70.03 last 132.72) total: 10000 open/close in 77.31 seconds: 129.34 ops/second llite.lustre-ffff9266927b3800.statahead_batch_max=0 llite.lustre-ffff9266927b3800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9266927b3800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.482s user 0m0.284s sys 0m21.356s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9266927b3800.statahead_batch_max=256 llite.lustre-ffff9266927b3800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9266927b3800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9266927b3800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m27.793s user 0m0.247s sys 0m17.824s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9266927b3800.batch_stats= snapshot_time: 1789524416.193259566 secs.nsecs start_time: 1789524382.459370822 secs.nsecs elapsed_time: 33.733888744 secs.nsecs subreqs per batch batches %% cum %% 1: 97 47 47 2: 22 10 57 4: 15 7 65 8: 6 2 67 16: 7 3 71 32: 17 8 79 64: 6 2 82 128: 0 0 82 256: 36 17 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9266927b3800.statahead_batch_max=64 llite.lustre-ffff9266927b3800.statahead_max=128