== sanity test 123ad: Verify batching statahead works correctly ========================================================== 04:16:47 (1776932207) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8aacc6d2a000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8aacc6d2a000.batch_stats=0 llite.lustre-ffff8aacc6d2a000.statahead_max=32 llite.lustre-ffff8aacc6d2a000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8aacc6d2a000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8aacc6d2a000.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 1.15 seconds: 86.89 ops/second llite.lustre-ffff8aacc6d2a000.statahead_max=0 101 real 0m0.951s user 0m0.005s sys 0m0.348s ls -l 100 files without statahead: 1 sec llite.lustre-ffff8aacc6d2a000.statahead_max=32 32 101 real 0m0.735s user 0m0.002s sys 0m0.471s ls -l 100 files with statahead: 1 sec statahead total: 102 statahead wrong: 2 agl total: 95 list_total: 34 fname_total: 66 hit_total: 19050 miss_total: 1271 total: 900 open/close in 3.73 seconds: 241.07 ops/second llite.lustre-ffff8aacc6d2a000.statahead_max=0 1001 real 0m10.558s user 0m0.029s sys 0m3.752s ls -l 1000 files without statahead: 11 sec llite.lustre-ffff8aacc6d2a000.statahead_max=32 32 1001 real 0m6.531s user 0m0.026s sys 0m3.174s ls -l 1000 files with statahead: 7 sec statahead total: 103 statahead wrong: 2 agl total: 96 list_total: 35 fname_total: 66 hit_total: 20049 miss_total: 1272 - open/close 2417 (time 1776932252.28 total 10.00 last 241.63) total: 3000 open/close in 12.40 seconds: 242.03 ops/second llite.lustre-ffff8aacc6d2a000.statahead_max=0 4001 real 0m42.340s user 0m0.117s sys 0m15.002s ls -l 4000 files without statahead: 42 sec llite.lustre-ffff8aacc6d2a000.statahead_max=32 32 4001 real 0m27.893s user 0m0.116s sys 0m13.569s ls -l 4000 files with statahead: 28 sec statahead total: 104 statahead wrong: 2 agl total: 97 list_total: 36 fname_total: 66 hit_total: 24048 miss_total: 1273 ls -l done rm -r /mnt/lustre/d123ad.sanity: 45 seconds llite.lustre-ffff8aacc6d2a000.statahead_stats= statahead total: 104 statahead wrong: 2 agl total: 97 list_total: 36 fname_total: 66 hit_total: 24048 miss_total: 1273 mdc.lustre-MDT0000-mdc-ffff8aacc6d2a000.batch_stats= snapshot_time: 1776932383.487136184 secs.nsecs start_time: 1776932210.077973926 secs.nsecs elapsed_time: 173.409162258 secs.nsecs subreqs per batch batches % cum % 1: 2 1 1 2: 3 1 3 4: 1 0 3 8: 4 2 6 16: 111 67 73 32: 43 26 100 mdc.lustre-MDT0001-mdc-ffff8aacc6d2a000.batch_stats= snapshot_time: 1776932383.487318144 secs.nsecs start_time: 1776932210.078370929 secs.nsecs elapsed_time: 173.408947215 secs.nsecs subreqs per batch batches % cum % 1: 1 0 0 2: 1 0 1 4: 2 1 2 8: 4 2 4 16: 60 35 40 32: 99 59 100 - open/close 2140 (time 1776932394.78 total 10.00 last 213.99) - open/close 4518 (time 1776932404.78 total 20.00 last 237.72) - open/close 6670 (time 1776932414.79 total 30.01 last 215.14) - open/close 8728 (time 1776932424.79 total 40.01 last 205.72) total: 10000 open/close in 46.13 seconds: 216.79 ops/second llite.lustre-ffff8aacc6d2a000.statahead_batch_max=0 llite.lustre-ffff8aacc6d2a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8aacc6d2a000.stats=clear mdc.lustre-MDT0001-mdc-ffff8aacc6d2a000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m7.199s user 0m0.302s sys 1m3.593s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8aacc6d2a000.statahead_batch_max=32 llite.lustre-ffff8aacc6d2a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8aacc6d2a000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8aacc6d2a000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8aacc6d2a000.stats=clear mdc.lustre-MDT0001-mdc-ffff8aacc6d2a000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m15.763s user 0m0.381s sys 0m43.913s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8aacc6d2a000.batch_stats= snapshot_time: 1776932591.252676425 secs.nsecs start_time: 1776932504.151137687 secs.nsecs elapsed_time: 87.101538738 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff8aacc6d2a000.batch_stats= snapshot_time: 1776932591.252751058 secs.nsecs start_time: 1776932504.151269139 secs.nsecs elapsed_time: 87.101481919 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8aacc6d2a000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8aacc6d2a000.batch_stats=0 llite.lustre-ffff8aacc6d2a000.statahead_max=2048 llite.lustre-ffff8aacc6d2a000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8aacc6d2a000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8aacc6d2a000.batch_stats=0 striped dir -i1 -c2 -H crush2 /mnt/lustre/d123ad.sanity total: 100 open/close in 1.44 seconds: 69.38 ops/second llite.lustre-ffff8aacc6d2a000.statahead_max=0 101 real 0m1.045s user 0m0.005s sys 0m0.403s ls -l 100 files without statahead: 1 sec llite.lustre-ffff8aacc6d2a000.statahead_max=2048 2048 101 real 0m0.732s user 0m0.005s sys 0m0.466s ls -l 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 total: 900 open/close in 3.66 seconds: 245.79 ops/second llite.lustre-ffff8aacc6d2a000.statahead_max=0 1001 real 0m10.711s user 0m0.032s sys 0m3.900s ls -l 1000 files without statahead: 10 sec llite.lustre-ffff8aacc6d2a000.statahead_max=2048 2048 1001 real 0m6.166s user 0m0.013s sys 0m2.971s ls -l 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 - open/close 2554 (time 1776932776.02 total 10.00 last 255.36) total: 4000 open/close in 15.40 seconds: 259.78 ops/second llite.lustre-ffff8aacc6d2a000.statahead_max=0 5001 real 0m49.050s user 0m0.150s sys 0m17.674s ls -l 5000 files without statahead: 49 sec llite.lustre-ffff8aacc6d2a000.statahead_max=2048 2048 5001 real 0m29.796s user 0m0.155s sys 0m16.572s ls -l 5000 files with statahead: 30 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 16096 miss_total: 4 ls -l done rm -r /mnt/lustre/d123ad.sanity: 51 seconds llite.lustre-ffff8aacc6d2a000.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 16096 miss_total: 4 mdc.lustre-MDT0000-mdc-ffff8aacc6d2a000.batch_stats= snapshot_time: 1776932923.222526062 secs.nsecs start_time: 1776932592.499941101 secs.nsecs elapsed_time: 330.722584961 secs.nsecs subreqs per batch batches % cum % 1: 152 80 80 2: 13 6 87 4: 5 2 89 8: 4 2 92 16: 0 0 92 32: 0 0 92 64: 0 0 92 128: 1 0 92 256: 14 7 100 mdc.lustre-MDT0001-mdc-ffff8aacc6d2a000.batch_stats= snapshot_time: 1776932923.222614626 secs.nsecs start_time: 1776932592.500103358 secs.nsecs elapsed_time: 330.722511268 secs.nsecs subreqs per batch batches % cum % 1: 160 78 78 2: 15 7 86 4: 3 1 87 8: 5 2 90 16: 2 0 91 32: 1 0 91 64: 0 0 91 128: 2 0 92 256: 15 7 100 - open/close 2322 (time 1776932935.47 total 10.00 last 232.14) - open/close 4462 (time 1776932945.47 total 20.00 last 213.98) - open/close 6686 (time 1776932955.48 total 30.01 last 222.33) - open/close 8910 (time 1776932965.48 total 40.01 last 222.32) total: 10000 open/close in 45.15 seconds: 221.46 ops/second llite.lustre-ffff8aacc6d2a000.statahead_batch_max=0 llite.lustre-ffff8aacc6d2a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8aacc6d2a000.stats=clear mdc.lustre-MDT0001-mdc-ffff8aacc6d2a000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m7.837s user 0m0.303s sys 0m55.637s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8aacc6d2a000.statahead_batch_max=256 llite.lustre-ffff8aacc6d2a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8aacc6d2a000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8aacc6d2a000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8aacc6d2a000.stats=clear mdc.lustre-MDT0001-mdc-ffff8aacc6d2a000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m5.647s user 0m0.338s sys 0m44.089s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8aacc6d2a000.batch_stats= snapshot_time: 1776933121.512518293 secs.nsecs start_time: 1776933044.221639848 secs.nsecs elapsed_time: 77.290878445 secs.nsecs subreqs per batch batches % cum % 1: 503 77 77 2: 71 10 88 4: 14 2 90 8: 1 0 90 16: 3 0 91 32: 19 2 94 64: 4 0 94 128: 0 0 94 256: 34 5 100 mdc.lustre-MDT0001-mdc-ffff8aacc6d2a000.batch_stats= snapshot_time: 1776933121.512626781 secs.nsecs start_time: 1776933044.221738814 secs.nsecs elapsed_time: 77.290887967 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8aacc6d2a000.statahead_batch_max=64 llite.lustre-ffff8aacc6d2a000.statahead_max=128