== sanity test 123ad: Verify batching statahead works correctly ========================================================== 23:35:09 (1763354109) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff94f247d67800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff94f247d67800.batch_stats=0 llite.lustre-ffff94f247d67800.statahead_max=32 llite.lustre-ffff94f247d67800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff94f247d67800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff94f247d67800.batch_stats=0 striped dir -i1 -c2 -H crush2 /mnt/lustre/d123ad.sanity total: 100 open/close in 1.14 seconds: 87.63 ops/second llite.lustre-ffff94f247d67800.statahead_max=0 101 real 0m0.984s user 0m0.004s sys 0m0.285s ls -l 100 files without statahead: 1 sec llite.lustre-ffff94f247d67800.statahead_max=32 32 101 real 0m0.429s user 0m0.004s sys 0m0.236s ls -l 100 files with statahead: 0 sec statahead total: 124 statahead wrong: 2 agl total: 114 list_total: 32 fname_total: 91 hit_total: 7281 miss_total: 1291 total: 900 open/close in 4.50 seconds: 200.18 ops/second llite.lustre-ffff94f247d67800.statahead_max=0 1001 real 0m11.038s user 0m0.028s sys 0m2.812s ls -l 1000 files without statahead: 11 sec llite.lustre-ffff94f247d67800.statahead_max=32 32 1001 real 0m3.955s user 0m0.020s sys 0m1.679s ls -l 1000 files with statahead: 4 sec statahead total: 125 statahead wrong: 2 agl total: 115 list_total: 33 fname_total: 91 hit_total: 8280 miss_total: 1292 - open/close 1954 (time 1763354149.60 total 10.00 last 195.37) total: 3000 open/close in 16.19 seconds: 185.25 ops/second llite.lustre-ffff94f247d67800.statahead_max=0 4001 real 0m41.170s user 0m0.131s sys 0m10.628s ls -l 4000 files without statahead: 42 sec llite.lustre-ffff94f247d67800.statahead_max=32 32 4001 real 0m15.589s user 0m0.086s sys 0m6.404s ls -l 4000 files with statahead: 15 sec statahead total: 126 statahead wrong: 2 agl total: 116 list_total: 34 fname_total: 91 hit_total: 12278 miss_total: 1294 ls -l done rm -r /mnt/lustre/d123ad.sanity: 33 seconds llite.lustre-ffff94f247d67800.statahead_stats= statahead total: 126 statahead wrong: 2 agl total: 116 list_total: 34 fname_total: 91 hit_total: 12278 miss_total: 1294 mdc.lustre-MDT0000-mdc-ffff94f247d67800.batch_stats= snapshot_time: 1763354253.751851723 secs.nsecs start_time: 1763354110.991124104 secs.nsecs elapsed_time: 142.760727619 secs.nsecs subreqs per batch batches % cum % 1: 3 1 1 2: 2 1 3 4: 2 1 4 8: 2 1 5 16: 111 67 73 32: 44 26 100 mdc.lustre-MDT0001-mdc-ffff94f247d67800.batch_stats= snapshot_time: 1763354253.751912455 secs.nsecs start_time: 1763354110.991188259 secs.nsecs elapsed_time: 142.760724196 secs.nsecs subreqs per batch batches % cum % 1: 1 0 0 2: 0 0 0 4: 1 0 1 8: 5 3 4 16: 63 37 42 32: 96 57 100 - open/close 1803 (time 1763354265.49 total 10.01 last 180.17) - open/close 3596 (time 1763354275.50 total 20.01 last 179.18) - open/close 5422 (time 1763354285.50 total 30.02 last 182.53) - open/close 7132 (time 1763354295.51 total 40.02 last 170.96) - open/close 8749 (time 1763354305.51 total 50.02 last 161.65) total: 10000 open/close in 57.30 seconds: 174.51 ops/second llite.lustre-ffff94f247d67800.statahead_batch_max=0 llite.lustre-ffff94f247d67800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff94f247d67800.stats=clear mdc.lustre-MDT0001-mdc-ffff94f247d67800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.220s user 0m0.269s sys 0m27.515s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff94f247d67800.statahead_batch_max=32 llite.lustre-ffff94f247d67800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff94f247d67800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff94f247d67800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff94f247d67800.stats=clear mdc.lustre-MDT0001-mdc-ffff94f247d67800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m40.955s user 0m0.221s sys 0m18.299s batched statahead RPC= hit count=9996 mdc.lustre-MDT0000-mdc-ffff94f247d67800.batch_stats= snapshot_time: 1763354395.203314214 secs.nsecs start_time: 1763354348.692567489 secs.nsecs elapsed_time: 46.510746725 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff94f247d67800.batch_stats= snapshot_time: 1763354395.203402985 secs.nsecs start_time: 1763354348.693394187 secs.nsecs elapsed_time: 46.510008798 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff94f247d67800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff94f247d67800.batch_stats=0 llite.lustre-ffff94f247d67800.statahead_max=2048 llite.lustre-ffff94f247d67800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff94f247d67800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff94f247d67800.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 1.07 seconds: 93.63 ops/second llite.lustre-ffff94f247d67800.statahead_max=0 101 real 0m1.006s user 0m0.007s sys 0m0.288s ls -l 100 files without statahead: 1 sec llite.lustre-ffff94f247d67800.statahead_max=2048 2048 101 real 0m0.425s user 0m0.005s sys 0m0.194s ls -l 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10095 miss_total: 5 total: 900 open/close in 3.83 seconds: 234.85 ops/second llite.lustre-ffff94f247d67800.statahead_max=0 1001 real 0m10.114s user 0m0.028s sys 0m2.697s ls -l 1000 files without statahead: 10 sec llite.lustre-ffff94f247d67800.statahead_max=2048 2048 1001 real 0m3.356s user 0m0.016s sys 0m1.371s ls -l 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11094 miss_total: 6 - open/close 1685 (time 1763354554.84 total 10.01 last 168.41) - open/close 3372 (time 1763354564.85 total 20.01 last 168.63) total: 4000 open/close in 23.61 seconds: 169.44 ops/second llite.lustre-ffff94f247d67800.statahead_max=0 5001 real 0m58.748s user 0m0.170s sys 0m14.037s ls -l 5000 files without statahead: 59 sec llite.lustre-ffff94f247d67800.statahead_max=2048 2048 5001 real 0m15.586s user 0m0.118s sys 0m8.670s ls -l 5000 files with statahead: 16 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 16093 miss_total: 7 ls -l done rm -r /mnt/lustre/d123ad.sanity: 49 seconds llite.lustre-ffff94f247d67800.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 16093 miss_total: 7 mdc.lustre-MDT0000-mdc-ffff94f247d67800.batch_stats= snapshot_time: 1763354700.418164672 secs.nsecs start_time: 1763354396.172786446 secs.nsecs elapsed_time: 304.245378226 secs.nsecs subreqs per batch batches % cum % 1: 36 46 46 2: 14 18 64 4: 8 10 75 8: 2 2 77 16: 0 0 77 32: 0 0 77 64: 1 1 79 128: 1 1 80 256: 15 19 100 mdc.lustre-MDT0001-mdc-ffff94f247d67800.batch_stats= snapshot_time: 1763354700.418268954 secs.nsecs start_time: 1763354396.172945817 secs.nsecs elapsed_time: 304.245323137 secs.nsecs subreqs per batch batches % cum % 1: 32 43 43 2: 11 15 58 4: 7 9 68 8: 6 8 76 16: 0 0 76 32: 0 0 76 64: 1 1 78 128: 2 2 80 256: 14 19 100 - open/close 1829 (time 1763354711.65 total 10.00 last 182.89) - open/close 3907 (time 1763354721.65 total 20.00 last 207.79) - open/close 5613 (time 1763354731.65 total 30.00 last 170.59) - open/close 7268 (time 1763354741.65 total 40.00 last 165.45) - open/close 9099 (time 1763354751.66 total 50.01 last 183.05) total: 10000 open/close in 55.34 seconds: 180.70 ops/second llite.lustre-ffff94f247d67800.statahead_batch_max=0 llite.lustre-ffff94f247d67800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff94f247d67800.stats=clear mdc.lustre-MDT0001-mdc-ffff94f247d67800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m43.887s user 0m0.313s sys 0m35.546s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff94f247d67800.statahead_batch_max=256 llite.lustre-ffff94f247d67800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff94f247d67800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff94f247d67800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff94f247d67800.stats=clear mdc.lustre-MDT0001-mdc-ffff94f247d67800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.096s user 0m0.206s sys 0m24.246s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff94f247d67800.batch_stats= snapshot_time: 1763354842.706246367 secs.nsecs start_time: 1763354804.315098863 secs.nsecs elapsed_time: 38.391147504 secs.nsecs subreqs per batch batches % cum % 1: 146 56 56 2: 29 11 67 4: 17 6 74 8: 3 1 75 16: 3 1 76 32: 23 8 85 64: 3 1 86 128: 0 0 86 256: 35 13 100 mdc.lustre-MDT0001-mdc-ffff94f247d67800.batch_stats= snapshot_time: 1763354842.706306399 secs.nsecs start_time: 1763354804.315161256 secs.nsecs elapsed_time: 38.391145143 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff94f247d67800.statahead_batch_max=64 llite.lustre-ffff94f247d67800.statahead_max=128