== sanity test 123ad: Verify batching statahead works correctly ========================================================== 00:42:52 (1744087372) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8800abf4a800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8800abf4a800.batch_stats=0 llite.lustre-ffff8800abf4a800.statahead_max=32 llite.lustre-ffff8800abf4a800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8800abf4a800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8800abf4a800.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.84 seconds: 119.20 ops/second llite.lustre-ffff8800abf4a800.statahead_max=0 101 real 0m0.878s user 0m0.004s sys 0m0.333s ls -l 100 files without statahead: 1 sec llite.lustre-ffff8800abf4a800.statahead_max=32 32 101 real 0m0.333s user 0m0.005s sys 0m0.174s ls -l 100 files with statahead: 0 sec statahead total: 49 statahead wrong: 1 agl total: 49 list_total: 19 fname_total: 30 hit_total: 11836 miss_total: 216 total: 900 open/close in 3.13 seconds: 287.74 ops/second llite.lustre-ffff8800abf4a800.statahead_max=0 1001 real 0m6.362s user 0m0.028s sys 0m2.246s ls -l 1000 files without statahead: 6 sec llite.lustre-ffff8800abf4a800.statahead_max=32 32 1001 real 0m1.744s user 0m0.023s sys 0m0.958s ls -l 1000 files with statahead: 2 sec statahead total: 50 statahead wrong: 1 agl total: 50 list_total: 20 fname_total: 30 hit_total: 12835 miss_total: 217 - open/close 3969 (time 1744087401.25 total 10.00 last 396.74) - open/close 7717 (time 1744087411.25 total 20.00 last 374.79) total: 9000 open/close in 23.46 seconds: 383.71 ops/second llite.lustre-ffff8800abf4a800.statahead_max=0 10001 real 0m58.165s user 0m0.249s sys 0m20.396s ls -l 10000 files without statahead: 58 sec llite.lustre-ffff8800abf4a800.statahead_max=32 32 10001 real 0m25.086s user 0m0.242s sys 0m13.367s ls -l 10000 files with statahead: 25 sec statahead total: 51 statahead wrong: 1 agl total: 51 list_total: 21 fname_total: 30 hit_total: 22834 miss_total: 218 ls -l done rm -r /mnt/lustre/d123ad.sanity: 56 seconds llite.lustre-ffff8800abf4a800.statahead_stats= statahead total: 51 statahead wrong: 1 agl total: 51 list_total: 21 fname_total: 30 hit_total: 22834 miss_total: 218 mdc.lustre-MDT0000-mdc-ffff8800abf4a800.batch_stats= snapshot_time: 1744087558.811314030 secs.nsecs start_time: 1744087373.654788035 secs.nsecs elapsed_time: 185.156525995 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 2 0 0 4: 1 0 0 8: 6 1 2 16: 189 53 55 32: 156 44 100 mdc.lustre-MDT0001-mdc-ffff8800abf4a800.batch_stats= snapshot_time: 1744087558.811419793 secs.nsecs start_time: 1744087373.654837458 secs.nsecs elapsed_time: 185.156582335 secs.nsecs subreqs per batch batches % cum % 1: 1 0 0 2: 1 0 0 4: 5 1 1 8: 4 1 3 16: 200 56 59 32: 144 40 100 - open/close 2413 (time 1744087569.60 total 10.00 last 241.23) - open/close 4948 (time 1744087579.60 total 20.00 last 253.47) - open/close 7664 (time 1744087589.60 total 30.01 last 271.55) total: 10000 open/close in 39.98 seconds: 250.13 ops/second llite.lustre-ffff8800abf4a800.statahead_batch_max=0 llite.lustre-ffff8800abf4a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8800abf4a800.stats=clear mdc.lustre-MDT0001-mdc-ffff8800abf4a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m9.065s user 0m0.173s sys 0m8.445s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8800abf4a800.statahead_batch_max=32 llite.lustre-ffff8800abf4a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8800abf4a800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8800abf4a800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8800abf4a800.stats=clear mdc.lustre-MDT0001-mdc-ffff8800abf4a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m24.088s user 0m0.197s sys 0m10.988s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8800abf4a800.batch_stats= snapshot_time: 1744087636.537174527 secs.nsecs start_time: 1744087610.353839686 secs.nsecs elapsed_time: 26.183334841 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff8800abf4a800.batch_stats= snapshot_time: 1744087636.537319794 secs.nsecs start_time: 1744087610.353924756 secs.nsecs elapsed_time: 26.183395038 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8800abf4a800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8800abf4a800.batch_stats=0 llite.lustre-ffff8800abf4a800.statahead_max=2048 llite.lustre-ffff8800abf4a800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8800abf4a800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8800abf4a800.batch_stats=0 striped dir -i1 -c2 -H crush2 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.88 seconds: 113.49 ops/second llite.lustre-ffff8800abf4a800.statahead_max=0 101 real 0m1.006s user 0m0.007s sys 0m0.344s ls -l 100 files without statahead: 1 sec llite.lustre-ffff8800abf4a800.statahead_max=2048 2048 101 real 0m0.295s user 0m0.004s sys 0m0.153s ls -l 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 total: 900 open/close in 3.19 seconds: 282.45 ops/second llite.lustre-ffff8800abf4a800.statahead_max=0 1001 real 0m9.206s user 0m0.034s sys 0m3.253s ls -l 1000 files without statahead: 9 sec llite.lustre-ffff8800abf4a800.statahead_max=2048 2048 1001 real 0m1.170s user 0m0.011s sys 0m0.778s ls -l 1000 files with statahead: 1 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 - open/close 2512 (time 1744087750.94 total 10.00 last 251.15) total: 4000 open/close in 16.06 seconds: 249.10 ops/second llite.lustre-ffff8800abf4a800.statahead_max=0 5001 real 0m39.503s user 0m0.158s sys 0m13.808s ls -l 5000 files without statahead: 39 sec llite.lustre-ffff8800abf4a800.statahead_max=2048 2048 5001 real 0m5.029s user 0m0.099s sys 0m3.935s ls -l 5000 files with statahead: 5 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 16096 miss_total: 4 ls -l done rm -r /mnt/lustre/d123ad.sanity: 26 seconds llite.lustre-ffff8800abf4a800.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 16096 miss_total: 4 mdc.lustre-MDT0000-mdc-ffff8800abf4a800.batch_stats= snapshot_time: 1744087832.012316712 secs.nsecs start_time: 1744087637.139767189 secs.nsecs elapsed_time: 194.872549523 secs.nsecs subreqs per batch batches % cum % 1: 4 16 16 2: 0 0 16 4: 2 8 24 8: 2 8 32 16: 0 0 32 32: 0 0 32 64: 1 4 36 128: 3 12 48 256: 13 52 100 mdc.lustre-MDT0001-mdc-ffff8800abf4a800.batch_stats= snapshot_time: 1744087832.012494962 secs.nsecs start_time: 1744087637.139841814 secs.nsecs elapsed_time: 194.872653148 secs.nsecs subreqs per batch batches % cum % 1: 2 7 7 2: 0 0 7 4: 2 7 14 8: 2 7 21 16: 2 7 28 32: 0 0 28 64: 3 10 39 128: 1 3 42 256: 16 57 100 - open/close 2768 (time 1744087842.82 total 10.00 last 276.77) - open/close 5324 (time 1744087852.82 total 20.00 last 255.54) - open/close 7725 (time 1744087862.82 total 30.01 last 240.02) total: 10000 open/close in 38.17 seconds: 262.01 ops/second llite.lustre-ffff8800abf4a800.statahead_batch_max=0 llite.lustre-ffff8800abf4a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8800abf4a800.stats=clear mdc.lustre-MDT0001-mdc-ffff8800abf4a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m9.022s user 0m0.180s sys 0m7.941s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8800abf4a800.statahead_batch_max=256 llite.lustre-ffff8800abf4a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8800abf4a800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8800abf4a800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8800abf4a800.stats=clear mdc.lustre-MDT0001-mdc-ffff8800abf4a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m8.633s user 0m0.168s sys 0m7.448s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8800abf4a800.batch_stats= snapshot_time: 1744087893.408174267 secs.nsecs start_time: 1744087882.152874994 secs.nsecs elapsed_time: 11.255299273 secs.nsecs subreqs per batch batches % cum % 1: 238 68 68 2: 19 5 74 4: 14 4 78 8: 10 2 80 16: 14 4 85 32: 14 4 89 64: 3 0 89 128: 0 0 89 256: 35 10 100 mdc.lustre-MDT0001-mdc-ffff8800abf4a800.batch_stats= snapshot_time: 1744087893.408287447 secs.nsecs start_time: 1744087882.152962041 secs.nsecs elapsed_time: 11.255325406 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8800abf4a800.statahead_batch_max=64 llite.lustre-ffff8800abf4a800.statahead_max=128