== sanity test 123ad: Verify batching statahead works correctly ========================================================== 16:11:49 (1746130309) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff88012c504800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff88012c504800.batch_stats=0 llite.lustre-ffff88012c504800.statahead_max=32 llite.lustre-ffff88012c504800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff88012c504800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff88012c504800.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 1.40 seconds: 71.39 ops/second llite.lustre-ffff88012c504800.statahead_max=0 101 real 0m1.350s user 0m0.004s sys 0m0.325s ls -l 100 files without statahead: 1 sec llite.lustre-ffff88012c504800.statahead_max=32 32 101 real 0m0.399s user 0m0.005s sys 0m0.152s ls -l 100 files with statahead: 1 sec statahead total: 130 statahead wrong: 2 agl total: 130 list_total: 28 fname_total: 102 hit_total: 4447 miss_total: 1743 total: 900 open/close in 7.44 seconds: 120.97 ops/second llite.lustre-ffff88012c504800.statahead_max=0 1001 real 0m14.017s user 0m0.062s sys 0m3.324s ls -l 1000 files without statahead: 14 sec llite.lustre-ffff88012c504800.statahead_max=32 32 1001 real 0m3.048s user 0m0.017s sys 0m1.173s ls -l 1000 files with statahead: 3 sec statahead total: 131 statahead wrong: 2 agl total: 131 list_total: 29 fname_total: 102 hit_total: 5446 miss_total: 1751 - open/close 1214 (time 1746130356.44 total 10.00 last 121.35) total: 2000 open/close in 15.85 seconds: 126.21 ops/second llite.lustre-ffff88012c504800.statahead_max=0 3001 real 0m33.601s user 0m0.341s sys 0m9.160s ls -l 3000 files without statahead: 34 sec llite.lustre-ffff88012c504800.statahead_max=32 32 3001 real 0m11.212s user 0m0.112s sys 0m3.717s ls -l 3000 files with statahead: 11 sec statahead total: 132 statahead wrong: 2 agl total: 132 list_total: 30 fname_total: 102 hit_total: 8445 miss_total: 1765 ls -l done rm -r /mnt/lustre/d123ad.sanity: 28 seconds llite.lustre-ffff88012c504800.statahead_stats= statahead total: 132 statahead wrong: 2 agl total: 132 list_total: 30 fname_total: 102 hit_total: 8445 miss_total: 1765 mdc.lustre-MDT0000-mdc-ffff88012c504800.batch_stats= snapshot_time: 1746130441.230947458 secs.nsecs start_time: 1746130311.933669949 secs.nsecs elapsed_time: 129.297277509 secs.nsecs subreqs per batch batches % cum % 1: 2 1 1 2: 1 0 2 4: 5 3 5 8: 3 2 8 16: 69 50 58 32: 57 41 100 mdc.lustre-MDT0001-mdc-ffff88012c504800.batch_stats= snapshot_time: 1746130441.231051348 secs.nsecs start_time: 1746130311.933745044 secs.nsecs elapsed_time: 129.297306304 secs.nsecs subreqs per batch batches % cum % 1: 1 0 0 2: 0 0 0 4: 3 2 2 8: 4 2 5 16: 79 58 64 32: 48 35 100 - open/close 1166 (time 1746130452.80 total 10.00 last 116.59) - open/close 2911 (time 1746130462.81 total 20.00 last 174.46) - open/close 4909 (time 1746130472.81 total 30.01 last 199.75) - open/close 6755 (time 1746130482.81 total 40.01 last 184.58) - open/close 8188 (time 1746130492.82 total 50.01 last 143.22) - open/close 9630 (time 1746130502.82 total 60.01 last 144.19) total: 10000 open/close in 62.07 seconds: 161.10 ops/second llite.lustre-ffff88012c504800.statahead_batch_max=0 llite.lustre-ffff88012c504800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff88012c504800.stats=clear mdc.lustre-MDT0001-mdc-ffff88012c504800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m17.338s user 0m0.268s sys 0m9.837s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff88012c504800.statahead_batch_max=32 llite.lustre-ffff88012c504800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff88012c504800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff88012c504800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff88012c504800.stats=clear mdc.lustre-MDT0001-mdc-ffff88012c504800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.258s user 0m0.351s sys 0m11.346s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff88012c504800.batch_stats= snapshot_time: 1746130564.247339864 secs.nsecs start_time: 1746130524.774710249 secs.nsecs elapsed_time: 39.472629615 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff88012c504800.batch_stats= snapshot_time: 1746130564.251025025 secs.nsecs start_time: 1746130524.774803218 secs.nsecs elapsed_time: 39.476221807 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff88012c504800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff88012c504800.batch_stats=0 llite.lustre-ffff88012c504800.statahead_max=2048 llite.lustre-ffff88012c504800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff88012c504800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff88012c504800.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 1.13 seconds: 88.16 ops/second llite.lustre-ffff88012c504800.statahead_max=0 101 real 0m1.048s user 0m0.014s sys 0m0.303s ls -l 100 files without statahead: 1 sec llite.lustre-ffff88012c504800.statahead_max=2048 2048 101 real 0m0.328s user 0m0.006s sys 0m0.146s ls -l 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 57 total: 900 open/close in 6.30 seconds: 142.85 ops/second llite.lustre-ffff88012c504800.statahead_max=0 1001 real 0m12.898s user 0m0.077s sys 0m3.165s ls -l 1000 files without statahead: 13 sec llite.lustre-ffff88012c504800.statahead_max=2048 2048 1001 real 0m1.620s user 0m0.030s sys 0m1.147s ls -l 1000 files with statahead: 2 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 58 - open/close 1208 (time 1746130737.98 total 10.00 last 120.80) total: 2000 open/close in 15.80 seconds: 126.62 ops/second llite.lustre-ffff88012c504800.statahead_max=0 3001 real 0m35.498s user 0m0.277s sys 0m9.107s ls -l 3000 files without statahead: 35 sec llite.lustre-ffff88012c504800.statahead_max=2048 2048 3001 real 0m4.864s user 0m0.090s sys 0m3.275s ls -l 3000 files with statahead: 4 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 14096 miss_total: 59 ls -l done rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff88012c504800.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 14096 miss_total: 59 mdc.lustre-MDT0000-mdc-ffff88012c504800.batch_stats= snapshot_time: 1746130809.509786195 secs.nsecs start_time: 1746130564.954674523 secs.nsecs elapsed_time: 244.555111672 secs.nsecs subreqs per batch batches % cum % 1: 5 17 17 2: 4 13 31 4: 6 20 51 8: 2 6 58 16: 1 3 62 32: 2 6 68 64: 0 0 68 128: 0 0 68 256: 9 31 100 mdc.lustre-MDT0001-mdc-ffff88012c504800.batch_stats= snapshot_time: 1746130809.509877940 secs.nsecs start_time: 1746130564.954794323 secs.nsecs elapsed_time: 244.555083617 secs.nsecs subreqs per batch batches % cum % 1: 8 25 25 2: 2 6 32 4: 4 12 45 8: 5 16 61 16: 1 3 64 32: 1 3 67 64: 1 3 70 128: 0 0 70 256: 9 29 100 - open/close 1907 (time 1746130820.30 total 10.00 last 190.64) - open/close 4611 (time 1746130830.31 total 20.01 last 270.30) - open/close 6429 (time 1746130840.31 total 30.01 last 181.76) - open/close 8303 (time 1746130850.31 total 40.01 last 187.38) total: 10000 open/close in 48.19 seconds: 207.52 ops/second llite.lustre-ffff88012c504800.statahead_batch_max=0 llite.lustre-ffff88012c504800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff88012c504800.stats=clear mdc.lustre-MDT0001-mdc-ffff88012c504800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m15.900s user 0m0.265s sys 0m10.253s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff88012c504800.statahead_batch_max=256 llite.lustre-ffff88012c504800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff88012c504800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff88012c504800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff88012c504800.stats=clear mdc.lustre-MDT0001-mdc-ffff88012c504800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m13.765s user 0m0.277s sys 0m10.940s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff88012c504800.batch_stats= snapshot_time: 1746130894.172203007 secs.nsecs start_time: 1746130876.839862259 secs.nsecs elapsed_time: 17.332340748 secs.nsecs subreqs per batch batches % cum % 1: 101 53 53 2: 9 4 58 4: 7 3 61 8: 4 2 64 16: 13 6 70 32: 13 6 77 64: 6 3 80 128: 0 0 80 256: 36 19 100 mdc.lustre-MDT0001-mdc-ffff88012c504800.batch_stats= snapshot_time: 1746130894.172276331 secs.nsecs start_time: 1746130876.839927131 secs.nsecs elapsed_time: 17.332349200 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff88012c504800.statahead_batch_max=64 llite.lustre-ffff88012c504800.statahead_max=128