== sanity test 123ad: Verify batching statahead works correctly ========================================================== 20:16:50 (1755044210) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9e28d02f2000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9e28d02f2000.batch_stats=0 llite.lustre-ffff9e28d02f2000.statahead_max=32 llite.lustre-ffff9e28d02f2000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9e28d02f2000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9e28d02f2000.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.90 seconds: 111.25 ops/second llite.lustre-ffff9e28d02f2000.statahead_max=0 101 real 0m0.613s user 0m0.002s sys 0m0.216s ls -l 100 files without statahead: 1 sec llite.lustre-ffff9e28d02f2000.statahead_max=32 32 101 real 0m0.374s user 0m0.004s sys 0m0.171s ls -l 100 files with statahead: 1 sec statahead total: 63 statahead wrong: 2 agl total: 59 list_total: 27 fname_total: 36 hit_total: 18991 miss_total: 713 total: 900 open/close in 2.01 seconds: 446.91 ops/second llite.lustre-ffff9e28d02f2000.statahead_max=0 1001 real 0m6.930s user 0m0.022s sys 0m2.449s ls -l 1000 files without statahead: 7 sec llite.lustre-ffff9e28d02f2000.statahead_max=32 32 1001 real 0m3.691s user 0m0.010s sys 0m1.698s ls -l 1000 files with statahead: 4 sec statahead total: 64 statahead wrong: 2 agl total: 60 list_total: 28 fname_total: 36 hit_total: 19990 miss_total: 714 - open/close 4733 (time 1755044241.35 total 10.00 last 473.24) total: 9000 open/close in 19.99 seconds: 450.20 ops/second llite.lustre-ffff9e28d02f2000.statahead_max=0 10001 real 0m56.985s user 0m0.188s sys 0m20.336s ls -l 10000 files without statahead: 57 sec llite.lustre-ffff9e28d02f2000.statahead_max=32 32 10001 real 0m37.523s user 0m0.150s sys 0m16.455s ls -l 10000 files with statahead: 38 sec statahead total: 65 statahead wrong: 2 agl total: 61 list_total: 29 fname_total: 36 hit_total: 29989 miss_total: 715 ls -l done rm -r /mnt/lustre/d123ad.sanity: 62 seconds llite.lustre-ffff9e28d02f2000.statahead_stats= statahead total: 65 statahead wrong: 2 agl total: 61 list_total: 29 fname_total: 36 hit_total: 29989 miss_total: 715 mdc.lustre-MDT0000-mdc-ffff9e28d02f2000.batch_stats= snapshot_time: 1755044419.421058481 secs.nsecs start_time: 1755044211.619784704 secs.nsecs elapsed_time: 207.801273777 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 1 0 0 4: 4 1 1 8: 5 1 2 16: 198 55 58 32: 146 41 100 mdc.lustre-MDT0001-mdc-ffff9e28d02f2000.batch_stats= snapshot_time: 1755044419.421185978 secs.nsecs start_time: 1755044211.619839672 secs.nsecs elapsed_time: 207.801346306 secs.nsecs subreqs per batch batches % cum % 1: 3 0 0 2: 1 0 1 4: 3 0 1 8: 5 1 3 16: 190 53 56 32: 153 43 100 - open/close 2508 (time 1755044430.59 total 10.00 last 250.77) - open/close 5469 (time 1755044440.59 total 20.00 last 296.09) - open/close 8448 (time 1755044450.59 total 30.00 last 297.88) total: 10000 open/close in 35.32 seconds: 283.16 ops/second llite.lustre-ffff9e28d02f2000.statahead_batch_max=0 llite.lustre-ffff9e28d02f2000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9e28d02f2000.stats=clear mdc.lustre-MDT0001-mdc-ffff9e28d02f2000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m41.802s user 0m0.170s sys 0m39.286s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9e28d02f2000.statahead_batch_max=32 llite.lustre-ffff9e28d02f2000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9e28d02f2000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9e28d02f2000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9e28d02f2000.stats=clear mdc.lustre-MDT0001-mdc-ffff9e28d02f2000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.076s user 0m0.143s sys 0m18.995s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9e28d02f2000.batch_stats= snapshot_time: 1755044539.451713708 secs.nsecs start_time: 1755044500.942129537 secs.nsecs elapsed_time: 38.509584171 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff9e28d02f2000.batch_stats= snapshot_time: 1755044539.451754258 secs.nsecs start_time: 1755044500.942183917 secs.nsecs elapsed_time: 38.509570341 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9e28d02f2000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9e28d02f2000.batch_stats=0 llite.lustre-ffff9e28d02f2000.statahead_max=2048 llite.lustre-ffff9e28d02f2000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9e28d02f2000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9e28d02f2000.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.82 seconds: 121.82 ops/second llite.lustre-ffff9e28d02f2000.statahead_max=0 101 real 0m0.563s user 0m0.004s sys 0m0.185s ls -l 100 files without statahead: 1 sec llite.lustre-ffff9e28d02f2000.statahead_max=2048 2048 101 real 0m0.354s user 0m0.004s sys 0m0.175s ls -l 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 total: 900 open/close in 1.91 seconds: 472.41 ops/second llite.lustre-ffff9e28d02f2000.statahead_max=0 1001 real 0m5.261s user 0m0.017s sys 0m1.767s ls -l 1000 files without statahead: 6 sec llite.lustre-ffff9e28d02f2000.statahead_max=2048 2048 1001 real 0m3.033s user 0m0.019s sys 0m1.361s ls -l 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 - open/close 2890 (time 1755044650.71 total 10.00 last 289.00) - open/close 5371 (time 1755044660.71 total 20.00 last 248.08) - open/close 7708 (time 1755044670.71 total 30.00 last 233.68) total: 9000 open/close in 36.07 seconds: 249.55 ops/second llite.lustre-ffff9e28d02f2000.statahead_max=0 10001 real 1m38.053s user 0m0.245s sys 0m32.268s ls -l 10000 files without statahead: 98 sec llite.lustre-ffff9e28d02f2000.statahead_max=2048 2048 10001 real 0m34.352s user 0m0.141s sys 0m23.926s ls -l 10000 files with statahead: 35 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21096 miss_total: 4 ls -l done rm -r /mnt/lustre/d123ad.sanity: 83 seconds llite.lustre-ffff9e28d02f2000.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21096 miss_total: 4 mdc.lustre-MDT0000-mdc-ffff9e28d02f2000.batch_stats= snapshot_time: 1755044904.885361252 secs.nsecs start_time: 1755044540.273751273 secs.nsecs elapsed_time: 364.611609979 secs.nsecs subreqs per batch batches % cum % 1: 72 59 59 2: 7 5 65 4: 3 2 67 8: 3 2 70 16: 0 0 70 32: 0 0 70 64: 3 2 72 128: 1 0 73 256: 32 26 100 mdc.lustre-MDT0001-mdc-ffff9e28d02f2000.batch_stats= snapshot_time: 1755044904.885405027 secs.nsecs start_time: 1755044540.273905655 secs.nsecs elapsed_time: 364.611499372 secs.nsecs subreqs per batch batches % cum % 1: 61 55 55 2: 9 8 63 4: 3 2 66 8: 2 1 68 16: 0 0 68 32: 0 0 68 64: 2 1 70 128: 1 0 70 256: 32 29 100 - open/close 2461 (time 1755044915.95 total 10.00 last 246.04) - open/close 4613 (time 1755044925.95 total 20.01 last 215.13) - open/close 7301 (time 1755044935.96 total 30.01 last 268.69) - open/close 9693 (time 1755044945.96 total 40.01 last 239.10) total: 10000 open/close in 41.39 seconds: 241.59 ops/second llite.lustre-ffff9e28d02f2000.statahead_batch_max=0 llite.lustre-ffff9e28d02f2000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9e28d02f2000.stats=clear mdc.lustre-MDT0001-mdc-ffff9e28d02f2000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m50.566s user 0m0.150s sys 0m43.338s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9e28d02f2000.statahead_batch_max=256 llite.lustre-ffff9e28d02f2000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9e28d02f2000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9e28d02f2000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9e28d02f2000.stats=clear mdc.lustre-MDT0001-mdc-ffff9e28d02f2000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.674s user 0m0.121s sys 0m24.333s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9e28d02f2000.batch_stats= snapshot_time: 1755045041.055356981 secs.nsecs start_time: 1755045000.937955667 secs.nsecs elapsed_time: 40.117401314 secs.nsecs subreqs per batch batches % cum % 1: 130 54 54 2: 33 13 68 4: 9 3 71 8: 4 1 73 16: 1 0 74 32: 22 9 83 64: 4 1 84 128: 1 0 85 256: 35 14 100 mdc.lustre-MDT0001-mdc-ffff9e28d02f2000.batch_stats= snapshot_time: 1755045041.055422780 secs.nsecs start_time: 1755045000.938095087 secs.nsecs elapsed_time: 40.117327693 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9e28d02f2000.statahead_batch_max=64 llite.lustre-ffff9e28d02f2000.statahead_max=128