== sanity test 123ad: Verify batching statahead works correctly ========================================================== 14:33:23 (1777055603) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8984089c3800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8984089c3800.batch_stats=0 llite.lustre-ffff8984089c3800.statahead_max=32 llite.lustre-ffff8984089c3800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8984089c3800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8984089c3800.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 1.66 seconds: 60.20 ops/second llite.lustre-ffff8984089c3800.statahead_max=0 101 real 0m1.854s user 0m0.010s sys 0m0.530s ls -l 100 files without statahead: 2 sec llite.lustre-ffff8984089c3800.statahead_max=32 32 101 real 0m0.691s user 0m0.006s sys 0m0.434s ls -l 100 files with statahead: 0 sec statahead total: 112 statahead wrong: 2 agl total: 105 list_total: 34 fname_total: 76 hit_total: 14147 miss_total: 1674 total: 900 open/close in 6.77 seconds: 133.00 ops/second llite.lustre-ffff8984089c3800.statahead_max=0 1001 real 0m14.665s user 0m0.051s sys 0m4.779s ls -l 1000 files without statahead: 14 sec llite.lustre-ffff8984089c3800.statahead_max=32 32 1001 real 0m7.588s user 0m0.030s sys 0m3.449s ls -l 1000 files with statahead: 8 sec statahead total: 113 statahead wrong: 2 agl total: 106 list_total: 35 fname_total: 76 hit_total: 15146 miss_total: 1675 - open/close 1467 (time 1777055661.23 total 10.00 last 146.67) total: 2000 open/close in 13.95 seconds: 143.39 ops/second llite.lustre-ffff8984089c3800.statahead_max=0 3001 real 0m46.154s user 0m0.147s sys 0m14.348s ls -l 3000 files without statahead: 47 sec llite.lustre-ffff8984089c3800.statahead_max=32 32 3001 real 0m22.292s user 0m0.113s sys 0m10.154s ls -l 3000 files with statahead: 22 sec statahead total: 114 statahead wrong: 2 agl total: 107 list_total: 36 fname_total: 76 hit_total: 18144 miss_total: 1677 ls -l done rm -r /mnt/lustre/d123ad.sanity: 44 seconds llite.lustre-ffff8984089c3800.statahead_stats= statahead total: 114 statahead wrong: 2 agl total: 107 list_total: 36 fname_total: 76 hit_total: 18144 miss_total: 1677 mdc.lustre-MDT0000-mdc-ffff8984089c3800.batch_stats= snapshot_time: 1777055791.517125658 secs.nsecs start_time: 1777055606.158356994 secs.nsecs elapsed_time: 185.358768664 secs.nsecs subreqs per batch batches % cum % 1: 2 1 1 2: 2 1 3 4: 3 2 5 8: 4 3 8 16: 82 61 69 32: 40 30 100 mdc.lustre-MDT0001-mdc-ffff8984089c3800.batch_stats= snapshot_time: 1777055791.517202518 secs.nsecs start_time: 1777055606.158550169 secs.nsecs elapsed_time: 185.358652349 secs.nsecs subreqs per batch batches % cum % 1: 1 0 0 2: 0 0 0 4: 4 2 3 8: 2 1 5 16: 52 38 43 32: 77 56 100 - open/close 1456 (time 1777055803.44 total 10.00 last 145.57) - open/close 2684 (time 1777055813.45 total 20.01 last 122.74) - open/close 3773 (time 1777055823.45 total 30.02 last 108.81) - open/close 4985 (time 1777055833.46 total 40.02 last 121.19) - open/close 6201 (time 1777055843.46 total 50.02 last 121.59) - open/close 7469 (time 1777055853.46 total 60.02 last 126.77) - open/close 8834 (time 1777055863.46 total 70.03 last 136.42) - open/close 9999 (time 1777055873.47 total 80.03 last 116.47) total: 10000 open/close in 80.03 seconds: 124.95 ops/second llite.lustre-ffff8984089c3800.statahead_batch_max=0 llite.lustre-ffff8984089c3800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8984089c3800.stats=clear mdc.lustre-MDT0001-mdc-ffff8984089c3800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m8.586s user 0m0.395s sys 0m57.785s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8984089c3800.statahead_batch_max=32 llite.lustre-ffff8984089c3800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8984089c3800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8984089c3800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8984089c3800.stats=clear mdc.lustre-MDT0001-mdc-ffff8984089c3800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m27.219s user 0m0.376s sys 0m40.492s batched statahead RPC= hit count=9997 mdc.lustre-MDT0000-mdc-ffff8984089c3800.batch_stats= snapshot_time: 1777056050.554965077 secs.nsecs start_time: 1777055949.516072288 secs.nsecs elapsed_time: 101.038892789 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff8984089c3800.batch_stats= snapshot_time: 1777056050.555035212 secs.nsecs start_time: 1777055949.516391142 secs.nsecs elapsed_time: 101.038644070 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8984089c3800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8984089c3800.batch_stats=0 llite.lustre-ffff8984089c3800.statahead_max=2048 llite.lustre-ffff8984089c3800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8984089c3800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff8984089c3800.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 1.80 seconds: 55.42 ops/second llite.lustre-ffff8984089c3800.statahead_max=0 101 real 0m1.597s user 0m0.010s sys 0m0.526s ls -l 100 files without statahead: 2 sec llite.lustre-ffff8984089c3800.statahead_max=2048 2048 101 real 0m0.783s user 0m0.010s sys 0m0.519s ls -l 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10096 miss_total: 4 total: 900 open/close in 6.95 seconds: 129.43 ops/second llite.lustre-ffff8984089c3800.statahead_max=0 1001 real 0m18.126s user 0m0.052s sys 0m5.244s ls -l 1000 files without statahead: 18 sec llite.lustre-ffff8984089c3800.statahead_max=2048 2048 1001 real 0m6.919s user 0m0.033s sys 0m3.478s ls -l 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11095 miss_total: 5 total: 1000 open/close in 7.22 seconds: 138.55 ops/second llite.lustre-ffff8984089c3800.statahead_max=0 2001 real 0m33.477s user 0m0.095s sys 0m10.232s ls -l 2000 files without statahead: 34 sec llite.lustre-ffff8984089c3800.statahead_max=2048 2048 2001 real 0m17.396s user 0m0.079s sys 0m8.717s ls -l 2000 files with statahead: 18 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 13094 miss_total: 6 ls -l done rm -r /mnt/lustre/d123ad.sanity: 30 seconds llite.lustre-ffff8984089c3800.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 13094 miss_total: 6 mdc.lustre-MDT0000-mdc-ffff8984089c3800.batch_stats= snapshot_time: 1777056443.736884060 secs.nsecs start_time: 1777056052.533250894 secs.nsecs elapsed_time: 391.203633166 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 3 25 25 8: 2 16 41 16: 1 8 50 32: 0 0 50 64: 0 0 50 128: 0 0 50 256: 6 50 100 mdc.lustre-MDT0001-mdc-ffff8984089c3800.batch_stats= snapshot_time: 1777056443.736999827 secs.nsecs start_time: 1777056052.533464561 secs.nsecs elapsed_time: 391.203535266 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 2 11 11 8: 4 23 35 16: 1 5 41 32: 2 11 52 64: 2 11 64 128: 0 0 64 256: 6 35 100 - open/close 1181 (time 1777056455.41 total 10.01 last 118.04) - open/close 2512 (time 1777056465.42 total 20.01 last 133.04) - open/close 3700 (time 1777056475.43 total 30.02 last 118.72) - open/close 4791 (time 1777056485.43 total 40.02 last 109.08) - open/close 6297 (time 1777056495.43 total 50.02 last 150.59) - open/close 8066 (time 1777056505.43 total 60.02 last 176.82) total: 10000 open/close in 69.96 seconds: 142.93 ops/second llite.lustre-ffff8984089c3800.statahead_batch_max=0 llite.lustre-ffff8984089c3800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8984089c3800.stats=clear mdc.lustre-MDT0001-mdc-ffff8984089c3800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m9.154s user 0m0.390s sys 0m54.304s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8984089c3800.statahead_batch_max=256 llite.lustre-ffff8984089c3800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8984089c3800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff8984089c3800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8984089c3800.stats=clear mdc.lustre-MDT0001-mdc-ffff8984089c3800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m3.208s user 0m0.326s sys 0m42.063s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8984089c3800.batch_stats= snapshot_time: 1777056665.782857832 secs.nsecs start_time: 1777056591.052183290 secs.nsecs elapsed_time: 74.730674542 secs.nsecs subreqs per batch batches % cum % 1: 391 75 75 2: 52 10 85 4: 12 2 87 8: 2 0 88 16: 3 0 88 32: 20 3 92 64: 5 0 93 128: 0 0 93 256: 34 6 100 mdc.lustre-MDT0001-mdc-ffff8984089c3800.batch_stats= snapshot_time: 1777056665.782950814 secs.nsecs start_time: 1777056591.052384853 secs.nsecs elapsed_time: 74.730565961 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8984089c3800.statahead_batch_max=64 llite.lustre-ffff8984089c3800.statahead_max=128