== sanity test 123ad: Verify batching statahead works correctly ========================================================== 18:16:13 (1746137773) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff88012a645800.batch_stats=0 llite.lustre-ffff88012a645800.statahead_max=32 llite.lustre-ffff88012a645800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff88012a645800.batch_stats=0 total: 100 open/close in 2.07 seconds: 48.41 ops/second llite.lustre-ffff88012a645800.statahead_max=0 101 real 0m2.013s user 0m0.004s sys 0m0.420s ls -l 100 files without statahead: 2 sec llite.lustre-ffff88012a645800.statahead_max=32 32 101 real 0m0.647s user 0m0.006s sys 0m0.147s ls -l 100 files with statahead: 1 sec statahead total: 126 statahead wrong: 2 agl total: 126 list_total: 27 fname_total: 99 hit_total: 4033 miss_total: 1318 - open/close 884 (time 1746137795.76 total 10.01 last 88.35) total: 900 open/close in 10.19 seconds: 88.36 ops/second llite.lustre-ffff88012a645800.statahead_max=0 1001 real 0m18.251s user 0m0.065s sys 0m3.614s ls -l 1000 files without statahead: 18 sec llite.lustre-ffff88012a645800.statahead_max=32 32 1001 real 0m6.536s user 0m0.030s sys 0m1.430s ls -l 1000 files with statahead: 7 sec statahead total: 127 statahead wrong: 2 agl total: 127 list_total: 28 fname_total: 99 hit_total: 5032 miss_total: 1323 - open/close 931 (time 1746137836.78 total 10.00 last 93.06) total: 1000 open/close in 10.67 seconds: 93.69 ops/second llite.lustre-ffff88012a645800.statahead_max=0 2001 real 0m37.327s user 0m0.126s sys 0m7.501s ls -l 2000 files without statahead: 37 sec llite.lustre-ffff88012a645800.statahead_max=32 32 2001 real 0m15.009s user 0m0.090s sys 0m3.061s ls -l 2000 files with statahead: 15 sec statahead total: 128 statahead wrong: 2 agl total: 128 list_total: 29 fname_total: 99 hit_total: 7031 miss_total: 1338 ls -l done rm -r /mnt/lustre/d123ad.sanity: 34 seconds llite.lustre-ffff88012a645800.statahead_stats= statahead total: 128 statahead wrong: 2 agl total: 128 list_total: 29 fname_total: 99 hit_total: 7031 miss_total: 1338 mdc.lustre-MDT0000-mdc-ffff88012a645800.batch_stats= snapshot_time: 1746137931.166232125 secs.nsecs start_time: 1746137776.920425433 secs.nsecs elapsed_time: 154.245806692 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 1 0 0 8: 3 2 3 16: 4 3 7 32: 96 92 100 - open/close 933 (time 1746137942.90 total 10.02 last 93.16) - open/close 1763 (time 1746137952.90 total 20.02 last 83.00) - open/close 2738 (time 1746137962.90 total 30.02 last 97.48) - open/close 3803 (time 1746137972.91 total 40.03 last 106.39) - open/close 4682 (time 1746137982.92 total 50.03 last 87.85) - open/close 5478 (time 1746137992.92 total 60.04 last 79.56) - open/close 6306 (time 1746138002.93 total 70.05 last 82.74) - open/close 7025 (time 1746138012.95 total 80.06 last 71.78) - open/close 7851 (time 1746138022.95 total 90.07 last 82.56) - open/close 8707 (time 1746138032.95 total 100.07 last 85.59) - open/close 9677 (time 1746138042.96 total 110.07 last 96.95) total: 10000 open/close in 113.14 seconds: 88.39 ops/second llite.lustre-ffff88012a645800.statahead_batch_max=0 llite.lustre-ffff88012a645800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff88012a645800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.337s user 0m0.374s sys 0m12.309s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff88012a645800.statahead_batch_max=32 llite.lustre-ffff88012a645800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff88012a645800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff88012a645800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m4.146s user 0m0.388s sys 0m14.487s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff88012a645800.batch_stats= snapshot_time: 1746138153.033159235 secs.nsecs start_time: 1746138082.851071210 secs.nsecs elapsed_time: 70.182088025 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff88012a645800.batch_stats=0 llite.lustre-ffff88012a645800.statahead_max=2048 llite.lustre-ffff88012a645800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff88012a645800.batch_stats=0 total: 100 open/close in 2.48 seconds: 40.40 ops/second llite.lustre-ffff88012a645800.statahead_max=0 101 real 0m1.907s user 0m0.011s sys 0m0.372s ls -l 100 files without statahead: 2 sec llite.lustre-ffff88012a645800.statahead_max=2048 2048 101 real 0m0.611s user 0m0.005s sys 0m0.176s ls -l 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 57 - open/close 848 (time 1746138415.19 total 10.01 last 84.75) total: 900 open/close in 10.56 seconds: 85.19 ops/second llite.lustre-ffff88012a645800.statahead_max=0 1001 real 0m19.338s user 0m0.082s sys 0m3.834s ls -l 1000 files without statahead: 19 sec llite.lustre-ffff88012a645800.statahead_max=2048 2048 1001 real 0m4.533s user 0m0.047s sys 0m1.561s ls -l 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 58 - open/close 772 (time 1746138456.68 total 10.00 last 77.18) total: 1000 open/close in 12.72 seconds: 78.62 ops/second llite.lustre-ffff88012a645800.statahead_max=0 2001 real 0m40.517s user 0m0.195s sys 0m7.686s ls -l 2000 files without statahead: 41 sec llite.lustre-ffff88012a645800.statahead_max=2048 2048 2001 real 0m7.272s user 0m0.080s sys 0m2.914s ls -l 2000 files with statahead: 7 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 13096 miss_total: 59 ls -l done rm -r /mnt/lustre/d123ad.sanity: 32 seconds llite.lustre-ffff88012a645800.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 13096 miss_total: 59 mdc.lustre-MDT0000-mdc-ffff88012a645800.batch_stats= snapshot_time: 1746138547.906568168 secs.nsecs start_time: 1746138154.155746900 secs.nsecs elapsed_time: 393.750821268 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 13 13 16: 3 13 27 32: 3 13 40 64: 0 0 40 128: 1 4 45 256: 12 54 100 - open/close 875 (time 1746138559.73 total 10.01 last 87.45) - open/close 1646 (time 1746138569.73 total 20.01 last 77.08) - open/close 2444 (time 1746138579.74 total 30.02 last 79.71) - open/close 3403 (time 1746138589.75 total 40.03 last 95.82) - open/close 4286 (time 1746138599.77 total 50.04 last 88.19) - open/close 5186 (time 1746138609.77 total 60.04 last 89.99) - open/close 6027 (time 1746138619.77 total 70.04 last 84.08) - open/close 6892 (time 1746138629.78 total 80.05 last 86.41) - open/close 7720 (time 1746138639.79 total 90.06 last 82.71) - open/close 8493 (time 1746138649.79 total 100.06 last 77.30) - open/close 9331 (time 1746138659.80 total 110.07 last 83.72) total: 10000 open/close in 118.71 seconds: 84.24 ops/second llite.lustre-ffff88012a645800.statahead_batch_max=0 llite.lustre-ffff88012a645800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff88012a645800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m39.785s user 0m0.364s sys 0m13.122s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff88012a645800.statahead_batch_max=256 llite.lustre-ffff88012a645800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff88012a645800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff88012a645800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m26.958s user 0m0.400s sys 0m13.886s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff88012a645800.batch_stats= snapshot_time: 1746138747.230770841 secs.nsecs start_time: 1746138713.807630267 secs.nsecs elapsed_time: 33.423140574 secs.nsecs subreqs per batch batches % cum % 1: 116 52 52 2: 13 5 58 4: 17 7 66 8: 8 3 70 16: 14 6 76 32: 12 5 82 64: 2 0 83 128: 1 0 83 256: 36 16 100 seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff88012a645800.statahead_batch_max=64 llite.lustre-ffff88012a645800.statahead_max=128