== sanity test 123ad: Verify batching statahead works correctly ========================================================== 04:20:09 (1786695609) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9ff7c2e39800.batch_stats=0 llite.lustre-ffff9ff7c2e39800.statahead_max=32 llite.lustre-ffff9ff7c2e39800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9ff7c2e39800.batch_stats=0 total: 100 open/close in 3.17 seconds: 31.54 ops/second llite.lustre-ffff9ff7c2e39800.statahead_max=0 101 real 0m2.371s user 0m0.005s sys 0m0.329s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9ff7c2e39800.statahead_max=32 llite.lustre-ffff9ff7c2e39800.statahead_max=32 101 real 0m1.042s user 0m0.004s sys 0m0.155s 'ls -l' 100 files with statahead: 1 sec statahead total: 115 statahead wrong: 2 agl total: 109 list_total: 31 fname_total: 65 hit_total: 3668 miss_total: 1562 swrong=2 ewrong=2 - open/close 704 (time 1786695638.26 total 10.00 last 70.37) total: 900 open/close in 12.62 seconds: 71.30 ops/second llite.lustre-ffff9ff7c2e39800.statahead_max=0 1001 real 0m19.839s user 0m0.033s sys 0m3.131s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff9ff7c2e39800.statahead_max=32 llite.lustre-ffff9ff7c2e39800.statahead_max=32 1001 real 0m11.667s user 0m0.032s sys 0m1.641s 'ls -l' 1000 files with statahead: 12 sec statahead total: 116 statahead wrong: 2 agl total: 110 list_total: 32 fname_total: 65 hit_total: 4666 miss_total: 1564 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff9ff7c2e39800.statahead_stats= statahead total: 116 statahead wrong: 2 agl total: 110 list_total: 32 fname_total: 65 hit_total: 4666 miss_total: 1564 mdc.lustre-MDT0000-mdc-ffff9ff7c2e39800.batch_stats= snapshot_time: 1786695707.769534664 secs.nsecs start_time: 1786695614.916064094 secs.nsecs elapsed_time: 92.853470570 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 668 (time 1786695720.28 total 10.00 last 66.79) - open/close 1286 (time 1786695730.29 total 20.02 last 61.70) - open/close 1912 (time 1786695740.30 total 30.03 last 62.54) - open/close 2582 (time 1786695750.31 total 40.04 last 66.93) - open/close 3211 (time 1786695760.32 total 50.04 last 62.86) - open/close 3848 (time 1786695770.33 total 60.06 last 63.62) - open/close 4487 (time 1786695780.34 total 70.07 last 63.83) - open/close 5103 (time 1786695790.35 total 80.07 last 61.56) - open/close 5697 (time 1786695800.35 total 90.07 last 59.40) - open/close 6268 (time 1786695810.36 total 100.09 last 57.02) - open/close 6987 (time 1786695820.38 total 110.10 last 71.80) - open/close 7678 (time 1786695830.39 total 120.11 last 69.02) - open/close 8403 (time 1786695840.40 total 130.12 last 72.42) - open/close 9055 (time 1786695850.41 total 140.13 last 65.14) - open/close 9719 (time 1786695860.42 total 150.14 last 66.35) total: 10000 open/close in 154.94 seconds: 64.54 ops/second llite.lustre-ffff9ff7c2e39800.statahead_batch_max=0 llite.lustre-ffff9ff7c2e39800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9ff7c2e39800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m20.419s user 0m0.321s sys 0m16.014s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9ff7c2e39800.statahead_batch_max=32 llite.lustre-ffff9ff7c2e39800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9ff7c2e39800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9ff7c2e39800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m47.672s user 0m0.326s sys 0m15.179s batched statahead RPC= hit count=9976 mdc.lustre-MDT0000-mdc-ffff9ff7c2e39800.batch_stats= snapshot_time: 1786696085.041940425 secs.nsecs start_time: 1786695955.826599489 secs.nsecs elapsed_time: 129.215340936 secs.nsecs subreqs per batch batches %% cum %% 1: 3 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 1 16: 1 0 1 32: 313 98 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9ff7c2e39800.batch_stats=0 llite.lustre-ffff9ff7c2e39800.statahead_max=2048 llite.lustre-ffff9ff7c2e39800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9ff7c2e39800.batch_stats=0 total: 100 open/close in 2.64 seconds: 37.94 ops/second llite.lustre-ffff9ff7c2e39800.statahead_max=0 101 real 0m2.871s user 0m0.005s sys 0m0.340s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9ff7c2e39800.statahead_max=2048 llite.lustre-ffff9ff7c2e39800.statahead_max=2048 101 real 0m0.877s user 0m0.004s sys 0m0.157s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10075 miss_total: 25 swrong=0 ewrong=0 - open/close 833 (time 1786696400.56 total 10.00 last 83.30) total: 900 open/close in 10.89 seconds: 82.61 ops/second llite.lustre-ffff9ff7c2e39800.statahead_max=0 1001 real 0m20.741s user 0m0.032s sys 0m3.209s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff9ff7c2e39800.statahead_max=2048 llite.lustre-ffff9ff7c2e39800.statahead_max=2048 1001 real 0m7.671s user 0m0.026s sys 0m1.627s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11074 miss_total: 26 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff9ff7c2e39800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11074 miss_total: 26 mdc.lustre-MDT0000-mdc-ffff9ff7c2e39800.batch_stats= snapshot_time: 1786696463.876429989 secs.nsecs start_time: 1786696087.589867854 secs.nsecs elapsed_time: 376.286562135 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 794 (time 1786696477.00 total 10.00 last 79.37) - open/close 1464 (time 1786696487.00 total 20.01 last 66.99) - open/close 2141 (time 1786696497.01 total 30.02 last 67.62) - open/close 2844 (time 1786696507.03 total 40.04 last 70.15) - open/close 3621 (time 1786696517.04 total 50.05 last 77.63) - open/close 4383 (time 1786696527.05 total 60.05 last 76.16) - open/close 5037 (time 1786696537.05 total 70.06 last 65.37) - open/close 5873 (time 1786696547.05 total 80.06 last 83.59) - open/close 6840 (time 1786696557.06 total 90.06 last 96.66) - open/close 7571 (time 1786696567.06 total 100.07 last 73.07) - open/close 8450 (time 1786696577.07 total 110.07 last 87.85) - open/close 9387 (time 1786696587.07 total 120.08 last 93.64) total: 10000 open/close in 127.72 seconds: 78.29 ops/second llite.lustre-ffff9ff7c2e39800.statahead_batch_max=0 llite.lustre-ffff9ff7c2e39800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9ff7c2e39800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m4.167s user 0m0.303s sys 0m15.621s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9ff7c2e39800.statahead_batch_max=256 llite.lustre-ffff9ff7c2e39800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9ff7c2e39800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9ff7c2e39800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.615s user 0m0.284s sys 0m16.131s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9ff7c2e39800.batch_stats= snapshot_time: 1786696725.262495371 secs.nsecs start_time: 1786696668.344507501 secs.nsecs elapsed_time: 56.917987870 secs.nsecs subreqs per batch batches %% cum %% 1: 220 52 52 2: 72 17 69 4: 39 9 78 8: 23 5 84 16: 16 3 87 32: 13 3 90 64: 4 0 91 128: 0 0 91 256: 34 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9ff7c2e39800.statahead_batch_max=64 llite.lustre-ffff9ff7c2e39800.statahead_max=128