== sanity test 123ad: Verify batching statahead works correctly ========================================================== 21:00:14 (1786755614) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9e4f0cd54000.batch_stats=0 llite.lustre-ffff9e4f0cd54000.statahead_max=32 llite.lustre-ffff9e4f0cd54000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9e4f0cd54000.batch_stats=0 total: 100 open/close in 2.06 seconds: 48.51 ops/second llite.lustre-ffff9e4f0cd54000.statahead_max=0 101 real 0m2.027s user 0m0.007s sys 0m0.341s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9e4f0cd54000.statahead_max=32 llite.lustre-ffff9e4f0cd54000.statahead_max=32 101 real 0m1.007s user 0m0.005s sys 0m0.170s 'ls -l' 100 files with statahead: 1 sec statahead total: 137 statahead wrong: 2 agl total: 131 list_total: 29 fname_total: 95 hit_total: 4116 miss_total: 1686 swrong=2 ewrong=2 - open/close 842 (time 1786755639.43 total 10.01 last 84.14) total: 900 open/close in 10.93 seconds: 82.31 ops/second llite.lustre-ffff9e4f0cd54000.statahead_max=0 1001 real 0m19.416s user 0m0.038s sys 0m3.054s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff9e4f0cd54000.statahead_max=32 llite.lustre-ffff9e4f0cd54000.statahead_max=32 1001 real 0m11.002s user 0m0.021s sys 0m1.594s 'ls -l' 1000 files with statahead: 11 sec statahead total: 138 statahead wrong: 2 agl total: 132 list_total: 30 fname_total: 95 hit_total: 5113 miss_total: 1689 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff9e4f0cd54000.statahead_stats= statahead total: 138 statahead wrong: 2 agl total: 132 list_total: 30 fname_total: 95 hit_total: 5113 miss_total: 1689 mdc.lustre-MDT0000-mdc-ffff9e4f0cd54000.batch_stats= snapshot_time: 1786755706.825770425 secs.nsecs start_time: 1786755619.049462322 secs.nsecs elapsed_time: 87.776308103 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 1 2 12 32: 34 87 100 - open/close 878 (time 1786755718.64 total 10.00 last 87.78) - open/close 1609 (time 1786755728.66 total 20.02 last 72.99) - open/close 2467 (time 1786755738.66 total 30.02 last 85.78) - open/close 3281 (time 1786755748.66 total 40.02 last 81.38) - open/close 4072 (time 1786755758.66 total 50.03 last 79.07) - open/close 4922 (time 1786755768.67 total 60.03 last 84.96) - open/close 5803 (time 1786755778.67 total 70.03 last 88.09) - open/close 6578 (time 1786755788.68 total 80.04 last 77.44) - open/close 7456 (time 1786755798.68 total 90.04 last 87.77) - open/close 8249 (time 1786755808.69 total 100.05 last 79.21) - open/close 9190 (time 1786755818.74 total 110.10 last 93.68) total: 10000 open/close in 118.70 seconds: 84.25 ops/second llite.lustre-ffff9e4f0cd54000.statahead_batch_max=0 llite.lustre-ffff9e4f0cd54000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9e4f0cd54000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.189s user 0m0.321s sys 0m15.254s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9e4f0cd54000.statahead_batch_max=32 llite.lustre-ffff9e4f0cd54000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9e4f0cd54000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9e4f0cd54000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m39.392s user 0m0.303s sys 0m14.498s batched statahead RPC= hit count=9988 mdc.lustre-MDT0000-mdc-ffff9e4f0cd54000.batch_stats= snapshot_time: 1786756004.289550139 secs.nsecs start_time: 1786755891.800438772 secs.nsecs elapsed_time: 112.489111367 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9e4f0cd54000.batch_stats=0 llite.lustre-ffff9e4f0cd54000.statahead_max=2048 llite.lustre-ffff9e4f0cd54000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9e4f0cd54000.batch_stats=0 total: 100 open/close in 3.03 seconds: 32.96 ops/second llite.lustre-ffff9e4f0cd54000.statahead_max=0 101 real 0m1.769s user 0m0.003s sys 0m0.303s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9e4f0cd54000.statahead_max=2048 llite.lustre-ffff9e4f0cd54000.statahead_max=2048 101 real 0m0.841s user 0m0.001s sys 0m0.152s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10087 miss_total: 13 swrong=0 ewrong=0 total: 900 open/close in 9.45 seconds: 95.21 ops/second llite.lustre-ffff9e4f0cd54000.statahead_max=0 1001 real 0m21.065s user 0m0.037s sys 0m3.116s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff9e4f0cd54000.statahead_max=2048 llite.lustre-ffff9e4f0cd54000.statahead_max=2048 1001 real 0m7.453s user 0m0.027s sys 0m1.392s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11086 miss_total: 14 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff9e4f0cd54000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11086 miss_total: 14 mdc.lustre-MDT0000-mdc-ffff9e4f0cd54000.batch_stats= snapshot_time: 1786756358.597146784 secs.nsecs start_time: 1786756006.653866235 secs.nsecs elapsed_time: 351.943280549 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 745 (time 1786756371.27 total 10.00 last 74.48) - open/close 1429 (time 1786756381.28 total 20.02 last 68.31) - open/close 2201 (time 1786756391.29 total 30.02 last 77.17) - open/close 3009 (time 1786756401.29 total 40.03 last 80.74) - open/close 3899 (time 1786756411.30 total 50.03 last 88.96) - open/close 4640 (time 1786756421.31 total 60.04 last 74.01) - open/close 5402 (time 1786756431.31 total 70.05 last 76.18) - open/close 6185 (time 1786756441.32 total 80.05 last 78.26) - open/close 7032 (time 1786756451.32 total 90.05 last 84.68) - open/close 7940 (time 1786756461.32 total 100.06 last 90.78) - open/close 8769 (time 1786756471.33 total 110.06 last 82.84) - open/close 9556 (time 1786756481.33 total 120.07 last 78.66) total: 10000 open/close in 125.79 seconds: 79.50 ops/second llite.lustre-ffff9e4f0cd54000.statahead_batch_max=0 llite.lustre-ffff9e4f0cd54000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9e4f0cd54000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.330s user 0m0.295s sys 0m15.092s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9e4f0cd54000.statahead_batch_max=256 llite.lustre-ffff9e4f0cd54000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9e4f0cd54000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9e4f0cd54000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.669s user 0m0.274s sys 0m15.343s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9e4f0cd54000.batch_stats= snapshot_time: 1786756623.472383601 secs.nsecs start_time: 1786756555.256965873 secs.nsecs elapsed_time: 68.215417728 secs.nsecs subreqs per batch batches %% cum %% 1: 237 50 50 2: 81 17 67 4: 48 10 77 8: 41 8 86 16: 11 2 88 32: 18 3 92 64: 4 0 93 128: 0 0 93 256: 33 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9e4f0cd54000.statahead_batch_max=64 llite.lustre-ffff9e4f0cd54000.statahead_max=128