== sanity test 123ad: Verify batching statahead works correctly ========================================================== 13:23:41 (1786469021) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9317060a9000.batch_stats=0 llite.lustre-ffff9317060a9000.statahead_max=32 llite.lustre-ffff9317060a9000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9317060a9000.batch_stats=0 total: 100 open/close in 0.68 seconds: 148.07 ops/second llite.lustre-ffff9317060a9000.statahead_max=0 101 real 0m0.609s user 0m0.005s sys 0m0.246s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff9317060a9000.statahead_max=32 llite.lustre-ffff9317060a9000.statahead_max=32 101 real 0m0.363s user 0m0.001s sys 0m0.211s 'ls -l' 100 files with statahead: 0 sec statahead total: 71 statahead wrong: 2 agl total: 67 list_total: 26 fname_total: 35 hit_total: 4064 miss_total: 1123 swrong=2 ewrong=2 total: 900 open/close in 1.78 seconds: 505.31 ops/second llite.lustre-ffff9317060a9000.statahead_max=0 1001 real 0m5.325s user 0m0.021s sys 0m2.090s 'ls -l' 1000 files without statahead: 5 sec llite.lustre-ffff9317060a9000.statahead_max=32 llite.lustre-ffff9317060a9000.statahead_max=32 1001 real 0m3.419s user 0m0.015s sys 0m1.927s 'ls -l' 1000 files with statahead: 4 sec statahead total: 72 statahead wrong: 2 agl total: 68 list_total: 27 fname_total: 35 hit_total: 5063 miss_total: 1124 swrong=2 ewrong=2 - open/close 4222 (time 1786469050.36 total 10.00 last 422.12) - open/close 8306 (time 1786469060.36 total 20.00 last 408.40) total: 9000 open/close in 21.63 seconds: 416.08 ops/second llite.lustre-ffff9317060a9000.statahead_max=0 10001 real 1m31.845s user 0m0.285s sys 0m24.905s 'ls -l' 10000 files without statahead: 92 sec llite.lustre-ffff9317060a9000.statahead_max=32 llite.lustre-ffff9317060a9000.statahead_max=32 10001 real 0m45.517s user 0m0.197s sys 0m17.514s 'ls -l' 10000 files with statahead: 45 sec statahead total: 73 statahead wrong: 2 agl total: 69 list_total: 28 fname_total: 35 hit_total: 15053 miss_total: 1134 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 97 seconds llite.lustre-ffff9317060a9000.statahead_stats= statahead total: 73 statahead wrong: 2 agl total: 69 list_total: 28 fname_total: 35 hit_total: 15053 miss_total: 1134 mdc.lustre-MDT0000-mdc-ffff9317060a9000.batch_stats= snapshot_time: 1786469310.754286667 secs.nsecs start_time: 1786469023.324651603 secs.nsecs elapsed_time: 287.429635064 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 1 0 0 8: 3 0 1 16: 3 0 2 32: 347 97 100 - open/close 1863 (time 1786469322.26 total 10.01 last 186.18) - open/close 3515 (time 1786469332.26 total 20.01 last 165.16) - open/close 5099 (time 1786469342.26 total 30.01 last 158.36) - open/close 6926 (time 1786469352.27 total 40.01 last 182.64) - open/close 8435 (time 1786469362.27 total 50.02 last 150.89) total: 10000 open/close in 57.57 seconds: 173.72 ops/second llite.lustre-ffff9317060a9000.statahead_batch_max=0 llite.lustre-ffff9317060a9000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9317060a9000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.330s user 0m0.255s sys 0m28.953s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9317060a9000.statahead_batch_max=32 llite.lustre-ffff9317060a9000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9317060a9000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9317060a9000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m42.643s user 0m0.214s sys 0m18.351s batched statahead RPC= hit count=9985 mdc.lustre-MDT0000-mdc-ffff9317060a9000.batch_stats= snapshot_time: 1786469455.258418945 secs.nsecs start_time: 1786469405.836234447 secs.nsecs elapsed_time: 49.422184498 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9317060a9000.batch_stats=0 llite.lustre-ffff9317060a9000.statahead_max=2048 llite.lustre-ffff9317060a9000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9317060a9000.batch_stats=0 total: 100 open/close in 1.05 seconds: 95.04 ops/second llite.lustre-ffff9317060a9000.statahead_max=0 101 real 0m1.183s user 0m0.004s sys 0m0.311s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9317060a9000.statahead_max=2048 llite.lustre-ffff9317060a9000.statahead_max=2048 101 real 0m0.434s user 0m0.006s sys 0m0.193s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10084 miss_total: 16 swrong=0 ewrong=0 total: 900 open/close in 3.85 seconds: 233.63 ops/second llite.lustre-ffff9317060a9000.statahead_max=0 1001 real 0m10.874s user 0m0.031s sys 0m2.871s 'ls -l' 1000 files without statahead: 11 sec llite.lustre-ffff9317060a9000.statahead_max=2048 llite.lustre-ffff9317060a9000.statahead_max=2048 1001 real 0m3.528s user 0m0.018s sys 0m1.663s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 8 seconds llite.lustre-ffff9317060a9000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 mdc.lustre-MDT0000-mdc-ffff9317060a9000.batch_stats= snapshot_time: 1786469617.150730937 secs.nsecs start_time: 1786469456.356392403 secs.nsecs elapsed_time: 160.794338534 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 1651 (time 1786469628.89 total 10.00 last 165.10) - open/close 3374 (time 1786469638.90 total 20.01 last 172.18) - open/close 5119 (time 1786469648.90 total 30.01 last 174.40) - open/close 6989 (time 1786469658.91 total 40.02 last 186.96) - open/close 9017 (time 1786469668.91 total 50.02 last 202.77) total: 10000 open/close in 55.68 seconds: 179.60 ops/second llite.lustre-ffff9317060a9000.statahead_batch_max=0 llite.lustre-ffff9317060a9000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9317060a9000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.210s user 0m0.229s sys 0m25.078s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9317060a9000.statahead_batch_max=256 llite.lustre-ffff9317060a9000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9317060a9000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9317060a9000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m29.097s user 0m0.214s sys 0m19.938s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9317060a9000.batch_stats= snapshot_time: 1786469746.833625645 secs.nsecs start_time: 1786469710.693657786 secs.nsecs elapsed_time: 36.139967859 secs.nsecs subreqs per batch batches %% cum %% 1: 241 61 61 2: 43 10 71 4: 36 9 81 8: 13 3 84 16: 6 1 85 32: 21 5 91 64: 0 0 91 128: 0 0 91 256: 35 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9317060a9000.statahead_batch_max=64 llite.lustre-ffff9317060a9000.statahead_max=128