== sanity test 123ad: Verify batching statahead works correctly ========================================================== 21:16:14 (1786756574) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9319d0343000.batch_stats=0 llite.lustre-ffff9319d0343000.statahead_max=32 llite.lustre-ffff9319d0343000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9319d0343000.batch_stats=0 total: 100 open/close in 2.92 seconds: 34.22 ops/second llite.lustre-ffff9319d0343000.statahead_max=0 101 real 0m2.678s user 0m0.006s sys 0m0.364s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9319d0343000.statahead_max=32 llite.lustre-ffff9319d0343000.statahead_max=32 101 real 0m1.242s user 0m0.008s sys 0m0.172s 'ls -l' 100 files with statahead: 2 sec statahead total: 119 statahead wrong: 2 agl total: 113 list_total: 30 fname_total: 67 hit_total: 4012 miss_total: 1418 swrong=2 ewrong=2 - open/close 690 (time 1786756603.19 total 10.02 last 68.84) total: 900 open/close in 12.94 seconds: 69.56 ops/second llite.lustre-ffff9319d0343000.statahead_max=0 1001 real 0m19.913s user 0m0.033s sys 0m3.199s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff9319d0343000.statahead_max=32 llite.lustre-ffff9319d0343000.statahead_max=32 1001 real 0m12.259s user 0m0.035s sys 0m1.571s 'ls -l' 1000 files with statahead: 12 sec statahead total: 120 statahead wrong: 2 agl total: 114 list_total: 31 fname_total: 67 hit_total: 5008 miss_total: 1422 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff9319d0343000.statahead_stats= statahead total: 120 statahead wrong: 2 agl total: 114 list_total: 31 fname_total: 67 hit_total: 5008 miss_total: 1422 mdc.lustre-MDT0000-mdc-ffff9319d0343000.batch_stats= snapshot_time: 1786756675.342455886 secs.nsecs start_time: 1786756579.619265588 secs.nsecs elapsed_time: 95.723190298 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 780 (time 1786756687.56 total 10.02 last 77.87) - open/close 1469 (time 1786756697.57 total 20.02 last 68.87) - open/close 2242 (time 1786756707.58 total 30.03 last 77.24) - open/close 2912 (time 1786756717.58 total 40.03 last 66.98) - open/close 3631 (time 1786756727.59 total 50.04 last 71.85) - open/close 4248 (time 1786756737.59 total 60.04 last 61.70) - open/close 4894 (time 1786756747.59 total 70.04 last 64.57) - open/close 5508 (time 1786756757.60 total 80.05 last 61.36) - open/close 6132 (time 1786756767.60 total 90.05 last 62.39) - open/close 6847 (time 1786756777.60 total 100.06 last 71.48) - open/close 7350 (time 1786756787.62 total 110.07 last 50.21) - open/close 7905 (time 1786756797.64 total 120.09 last 55.42) - open/close 8494 (time 1786756807.65 total 130.10 last 58.80) - open/close 9145 (time 1786756817.66 total 140.11 last 65.07) - open/close 9725 (time 1786756827.66 total 150.12 last 57.97) total: 10000 open/close in 154.43 seconds: 64.76 ops/second llite.lustre-ffff9319d0343000.statahead_batch_max=0 llite.lustre-ffff9319d0343000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9319d0343000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m19.972s user 0m0.348s sys 0m15.926s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9319d0343000.statahead_batch_max=32 llite.lustre-ffff9319d0343000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9319d0343000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9319d0343000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m38.401s user 0m0.313s sys 0m15.236s batched statahead RPC= hit count=9988 mdc.lustre-MDT0000-mdc-ffff9319d0343000.batch_stats= snapshot_time: 1786757041.691948469 secs.nsecs start_time: 1786756928.123816832 secs.nsecs elapsed_time: 113.568131637 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9319d0343000.batch_stats=0 llite.lustre-ffff9319d0343000.statahead_max=2048 llite.lustre-ffff9319d0343000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9319d0343000.batch_stats=0 total: 100 open/close in 2.69 seconds: 37.20 ops/second llite.lustre-ffff9319d0343000.statahead_max=0 101 real 0m2.100s user 0m0.006s sys 0m0.344s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9319d0343000.statahead_max=2048 llite.lustre-ffff9319d0343000.statahead_max=2048 101 real 0m1.054s user 0m0.005s sys 0m0.178s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10087 miss_total: 13 swrong=0 ewrong=0 - open/close 764 (time 1786757363.51 total 10.02 last 76.24) total: 900 open/close in 12.04 seconds: 74.76 ops/second llite.lustre-ffff9319d0343000.statahead_max=0 1001 real 0m25.889s user 0m0.029s sys 0m3.150s 'ls -l' 1000 files without statahead: 25 sec llite.lustre-ffff9319d0343000.statahead_max=2048 llite.lustre-ffff9319d0343000.statahead_max=2048 1001 real 0m6.802s user 0m0.025s sys 0m1.479s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11086 miss_total: 14 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff9319d0343000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11086 miss_total: 14 mdc.lustre-MDT0000-mdc-ffff9319d0343000.batch_stats= snapshot_time: 1786757433.564954686 secs.nsecs start_time: 1786757044.179739457 secs.nsecs elapsed_time: 389.385215229 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 751 (time 1786757446.53 total 10.01 last 75.05) - open/close 1351 (time 1786757456.54 total 20.02 last 59.95) - open/close 2259 (time 1786757466.56 total 30.03 last 90.64) - open/close 3095 (time 1786757476.57 total 40.04 last 83.54) - open/close 3845 (time 1786757486.57 total 50.04 last 74.98) - open/close 4679 (time 1786757496.58 total 60.05 last 83.36) - open/close 5378 (time 1786757506.59 total 70.06 last 69.83) - open/close 6233 (time 1786757516.59 total 80.07 last 85.43) - open/close 7110 (time 1786757526.62 total 90.09 last 87.50) - open/close 8145 (time 1786757536.62 total 100.09 last 103.48) - open/close 9023 (time 1786757546.62 total 110.10 last 87.74) - open/close 9869 (time 1786757556.63 total 120.10 last 84.56) total: 10000 open/close in 121.91 seconds: 82.03 ops/second llite.lustre-ffff9319d0343000.statahead_batch_max=0 llite.lustre-ffff9319d0343000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9319d0343000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m6.753s user 0m0.322s sys 0m15.017s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9319d0343000.statahead_batch_max=256 llite.lustre-ffff9319d0343000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9319d0343000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9319d0343000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m0.843s user 0m0.318s sys 0m14.499s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9319d0343000.batch_stats= snapshot_time: 1786757714.692063057 secs.nsecs start_time: 1786757640.492208381 secs.nsecs elapsed_time: 74.199854676 secs.nsecs subreqs per batch batches %% cum %% 1: 223 46 46 2: 88 18 65 4: 60 12 78 8: 26 5 83 16: 18 3 87 32: 22 4 92 64: 5 1 93 128: 0 0 93 256: 33 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9319d0343000.statahead_batch_max=64 llite.lustre-ffff9319d0343000.statahead_max=128