== sanity test 123ad: Verify batching statahead works correctly ========================================================== 11:44:43 (1786981483) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff965e88fbf800.batch_stats=0 llite.lustre-ffff965e88fbf800.statahead_max=32 llite.lustre-ffff965e88fbf800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff965e88fbf800.batch_stats=0 total: 100 open/close in 2.14 seconds: 46.73 ops/second llite.lustre-ffff965e88fbf800.statahead_max=0 101 real 0m1.840s user 0m0.002s sys 0m0.300s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff965e88fbf800.statahead_max=32 llite.lustre-ffff965e88fbf800.statahead_max=32 101 real 0m1.598s user 0m0.004s sys 0m0.209s 'ls -l' 100 files with statahead: 1 sec statahead total: 118 statahead wrong: 2 agl total: 112 list_total: 30 fname_total: 77 hit_total: 3532 miss_total: 1195 swrong=2 ewrong=2 total: 900 open/close in 9.79 seconds: 91.91 ops/second llite.lustre-ffff965e88fbf800.statahead_max=0 1001 real 0m17.569s user 0m0.029s sys 0m3.019s 'ls -l' 1000 files without statahead: 17 sec llite.lustre-ffff965e88fbf800.statahead_max=32 llite.lustre-ffff965e88fbf800.statahead_max=32 1001 real 0m10.789s user 0m0.026s sys 0m1.536s 'ls -l' 1000 files with statahead: 10 sec statahead total: 119 statahead wrong: 2 agl total: 113 list_total: 31 fname_total: 77 hit_total: 4531 miss_total: 1196 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff965e88fbf800.statahead_stats= statahead total: 119 statahead wrong: 2 agl total: 113 list_total: 31 fname_total: 77 hit_total: 4531 miss_total: 1196 mdc.lustre-MDT0000-mdc-ffff965e88fbf800.batch_stats= snapshot_time: 1786981575.973623425 secs.nsecs start_time: 1786981488.644569372 secs.nsecs elapsed_time: 87.329054053 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 1 2 10 32: 34 89 100 - open/close 873 (time 1786981588.57 total 10.01 last 87.23) - open/close 1792 (time 1786981598.58 total 20.01 last 91.87) - open/close 2556 (time 1786981608.59 total 30.02 last 76.31) - open/close 3318 (time 1786981618.59 total 40.02 last 76.18) - open/close 4209 (time 1786981628.59 total 50.03 last 89.07) - open/close 5096 (time 1786981638.60 total 60.03 last 88.68) - open/close 5931 (time 1786981648.60 total 70.04 last 83.45) - open/close 6842 (time 1786981658.62 total 80.06 last 90.90) - open/close 7696 (time 1786981668.63 total 90.07 last 85.32) - open/close 8465 (time 1786981678.64 total 100.07 last 76.86) - open/close 9369 (time 1786981688.65 total 110.09 last 90.29) total: 10000 open/close in 116.88 seconds: 85.56 ops/second llite.lustre-ffff965e88fbf800.statahead_batch_max=0 llite.lustre-ffff965e88fbf800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff965e88fbf800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.991s user 0m0.292s sys 0m15.738s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff965e88fbf800.statahead_batch_max=32 llite.lustre-ffff965e88fbf800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff965e88fbf800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff965e88fbf800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m45.544s user 0m0.300s sys 0m14.646s batched statahead RPC= hit count=9980 mdc.lustre-MDT0000-mdc-ffff965e88fbf800.batch_stats= snapshot_time: 1786981880.124180063 secs.nsecs start_time: 1786981760.807565070 secs.nsecs elapsed_time: 119.316614993 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 0 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff965e88fbf800.batch_stats=0 llite.lustre-ffff965e88fbf800.statahead_max=2048 llite.lustre-ffff965e88fbf800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff965e88fbf800.batch_stats=0 total: 100 open/close in 2.47 seconds: 40.54 ops/second llite.lustre-ffff965e88fbf800.statahead_max=0 101 real 0m1.725s user 0m0.006s sys 0m0.314s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff965e88fbf800.statahead_max=2048 llite.lustre-ffff965e88fbf800.statahead_max=2048 101 real 0m0.862s user 0m0.005s sys 0m0.203s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10079 miss_total: 21 swrong=0 ewrong=0 - open/close 830 (time 1786982180.56 total 10.00 last 82.99) total: 900 open/close in 11.16 seconds: 80.61 ops/second llite.lustre-ffff965e88fbf800.statahead_max=0 1001 real 0m19.456s user 0m0.037s sys 0m2.996s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff965e88fbf800.statahead_max=2048 llite.lustre-ffff965e88fbf800.statahead_max=2048 1001 real 0m7.278s user 0m0.030s sys 0m1.412s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11078 miss_total: 22 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff965e88fbf800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11078 miss_total: 22 mdc.lustre-MDT0000-mdc-ffff965e88fbf800.batch_stats= snapshot_time: 1786982241.877565943 secs.nsecs start_time: 1786981882.445045317 secs.nsecs elapsed_time: 359.432520626 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 0 0 40 64: 0 0 40 128: 3 30 70 256: 3 30 100 - open/close 729 (time 1786982254.22 total 10.02 last 72.77) - open/close 1528 (time 1786982264.23 total 20.02 last 79.87) - open/close 2374 (time 1786982274.23 total 30.03 last 84.55) - open/close 3232 (time 1786982284.24 total 40.03 last 85.74) - open/close 4009 (time 1786982294.24 total 50.03 last 77.70) - open/close 4797 (time 1786982304.25 total 60.04 last 78.75) - open/close 5523 (time 1786982314.25 total 70.04 last 72.59) - open/close 6171 (time 1786982324.25 total 80.05 last 64.76) - open/close 6705 (time 1786982334.27 total 90.07 last 53.29) - open/close 7377 (time 1786982344.29 total 100.08 last 67.12) - open/close 8185 (time 1786982354.30 total 110.09 last 80.73) - open/close 9050 (time 1786982364.31 total 120.10 last 86.37) - open/close 9895 (time 1786982374.31 total 130.11 last 84.48) total: 10000 open/close in 131.39 seconds: 76.11 ops/second llite.lustre-ffff965e88fbf800.statahead_batch_max=0 llite.lustre-ffff965e88fbf800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff965e88fbf800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m1.782s user 0m0.272s sys 0m15.530s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff965e88fbf800.statahead_batch_max=256 llite.lustre-ffff965e88fbf800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff965e88fbf800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff965e88fbf800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m4.003s user 0m0.298s sys 0m15.606s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff965e88fbf800.batch_stats= snapshot_time: 1786982524.549722648 secs.nsecs start_time: 1786982447.620023763 secs.nsecs elapsed_time: 76.929698885 secs.nsecs subreqs per batch batches %% cum %% 1: 118 44 44 2: 29 11 55 4: 33 12 68 8: 16 6 74 16: 13 4 79 32: 14 5 84 64: 5 1 86 128: 0 0 86 256: 35 13 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff965e88fbf800.statahead_batch_max=64 llite.lustre-ffff965e88fbf800.statahead_max=128