== sanity test 123ad: Verify batching statahead works correctly ========================================================== 08:38:25 (1787575105) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff99ce97b01800.batch_stats=0 llite.lustre-ffff99ce97b01800.statahead_max=32 llite.lustre-ffff99ce97b01800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff99ce97b01800.batch_stats=0 total: 100 open/close in 3.08 seconds: 32.43 ops/second llite.lustre-ffff99ce97b01800.statahead_max=0 101 real 0m2.469s user 0m0.007s sys 0m0.314s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff99ce97b01800.statahead_max=32 llite.lustre-ffff99ce97b01800.statahead_max=32 101 real 0m1.217s user 0m0.009s sys 0m0.182s 'ls -l' 100 files with statahead: 1 sec statahead total: 133 statahead wrong: 2 agl total: 127 list_total: 31 fname_total: 65 hit_total: 3756 miss_total: 1616 swrong=2 ewrong=2 - open/close 650 (time 1787575133.91 total 10.00 last 64.99) total: 900 open/close in 14.42 seconds: 62.40 ops/second llite.lustre-ffff99ce97b01800.statahead_max=0 1001 real 0m20.660s user 0m0.030s sys 0m2.782s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff99ce97b01800.statahead_max=32 llite.lustre-ffff99ce97b01800.statahead_max=32 1001 real 0m9.557s user 0m0.031s sys 0m1.499s 'ls -l' 1000 files with statahead: 10 sec statahead total: 134 statahead wrong: 2 agl total: 128 list_total: 32 fname_total: 65 hit_total: 4754 miss_total: 1618 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff99ce97b01800.statahead_stats= statahead total: 134 statahead wrong: 2 agl total: 128 list_total: 32 fname_total: 65 hit_total: 4754 miss_total: 1618 mdc.lustre-MDT0000-mdc-ffff99ce97b01800.batch_stats= snapshot_time: 1787575202.262340330 secs.nsecs start_time: 1787575109.871089275 secs.nsecs elapsed_time: 92.391251055 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 742 (time 1787575214.70 total 10.01 last 74.11) - open/close 1467 (time 1787575224.71 total 20.02 last 72.42) - open/close 2184 (time 1787575234.72 total 30.03 last 71.63) - open/close 2934 (time 1787575244.73 total 40.04 last 74.94) - open/close 3636 (time 1787575254.75 total 50.05 last 70.10) - open/close 4333 (time 1787575264.77 total 60.08 last 69.54) - open/close 5019 (time 1787575274.79 total 70.10 last 68.48) - open/close 5758 (time 1787575284.80 total 80.11 last 73.82) - open/close 6516 (time 1787575294.81 total 90.11 last 75.74) - open/close 7178 (time 1787575304.82 total 100.12 last 66.14) - open/close 7825 (time 1787575314.82 total 110.13 last 64.67) - open/close 8470 (time 1787575324.82 total 120.13 last 64.50) - open/close 9171 (time 1787575334.83 total 130.13 last 70.07) - open/close 9851 (time 1787575344.84 total 140.15 last 67.88) total: 10000 open/close in 142.65 seconds: 70.10 ops/second llite.lustre-ffff99ce97b01800.statahead_batch_max=0 llite.lustre-ffff99ce97b01800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff99ce97b01800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m56.516s user 0m0.332s sys 0m16.444s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff99ce97b01800.statahead_batch_max=32 llite.lustre-ffff99ce97b01800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff99ce97b01800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff99ce97b01800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m34.140s user 0m0.289s sys 0m13.857s batched statahead RPC= hit count=9981 mdc.lustre-MDT0000-mdc-ffff99ce97b01800.batch_stats= snapshot_time: 1787575515.674043529 secs.nsecs start_time: 1787575411.932464275 secs.nsecs elapsed_time: 103.741579254 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff99ce97b01800.batch_stats=0 llite.lustre-ffff99ce97b01800.statahead_max=2048 llite.lustre-ffff99ce97b01800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff99ce97b01800.batch_stats=0 total: 100 open/close in 2.91 seconds: 34.32 ops/second llite.lustre-ffff99ce97b01800.statahead_max=0 101 real 0m2.759s user 0m0.003s sys 0m0.350s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff99ce97b01800.statahead_max=2048 llite.lustre-ffff99ce97b01800.statahead_max=2048 101 real 0m1.344s user 0m0.007s sys 0m0.144s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10080 miss_total: 20 swrong=0 ewrong=0 - open/close 577 (time 1787575854.73 total 10.04 last 57.48) total: 900 open/close in 14.86 seconds: 60.55 ops/second llite.lustre-ffff99ce97b01800.statahead_max=0 1001 real 0m24.692s user 0m0.036s sys 0m3.199s 'ls -l' 1000 files without statahead: 25 sec llite.lustre-ffff99ce97b01800.statahead_max=2048 llite.lustre-ffff99ce97b01800.statahead_max=2048 1001 real 0m8.138s user 0m0.024s sys 0m1.381s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11079 miss_total: 21 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 25 seconds llite.lustre-ffff99ce97b01800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11079 miss_total: 21 mdc.lustre-MDT0000-mdc-ffff99ce97b01800.batch_stats= snapshot_time: 1787575931.588838438 secs.nsecs start_time: 1787575517.765070891 secs.nsecs elapsed_time: 413.823767547 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 687 (time 1787575944.88 total 10.01 last 68.65) - open/close 1387 (time 1787575954.89 total 20.01 last 69.96) - open/close 2052 (time 1787575964.90 total 30.02 last 66.45) - open/close 2755 (time 1787575974.90 total 40.03 last 70.27) - open/close 3455 (time 1787575984.90 total 50.03 last 69.99) - open/close 4119 (time 1787575994.93 total 60.05 last 66.22) - open/close 4789 (time 1787576004.94 total 70.07 last 66.90) - open/close 5425 (time 1787576014.95 total 80.08 last 63.55) - open/close 6110 (time 1787576024.96 total 90.09 last 68.43) - open/close 6810 (time 1787576034.99 total 100.11 last 69.84) - open/close 7525 (time 1787576044.99 total 110.12 last 71.46) - open/close 8186 (time 1787576055.00 total 120.13 last 66.02) - open/close 8897 (time 1787576065.02 total 130.14 last 71.00) - open/close 9573 (time 1787576075.03 total 140.16 last 67.50) total: 10000 open/close in 146.02 seconds: 68.48 ops/second llite.lustre-ffff99ce97b01800.statahead_batch_max=0 llite.lustre-ffff99ce97b01800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff99ce97b01800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.900s user 0m0.402s sys 0m15.915s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff99ce97b01800.statahead_batch_max=256 llite.lustre-ffff99ce97b01800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff99ce97b01800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff99ce97b01800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m52.250s user 0m0.316s sys 0m14.990s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff99ce97b01800.batch_stats= snapshot_time: 1787576212.505666966 secs.nsecs start_time: 1787576147.565593304 secs.nsecs elapsed_time: 64.940073662 secs.nsecs subreqs per batch batches %% cum %% 1: 83 41 41 2: 20 10 51 4: 21 10 62 8: 7 3 65 16: 12 6 71 32: 16 8 79 64: 4 2 81 128: 0 0 81 256: 36 18 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff99ce97b01800.statahead_batch_max=64 llite.lustre-ffff99ce97b01800.statahead_max=128