== sanity test 123ad: Verify batching statahead works correctly ========================================================== 17:24:29 (1787865869) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9c6224aef000.batch_stats=0 llite.lustre-ffff9c6224aef000.statahead_max=32 llite.lustre-ffff9c6224aef000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9c6224aef000.batch_stats=0 total: 100 open/close in 2.43 seconds: 41.19 ops/second llite.lustre-ffff9c6224aef000.statahead_max=0 101 real 0m2.203s user 0m0.007s sys 0m0.290s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9c6224aef000.statahead_max=32 llite.lustre-ffff9c6224aef000.statahead_max=32 101 real 0m1.251s user 0m0.005s sys 0m0.150s 'ls -l' 100 files with statahead: 2 sec statahead total: 119 statahead wrong: 2 agl total: 112 list_total: 31 fname_total: 73 hit_total: 4031 miss_total: 1727 swrong=2 ewrong=2 - open/close 606 (time 1787865896.60 total 10.01 last 60.53) total: 900 open/close in 14.68 seconds: 61.32 ops/second llite.lustre-ffff9c6224aef000.statahead_max=0 1001 real 0m22.439s user 0m0.042s sys 0m3.232s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff9c6224aef000.statahead_max=32 llite.lustre-ffff9c6224aef000.statahead_max=32 1001 real 0m9.712s user 0m0.029s sys 0m1.276s 'ls -l' 1000 files with statahead: 10 sec statahead total: 120 statahead wrong: 2 agl total: 113 list_total: 32 fname_total: 73 hit_total: 5028 miss_total: 1730 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff9c6224aef000.statahead_stats= statahead total: 120 statahead wrong: 2 agl total: 113 list_total: 32 fname_total: 73 hit_total: 5028 miss_total: 1730 mdc.lustre-MDT0000-mdc-ffff9c6224aef000.batch_stats= snapshot_time: 1787865968.634379747 secs.nsecs start_time: 1787865873.652355083 secs.nsecs elapsed_time: 94.982024664 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 602 (time 1787865981.20 total 10.00 last 60.18) - open/close 1101 (time 1787865991.21 total 20.02 last 49.83) - open/close 1602 (time 1787866001.22 total 30.03 last 50.06) - open/close 2309 (time 1787866011.23 total 40.03 last 70.64) - open/close 2984 (time 1787866021.24 total 50.05 last 67.42) - open/close 3781 (time 1787866031.25 total 60.05 last 79.66) - open/close 4355 (time 1787866041.25 total 70.05 last 57.38) - open/close 4903 (time 1787866051.26 total 80.06 last 54.77) - open/close 5437 (time 1787866061.27 total 90.08 last 53.30) - open/close 6020 (time 1787866071.28 total 100.08 last 58.26) - open/close 6710 (time 1787866081.29 total 110.09 last 68.97) - open/close 7282 (time 1787866091.30 total 120.10 last 57.13) - open/close 7981 (time 1787866101.31 total 130.12 last 69.80) - open/close 8716 (time 1787866111.32 total 140.12 last 73.45) - open/close 9456 (time 1787866121.33 total 150.13 last 73.91) total: 10000 open/close in 158.97 seconds: 62.91 ops/second llite.lustre-ffff9c6224aef000.statahead_batch_max=0 llite.lustre-ffff9c6224aef000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9c6224aef000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m2.866s user 0m0.306s sys 0m13.415s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9c6224aef000.statahead_batch_max=32 llite.lustre-ffff9c6224aef000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9c6224aef000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9c6224aef000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m46.551s user 0m0.275s sys 0m13.004s batched statahead RPC= hit count=9980 mdc.lustre-MDT0000-mdc-ffff9c6224aef000.batch_stats= snapshot_time: 1787866321.699664386 secs.nsecs start_time: 1787866202.867104963 secs.nsecs elapsed_time: 118.832559423 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9c6224aef000.batch_stats=0 llite.lustre-ffff9c6224aef000.statahead_max=2048 llite.lustre-ffff9c6224aef000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9c6224aef000.batch_stats=0 total: 100 open/close in 2.98 seconds: 33.58 ops/second llite.lustre-ffff9c6224aef000.statahead_max=0 101 real 0m1.885s user 0m0.005s sys 0m0.296s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9c6224aef000.statahead_max=2048 llite.lustre-ffff9c6224aef000.statahead_max=2048 101 real 0m1.119s user 0m0.003s sys 0m0.154s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10079 miss_total: 21 swrong=0 ewrong=0 - open/close 726 (time 1787866616.44 total 10.03 last 72.40) total: 900 open/close in 12.48 seconds: 72.14 ops/second llite.lustre-ffff9c6224aef000.statahead_max=0 1001 real 0m18.778s user 0m0.031s sys 0m2.846s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff9c6224aef000.statahead_max=2048 llite.lustre-ffff9c6224aef000.statahead_max=2048 1001 real 0m7.253s user 0m0.028s sys 0m1.358s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11078 miss_total: 22 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff9c6224aef000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11078 miss_total: 22 mdc.lustre-MDT0000-mdc-ffff9c6224aef000.batch_stats= snapshot_time: 1787866677.131688481 secs.nsecs start_time: 1787866324.235158844 secs.nsecs elapsed_time: 352.896529637 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 748 (time 1787866690.11 total 10.00 last 74.80) - open/close 1404 (time 1787866700.12 total 20.01 last 65.51) - open/close 1994 (time 1787866710.13 total 30.02 last 58.94) - open/close 2733 (time 1787866720.15 total 40.04 last 73.78) - open/close 3554 (time 1787866730.15 total 50.04 last 82.07) - open/close 4329 (time 1787866740.15 total 60.05 last 77.46) - open/close 5100 (time 1787866750.17 total 70.07 last 76.94) - open/close 5912 (time 1787866760.19 total 80.08 last 81.09) - open/close 6672 (time 1787866770.19 total 90.09 last 75.96) - open/close 7392 (time 1787866780.20 total 100.10 last 71.94) - open/close 8246 (time 1787866790.21 total 110.10 last 85.36) - open/close 8944 (time 1787866800.21 total 120.10 last 69.79) - open/close 9755 (time 1787866810.22 total 130.11 last 81.02) total: 10000 open/close in 132.65 seconds: 75.39 ops/second llite.lustre-ffff9c6224aef000.statahead_batch_max=0 llite.lustre-ffff9c6224aef000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9c6224aef000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m3.363s user 0m0.283s sys 0m13.507s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9c6224aef000.statahead_batch_max=256 llite.lustre-ffff9c6224aef000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9c6224aef000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9c6224aef000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m51.339s user 0m0.266s sys 0m13.348s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9c6224aef000.batch_stats= snapshot_time: 1787866947.874818050 secs.nsecs start_time: 1787866884.109526148 secs.nsecs elapsed_time: 63.765291902 secs.nsecs subreqs per batch batches %% cum %% 1: 77 36 36 2: 28 13 50 4: 21 10 60 8: 16 7 67 16: 9 4 72 32: 17 8 80 64: 6 2 83 128: 0 0 83 256: 35 16 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9c6224aef000.statahead_batch_max=64 llite.lustre-ffff9c6224aef000.statahead_max=128