== sanity test 123ad: Verify batching statahead works correctly ========================================================== 10:06:38 (1790949998) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8bfd862a5000.batch_stats=0 llite.lustre-ffff8bfd862a5000.statahead_max=32 llite.lustre-ffff8bfd862a5000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8bfd862a5000.batch_stats=0 total: 100 open/close in 2.74 seconds: 36.48 ops/second llite.lustre-ffff8bfd862a5000.statahead_max=0 101 real 0m2.196s user 0m0.006s sys 0m0.287s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8bfd862a5000.statahead_max=32 llite.lustre-ffff8bfd862a5000.statahead_max=32 101 real 0m1.262s user 0m0.006s sys 0m0.150s 'ls -l' 100 files with statahead: 1 sec statahead total: 123 statahead wrong: 1 agl total: 117 list_total: 30 fname_total: 93 hit_total: 4005 miss_total: 259 swrong=1 ewrong=1 - open/close 668 (time 1790950026.09 total 10.01 last 66.72) total: 900 open/close in 13.15 seconds: 68.43 ops/second llite.lustre-ffff8bfd862a5000.statahead_max=0 1001 real 0m22.663s user 0m0.030s sys 0m2.815s 'ls -l' 1000 files without statahead: 23 sec llite.lustre-ffff8bfd862a5000.statahead_max=32 llite.lustre-ffff8bfd862a5000.statahead_max=32 1001 real 0m9.698s user 0m0.019s sys 0m1.397s 'ls -l' 1000 files with statahead: 9 sec statahead total: 124 statahead wrong: 1 agl total: 118 list_total: 31 fname_total: 93 hit_total: 5002 miss_total: 262 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff8bfd862a5000.statahead_stats= statahead total: 124 statahead wrong: 1 agl total: 118 list_total: 31 fname_total: 93 hit_total: 5002 miss_total: 262 mdc.lustre-MDT0000-mdc-ffff8bfd862a5000.batch_stats= snapshot_time: 1790950093.770329509 secs.nsecs start_time: 1790950003.230607934 secs.nsecs elapsed_time: 90.539721575 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 763 (time 1790950106.13 total 10.01 last 76.23) - open/close 1454 (time 1790950116.13 total 20.02 last 69.04) - open/close 2148 (time 1790950126.14 total 30.02 last 69.37) - open/close 2940 (time 1790950136.15 total 40.03 last 79.14) - open/close 3723 (time 1790950146.16 total 50.04 last 78.20) - open/close 4458 (time 1790950156.17 total 60.05 last 73.44) - open/close 5250 (time 1790950166.17 total 70.05 last 79.18) - open/close 5986 (time 1790950176.18 total 80.07 last 73.50) - open/close 6749 (time 1790950186.19 total 90.08 last 76.22) - open/close 7465 (time 1790950196.21 total 100.09 last 71.51) - open/close 8230 (time 1790950206.21 total 110.09 last 76.46) - open/close 8857 (time 1790950216.22 total 120.11 last 62.62) - open/close 9527 (time 1790950226.23 total 130.11 last 66.98) total: 10000 open/close in 137.07 seconds: 72.95 ops/second llite.lustre-ffff8bfd862a5000.statahead_batch_max=0 llite.lustre-ffff8bfd862a5000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8bfd862a5000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.747s user 0m0.325s sys 0m14.686s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8bfd862a5000.statahead_batch_max=32 llite.lustre-ffff8bfd862a5000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8bfd862a5000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8bfd862a5000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m35.446s user 0m0.310s sys 0m13.076s batched statahead RPC= hit count=9986 mdc.lustre-MDT0000-mdc-ffff8bfd862a5000.batch_stats= snapshot_time: 1790950404.831593786 secs.nsecs start_time: 1790950298.943563414 secs.nsecs elapsed_time: 105.888030372 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8bfd862a5000.batch_stats=0 llite.lustre-ffff8bfd862a5000.statahead_max=2048 llite.lustre-ffff8bfd862a5000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8bfd862a5000.batch_stats=0 total: 100 open/close in 2.41 seconds: 41.45 ops/second llite.lustre-ffff8bfd862a5000.statahead_max=0 101 real 0m2.304s user 0m0.005s sys 0m0.313s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8bfd862a5000.statahead_max=2048 llite.lustre-ffff8bfd862a5000.statahead_max=2048 101 real 0m0.839s user 0m0.004s sys 0m0.168s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10085 miss_total: 15 swrong=0 ewrong=0 - open/close 750 (time 1790950710.67 total 10.01 last 74.95) total: 900 open/close in 12.09 seconds: 74.43 ops/second llite.lustre-ffff8bfd862a5000.statahead_max=0 1001 real 0m20.003s user 0m0.034s sys 0m2.778s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff8bfd862a5000.statahead_max=2048 llite.lustre-ffff8bfd862a5000.statahead_max=2048 1001 real 0m5.868s user 0m0.026s sys 0m1.445s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff8bfd862a5000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 mdc.lustre-MDT0000-mdc-ffff8bfd862a5000.batch_stats= snapshot_time: 1790950768.455238448 secs.nsecs start_time: 1790950407.257754501 secs.nsecs elapsed_time: 361.197483947 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 761 (time 1790950780.83 total 10.01 last 76.05) - open/close 1475 (time 1790950790.84 total 20.02 last 71.30) - open/close 2209 (time 1790950800.84 total 30.02 last 73.38) - open/close 2960 (time 1790950810.85 total 40.03 last 75.07) - open/close 3732 (time 1790950820.85 total 50.04 last 77.14) - open/close 4479 (time 1790950830.86 total 60.04 last 74.66) - open/close 5237 (time 1790950840.86 total 70.05 last 75.77) - open/close 6019 (time 1790950850.87 total 80.05 last 78.13) - open/close 6807 (time 1790950860.87 total 90.06 last 78.78) - open/close 7552 (time 1790950870.88 total 100.06 last 74.46) - open/close 8289 (time 1790950880.88 total 110.07 last 73.67) - open/close 9061 (time 1790950890.89 total 120.07 last 77.14) - open/close 9822 (time 1790950900.90 total 130.08 last 76.08) total: 10000 open/close in 132.34 seconds: 75.56 ops/second llite.lustre-ffff8bfd862a5000.statahead_batch_max=0 llite.lustre-ffff8bfd862a5000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8bfd862a5000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m51.362s user 0m0.305s sys 0m15.929s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8bfd862a5000.statahead_batch_max=256 llite.lustre-ffff8bfd862a5000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8bfd862a5000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8bfd862a5000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m41.744s user 0m0.287s sys 0m15.695s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8bfd862a5000.batch_stats= snapshot_time: 1790951012.272371615 secs.nsecs start_time: 1790950962.279674600 secs.nsecs elapsed_time: 49.992697015 secs.nsecs subreqs per batch batches %% cum %% 1: 138 47 47 2: 29 9 57 4: 32 10 68 8: 21 7 75 16: 12 4 79 32: 21 7 86 64: 3 1 87 128: 1 0 88 256: 34 11 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8bfd862a5000.statahead_batch_max=64 llite.lustre-ffff8bfd862a5000.statahead_max=128