== sanity test 123ad: Verify batching statahead works correctly ========================================================== 01:59:13 (1787378353) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff97335223a000.batch_stats=0 llite.lustre-ffff97335223a000.statahead_max=32 llite.lustre-ffff97335223a000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff97335223a000.batch_stats=0 total: 100 open/close in 2.33 seconds: 42.92 ops/second llite.lustre-ffff97335223a000.statahead_max=0 101 real 0m2.088s user 0m0.003s sys 0m0.292s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff97335223a000.statahead_max=32 llite.lustre-ffff97335223a000.statahead_max=32 101 real 0m1.009s user 0m0.006s sys 0m0.146s 'ls -l' 100 files with statahead: 1 sec statahead total: 123 statahead wrong: 2 agl total: 117 list_total: 29 fname_total: 93 hit_total: 4517 miss_total: 1273 swrong=2 ewrong=2 - open/close 779 (time 1787378380.39 total 10.01 last 77.81) total: 900 open/close in 12.12 seconds: 74.23 ops/second llite.lustre-ffff97335223a000.statahead_max=0 1001 real 0m17.810s user 0m0.032s sys 0m2.850s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff97335223a000.statahead_max=32 llite.lustre-ffff97335223a000.statahead_max=32 1001 real 0m10.494s user 0m0.026s sys 0m1.249s 'ls -l' 1000 files with statahead: 11 sec statahead total: 124 statahead wrong: 2 agl total: 118 list_total: 30 fname_total: 93 hit_total: 5513 miss_total: 1277 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff97335223a000.statahead_stats= statahead total: 124 statahead wrong: 2 agl total: 118 list_total: 30 fname_total: 93 hit_total: 5513 miss_total: 1277 mdc.lustre-MDT0000-mdc-ffff97335223a000.batch_stats= snapshot_time: 1787378443.341136018 secs.nsecs start_time: 1787378358.849695486 secs.nsecs elapsed_time: 84.491440532 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 870 (time 1787378455.77 total 10.00 last 87.00) - open/close 1642 (time 1787378465.78 total 20.01 last 77.16) - open/close 2417 (time 1787378475.82 total 30.05 last 77.16) - open/close 3196 (time 1787378485.84 total 40.06 last 77.79) - open/close 4110 (time 1787378495.84 total 50.07 last 91.35) - open/close 5015 (time 1787378505.85 total 60.07 last 90.46) - open/close 5919 (time 1787378515.85 total 70.08 last 90.36) - open/close 6639 (time 1787378525.86 total 80.09 last 71.94) - open/close 7379 (time 1787378535.87 total 90.09 last 73.95) - open/close 8204 (time 1787378545.87 total 100.10 last 82.48) - open/close 8917 (time 1787378555.88 total 110.10 last 71.24) - open/close 9753 (time 1787378565.88 total 120.11 last 83.54) total: 10000 open/close in 122.65 seconds: 81.53 ops/second llite.lustre-ffff97335223a000.statahead_batch_max=0 llite.lustre-ffff97335223a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff97335223a000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.306s user 0m0.316s sys 0m13.304s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff97335223a000.statahead_batch_max=32 llite.lustre-ffff97335223a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff97335223a000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff97335223a000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m36.036s user 0m0.303s sys 0m12.552s batched statahead RPC= hit count=9978 mdc.lustre-MDT0000-mdc-ffff97335223a000.batch_stats= snapshot_time: 1787378739.691188829 secs.nsecs start_time: 1787378633.830157866 secs.nsecs elapsed_time: 105.861030963 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff97335223a000.batch_stats=0 llite.lustre-ffff97335223a000.statahead_max=2048 llite.lustre-ffff97335223a000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff97335223a000.batch_stats=0 total: 100 open/close in 2.19 seconds: 45.62 ops/second llite.lustre-ffff97335223a000.statahead_max=0 101 real 0m1.957s user 0m0.003s sys 0m0.314s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff97335223a000.statahead_max=2048 llite.lustre-ffff97335223a000.statahead_max=2048 101 real 0m1.030s user 0m0.005s sys 0m0.166s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10077 miss_total: 23 swrong=0 ewrong=0 - open/close 763 (time 1787379021.28 total 10.01 last 76.26) total: 900 open/close in 11.89 seconds: 75.72 ops/second llite.lustre-ffff97335223a000.statahead_max=0 1001 real 0m19.276s user 0m0.036s sys 0m2.816s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff97335223a000.statahead_max=2048 llite.lustre-ffff97335223a000.statahead_max=2048 1001 real 0m5.644s user 0m0.028s sys 0m1.323s 'ls -l' 1000 files with statahead: 5 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11076 miss_total: 24 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff97335223a000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11076 miss_total: 24 mdc.lustre-MDT0000-mdc-ffff97335223a000.batch_stats= snapshot_time: 1787379078.687330606 secs.nsecs start_time: 1787378742.721521816 secs.nsecs elapsed_time: 335.965808790 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 2 18 63 128: 0 0 63 256: 4 36 100 - open/close 851 (time 1787379090.95 total 10.00 last 85.08) - open/close 1639 (time 1787379100.95 total 20.01 last 78.77) - open/close 2332 (time 1787379110.96 total 30.01 last 69.27) - open/close 2971 (time 1787379120.96 total 40.02 last 63.87) - open/close 3587 (time 1787379130.97 total 50.02 last 61.58) - open/close 4338 (time 1787379140.97 total 60.02 last 75.10) - open/close 5201 (time 1787379150.97 total 70.02 last 86.26) - open/close 6044 (time 1787379160.98 total 80.03 last 84.27) - open/close 6859 (time 1787379170.99 total 90.04 last 81.42) - open/close 7737 (time 1787379180.99 total 100.04 last 87.80) - open/close 8582 (time 1787379190.99 total 110.04 last 84.49) - open/close 9366 (time 1787379200.99 total 120.04 last 78.39) total: 10000 open/close in 128.15 seconds: 78.03 ops/second llite.lustre-ffff97335223a000.statahead_batch_max=0 llite.lustre-ffff97335223a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff97335223a000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m56.977s user 0m0.333s sys 0m13.394s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff97335223a000.statahead_batch_max=256 llite.lustre-ffff97335223a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff97335223a000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff97335223a000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m47.685s user 0m0.279s sys 0m14.004s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff97335223a000.batch_stats= snapshot_time: 1787379333.574558046 secs.nsecs start_time: 1787379275.194411011 secs.nsecs elapsed_time: 58.380147035 secs.nsecs subreqs per batch batches %% cum %% 1: 104 44 44 2: 28 11 56 4: 24 10 66 8: 12 5 71 16: 12 5 76 32: 13 5 82 64: 5 2 84 128: 1 0 85 256: 35 14 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff97335223a000.statahead_batch_max=64 llite.lustre-ffff97335223a000.statahead_max=128