== sanity test 123ad: Verify batching statahead works correctly ========================================================== 10:56:52 (1788533812) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9ebbac7c6800.batch_stats=0 llite.lustre-ffff9ebbac7c6800.statahead_max=32 llite.lustre-ffff9ebbac7c6800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9ebbac7c6800.batch_stats=0 total: 100 open/close in 4.06 seconds: 24.62 ops/second llite.lustre-ffff9ebbac7c6800.statahead_max=0 101 real 0m3.198s user 0m0.005s sys 0m0.345s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9ebbac7c6800.statahead_max=32 llite.lustre-ffff9ebbac7c6800.statahead_max=32 101 real 0m1.570s user 0m0.006s sys 0m0.148s 'ls -l' 100 files with statahead: 2 sec statahead total: 123 statahead wrong: 2 agl total: 117 list_total: 30 fname_total: 92 hit_total: 4629 miss_total: 1286 swrong=2 ewrong=2 - open/close 597 (time 1788533844.62 total 10.03 last 59.54) total: 900 open/close in 15.25 seconds: 59.03 ops/second llite.lustre-ffff9ebbac7c6800.statahead_max=0 1001 real 0m24.238s user 0m0.037s sys 0m2.960s 'ls -l' 1000 files without statahead: 25 sec llite.lustre-ffff9ebbac7c6800.statahead_max=32 llite.lustre-ffff9ebbac7c6800.statahead_max=32 1001 real 0m10.742s user 0m0.027s sys 0m1.394s 'ls -l' 1000 files with statahead: 11 sec statahead total: 124 statahead wrong: 2 agl total: 118 list_total: 31 fname_total: 92 hit_total: 5626 miss_total: 1289 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 26 seconds llite.lustre-ffff9ebbac7c6800.statahead_stats= statahead total: 124 statahead wrong: 2 agl total: 118 list_total: 31 fname_total: 92 hit_total: 5626 miss_total: 1289 mdc.lustre-MDT0000-mdc-ffff9ebbac7c6800.batch_stats= snapshot_time: 1788533924.609875125 secs.nsecs start_time: 1788533817.588835274 secs.nsecs elapsed_time: 107.021039851 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 566 (time 1788533937.50 total 10.01 last 56.56) - open/close 1132 (time 1788533947.51 total 20.01 last 56.56) - open/close 1646 (time 1788533957.51 total 30.02 last 51.39) - open/close 2232 (time 1788533967.52 total 40.03 last 58.54) - open/close 2914 (time 1788533977.52 total 50.03 last 68.20) - open/close 3591 (time 1788533987.53 total 60.04 last 67.64) - open/close 4221 (time 1788533997.54 total 70.04 last 62.98) - open/close 4773 (time 1788534007.54 total 80.04 last 55.17) - open/close 5359 (time 1788534017.55 total 90.05 last 58.56) - open/close 5930 (time 1788534027.55 total 100.06 last 57.06) - open/close 6549 (time 1788534037.56 total 110.06 last 61.87) - open/close 7229 (time 1788534047.56 total 120.07 last 67.96) - open/close 7888 (time 1788534057.57 total 130.07 last 65.89) - open/close 8477 (time 1788534067.57 total 140.07 last 58.89) - open/close 9096 (time 1788534077.58 total 150.09 last 61.80) - open/close 9727 (time 1788534087.59 total 160.09 last 63.06) total: 10000 open/close in 164.40 seconds: 60.83 ops/second llite.lustre-ffff9ebbac7c6800.statahead_batch_max=0 llite.lustre-ffff9ebbac7c6800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9ebbac7c6800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m17.274s user 0m0.356s sys 0m14.539s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9ebbac7c6800.statahead_batch_max=32 llite.lustre-ffff9ebbac7c6800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9ebbac7c6800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9ebbac7c6800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m48.513s user 0m0.320s sys 0m13.461s batched statahead RPC= hit count=9978 mdc.lustre-MDT0000-mdc-ffff9ebbac7c6800.batch_stats= snapshot_time: 1788534299.391477658 secs.nsecs start_time: 1788534180.322834258 secs.nsecs elapsed_time: 119.068643400 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9ebbac7c6800.batch_stats=0 llite.lustre-ffff9ebbac7c6800.statahead_max=2048 llite.lustre-ffff9ebbac7c6800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9ebbac7c6800.batch_stats=0 total: 100 open/close in 3.27 seconds: 30.61 ops/second llite.lustre-ffff9ebbac7c6800.statahead_max=0 101 real 0m2.957s user 0m0.006s sys 0m0.298s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9ebbac7c6800.statahead_max=2048 llite.lustre-ffff9ebbac7c6800.statahead_max=2048 101 real 0m1.189s user 0m0.005s sys 0m0.151s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10077 miss_total: 23 swrong=0 ewrong=0 - open/close 648 (time 1788534646.39 total 10.01 last 64.73) total: 900 open/close in 14.06 seconds: 64.02 ops/second llite.lustre-ffff9ebbac7c6800.statahead_max=0 1001 real 0m22.894s user 0m0.037s sys 0m3.068s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff9ebbac7c6800.statahead_max=2048 llite.lustre-ffff9ebbac7c6800.statahead_max=2048 1001 real 0m6.982s user 0m0.035s sys 0m1.664s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11076 miss_total: 24 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff9ebbac7c6800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11076 miss_total: 24 mdc.lustre-MDT0000-mdc-ffff9ebbac7c6800.batch_stats= snapshot_time: 1788534714.352451646 secs.nsecs start_time: 1788534302.036997125 secs.nsecs elapsed_time: 412.315454521 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 518 (time 1788534727.56 total 10.01 last 51.74) - open/close 1091 (time 1788534737.57 total 20.02 last 57.23) - open/close 1651 (time 1788534747.57 total 30.03 last 55.98) - open/close 2334 (time 1788534757.60 total 40.06 last 68.10) - open/close 3028 (time 1788534767.62 total 50.07 last 69.30) - open/close 3634 (time 1788534777.64 total 60.10 last 60.45) - open/close 4211 (time 1788534787.64 total 70.10 last 57.70) - open/close 4811 (time 1788534797.64 total 80.10 last 59.98) - open/close 5455 (time 1788534807.65 total 90.10 last 64.39) - open/close 6083 (time 1788534817.65 total 100.11 last 62.75) - open/close 6731 (time 1788534827.66 total 110.11 last 64.79) - open/close 7381 (time 1788534837.67 total 120.12 last 64.92) - open/close 7963 (time 1788534847.68 total 130.13 last 58.15) - open/close 8552 (time 1788534857.70 total 140.16 last 58.76) - open/close 9067 (time 1788534867.70 total 150.16 last 51.48) - open/close 9710 (time 1788534877.70 total 160.16 last 64.30) total: 10000 open/close in 164.39 seconds: 60.83 ops/second llite.lustre-ffff9ebbac7c6800.statahead_batch_max=0 llite.lustre-ffff9ebbac7c6800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9ebbac7c6800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m4.858s user 0m0.323s sys 0m14.910s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9ebbac7c6800.statahead_batch_max=256 llite.lustre-ffff9ebbac7c6800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9ebbac7c6800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9ebbac7c6800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m56.532s user 0m0.315s sys 0m14.753s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9ebbac7c6800.batch_stats= snapshot_time: 1788535024.686869670 secs.nsecs start_time: 1788534956.107733967 secs.nsecs elapsed_time: 68.579135703 secs.nsecs subreqs per batch batches %% cum %% 1: 138 48 48 2: 41 14 63 4: 23 8 71 8: 14 4 76 16: 11 3 80 32: 14 4 85 64: 5 1 87 128: 1 0 87 256: 35 12 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9ebbac7c6800.statahead_batch_max=64 llite.lustre-ffff9ebbac7c6800.statahead_max=128