== sanity test 123ad: Verify batching statahead works correctly ========================================================== 21:02:15 (1789606935) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9bb2bec90800.batch_stats=0 llite.lustre-ffff9bb2bec90800.statahead_max=32 llite.lustre-ffff9bb2bec90800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9bb2bec90800.batch_stats=0 total: 100 open/close in 2.73 seconds: 36.68 ops/second llite.lustre-ffff9bb2bec90800.statahead_max=0 101 real 0m2.444s user 0m0.005s sys 0m0.300s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9bb2bec90800.statahead_max=32 llite.lustre-ffff9bb2bec90800.statahead_max=32 101 real 0m1.060s user 0m0.005s sys 0m0.160s 'ls -l' 100 files with statahead: 1 sec statahead total: 105 statahead wrong: 2 agl total: 100 list_total: 29 fname_total: 58 hit_total: 4453 miss_total: 1274 swrong=2 ewrong=2 - open/close 729 (time 1789606963.62 total 10.00 last 72.89) total: 900 open/close in 12.56 seconds: 71.64 ops/second llite.lustre-ffff9bb2bec90800.statahead_max=0 1001 real 0m22.605s user 0m0.030s sys 0m2.682s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff9bb2bec90800.statahead_max=32 llite.lustre-ffff9bb2bec90800.statahead_max=32 1001 real 0m9.707s user 0m0.022s sys 0m1.274s 'ls -l' 1000 files with statahead: 10 sec statahead total: 106 statahead wrong: 2 agl total: 101 list_total: 30 fname_total: 58 hit_total: 5451 miss_total: 1276 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff9bb2bec90800.statahead_stats= statahead total: 106 statahead wrong: 2 agl total: 101 list_total: 30 fname_total: 58 hit_total: 5451 miss_total: 1276 mdc.lustre-MDT0000-mdc-ffff9bb2bec90800.batch_stats= snapshot_time: 1789607029.999901721 secs.nsecs start_time: 1789606939.663136492 secs.nsecs elapsed_time: 90.336765229 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 818 (time 1789607042.20 total 10.00 last 81.79) - open/close 1643 (time 1789607052.20 total 20.01 last 82.47) - open/close 2369 (time 1789607062.22 total 30.02 last 72.51) - open/close 3118 (time 1789607072.22 total 40.02 last 74.85) - open/close 3912 (time 1789607082.23 total 50.03 last 79.36) - open/close 4598 (time 1789607092.23 total 60.03 last 68.57) - open/close 5302 (time 1789607102.24 total 70.04 last 70.33) - open/close 5956 (time 1789607112.26 total 80.06 last 65.31) - open/close 6755 (time 1789607122.26 total 90.06 last 79.90) - open/close 7527 (time 1789607132.26 total 100.06 last 77.17) - open/close 8272 (time 1789607142.28 total 110.08 last 74.38) - open/close 9073 (time 1789607152.28 total 120.09 last 80.03) - open/close 9916 (time 1789607162.29 total 130.10 last 84.22) total: 10000 open/close in 130.96 seconds: 76.36 ops/second llite.lustre-ffff9bb2bec90800.statahead_batch_max=0 llite.lustre-ffff9bb2bec90800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bb2bec90800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m2.293s user 0m0.301s sys 0m14.697s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9bb2bec90800.statahead_batch_max=32 llite.lustre-ffff9bb2bec90800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bb2bec90800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9bb2bec90800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m40.213s user 0m0.312s sys 0m13.423s batched statahead RPC= hit count=9979 mdc.lustre-MDT0000-mdc-ffff9bb2bec90800.batch_stats= snapshot_time: 1789607342.603329789 secs.nsecs start_time: 1789607233.162429401 secs.nsecs elapsed_time: 109.440900388 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9bb2bec90800.batch_stats=0 llite.lustre-ffff9bb2bec90800.statahead_max=2048 llite.lustre-ffff9bb2bec90800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9bb2bec90800.batch_stats=0 total: 100 open/close in 2.57 seconds: 38.89 ops/second llite.lustre-ffff9bb2bec90800.statahead_max=0 101 real 0m2.724s user 0m0.004s sys 0m0.293s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9bb2bec90800.statahead_max=2048 llite.lustre-ffff9bb2bec90800.statahead_max=2048 101 real 0m0.661s user 0m0.003s sys 0m0.147s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10078 miss_total: 22 swrong=0 ewrong=0 - open/close 778 (time 1789607654.83 total 10.01 last 77.74) total: 900 open/close in 12.08 seconds: 74.51 ops/second llite.lustre-ffff9bb2bec90800.statahead_max=0 1001 real 0m19.256s user 0m0.031s sys 0m2.706s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff9bb2bec90800.statahead_max=2048 llite.lustre-ffff9bb2bec90800.statahead_max=2048 1001 real 0m6.291s user 0m0.030s sys 0m1.486s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11077 miss_total: 23 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff9bb2bec90800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11077 miss_total: 23 mdc.lustre-MDT0000-mdc-ffff9bb2bec90800.batch_stats= snapshot_time: 1789607711.132394327 secs.nsecs start_time: 1789607345.762738195 secs.nsecs elapsed_time: 365.369656132 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 0 0 20 32: 3 30 50 64: 1 10 60 128: 0 0 60 256: 4 40 100 - open/close 673 (time 1789607723.91 total 10.01 last 67.23) - open/close 1421 (time 1789607733.93 total 20.04 last 74.61) - open/close 2175 (time 1789607743.95 total 30.05 last 75.28) - open/close 2958 (time 1789607753.95 total 40.05 last 78.29) - open/close 3701 (time 1789607763.95 total 50.05 last 74.30) - open/close 4434 (time 1789607773.96 total 60.06 last 73.26) - open/close 5184 (time 1789607783.97 total 70.08 last 74.88) - open/close 5930 (time 1789607794.00 total 80.10 last 74.42) - open/close 6668 (time 1789607804.00 total 90.11 last 73.75) - open/close 7439 (time 1789607814.01 total 100.11 last 77.04) - open/close 8111 (time 1789607824.02 total 110.13 last 67.12) - open/close 8566 (time 1789607834.03 total 120.13 last 45.49) - open/close 9235 (time 1789607844.03 total 130.13 last 66.86) - open/close 9970 (time 1789607854.05 total 140.16 last 73.34) total: 10000 open/close in 140.51 seconds: 71.17 ops/second llite.lustre-ffff9bb2bec90800.statahead_batch_max=0 llite.lustre-ffff9bb2bec90800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bb2bec90800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m52.288s user 0m0.300s sys 0m15.357s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9bb2bec90800.statahead_batch_max=256 llite.lustre-ffff9bb2bec90800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bb2bec90800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9bb2bec90800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m52.095s user 0m0.319s sys 0m14.831s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9bb2bec90800.batch_stats= snapshot_time: 1789607976.858759668 secs.nsecs start_time: 1789607914.609393300 secs.nsecs elapsed_time: 62.249366368 secs.nsecs subreqs per batch batches %% cum %% 1: 172 50 50 2: 48 14 65 4: 30 8 73 8: 17 5 78 16: 13 3 82 32: 15 4 87 64: 8 2 89 128: 1 0 89 256: 34 10 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9bb2bec90800.statahead_batch_max=64 llite.lustre-ffff9bb2bec90800.statahead_max=128