== sanity test 123ad: Verify batching statahead works correctly ========================================================== 09:47:49 (1788875269) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8edf51082000.batch_stats=0 llite.lustre-ffff8edf51082000.statahead_max=32 llite.lustre-ffff8edf51082000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8edf51082000.batch_stats=0 total: 100 open/close in 2.54 seconds: 39.43 ops/second llite.lustre-ffff8edf51082000.statahead_max=0 101 real 0m2.128s user 0m0.006s sys 0m0.356s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8edf51082000.statahead_max=32 llite.lustre-ffff8edf51082000.statahead_max=32 101 real 0m1.003s user 0m0.004s sys 0m0.170s 'ls -l' 100 files with statahead: 1 sec statahead total: 127 statahead wrong: 2 agl total: 120 list_total: 30 fname_total: 96 hit_total: 4142 miss_total: 1287 swrong=2 ewrong=2 - open/close 736 (time 1788875298.26 total 10.01 last 73.55) total: 900 open/close in 12.53 seconds: 71.82 ops/second llite.lustre-ffff8edf51082000.statahead_max=0 1001 real 0m21.231s user 0m0.031s sys 0m3.308s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff8edf51082000.statahead_max=32 llite.lustre-ffff8edf51082000.statahead_max=32 1001 real 0m9.623s user 0m0.036s sys 0m1.418s 'ls -l' 1000 files with statahead: 9 sec statahead total: 128 statahead wrong: 2 agl total: 121 list_total: 31 fname_total: 96 hit_total: 5138 miss_total: 1291 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 25 seconds llite.lustre-ffff8edf51082000.statahead_stats= statahead total: 128 statahead wrong: 2 agl total: 121 list_total: 31 fname_total: 96 hit_total: 5138 miss_total: 1291 mdc.lustre-MDT0000-mdc-ffff8edf51082000.batch_stats= snapshot_time: 1788875369.638918744 secs.nsecs start_time: 1788875275.873085436 secs.nsecs elapsed_time: 93.765833308 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 744 (time 1788875382.29 total 10.00 last 74.37) - open/close 1466 (time 1788875392.31 total 20.02 last 72.10) - open/close 2206 (time 1788875402.32 total 30.03 last 73.94) - open/close 2957 (time 1788875412.33 total 40.04 last 74.99) - open/close 3523 (time 1788875422.34 total 50.05 last 56.56) - open/close 4158 (time 1788875432.35 total 60.06 last 63.44) - open/close 4822 (time 1788875442.36 total 70.07 last 66.34) - open/close 5497 (time 1788875452.39 total 80.10 last 67.27) - open/close 6174 (time 1788875462.39 total 90.10 last 67.69) - open/close 6878 (time 1788875472.40 total 100.11 last 70.33) - open/close 7604 (time 1788875482.40 total 110.11 last 72.58) - open/close 8304 (time 1788875492.41 total 120.12 last 69.96) - open/close 8973 (time 1788875502.42 total 130.13 last 66.85) - open/close 9668 (time 1788875512.42 total 140.13 last 69.46) total: 10000 open/close in 145.01 seconds: 68.96 ops/second llite.lustre-ffff8edf51082000.statahead_batch_max=0 llite.lustre-ffff8edf51082000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8edf51082000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m1.517s user 0m0.394s sys 0m16.183s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8edf51082000.statahead_batch_max=32 llite.lustre-ffff8edf51082000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8edf51082000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8edf51082000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m42.084s user 0m0.324s sys 0m13.929s batched statahead RPC= hit count=9982 mdc.lustre-MDT0000-mdc-ffff8edf51082000.batch_stats= snapshot_time: 1788875700.228280981 secs.nsecs start_time: 1788875586.986745724 secs.nsecs elapsed_time: 113.241535257 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8edf51082000.batch_stats=0 llite.lustre-ffff8edf51082000.statahead_max=2048 llite.lustre-ffff8edf51082000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8edf51082000.batch_stats=0 total: 100 open/close in 2.15 seconds: 46.57 ops/second llite.lustre-ffff8edf51082000.statahead_max=0 101 real 0m1.809s user 0m0.004s sys 0m0.314s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8edf51082000.statahead_max=2048 llite.lustre-ffff8edf51082000.statahead_max=2048 101 real 0m0.682s user 0m0.005s sys 0m0.160s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10081 miss_total: 19 swrong=0 ewrong=0 - open/close 883 (time 1788875973.83 total 10.01 last 88.18) total: 900 open/close in 10.24 seconds: 87.85 ops/second llite.lustre-ffff8edf51082000.statahead_max=0 1001 real 0m18.989s user 0m0.041s sys 0m2.941s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff8edf51082000.statahead_max=2048 llite.lustre-ffff8edf51082000.statahead_max=2048 1001 real 0m5.548s user 0m0.033s sys 0m1.455s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 17 seconds llite.lustre-ffff8edf51082000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 mdc.lustre-MDT0000-mdc-ffff8edf51082000.batch_stats= snapshot_time: 1788876025.985717558 secs.nsecs start_time: 1788875702.527572139 secs.nsecs elapsed_time: 323.458145419 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 16 16 16: 2 16 33 32: 2 16 50 64: 2 16 66 128: 0 0 66 256: 4 33 100 - open/close 860 (time 1788876038.12 total 10.00 last 85.99) - open/close 1685 (time 1788876048.12 total 20.01 last 82.45) - open/close 2527 (time 1788876058.13 total 30.01 last 84.17) - open/close 3341 (time 1788876068.13 total 40.02 last 81.35) - open/close 4076 (time 1788876078.14 total 50.02 last 73.48) - open/close 4861 (time 1788876088.15 total 60.03 last 78.42) - open/close 5666 (time 1788876098.16 total 70.04 last 80.42) - open/close 6509 (time 1788876108.17 total 80.05 last 84.22) - open/close 7387 (time 1788876118.17 total 90.06 last 87.73) - open/close 8341 (time 1788876128.18 total 100.06 last 95.34) - open/close 9159 (time 1788876138.19 total 110.07 last 81.74) total: 10000 open/close in 118.96 seconds: 84.06 ops/second llite.lustre-ffff8edf51082000.statahead_batch_max=0 llite.lustre-ffff8edf51082000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8edf51082000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m49.379s user 0m0.337s sys 0m16.909s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8edf51082000.statahead_batch_max=256 llite.lustre-ffff8edf51082000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8edf51082000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8edf51082000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.367s user 0m0.260s sys 0m14.502s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8edf51082000.batch_stats= snapshot_time: 1788876249.841577234 secs.nsecs start_time: 1788876204.225413548 secs.nsecs elapsed_time: 45.616163686 secs.nsecs subreqs per batch batches %% cum %% 1: 111 46 46 2: 29 12 58 4: 21 8 67 8: 11 4 71 16: 10 4 76 32: 17 7 83 64: 4 1 84 128: 1 0 85 256: 35 14 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8edf51082000.statahead_batch_max=64 llite.lustre-ffff8edf51082000.statahead_max=128