== sanity test 123ad: Verify batching statahead works correctly ========================================================== 20:47:38 (1781225258) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8a62d8517000.batch_stats=0 llite.lustre-ffff8a62d8517000.statahead_max=32 llite.lustre-ffff8a62d8517000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8a62d8517000.batch_stats=0 total: 100 open/close in 2.47 seconds: 40.54 ops/second llite.lustre-ffff8a62d8517000.statahead_max=0 101 real 0m2.660s user 0m0.004s sys 0m0.356s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8a62d8517000.statahead_max=32 llite.lustre-ffff8a62d8517000.statahead_max=32 101 real 0m1.339s user 0m0.008s sys 0m0.194s 'ls -l' 100 files with statahead: 1 sec statahead total: 158 statahead wrong: 2 agl total: 152 list_total: 30 fname_total: 114 hit_total: 3878 miss_total: 1743 swrong=2 ewrong=2 - open/close 682 (time 1781225289.34 total 10.01 last 68.16) total: 900 open/close in 13.58 seconds: 66.25 ops/second llite.lustre-ffff8a62d8517000.statahead_max=0 1001 real 0m20.830s user 0m0.032s sys 0m3.128s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff8a62d8517000.statahead_max=32 llite.lustre-ffff8a62d8517000.statahead_max=32 1001 real 0m11.332s user 0m0.036s sys 0m1.484s 'ls -l' 1000 files with statahead: 11 sec statahead total: 159 statahead wrong: 2 agl total: 153 list_total: 31 fname_total: 114 hit_total: 4875 miss_total: 1746 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff8a62d8517000.statahead_stats= statahead total: 159 statahead wrong: 2 agl total: 153 list_total: 31 fname_total: 114 hit_total: 4875 miss_total: 1746 mdc.lustre-MDT0000-mdc-ffff8a62d8517000.batch_stats= snapshot_time: 1781225362.856207788 secs.nsecs start_time: 1781225264.225405994 secs.nsecs elapsed_time: 98.630801794 secs.nsecs subreqs per batch batches % cum % 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 1 2 12 32: 34 87 100 - open/close 831 (time 1781225375.82 total 10.00 last 83.10) - open/close 1559 (time 1781225385.82 total 20.00 last 72.79) - open/close 2192 (time 1781225395.83 total 30.01 last 63.25) - open/close 2856 (time 1781225405.84 total 40.03 last 66.29) - open/close 3498 (time 1781225415.86 total 50.04 last 64.12) - open/close 4189 (time 1781225425.86 total 60.05 last 69.04) - open/close 4987 (time 1781225435.87 total 70.06 last 79.73) - open/close 5717 (time 1781225445.88 total 80.07 last 72.94) - open/close 6404 (time 1781225455.89 total 90.08 last 68.63) - open/close 7113 (time 1781225465.90 total 100.08 last 70.86) - open/close 7938 (time 1781225475.91 total 110.09 last 82.41) - open/close 8563 (time 1781225485.91 total 120.10 last 62.47) - open/close 9242 (time 1781225495.92 total 130.11 last 67.83) - open/close 9880 (time 1781225505.95 total 140.13 last 63.65) total: 10000 open/close in 141.97 seconds: 70.44 ops/second llite.lustre-ffff8a62d8517000.statahead_batch_max=0 llite.lustre-ffff8a62d8517000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a62d8517000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m18.053s user 0m0.341s sys 0m15.692s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a62d8517000.statahead_batch_max=32 llite.lustre-ffff8a62d8517000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a62d8517000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a62d8517000.stats=clear ls -l files in d123ad.sanity: 10001 real 2m7.474s user 0m0.317s sys 0m14.863s batched statahead RPC= hit count=9983 mdc.lustre-MDT0000-mdc-ffff8a62d8517000.batch_stats= snapshot_time: 1781225747.602990665 secs.nsecs start_time: 1781225599.819481304 secs.nsecs elapsed_time: 147.783509361 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8a62d8517000.batch_stats=0 llite.lustre-ffff8a62d8517000.statahead_max=2048 llite.lustre-ffff8a62d8517000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8a62d8517000.batch_stats=0 total: 100 open/close in 3.26 seconds: 30.63 ops/second llite.lustre-ffff8a62d8517000.statahead_max=0 101 real 0m2.270s user 0m0.005s sys 0m0.330s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8a62d8517000.statahead_max=2048 llite.lustre-ffff8a62d8517000.statahead_max=2048 101 real 0m1.450s user 0m0.003s sys 0m0.168s 'ls -l' 100 files with statahead: 2 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10082 miss_total: 18 swrong=0 ewrong=0 - open/close 725 (time 1781226106.76 total 10.03 last 72.29) total: 900 open/close in 13.95 seconds: 64.52 ops/second llite.lustre-ffff8a62d8517000.statahead_max=0 1001 real 0m22.682s user 0m0.035s sys 0m3.098s 'ls -l' 1000 files without statahead: 23 sec llite.lustre-ffff8a62d8517000.statahead_max=2048 llite.lustre-ffff8a62d8517000.statahead_max=2048 1001 real 0m7.422s user 0m0.030s sys 0m1.567s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 25 seconds llite.lustre-ffff8a62d8517000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 mdc.lustre-MDT0000-mdc-ffff8a62d8517000.batch_stats= snapshot_time: 1781226184.131231129 secs.nsecs start_time: 1781225750.906014266 secs.nsecs elapsed_time: 433.225216863 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 620 (time 1781226198.80 total 10.01 last 61.91) - open/close 1163 (time 1781226208.81 total 20.02 last 54.27) - open/close 1691 (time 1781226218.82 total 30.03 last 52.74) - open/close 2254 (time 1781226228.83 total 40.04 last 56.23) - open/close 3042 (time 1781226238.84 total 50.05 last 78.73) - open/close 3745 (time 1781226248.85 total 60.06 last 70.23) - open/close 4461 (time 1781226258.85 total 70.06 last 71.58) - open/close 5277 (time 1781226268.85 total 80.07 last 81.58) - open/close 5890 (time 1781226278.86 total 90.07 last 61.25) - open/close 6394 (time 1781226288.87 total 100.08 last 50.35) - open/close 6947 (time 1781226298.87 total 110.09 last 55.29) - open/close 7671 (time 1781226308.88 total 120.09 last 72.36) - open/close 8333 (time 1781226318.88 total 130.10 last 66.16) - open/close 9154 (time 1781226328.89 total 140.10 last 82.08) - open/close 9922 (time 1781226338.89 total 150.10 last 76.78) total: 10000 open/close in 151.14 seconds: 66.16 ops/second llite.lustre-ffff8a62d8517000.statahead_batch_max=0 llite.lustre-ffff8a62d8517000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a62d8517000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m14.330s user 0m0.304s sys 0m15.857s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a62d8517000.statahead_batch_max=256 llite.lustre-ffff8a62d8517000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a62d8517000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a62d8517000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m2.155s user 0m0.273s sys 0m15.679s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8a62d8517000.batch_stats= snapshot_time: 1781226500.779912649 secs.nsecs start_time: 1781226426.228109860 secs.nsecs elapsed_time: 74.551802789 secs.nsecs subreqs per batch batches % cum % 1: 122 47 47 2: 36 14 61 4: 22 8 70 8: 12 4 75 16: 10 3 78 32: 15 5 84 64: 3 1 85 128: 1 0 86 256: 35 13 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8a62d8517000.statahead_batch_max=64 llite.lustre-ffff8a62d8517000.statahead_max=128