== sanity test 123ad: Verify batching statahead works correctly ========================================================== 08:03:20 (1789128200) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9ac3b32d1800.batch_stats=0 llite.lustre-ffff9ac3b32d1800.statahead_max=32 llite.lustre-ffff9ac3b32d1800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9ac3b32d1800.batch_stats=0 total: 100 open/close in 2.51 seconds: 39.88 ops/second llite.lustre-ffff9ac3b32d1800.statahead_max=0 101 real 0m2.133s user 0m0.007s sys 0m0.312s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9ac3b32d1800.statahead_max=32 llite.lustre-ffff9ac3b32d1800.statahead_max=32 101 real 0m0.964s user 0m0.004s sys 0m0.152s 'ls -l' 100 files with statahead: 1 sec statahead total: 121 statahead wrong: 2 agl total: 116 list_total: 30 fname_total: 91 hit_total: 3791 miss_total: 1748 swrong=2 ewrong=2 - open/close 755 (time 1789128226.54 total 10.01 last 75.46) total: 900 open/close in 11.86 seconds: 75.87 ops/second llite.lustre-ffff9ac3b32d1800.statahead_max=0 1001 real 0m20.051s user 0m0.027s sys 0m2.729s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff9ac3b32d1800.statahead_max=32 llite.lustre-ffff9ac3b32d1800.statahead_max=32 1001 real 0m8.912s user 0m0.031s sys 0m1.394s 'ls -l' 1000 files with statahead: 9 sec statahead total: 122 statahead wrong: 2 agl total: 117 list_total: 31 fname_total: 91 hit_total: 4787 miss_total: 1752 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff9ac3b32d1800.statahead_stats= statahead total: 122 statahead wrong: 2 agl total: 117 list_total: 31 fname_total: 91 hit_total: 4787 miss_total: 1752 mdc.lustre-MDT0000-mdc-ffff9ac3b32d1800.batch_stats= snapshot_time: 1789128292.340315911 secs.nsecs start_time: 1789128204.945500936 secs.nsecs elapsed_time: 87.394814975 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 690 (time 1789128304.91 total 10.00 last 68.99) - open/close 1315 (time 1789128314.92 total 20.01 last 62.42) - open/close 2033 (time 1789128324.92 total 30.02 last 71.79) - open/close 2679 (time 1789128334.93 total 40.02 last 64.57) - open/close 3456 (time 1789128344.93 total 50.02 last 77.67) - open/close 4267 (time 1789128354.94 total 60.04 last 80.99) - open/close 5094 (time 1789128364.95 total 70.04 last 82.67) - open/close 5908 (time 1789128374.95 total 80.04 last 81.40) - open/close 6709 (time 1789128384.95 total 90.04 last 80.09) - open/close 7495 (time 1789128394.95 total 100.05 last 78.57) - open/close 8269 (time 1789128404.96 total 110.05 last 77.35) - open/close 9026 (time 1789128414.97 total 120.07 last 75.58) - open/close 9803 (time 1789128424.99 total 130.09 last 77.54) total: 10000 open/close in 132.38 seconds: 75.54 ops/second llite.lustre-ffff9ac3b32d1800.statahead_batch_max=0 llite.lustre-ffff9ac3b32d1800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9ac3b32d1800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.597s user 0m0.295s sys 0m14.756s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9ac3b32d1800.statahead_batch_max=32 llite.lustre-ffff9ac3b32d1800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9ac3b32d1800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9ac3b32d1800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m34.443s user 0m0.264s sys 0m13.215s batched statahead RPC= hit count=9983 mdc.lustre-MDT0000-mdc-ffff9ac3b32d1800.batch_stats= snapshot_time: 1789128593.645995111 secs.nsecs start_time: 1789128490.213032098 secs.nsecs elapsed_time: 103.432963013 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9ac3b32d1800.batch_stats=0 llite.lustre-ffff9ac3b32d1800.statahead_max=2048 llite.lustre-ffff9ac3b32d1800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9ac3b32d1800.batch_stats=0 total: 100 open/close in 2.56 seconds: 39.06 ops/second llite.lustre-ffff9ac3b32d1800.statahead_max=0 101 real 0m1.974s user 0m0.003s sys 0m0.272s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9ac3b32d1800.statahead_max=2048 llite.lustre-ffff9ac3b32d1800.statahead_max=2048 101 real 0m0.940s user 0m0.001s sys 0m0.144s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10082 miss_total: 18 swrong=0 ewrong=0 - open/close 796 (time 1789128909.86 total 10.01 last 79.55) total: 900 open/close in 11.92 seconds: 75.49 ops/second llite.lustre-ffff9ac3b32d1800.statahead_max=0 1001 real 0m21.292s user 0m0.032s sys 0m2.772s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff9ac3b32d1800.statahead_max=2048 llite.lustre-ffff9ac3b32d1800.statahead_max=2048 1001 real 0m6.742s user 0m0.025s sys 0m1.339s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff9ac3b32d1800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 mdc.lustre-MDT0000-mdc-ffff9ac3b32d1800.batch_stats= snapshot_time: 1789128974.088788412 secs.nsecs start_time: 1789128596.318562463 secs.nsecs elapsed_time: 377.770225949 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 704 (time 1789128986.99 total 10.00 last 70.37) - open/close 1463 (time 1789128997.00 total 20.01 last 75.83) - open/close 2263 (time 1789129007.01 total 30.03 last 79.84) - open/close 3016 (time 1789129017.02 total 40.04 last 75.24) - open/close 3802 (time 1789129027.03 total 50.05 last 78.52) - open/close 4559 (time 1789129037.06 total 60.07 last 75.52) - open/close 5207 (time 1789129047.06 total 70.08 last 64.78) - open/close 5732 (time 1789129057.07 total 80.08 last 52.47) - open/close 6193 (time 1789129067.08 total 90.09 last 46.05) - open/close 7000 (time 1789129077.08 total 100.10 last 80.65) - open/close 7754 (time 1789129087.09 total 110.10 last 75.37) - open/close 8582 (time 1789129097.09 total 120.11 last 82.78) - open/close 9396 (time 1789129107.10 total 130.11 last 81.33) total: 10000 open/close in 138.01 seconds: 72.46 ops/second llite.lustre-ffff9ac3b32d1800.statahead_batch_max=0 llite.lustre-ffff9ac3b32d1800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9ac3b32d1800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m52.831s user 0m0.313s sys 0m14.623s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9ac3b32d1800.statahead_batch_max=256 llite.lustre-ffff9ac3b32d1800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9ac3b32d1800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9ac3b32d1800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m50.284s user 0m0.292s sys 0m13.930s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9ac3b32d1800.batch_stats= snapshot_time: 1789129237.303466724 secs.nsecs start_time: 1789129176.069528416 secs.nsecs elapsed_time: 61.233938308 secs.nsecs subreqs per batch batches %% cum %% 1: 93 40 40 2: 31 13 54 4: 15 6 60 8: 22 9 70 16: 12 5 75 32: 17 7 82 64: 3 1 84 128: 1 0 84 256: 35 15 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9ac3b32d1800.statahead_batch_max=64 llite.lustre-ffff9ac3b32d1800.statahead_max=128