== sanity test 123ad: Verify batching statahead works correctly ========================================================== 01:14:31 (1789190071) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff90e985a6a000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff90e985a6a000.batch_stats=0 llite.lustre-ffff90e985a6a000.statahead_max=32 llite.lustre-ffff90e985a6a000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff90e985a6a000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff90e985a6a000.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.64 seconds: 156.86 ops/second llite.lustre-ffff90e985a6a000.statahead_max=0 101 real 0m0.617s user 0m0.002s sys 0m0.230s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff90e985a6a000.statahead_max=32 llite.lustre-ffff90e985a6a000.statahead_max=32 101 real 0m0.371s user 0m0.006s sys 0m0.194s 'ls -l' 100 files with statahead: 0 sec statahead total: 90 statahead wrong: 2 agl total: 85 list_total: 32 fname_total: 58 hit_total: 13839 miss_total: 659 swrong=2 ewrong=2 total: 900 open/close in 2.26 seconds: 398.48 ops/second llite.lustre-ffff90e985a6a000.statahead_max=0 1001 real 0m6.624s user 0m0.019s sys 0m2.258s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff90e985a6a000.statahead_max=32 llite.lustre-ffff90e985a6a000.statahead_max=32 1001 real 0m3.701s user 0m0.018s sys 0m1.544s 'ls -l' 1000 files with statahead: 4 sec statahead total: 91 statahead wrong: 2 agl total: 86 list_total: 33 fname_total: 58 hit_total: 14838 miss_total: 660 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff90e985a6a000.statahead_stats= statahead total: 91 statahead wrong: 2 agl total: 86 list_total: 33 fname_total: 58 hit_total: 14838 miss_total: 660 mdc.lustre-MDT0000-mdc-ffff90e985a6a000.batch_stats= snapshot_time: 1789190100.165248386 secs.nsecs start_time: 1789190073.515124209 secs.nsecs elapsed_time: 26.650124177 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 1 2 5 4: 1 2 7 8: 4 10 17 16: 18 46 64 32: 14 35 100 mdc.lustre-MDT0001-mdc-ffff90e985a6a000.batch_stats= snapshot_time: 1789190100.165304623 secs.nsecs start_time: 1789190073.515199616 secs.nsecs elapsed_time: 26.650105007 secs.nsecs subreqs per batch batches %% cum %% 1: 2 4 4 2: 2 4 9 4: 1 2 12 8: 2 4 17 16: 22 53 70 32: 12 29 100 - open/close 3159 (time 1789190111.19 total 10.00 last 315.85) - open/close 6692 (time 1789190121.19 total 20.00 last 353.29) total: 10000 open/close in 27.95 seconds: 357.78 ops/second llite.lustre-ffff90e985a6a000.statahead_batch_max=0 llite.lustre-ffff90e985a6a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff90e985a6a000.stats=clear mdc.lustre-MDT0001-mdc-ffff90e985a6a000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m30.152s user 0m0.196s sys 0m27.581s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff90e985a6a000.statahead_batch_max=32 llite.lustre-ffff90e985a6a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff90e985a6a000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff90e985a6a000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff90e985a6a000.stats=clear mdc.lustre-MDT0001-mdc-ffff90e985a6a000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.340s user 0m0.192s sys 0m18.483s batched statahead RPC= hit count=9997 mdc.lustre-MDT0000-mdc-ffff90e985a6a000.batch_stats= snapshot_time: 1789190201.599597626 secs.nsecs start_time: 1789190162.050962251 secs.nsecs elapsed_time: 39.548635375 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff90e985a6a000.batch_stats= snapshot_time: 1789190201.599637650 secs.nsecs start_time: 1789190162.051011146 secs.nsecs elapsed_time: 39.548626504 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff90e985a6a000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff90e985a6a000.batch_stats=0 llite.lustre-ffff90e985a6a000.statahead_max=2048 llite.lustre-ffff90e985a6a000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff90e985a6a000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff90e985a6a000.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 1.22 seconds: 82.01 ops/second llite.lustre-ffff90e985a6a000.statahead_max=0 101 real 0m0.688s user 0m0.006s sys 0m0.254s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff90e985a6a000.statahead_max=2048 llite.lustre-ffff90e985a6a000.statahead_max=2048 101 real 0m0.297s user 0m0.002s sys 0m0.201s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10096 miss_total: 4 swrong=0 ewrong=0 total: 900 open/close in 1.73 seconds: 518.91 ops/second llite.lustre-ffff90e985a6a000.statahead_max=0 1001 real 0m5.336s user 0m0.023s sys 0m1.944s 'ls -l' 1000 files without statahead: 5 sec llite.lustre-ffff90e985a6a000.statahead_max=2048 llite.lustre-ffff90e985a6a000.statahead_max=2048 1001 real 0m2.914s user 0m0.012s sys 0m1.154s 'ls -l' 1000 files with statahead: 2 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11095 miss_total: 5 swrong=0 ewrong=0 - open/close 5409 (time 1789190304.17 total 10.00 last 540.88) total: 9000 open/close in 16.62 seconds: 541.67 ops/second llite.lustre-ffff90e985a6a000.statahead_max=0 10001 real 1m44.372s user 0m0.286s sys 0m25.706s 'ls -l' 10000 files without statahead: 105 sec llite.lustre-ffff90e985a6a000.statahead_max=2048 llite.lustre-ffff90e985a6a000.statahead_max=2048 10001 real 0m25.136s user 0m0.162s sys 0m18.592s 'ls -l' 10000 files with statahead: 25 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21094 miss_total: 6 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 81 seconds llite.lustre-ffff90e985a6a000.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21094 miss_total: 6 mdc.lustre-MDT0000-mdc-ffff90e985a6a000.batch_stats= snapshot_time: 1789190533.257710469 secs.nsecs start_time: 1789190202.455782344 secs.nsecs elapsed_time: 330.801928125 secs.nsecs subreqs per batch batches %% cum %% 1: 74 57 57 2: 5 3 61 4: 5 3 65 8: 7 5 71 16: 2 1 72 32: 1 0 73 64: 1 0 74 128: 2 1 75 256: 31 24 100 mdc.lustre-MDT0001-mdc-ffff90e985a6a000.batch_stats= snapshot_time: 1789190533.257770385 secs.nsecs start_time: 1789190202.455936244 secs.nsecs elapsed_time: 330.801834141 secs.nsecs subreqs per batch batches %% cum %% 1: 50 47 47 2: 9 8 56 4: 6 5 61 8: 4 3 65 16: 1 0 66 32: 0 0 66 64: 2 1 68 128: 1 0 69 256: 32 30 100 - open/close 3820 (time 1789190544.52 total 10.00 last 381.95) - open/close 8069 (time 1789190554.52 total 20.00 last 424.84) total: 10000 open/close in 23.98 seconds: 417.04 ops/second llite.lustre-ffff90e985a6a000.statahead_batch_max=0 llite.lustre-ffff90e985a6a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff90e985a6a000.stats=clear mdc.lustre-MDT0001-mdc-ffff90e985a6a000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m28.528s user 0m0.172s sys 0m24.194s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff90e985a6a000.statahead_batch_max=256 llite.lustre-ffff90e985a6a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff90e985a6a000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff90e985a6a000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff90e985a6a000.stats=clear mdc.lustre-MDT0001-mdc-ffff90e985a6a000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m24.563s user 0m0.184s sys 0m18.557s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff90e985a6a000.batch_stats= snapshot_time: 1789190618.383173507 secs.nsecs start_time: 1789190589.416988995 secs.nsecs elapsed_time: 28.966184512 secs.nsecs subreqs per batch batches %% cum %% 1: 215 57 57 2: 59 15 73 4: 35 9 82 8: 3 0 83 16: 2 0 84 32: 21 5 89 64: 3 0 90 128: 0 0 90 256: 35 9 100 mdc.lustre-MDT0001-mdc-ffff90e985a6a000.batch_stats= snapshot_time: 1789190618.383224911 secs.nsecs start_time: 1789190589.417051051 secs.nsecs elapsed_time: 28.966173860 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff90e985a6a000.statahead_batch_max=64 llite.lustre-ffff90e985a6a000.statahead_max=128