== sanity test 123ad: Verify batching statahead works correctly ========================================================== 13:39:05 (1790789945) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8c0ec6a96000.batch_stats=0 llite.lustre-ffff8c0ec6a96000.statahead_max=32 llite.lustre-ffff8c0ec6a96000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8c0ec6a96000.batch_stats=0 total: 100 open/close in 2.33 seconds: 42.99 ops/second llite.lustre-ffff8c0ec6a96000.statahead_max=0 101 real 0m2.926s user 0m0.005s sys 0m0.307s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8c0ec6a96000.statahead_max=32 llite.lustre-ffff8c0ec6a96000.statahead_max=32 101 real 0m1.029s user 0m0.004s sys 0m0.151s 'ls -l' 100 files with statahead: 1 sec statahead total: 142 statahead wrong: 2 agl total: 136 list_total: 29 fname_total: 107 hit_total: 3992 miss_total: 1208 swrong=2 ewrong=2 - open/close 656 (time 1790789974.57 total 10.01 last 65.53) total: 900 open/close in 13.67 seconds: 65.85 ops/second llite.lustre-ffff8c0ec6a96000.statahead_max=0 1001 real 0m20.631s user 0m0.026s sys 0m2.873s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff8c0ec6a96000.statahead_max=32 llite.lustre-ffff8c0ec6a96000.statahead_max=32 1001 real 0m10.932s user 0m0.029s sys 0m1.303s 'ls -l' 1000 files with statahead: 11 sec statahead total: 143 statahead wrong: 2 agl total: 137 list_total: 30 fname_total: 107 hit_total: 4987 miss_total: 1213 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff8c0ec6a96000.statahead_stats= statahead total: 143 statahead wrong: 2 agl total: 137 list_total: 30 fname_total: 107 hit_total: 4987 miss_total: 1213 mdc.lustre-MDT0000-mdc-ffff8c0ec6a96000.batch_stats= snapshot_time: 1790790050.341128825 secs.nsecs start_time: 1790789951.022293024 secs.nsecs elapsed_time: 99.318835801 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 1 2 10 32: 34 89 100 - open/close 945 (time 1790790062.65 total 10.01 last 94.43) - open/close 1818 (time 1790790072.65 total 20.01 last 87.30) - open/close 2731 (time 1790790082.66 total 30.02 last 91.23) - open/close 3460 (time 1790790092.67 total 40.03 last 72.82) - open/close 4069 (time 1790790102.67 total 50.03 last 60.89) - open/close 4875 (time 1790790112.67 total 60.03 last 80.59) - open/close 5735 (time 1790790122.68 total 70.04 last 85.93) - open/close 6638 (time 1790790132.68 total 80.04 last 90.26) - open/close 7563 (time 1790790142.68 total 90.04 last 92.49) - open/close 8379 (time 1790790152.69 total 100.05 last 81.52) - open/close 9057 (time 1790790162.70 total 110.06 last 67.75) - open/close 9836 (time 1790790172.71 total 120.07 last 77.83) total: 10000 open/close in 122.21 seconds: 81.83 ops/second llite.lustre-ffff8c0ec6a96000.statahead_batch_max=0 llite.lustre-ffff8c0ec6a96000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c0ec6a96000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m59.660s user 0m0.314s sys 0m13.498s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c0ec6a96000.statahead_batch_max=32 llite.lustre-ffff8c0ec6a96000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c0ec6a96000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c0ec6a96000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m41.768s user 0m0.306s sys 0m12.829s batched statahead RPC= hit count=9990 mdc.lustre-MDT0000-mdc-ffff8c0ec6a96000.batch_stats= snapshot_time: 1790790358.849157396 secs.nsecs start_time: 1790790245.390220170 secs.nsecs elapsed_time: 113.458937226 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8c0ec6a96000.batch_stats=0 llite.lustre-ffff8c0ec6a96000.statahead_max=2048 llite.lustre-ffff8c0ec6a96000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8c0ec6a96000.batch_stats=0 total: 100 open/close in 2.98 seconds: 33.60 ops/second llite.lustre-ffff8c0ec6a96000.statahead_max=0 101 real 0m2.518s user 0m0.006s sys 0m0.315s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8c0ec6a96000.statahead_max=2048 llite.lustre-ffff8c0ec6a96000.statahead_max=2048 101 real 0m0.765s user 0m0.008s sys 0m0.138s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10089 miss_total: 11 swrong=0 ewrong=0 - open/close 752 (time 1790790662.40 total 10.02 last 75.06) total: 900 open/close in 12.31 seconds: 73.13 ops/second llite.lustre-ffff8c0ec6a96000.statahead_max=0 1001 real 0m25.752s user 0m0.030s sys 0m2.868s 'ls -l' 1000 files without statahead: 26 sec llite.lustre-ffff8c0ec6a96000.statahead_max=2048 llite.lustre-ffff8c0ec6a96000.statahead_max=2048 1001 real 0m8.405s user 0m0.028s sys 0m1.295s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11088 miss_total: 12 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff8c0ec6a96000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11088 miss_total: 12 mdc.lustre-MDT0000-mdc-ffff8c0ec6a96000.batch_stats= snapshot_time: 1790790734.307345868 secs.nsecs start_time: 1790790361.568614094 secs.nsecs elapsed_time: 372.738731774 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 1 10 30 32: 1 10 40 64: 0 0 40 128: 3 30 70 256: 3 30 100 - open/close 760 (time 1790790746.58 total 10.01 last 75.93) - open/close 1626 (time 1790790756.58 total 20.01 last 86.56) - open/close 2458 (time 1790790766.60 total 30.04 last 83.02) - open/close 3266 (time 1790790776.62 total 40.05 last 80.66) - open/close 4030 (time 1790790786.62 total 50.06 last 76.36) - open/close 4829 (time 1790790796.63 total 60.07 last 79.85) - open/close 5670 (time 1790790806.63 total 70.07 last 84.07) - open/close 6415 (time 1790790816.64 total 80.08 last 74.44) - open/close 7157 (time 1790790826.65 total 90.09 last 74.12) - open/close 7923 (time 1790790836.67 total 100.10 last 76.48) - open/close 8666 (time 1790790846.67 total 110.11 last 74.26) - open/close 9456 (time 1790790856.68 total 120.11 last 78.95) total: 10000 open/close in 127.58 seconds: 78.38 ops/second llite.lustre-ffff8c0ec6a96000.statahead_batch_max=0 llite.lustre-ffff8c0ec6a96000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c0ec6a96000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m4.827s user 0m0.313s sys 0m13.810s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c0ec6a96000.statahead_batch_max=256 llite.lustre-ffff8c0ec6a96000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c0ec6a96000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c0ec6a96000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.824s user 0m0.276s sys 0m13.291s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8c0ec6a96000.batch_stats= snapshot_time: 1790791006.137360726 secs.nsecs start_time: 1790790939.713108351 secs.nsecs elapsed_time: 66.424252375 secs.nsecs subreqs per batch batches %% cum %% 1: 110 40 40 2: 43 15 56 4: 30 11 67 8: 19 7 74 16: 16 5 80 32: 11 4 84 64: 6 2 86 128: 2 0 87 256: 34 12 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8c0ec6a96000.statahead_batch_max=64 llite.lustre-ffff8c0ec6a96000.statahead_max=128