== sanity test 123ad: Verify batching statahead works correctly ========================================================== 04:30:20 (1780389020) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8b7b90a3a000.batch_stats=0 llite.lustre-ffff8b7b90a3a000.statahead_max=32 llite.lustre-ffff8b7b90a3a000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8b7b90a3a000.batch_stats=0 total: 100 open/close in 0.60 seconds: 165.97 ops/second llite.lustre-ffff8b7b90a3a000.statahead_max=0 101 real 0m0.576s user 0m0.003s sys 0m0.225s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8b7b90a3a000.statahead_max=32 llite.lustre-ffff8b7b90a3a000.statahead_max=32 101 real 0m0.365s user 0m0.002s sys 0m0.215s 'ls -l' 100 files with statahead: 0 sec statahead total: 86 statahead wrong: 2 agl total: 81 list_total: 29 fname_total: 57 hit_total: 14102 miss_total: 1161 swrong=2 ewrong=2 total: 900 open/close in 1.71 seconds: 525.64 ops/second llite.lustre-ffff8b7b90a3a000.statahead_max=0 1001 real 0m5.814s user 0m0.022s sys 0m2.267s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff8b7b90a3a000.statahead_max=32 llite.lustre-ffff8b7b90a3a000.statahead_max=32 1001 real 0m3.935s user 0m0.017s sys 0m2.320s 'ls -l' 1000 files with statahead: 4 sec statahead total: 87 statahead wrong: 2 agl total: 82 list_total: 30 fname_total: 57 hit_total: 15101 miss_total: 1162 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff8b7b90a3a000.statahead_stats= statahead total: 87 statahead wrong: 2 agl total: 82 list_total: 30 fname_total: 57 hit_total: 15101 miss_total: 1162 mdc.lustre-MDT0000-mdc-ffff8b7b90a3a000.batch_stats= snapshot_time: 1780389045.361820294 secs.nsecs start_time: 1780389022.203024954 secs.nsecs elapsed_time: 23.158795340 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 4345 (time 1780389056.58 total 10.00 last 434.45) - open/close 8799 (time 1780389066.58 total 20.00 last 445.30) total: 10000 open/close in 22.66 seconds: 441.22 ops/second llite.lustre-ffff8b7b90a3a000.statahead_batch_max=0 llite.lustre-ffff8b7b90a3a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8b7b90a3a000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.110s user 0m0.172s sys 0m30.357s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8b7b90a3a000.statahead_batch_max=32 llite.lustre-ffff8b7b90a3a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8b7b90a3a000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8b7b90a3a000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.134s user 0m0.177s sys 0m20.381s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8b7b90a3a000.batch_stats= snapshot_time: 1780389147.729863499 secs.nsecs start_time: 1780389105.537692381 secs.nsecs elapsed_time: 42.192171118 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8b7b90a3a000.batch_stats=0 llite.lustre-ffff8b7b90a3a000.statahead_max=2048 llite.lustre-ffff8b7b90a3a000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8b7b90a3a000.batch_stats=0 total: 100 open/close in 0.60 seconds: 166.80 ops/second llite.lustre-ffff8b7b90a3a000.statahead_max=0 101 real 0m0.522s user 0m0.002s sys 0m0.205s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8b7b90a3a000.statahead_max=2048 llite.lustre-ffff8b7b90a3a000.statahead_max=2048 101 real 0m0.372s user 0m0.004s sys 0m0.188s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.81 seconds: 497.75 ops/second llite.lustre-ffff8b7b90a3a000.statahead_max=0 1001 real 0m5.794s user 0m0.021s sys 0m2.254s 'ls -l' 1000 files without statahead: 5 sec llite.lustre-ffff8b7b90a3a000.statahead_max=2048 llite.lustre-ffff8b7b90a3a000.statahead_max=2048 1001 real 0m3.191s user 0m0.013s sys 0m1.189s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 - open/close 4952 (time 1780389255.52 total 10.00 last 495.13) total: 9000 open/close in 19.02 seconds: 473.12 ops/second llite.lustre-ffff8b7b90a3a000.statahead_max=0 10001 real 1m1.577s user 0m0.238s sys 0m23.658s 'ls -l' 10000 files without statahead: 61 sec llite.lustre-ffff8b7b90a3a000.statahead_max=2048 llite.lustre-ffff8b7b90a3a000.statahead_max=2048 10001 real 0m33.910s user 0m0.179s sys 0m22.333s 'ls -l' 10000 files with statahead: 34 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21096 miss_total: 4 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 93 seconds llite.lustre-ffff8b7b90a3a000.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21096 miss_total: 4 mdc.lustre-MDT0000-mdc-ffff8b7b90a3a000.batch_stats= snapshot_time: 1780389466.258685185 secs.nsecs start_time: 1780389148.575869153 secs.nsecs elapsed_time: 317.682816032 secs.nsecs subreqs per batch batches % cum % 1: 380 64 64 2: 92 15 80 4: 30 5 85 8: 15 2 88 16: 8 1 89 32: 20 3 93 64: 2 0 93 128: 1 0 93 256: 38 6 100 - open/close 4323 (time 1780389477.66 total 10.00 last 432.27) - open/close 7416 (time 1780389487.66 total 20.00 last 309.24) - open/close 9897 (time 1780389497.67 total 30.01 last 247.90) total: 10000 open/close in 30.55 seconds: 327.36 ops/second llite.lustre-ffff8b7b90a3a000.statahead_batch_max=0 llite.lustre-ffff8b7b90a3a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8b7b90a3a000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.091s user 0m0.244s sys 0m23.100s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8b7b90a3a000.statahead_batch_max=256 llite.lustre-ffff8b7b90a3a000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8b7b90a3a000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8b7b90a3a000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m28.228s user 0m0.210s sys 0m18.734s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8b7b90a3a000.batch_stats= snapshot_time: 1780389569.824357740 secs.nsecs start_time: 1780389534.361709084 secs.nsecs elapsed_time: 35.462648656 secs.nsecs subreqs per batch batches % cum % 1: 191 59 59 2: 29 9 68 4: 25 7 76 8: 10 3 79 16: 8 2 82 32: 19 5 88 64: 3 0 89 128: 0 0 89 256: 35 10 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8b7b90a3a000.statahead_batch_max=64 llite.lustre-ffff8b7b90a3a000.statahead_max=128