== sanity test 123ad: Verify batching statahead works correctly ========================================================== 11:06:43 (1788880003) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9f7e1826b800.batch_stats=0 llite.lustre-ffff9f7e1826b800.statahead_max=32 llite.lustre-ffff9f7e1826b800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9f7e1826b800.batch_stats=0 total: 100 open/close in 0.59 seconds: 168.58 ops/second llite.lustre-ffff9f7e1826b800.statahead_max=0 101 real 0m0.561s user 0m0.005s sys 0m0.196s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9f7e1826b800.statahead_max=32 llite.lustre-ffff9f7e1826b800.statahead_max=32 101 real 0m0.338s user 0m0.003s sys 0m0.178s 'ls -l' 100 files with statahead: 1 sec statahead total: 98 statahead wrong: 2 agl total: 91 list_total: 29 fname_total: 60 hit_total: 13879 miss_total: 1677 swrong=2 ewrong=2 total: 900 open/close in 1.68 seconds: 534.98 ops/second llite.lustre-ffff9f7e1826b800.statahead_max=0 1001 real 0m5.650s user 0m0.021s sys 0m2.045s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff9f7e1826b800.statahead_max=32 llite.lustre-ffff9f7e1826b800.statahead_max=32 1001 real 0m3.535s user 0m0.018s sys 0m1.952s 'ls -l' 1000 files with statahead: 3 sec statahead total: 99 statahead wrong: 2 agl total: 92 list_total: 30 fname_total: 60 hit_total: 14878 miss_total: 1678 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff9f7e1826b800.statahead_stats= statahead total: 99 statahead wrong: 2 agl total: 92 list_total: 30 fname_total: 60 hit_total: 14878 miss_total: 1678 mdc.lustre-MDT0000-mdc-ffff9f7e1826b800.batch_stats= snapshot_time: 1788880027.703623173 secs.nsecs start_time: 1788880004.955356136 secs.nsecs elapsed_time: 22.748267037 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 4160 (time 1788880038.51 total 10.00 last 415.93) - open/close 9161 (time 1788880048.51 total 20.00 last 499.99) total: 10000 open/close in 21.85 seconds: 457.62 ops/second llite.lustre-ffff9f7e1826b800.statahead_batch_max=0 llite.lustre-ffff9f7e1826b800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9f7e1826b800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m27.744s user 0m0.149s sys 0m26.754s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9f7e1826b800.statahead_batch_max=32 llite.lustre-ffff9f7e1826b800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9f7e1826b800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9f7e1826b800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.260s user 0m0.155s sys 0m16.929s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9f7e1826b800.batch_stats= snapshot_time: 1788880115.751860998 secs.nsecs start_time: 1788880080.530925981 secs.nsecs elapsed_time: 35.220935017 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9f7e1826b800.batch_stats=0 llite.lustre-ffff9f7e1826b800.statahead_max=2048 llite.lustre-ffff9f7e1826b800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9f7e1826b800.batch_stats=0 total: 100 open/close in 0.54 seconds: 186.32 ops/second llite.lustre-ffff9f7e1826b800.statahead_max=0 101 real 0m0.514s user 0m0.002s sys 0m0.194s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff9f7e1826b800.statahead_max=2048 llite.lustre-ffff9f7e1826b800.statahead_max=2048 101 real 0m0.452s user 0m0.002s sys 0m0.250s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 2.16 seconds: 417.19 ops/second llite.lustre-ffff9f7e1826b800.statahead_max=0 1001 real 0m5.979s user 0m0.020s sys 0m2.179s 'ls -l' 1000 files without statahead: 5 sec llite.lustre-ffff9f7e1826b800.statahead_max=2048 llite.lustre-ffff9f7e1826b800.statahead_max=2048 1001 real 0m4.096s user 0m0.014s sys 0m2.384s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 - open/close 4380 (time 1788880222.57 total 10.00 last 437.87) - open/close 8702 (time 1788880232.57 total 20.00 last 432.18) total: 9000 open/close in 20.69 seconds: 434.90 ops/second llite.lustre-ffff9f7e1826b800.statahead_max=0 10001 real 0m59.010s user 0m0.228s sys 0m21.019s 'ls -l' 10000 files without statahead: 59 sec llite.lustre-ffff9f7e1826b800.statahead_max=2048 llite.lustre-ffff9f7e1826b800.statahead_max=2048 10001 real 0m27.359s user 0m0.156s sys 0m19.619s 'ls -l' 10000 files with statahead: 27 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21096 miss_total: 4 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 66 seconds llite.lustre-ffff9f7e1826b800.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21096 miss_total: 4 mdc.lustre-MDT0000-mdc-ffff9f7e1826b800.batch_stats= snapshot_time: 1788880395.837852746 secs.nsecs start_time: 1788880116.477496248 secs.nsecs elapsed_time: 279.360356498 secs.nsecs subreqs per batch batches %% cum %% 1: 96 45 45 2: 32 15 60 4: 9 4 65 8: 3 1 66 16: 3 1 68 32: 25 11 80 64: 1 0 80 128: 1 0 80 256: 40 19 100 - open/close 4504 (time 1788880406.63 total 10.00 last 450.31) - open/close 9015 (time 1788880416.63 total 20.00 last 451.07) total: 10000 open/close in 22.35 seconds: 447.48 ops/second llite.lustre-ffff9f7e1826b800.statahead_batch_max=0 llite.lustre-ffff9f7e1826b800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9f7e1826b800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.543s user 0m0.172s sys 0m31.680s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9f7e1826b800.statahead_batch_max=256 llite.lustre-ffff9f7e1826b800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9f7e1826b800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9f7e1826b800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m26.165s user 0m0.151s sys 0m20.349s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9f7e1826b800.batch_stats= snapshot_time: 1788880489.969743102 secs.nsecs start_time: 1788880459.188431601 secs.nsecs elapsed_time: 30.781311501 secs.nsecs subreqs per batch batches %% cum %% 1: 185 60 60 2: 36 11 71 4: 18 5 77 8: 5 1 79 16: 1 0 79 32: 25 8 87 64: 3 0 88 128: 0 0 88 256: 35 11 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9f7e1826b800.statahead_batch_max=64 llite.lustre-ffff9f7e1826b800.statahead_max=128