== sanity test 123ad: Verify batching statahead works correctly ========================================================== 00:26:42 (1788841602) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff918cd3251800.batch_stats=0 llite.lustre-ffff918cd3251800.statahead_max=32 llite.lustre-ffff918cd3251800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff918cd3251800.batch_stats=0 total: 100 open/close in 2.54 seconds: 39.42 ops/second llite.lustre-ffff918cd3251800.statahead_max=0 101 real 0m2.160s user 0m0.004s sys 0m0.311s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff918cd3251800.statahead_max=32 llite.lustre-ffff918cd3251800.statahead_max=32 101 real 0m0.865s user 0m0.006s sys 0m0.141s 'ls -l' 100 files with statahead: 1 sec statahead total: 128 statahead wrong: 2 agl total: 121 list_total: 30 fname_total: 81 hit_total: 3666 miss_total: 1446 swrong=2 ewrong=2 - open/close 768 (time 1788841628.88 total 10.00 last 76.79) total: 900 open/close in 12.00 seconds: 75.01 ops/second llite.lustre-ffff918cd3251800.statahead_max=0 1001 real 0m20.522s user 0m0.035s sys 0m2.879s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff918cd3251800.statahead_max=32 llite.lustre-ffff918cd3251800.statahead_max=32 1001 real 0m9.141s user 0m0.027s sys 0m1.395s 'ls -l' 1000 files with statahead: 9 sec statahead total: 129 statahead wrong: 2 agl total: 122 list_total: 31 fname_total: 81 hit_total: 4664 miss_total: 1448 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff918cd3251800.statahead_stats= statahead total: 129 statahead wrong: 2 agl total: 122 list_total: 31 fname_total: 81 hit_total: 4664 miss_total: 1448 mdc.lustre-MDT0000-mdc-ffff918cd3251800.batch_stats= snapshot_time: 1788841695.417581112 secs.nsecs start_time: 1788841607.161212397 secs.nsecs elapsed_time: 88.256368715 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 731 (time 1788841707.78 total 10.01 last 73.03) - open/close 1430 (time 1788841717.80 total 20.03 last 69.77) - open/close 2165 (time 1788841727.80 total 30.03 last 73.47) - open/close 2901 (time 1788841737.81 total 40.04 last 73.56) - open/close 3657 (time 1788841747.84 total 50.07 last 75.36) - open/close 4352 (time 1788841757.84 total 60.07 last 69.48) - open/close 5148 (time 1788841767.84 total 70.07 last 79.58) - open/close 5909 (time 1788841777.86 total 80.09 last 76.01) - open/close 6639 (time 1788841787.86 total 90.09 last 72.96) - open/close 7340 (time 1788841797.87 total 100.10 last 70.06) - open/close 8072 (time 1788841807.87 total 110.10 last 73.20) - open/close 8878 (time 1788841817.87 total 120.10 last 80.58) - open/close 9636 (time 1788841827.88 total 130.11 last 75.74) total: 10000 open/close in 135.20 seconds: 73.97 ops/second llite.lustre-ffff918cd3251800.statahead_batch_max=0 llite.lustre-ffff918cd3251800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff918cd3251800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m59.612s user 0m0.338s sys 0m14.907s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff918cd3251800.statahead_batch_max=32 llite.lustre-ffff918cd3251800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff918cd3251800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff918cd3251800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m45.558s user 0m0.308s sys 0m13.323s batched statahead RPC= hit count=9982 mdc.lustre-MDT0000-mdc-ffff918cd3251800.batch_stats= snapshot_time: 1788842016.129482226 secs.nsecs start_time: 1788841900.401716560 secs.nsecs elapsed_time: 115.727765666 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff918cd3251800.batch_stats=0 llite.lustre-ffff918cd3251800.statahead_max=2048 llite.lustre-ffff918cd3251800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff918cd3251800.batch_stats=0 total: 100 open/close in 2.49 seconds: 40.08 ops/second llite.lustre-ffff918cd3251800.statahead_max=0 101 real 0m2.346s user 0m0.005s sys 0m0.302s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff918cd3251800.statahead_max=2048 llite.lustre-ffff918cd3251800.statahead_max=2048 101 real 0m0.686s user 0m0.006s sys 0m0.157s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10081 miss_total: 19 swrong=0 ewrong=0 - open/close 745 (time 1788842327.30 total 10.00 last 74.47) total: 900 open/close in 12.10 seconds: 74.39 ops/second llite.lustre-ffff918cd3251800.statahead_max=0 1001 real 0m26.469s user 0m0.046s sys 0m2.832s 'ls -l' 1000 files without statahead: 26 sec llite.lustre-ffff918cd3251800.statahead_max=2048 llite.lustre-ffff918cd3251800.statahead_max=2048 1001 real 0m5.221s user 0m0.026s sys 0m1.289s 'ls -l' 1000 files with statahead: 5 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff918cd3251800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 mdc.lustre-MDT0000-mdc-ffff918cd3251800.batch_stats= snapshot_time: 1788842393.639135105 secs.nsecs start_time: 1788842018.262421323 secs.nsecs elapsed_time: 375.376713782 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 760 (time 1788842405.92 total 10.02 last 75.88) - open/close 1535 (time 1788842415.92 total 20.02 last 77.47) - open/close 2267 (time 1788842425.93 total 30.03 last 73.12) - open/close 3024 (time 1788842435.94 total 40.04 last 75.64) - open/close 3625 (time 1788842445.96 total 50.06 last 60.00) - open/close 4384 (time 1788842455.97 total 60.06 last 75.83) - open/close 5212 (time 1788842465.97 total 70.07 last 82.79) - open/close 5952 (time 1788842475.97 total 80.07 last 73.97) - open/close 6687 (time 1788842485.98 total 90.07 last 73.48) - open/close 7441 (time 1788842495.98 total 100.08 last 75.37) - open/close 8145 (time 1788842505.99 total 110.08 last 70.35) - open/close 8827 (time 1788842515.99 total 120.09 last 68.17) - open/close 9564 (time 1788842526.00 total 130.09 last 73.68) total: 10000 open/close in 136.51 seconds: 73.26 ops/second llite.lustre-ffff918cd3251800.statahead_batch_max=0 llite.lustre-ffff918cd3251800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff918cd3251800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m5.607s user 0m0.324s sys 0m15.067s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff918cd3251800.statahead_batch_max=256 llite.lustre-ffff918cd3251800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff918cd3251800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff918cd3251800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.980s user 0m0.299s sys 0m15.048s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff918cd3251800.batch_stats= snapshot_time: 1788842664.690895002 secs.nsecs start_time: 1788842608.101549326 secs.nsecs elapsed_time: 56.589345676 secs.nsecs subreqs per batch batches %% cum %% 1: 110 44 44 2: 26 10 55 4: 18 7 62 8: 23 9 71 16: 16 6 78 32: 12 4 83 64: 5 2 85 128: 1 0 85 256: 35 14 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff918cd3251800.statahead_batch_max=64 llite.lustre-ffff918cd3251800.statahead_max=128