== sanity test 123ad: Verify batching statahead works correctly ========================================================== 03:52:00 (1788335520) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffffa07c18593800.batch_stats=0 llite.lustre-ffffa07c18593800.statahead_max=32 llite.lustre-ffffa07c18593800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffffa07c18593800.batch_stats=0 total: 100 open/close in 2.85 seconds: 35.06 ops/second llite.lustre-ffffa07c18593800.statahead_max=0 101 real 0m1.808s user 0m0.004s sys 0m0.312s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffffa07c18593800.statahead_max=32 llite.lustre-ffffa07c18593800.statahead_max=32 101 real 0m1.149s user 0m0.006s sys 0m0.186s 'ls -l' 100 files with statahead: 2 sec statahead total: 131 statahead wrong: 2 agl total: 117 list_total: 30 fname_total: 82 hit_total: 4066 miss_total: 1751 swrong=2 ewrong=2 - open/close 847 (time 1788335546.66 total 10.00 last 84.69) total: 900 open/close in 10.75 seconds: 83.71 ops/second llite.lustre-ffffa07c18593800.statahead_max=0 1001 real 0m18.332s user 0m0.038s sys 0m2.788s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffffa07c18593800.statahead_max=32 llite.lustre-ffffa07c18593800.statahead_max=32 1001 real 0m7.776s user 0m0.021s sys 0m1.354s 'ls -l' 1000 files with statahead: 8 sec statahead total: 132 statahead wrong: 2 agl total: 118 list_total: 31 fname_total: 82 hit_total: 5064 miss_total: 1753 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 16 seconds llite.lustre-ffffa07c18593800.statahead_stats= statahead total: 132 statahead wrong: 2 agl total: 118 list_total: 31 fname_total: 82 hit_total: 5064 miss_total: 1753 mdc.lustre-MDT0000-mdc-ffffa07c18593800.batch_stats= snapshot_time: 1788335599.679115735 secs.nsecs start_time: 1788335525.345334506 secs.nsecs elapsed_time: 74.333781229 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 810 (time 1788335611.63 total 10.01 last 80.92) - open/close 1496 (time 1788335621.64 total 20.02 last 68.53) - open/close 2305 (time 1788335631.66 total 30.04 last 80.77) - open/close 3008 (time 1788335641.66 total 40.04 last 70.25) - open/close 3802 (time 1788335651.67 total 50.05 last 79.33) - open/close 4588 (time 1788335661.68 total 60.06 last 78.55) - open/close 5358 (time 1788335671.69 total 70.07 last 76.92) - open/close 6123 (time 1788335681.70 total 80.08 last 76.44) - open/close 6865 (time 1788335691.71 total 90.09 last 74.11) - open/close 7582 (time 1788335701.72 total 100.10 last 71.65) - open/close 8393 (time 1788335711.73 total 110.11 last 81.00) - open/close 9145 (time 1788335721.74 total 120.12 last 75.15) - open/close 9835 (time 1788335731.75 total 130.13 last 68.90) total: 10000 open/close in 132.19 seconds: 75.65 ops/second llite.lustre-ffffa07c18593800.statahead_batch_max=0 llite.lustre-ffffa07c18593800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa07c18593800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m53.288s user 0m0.332s sys 0m14.440s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffffa07c18593800.statahead_batch_max=32 llite.lustre-ffffa07c18593800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa07c18593800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffffa07c18593800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m16.504s user 0m0.260s sys 0m12.459s batched statahead RPC= hit count=9986 mdc.lustre-MDT0000-mdc-ffffa07c18593800.batch_stats= snapshot_time: 1788335879.659700054 secs.nsecs start_time: 1788335793.829423788 secs.nsecs elapsed_time: 85.830276266 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffffa07c18593800.batch_stats=0 llite.lustre-ffffa07c18593800.statahead_max=2048 llite.lustre-ffffa07c18593800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffffa07c18593800.batch_stats=0 total: 100 open/close in 1.64 seconds: 61.10 ops/second llite.lustre-ffffa07c18593800.statahead_max=0 101 real 0m1.465s user 0m0.008s sys 0m0.267s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffffa07c18593800.statahead_max=2048 llite.lustre-ffffa07c18593800.statahead_max=2048 101 real 0m0.625s user 0m0.003s sys 0m0.183s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10085 miss_total: 15 swrong=0 ewrong=0 total: 900 open/close in 9.06 seconds: 99.32 ops/second llite.lustre-ffffa07c18593800.statahead_max=0 1001 real 0m15.292s user 0m0.027s sys 0m2.678s 'ls -l' 1000 files without statahead: 15 sec llite.lustre-ffffa07c18593800.statahead_max=2048 llite.lustre-ffffa07c18593800.statahead_max=2048 1001 real 0m4.040s user 0m0.017s sys 0m1.247s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 14 seconds llite.lustre-ffffa07c18593800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 mdc.lustre-MDT0000-mdc-ffffa07c18593800.batch_stats= snapshot_time: 1788336158.953859736 secs.nsecs start_time: 1788335882.035531057 secs.nsecs elapsed_time: 276.918328679 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 1 9 54 128: 1 9 63 256: 4 36 100 - open/close 939 (time 1788336170.98 total 10.02 last 93.68) - open/close 2028 (time 1788336180.99 total 20.03 last 108.86) - open/close 3251 (time 1788336190.99 total 30.03 last 122.25) - open/close 4328 (time 1788336201.00 total 40.04 last 107.59) - open/close 5342 (time 1788336211.00 total 50.05 last 101.35) - open/close 6396 (time 1788336221.01 total 60.05 last 105.38) - open/close 7430 (time 1788336231.01 total 70.05 last 103.36) - open/close 8453 (time 1788336241.01 total 80.05 last 102.29) - open/close 9651 (time 1788336251.02 total 90.06 last 119.74) total: 10000 open/close in 92.82 seconds: 107.73 ops/second llite.lustre-ffffa07c18593800.statahead_batch_max=0 llite.lustre-ffffa07c18593800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa07c18593800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.009s user 0m0.264s sys 0m17.277s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffffa07c18593800.statahead_batch_max=256 llite.lustre-ffffa07c18593800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa07c18593800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffffa07c18593800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.242s user 0m0.235s sys 0m14.132s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffffa07c18593800.batch_stats= snapshot_time: 1788336331.815837358 secs.nsecs start_time: 1788336294.373071084 secs.nsecs elapsed_time: 37.442766274 secs.nsecs subreqs per batch batches %% cum %% 1: 157 51 51 2: 31 10 62 4: 33 10 73 8: 12 3 77 16: 11 3 80 32: 17 5 86 64: 6 1 88 128: 0 0 88 256: 35 11 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffffa07c18593800.statahead_batch_max=64 llite.lustre-ffffa07c18593800.statahead_max=128