== sanity test 123ad: Verify batching statahead works correctly ========================================================== 01:42:02 (1788586922) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9fc559042800.batch_stats=0 llite.lustre-ffff9fc559042800.statahead_max=32 llite.lustre-ffff9fc559042800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9fc559042800.batch_stats=0 total: 100 open/close in 2.33 seconds: 42.98 ops/second llite.lustre-ffff9fc559042800.statahead_max=0 101 real 0m1.908s user 0m0.003s sys 0m0.286s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9fc559042800.statahead_max=32 llite.lustre-ffff9fc559042800.statahead_max=32 101 real 0m1.212s user 0m0.001s sys 0m0.201s 'ls -l' 100 files with statahead: 1 sec statahead total: 132 statahead wrong: 1 agl total: 126 list_total: 35 fname_total: 86 hit_total: 3802 miss_total: 257 swrong=1 ewrong=1 - open/close 809 (time 1788586949.92 total 10.00 last 80.86) total: 900 open/close in 11.47 seconds: 78.46 ops/second llite.lustre-ffff9fc559042800.statahead_max=0 1001 real 0m18.982s user 0m0.036s sys 0m2.694s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff9fc559042800.statahead_max=32 llite.lustre-ffff9fc559042800.statahead_max=32 1001 real 0m8.419s user 0m0.023s sys 0m1.335s 'ls -l' 1000 files with statahead: 8 sec statahead total: 133 statahead wrong: 1 agl total: 127 list_total: 36 fname_total: 86 hit_total: 4797 miss_total: 262 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 16 seconds llite.lustre-ffff9fc559042800.statahead_stats= statahead total: 133 statahead wrong: 1 agl total: 127 list_total: 36 fname_total: 86 hit_total: 4797 miss_total: 262 mdc.lustre-MDT0000-mdc-ffff9fc559042800.batch_stats= snapshot_time: 1788587007.644934740 secs.nsecs start_time: 1788586927.563869912 secs.nsecs elapsed_time: 80.081064828 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 899 (time 1788587019.60 total 10.00 last 89.89) - open/close 1840 (time 1788587029.61 total 20.01 last 94.04) - open/close 2719 (time 1788587039.61 total 30.01 last 87.86) - open/close 3456 (time 1788587049.61 total 40.01 last 73.70) - open/close 4262 (time 1788587059.62 total 50.02 last 80.57) - open/close 5171 (time 1788587069.63 total 60.03 last 90.81) - open/close 5987 (time 1788587079.63 total 70.03 last 81.57) - open/close 6759 (time 1788587089.63 total 80.03 last 77.18) - open/close 7690 (time 1788587099.64 total 90.04 last 93.06) - open/close 8576 (time 1788587109.64 total 100.04 last 88.57) - open/close 9470 (time 1788587119.66 total 110.06 last 89.27) total: 10000 open/close in 115.93 seconds: 86.26 ops/second llite.lustre-ffff9fc559042800.statahead_batch_max=0 llite.lustre-ffff9fc559042800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9fc559042800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m58.777s user 0m0.273s sys 0m13.484s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9fc559042800.statahead_batch_max=32 llite.lustre-ffff9fc559042800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9fc559042800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9fc559042800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m36.499s user 0m0.295s sys 0m12.957s batched statahead RPC= hit count=9983 mdc.lustre-MDT0000-mdc-ffff9fc559042800.batch_stats= snapshot_time: 1788587299.558043764 secs.nsecs start_time: 1788587192.163944112 secs.nsecs elapsed_time: 107.394099652 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9fc559042800.batch_stats=0 llite.lustre-ffff9fc559042800.statahead_max=2048 llite.lustre-ffff9fc559042800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9fc559042800.batch_stats=0 total: 100 open/close in 2.37 seconds: 42.20 ops/second llite.lustre-ffff9fc559042800.statahead_max=0 101 real 0m1.982s user 0m0.001s sys 0m0.311s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9fc559042800.statahead_max=2048 llite.lustre-ffff9fc559042800.statahead_max=2048 101 real 0m0.878s user 0m0.003s sys 0m0.162s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10082 miss_total: 18 swrong=0 ewrong=0 - open/close 841 (time 1788587576.45 total 10.01 last 84.05) total: 900 open/close in 10.98 seconds: 82.00 ops/second llite.lustre-ffff9fc559042800.statahead_max=0 1001 real 0m21.239s user 0m0.034s sys 0m2.923s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff9fc559042800.statahead_max=2048 llite.lustre-ffff9fc559042800.statahead_max=2048 1001 real 0m6.460s user 0m0.036s sys 0m1.230s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff9fc559042800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 mdc.lustre-MDT0000-mdc-ffff9fc559042800.batch_stats= snapshot_time: 1788587638.087681260 secs.nsecs start_time: 1788587302.387019540 secs.nsecs elapsed_time: 335.700661720 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 1 9 54 128: 1 9 63 256: 4 36 100 - open/close 700 (time 1788587651.58 total 10.00 last 69.99) - open/close 1583 (time 1788587661.58 total 20.01 last 88.24) - open/close 2447 (time 1788587671.59 total 30.01 last 86.35) - open/close 3307 (time 1788587681.61 total 40.03 last 85.83) - open/close 4074 (time 1788587691.61 total 50.04 last 76.67) - open/close 4908 (time 1788587701.62 total 60.04 last 83.35) - open/close 5775 (time 1788587711.63 total 70.05 last 86.63) - open/close 6667 (time 1788587721.64 total 80.06 last 89.13) - open/close 7434 (time 1788587731.65 total 90.07 last 76.61) - open/close 8200 (time 1788587741.65 total 100.08 last 76.57) - open/close 9053 (time 1788587751.65 total 110.08 last 85.30) - open/close 9795 (time 1788587761.67 total 120.10 last 74.06) total: 10000 open/close in 122.97 seconds: 81.32 ops/second llite.lustre-ffff9fc559042800.statahead_batch_max=0 llite.lustre-ffff9fc559042800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9fc559042800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.737s user 0m0.294s sys 0m13.458s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9fc559042800.statahead_batch_max=256 llite.lustre-ffff9fc559042800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9fc559042800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9fc559042800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m44.011s user 0m0.279s sys 0m12.965s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9fc559042800.batch_stats= snapshot_time: 1788587881.474640984 secs.nsecs start_time: 1788587827.597937158 secs.nsecs elapsed_time: 53.876703826 secs.nsecs subreqs per batch batches %% cum %% 1: 104 44 44 2: 23 9 53 4: 25 10 64 8: 15 6 70 16: 13 5 76 32: 15 6 82 64: 3 1 83 128: 4 1 85 256: 34 14 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9fc559042800.statahead_batch_max=64 llite.lustre-ffff9fc559042800.statahead_max=128