Apart from the fact that he is not particularly bright (telegraphing the location of your greatest weakness, even for the sake of setting up an ambush, is just not the done thing), he is also not all that fast: we saw in the first fight in the vineyard that Buffy, after she recovered from her initial clobbering, had some success at dodging Caleb's blows when she went at him again, prefiguring the ap