As we learn in a later flashback, he was denied the closure and satisfaction of murder Joe Chill and so he has put himself in a position where he is guaranteed to be accosted by criminals on a daily basis; he can exact what he believes is the closest thing to vengeance he is ever likely to have.