"The right of suffrage is not, in law, one of the privileges or immunities thus secured by the Constitution." . . . . .