"his State or loyalty to the Union was a question concerning" . . . .