I am inclined to say that worn items that carry a conventional symbolic message -- black armbands, colored cockades in one's hat in the late 1790s, jewelry that contains religious or other symbols -- are likewise protected by the freedom of speech, both as a matter of doctrine and of original meaning.