. . "More particularly, the sequence of text symbols entering the tokenizer may include letters, numbers, punctuation and other symbols, and spaces." . . .