HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by astrange | Hacker News Reader
Parent
Full thread
astrange
·
No, a token is not a word.
View on HN
qsera
·
I mean, it is some text.
astrange
·
How do you get from a piece of text smaller than a word to an entire coherent sentence?
Reply on news.ycombinator.com