Not letters, but tokens. Think that it's translating everything to/from Chinese. | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

mirekrusin 9 months ago | parent | context | favorite | on: Large Enough

Not letters, but tokens. Think that it's translating everything to/from Chinese.

abdullahkhalids 9 months ago [–]

How does that explain why the tokens for strawberry, melon and "Stellaberry" [1] are close to each other?

[1] Suggestion from chatgpt3.5 for new fruit name.

roywiggins 9 months ago | [–]

Illiterate humans can come up with new words like that too without being able to spell, LLMs are modeling language without precisely modeling spelling.

Join us for AI Startup School this June 16-17 in San Francisco!
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact