How does that explain why the tokens for strawberry, melon and "Stellaberry" [1]... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

abdullahkhalids 9 months ago | parent | context | favorite | on: Large Enough

How does that explain why the tokens for strawberry, melon and "Stellaberry" [1] are close to each other?

[1] Suggestion from chatgpt3.5 for new fruit name.

roywiggins 9 months ago [–]

Illiterate humans can come up with new words like that too without being able to spell, LLMs are modeling language without precisely modeling spelling.

Join us for AI Startup School this June 16-17 in San Francisco!
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact