Hacker News new | past | comments | ask | show | jobs | submit login

it was never fair to call them stochastic parrots and anybody who is paying any attention knows that sequence models can generalize at least partially OOD



OOD = Out-of-Distribution = when a model encounters inputs which differ from data it was trained on.

For anyone else not familiar with the acronym of the day :).


Or equivalently, it vastly underestimates the intelligence of parrots


Anyone who has studied Monte Carlo methods and stochastic differential equations and their applications and stochastic algorithms never found “stochastic parrot” a pejorative. In a very real way determinism is a requirement for a small mind that can’t get comfortable or understand advanced probability theory and its application.


anyone who read the papers where the term was introduced knows it was clearly intended as a pejorative.

i’m not sure if you intended to call those upthread small-minded


Weird the section of people wanting fairness to LLMs.

If it makes you feel better, I'd say the Eliza Effect is good evidence human have a lot of "stochastic parrot" in them also. And there's no reason that being stochastic parrot means something can't generalize.

The thing with these terms is LLMs are distinctly new things. Even blind men looking at elephants can improve their performance with good terminology and by listening to each other. "Effective searchers", "question answers" and "stochastic parrots" are useful term just 'cause the describe concrete behaviors - notably "stochastic parrots" gives some idea of the "no particular goal" quality of LLMs (will happily be NAZIs, pacifists or communists given the proper context). On the other hand, "intelligent" gives no good clues since humans haven't really defined the term for themselves and it is a synonym for good, worthy or capable (giving the machine a prize rather than looking at it).


I don’t disagree with your comment, but if you read the papers where the term was introduced that is very clearly not what they have in mind with the phrase “stochastic parrot.”




Consider applying for YC's Summer 2025 batch! Applications are open till May 13

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: