> Imho there is no winning strategy for Nethack. It's some random stuff "you need to know" to progress even a little bit paired with complete rule of the dice while encountering maximally nonsensical "puzzles".

In the training data for the LLMs there is probably a significant of information about Nethack already, I would think.

So with the right prompt perhaps it could play better than some people, if those people did not have any info about nethack and had not played it before.