Hacker News new | past | comments | ask | show | jobs | submit login

The psychology replication crisis is much worse than any other field.

http://slatestarcodex.com/2015/09/05/if-you-cant-make-predic...




>The psychology replication crisis is much worse than any other field.

The article doesn't get into this.

Coming from a physics background, I will not say there's a crisis, but:

1. Few research is replicated.

2. We who did physics research were very unconcerned about whether our results could be replicated. Our journal papers were very concise, and it was common practice not to give all the details needed to replicate, partially due to paper size concerns, but very often also to keep the "secret recipe" to ourselves as a means to prevent others from conducting future research that we want to conduct (need less competition for grant money).

3. Pick any researcher in any field of physics, and ask them: "Can you list a few papers published in the last 15 years that are highly cited that you think are completely wrong?" Everyone will have a list like that. Everyone.


>keep the "secret recipe" to ourselves >Everyone will have a list like that

You and/or your publishers are terrible human beings.


>You and/or your publishers are terrible human beings.

Eh? Not sure why. Because we have a list of papers we don't believe? It would be naive to believe everything that is published.

I don't like the notion of withholding information, and personally I would not like to accept any paper that does that, but I'm merely stating the norm in the field.

You still have to contend with journal size restrictions. A paper in Physical Review Letters needs to be less than 3 pages. You simply cannot put in enough detail for replication in there. Nature has a page limit of 5.


Maybe I was wrong but here are the reasons for the condemnation

1. propagating falsehoods, or flaws in published work without correcting or refuting their validity, claims etc. by your strong admission that everyone knows of such work (which is subsequently used and cited) yet "completely wrong" there must be so much crap getting published. but there is disinclination to do anything about it

2. witholding of information necessary for reproducing results of experiments as a means of discouraging co-operation with peers you view as rivals or adversaries.

The second is really serious because it effectively subverts the scientific method, undermining scientific consensus and progress. That these are "norms in the field" means nothing save for everybody's indifference and lack of cooperation.

Is the above correct?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: