the delivery is all in the final paragraph: <i>I strongly believe that identifying reliable research is not the main problem in social science today. The real issue is making sure unreliable research is not produced in the first place, and if it is produced, to make sure it does not receive money and citations. And for that you have to change The Incentives.</i><p>The actual modelling and stats discussions are fascinating. Scarily on point for me: Many of these papers would have been bounced if the reviewers did their work as well as this participant. So, when they say the $10k wasn't motivating, I wonder what would be to address the problem. Probably... Tenure risks for bad reviewing (bad as in lazy). Since negative motivations are worserer than positive ones, Somebody has to re-couch that in a net positive. "If you do a good job of gatekeeping crap from the peer review stream, we'll value you as highly as an author when it comes to renumeration and tenure and positional authority roles"