Kahneman: “I placed too much faith in underpowered studies”

http://retractionwatch.com/2017/02/20/placed-much-faith-underpowered-studies-nobel-prize-winner-admits-mistakes/ Kahneman responded: The argument is inescapable: Studies that are underpowered for the detection of plausible effects must occasionally return non-significant results even when the research hypothesis is true – the absence of these results is evidence that something is amiss in the published record. Furthermore, the existence of a substantial file-drawer effect undermines the…

Psychology is broken

Now, a painstaking yearslong effort to reproduce 100 studies published in three leading psychology journals has found that more than half of the findings did not hold up when retested. The analysis was done by research psychologists, many of whom volunteered their time to double-check what they considered important work. Their conclusions, reported Thursday in…

Science isn’t broken

If you follow the headlines, your confidence in science may have taken a hit lately. Peer review? More like self-review. An investigation in November uncovered a scam in which researchers were rubber-stamping their own work, circumventing peer review at five high-profile publishers. Scientific journals? Not exactly a badge of legitimacy, given that the International Journal…

A scientific look at bad science

This is why replication is so vital, wouldn’t you agree Paul? A study in the Proceedings of the National Academy of Sciences reviewed 2,047 retractions of biomedical and life-sciences articles and found that just 21.3 percent stemmed from straightforward error, while 67.4 percent resulted from misconduct, including fraud or suspected fraud (43.4 percent) and plagiarism…

Scientists are hoarding data and it’s ruining medical research

Paul Attewell, are you paying attention? This “deworm everybody” approach has been driven by a single, hugely influential trial published in 2004 by two economists, Edward Miguel and Michael Kremer. This trial, done in Kenya, found that deworming whole schools improved children’s health, school performance, and school attendance. What’s more, these benefits apparently extended to…

Seminal campus rape study debunked

Yet another shoddy paper falls apart under scrutiny. David Lisak’s serial predator theory of campus rape has made him a celebrity. Once a virtually unknown associate professor at the University of Massachusetts-Boston, his work is now cited by White House officials and reporters for major newspapers. His influence is evident in the recent documentary The…

Replication issues hit ethnography: did Goffman make up her book?

On the Run is the story of sociologist Alice Goffman’s six years of immersion in a struggling Philadelphia neighborhood, in which she tells the stories of the “routine stops, searches, raids, and beatings that young men navigate as they come of age.” The book was initially hailed as an ethnographic classic, but to me it raised…