...helping clients in complex environments make better decisions, faster.

CALL NOW: 404.898.9096

info@decisionclarityconsulting.com

Posts Tagged ‘Faulty Research’

Fairy tales masquerading as evidence

Science bible stories, take 27 by Mark Liberman is a useful discussion (including in the comments) about the tendency of media to take up a topical research paper without regard to the methodological robustness of the study or whether the results are meaningfully true.

As I observed a few years ago, “scientific studies”  have taken over the place that bible stories used to occupy. It’s only fundamentalists like me who worry about whether they’re true. For most people, it’s enough that they can be interpreted to be morally instructive.

[snip]

I’d add a third important factor: by and large, the “wise men” (and now the “wise women”) don’t really care about whether the empirical and theoretical foundations of their opinions are sound . They care about readers, ratings, and reputation — and in some cases about political outcomes or cultural values —  with truth relevant only insofar as it affects those goals.

I think Liberman is correct.  People rarely consider what evidence they need in order to make an argument, instead they go after information that is convenient to get.  At the same time, the market structure for ideas and information is such that there are incentives to produce affirming information to a range of prejudices, regardless of the truth of the matter.  Elsewhere I refer to this as cognitive pollution as it constitutes dirt in the system that tends to occlude rather than clarify.

RELATED:  The culturomic psychology of urbanization by Mark Liberman

Decision Clarity Consulting has no affiliation with the Scheier Group, owner of the DECISION CLARITY®, and the Scheier Group does not sponsor, endorse, or control any material on this site. Decision Clarity Consulting, in accordance with an agreement with Scheier Group, performs no work with non-profit or government entities.