A Propaganda Index for Reviewing Problem Framing in Articles and Manuscripts: An Exploratory Study, 2011, Gambrill & Reiman

[Dolphin]

A Propaganda Index for Reviewing Problem Framing in Articles and Manuscripts: An Exploratory Study

Objective To determine the effectiveness of an index in increasing recognition of misleading problem framing in articles and manuscripts. Design A propaganda index consisting of 32 items was developed drawing on related literature. Seventeen subjects who review manuscripts for possible...

journals.plos.org

Citation: Gambrill E, Reiman A (2011) A Propaganda Index for Reviewing Problem Framing in Articles and Manuscripts: An Exploratory Study. PLoS ONE 6(5): e19516. https://doi.org/10.1371/journal.pone.0019516

Abstract​

Objective​

To determine the effectiveness of an index in increasing recognition of misleading problem framing in articles and manuscripts.

Design​

A propaganda index consisting of 32 items was developed drawing on related literature. Seventeen subjects who review manuscripts for possible publication were requested to read five recent published reports of randomized controlled trials concerning social anxiety and to identify indicators of propaganda (defined as encouraging beliefs and actions with the least thought possible). They then re-read the same five articles using a propaganda index to note instances of propaganda.

Data source​

Convenience sample of individuals who review manuscripts for possible publication and sample of recent published reports of randomized controlled trials regarding social anxiety in five different journals by different authors, blinded by author and journal.

Results​

Data showed that there was a high rate of propagandistic problem framing in reports of RCTs regarding social anxiety such as hiding well argued alternative views and vagueness. This occurred in 117 out of 160 opportunities over five research reports. A convenience sample of 17 academics spotted only 4.5 percent of propaganda indicators. This increased to 64 percent with use of the 32 item propaganda index. Use of a propaganda index increased recognition of related indicators. However many instances remained undetected.

Conclusion​

This propaganda index warrants further exploration as a complement to reporting guidelines such as CONSORT and PRISMA.

 

[bobbler]

Good this sort of idea is starting to be developed

If done well it feels the way to get the message across as a wake up call to those caught in a can’t beat em join em change of the norm

Hope it doesn’t get twisted by others, a la other systems have etc

 

[Trish]

This article is from 14 years ago. Any idea whether there has been any follow up? I am noticing increasingly medical papers have catchy clickbaity headings, and there is still plenty of conclusions unsupported by evidence, such as correlation-causation interpretation to suit prejudices.