Blog: Andrew Gelman, "However noble the goal, research findings should be reported accurately......"

Andy · Jan 9, 2018

Not directly about ME but discuss problems we commonly face, in regard to reporting on research results.

Title:“However noble the goal, research findings should be reported accurately. Distortion of results often occurs not in the data presented but . . . in the abstract, discussion, secondary literature and press releases. Such distortion can lead to unsupported beliefs about what works for obesity treatment and prevention. Such unsupported beliefs may in turn adversely affect future research efforts and the decisions of lawmakers, clinicians and public health leaders.”

David Allison points us to this article by Bryan McComb, Alexis Frazier-Wood, John Dawson, and himself, “Drawing conclusions from within-group comparisons and selected subsets of data leads to unsubstantiated conclusions.” It’s a letter to the editor for the Australian and New Zealand Journal of Public Health, and it begins:

[In the paper, “School-based systems change for obesity prevention in adolescents: Outcomes of the Australian Capital Territory ‘It’s Your Move!’”] Malakellis et al. conducted an ambitious quasi-experimental evaluation of “multiple initiatives at [the] individual, community, and school policy level to support healthier nutrition and physical activity” among children.1 In the Abstract they concluded, “There was some evidence of effectiveness of the systems approach to preventing obesity among adolescents” and cited implications for public health as follows: “These findings demonstrate that the use of systems methods can be effective on a small scale.” Given the importance of reducing childhood obesity, news of an effective program is welcome. Unfortunately, the data and analyses do not support the conclusions.
.......
Spin can distort the scientific record and mislead the public

Although Malakellis et al. may have presented their data accurately, by including statements of effectiveness based on a within-group test instead of relying on the proper between-group test, the article did not represent the findings accurately. The goal of reducing childhood obesity is a noble one. . . . However noble the goal, research findings should be reported accurately. Distortion of results often occurs not in the data presented but, as in the current article, in the abstract, discussion, secondary literature and press releases. Such distortion can lead to unsupported beliefs about what works for obesity treatment and prevention. Such unsupported beliefs may in turn adversely affect future research efforts and the decisions of lawmakers, clinicians and public health leaders.
Click to expand...

http://andrewgelman.com/2018/01/07/...d-abstract-discussion-secondary-literature-p/

Log in or Sign up

Blog: Andrew Gelman, "However noble the goal, research findings should be reported accurately......"

Andy Committee Member & Outreach

Share This Page

Log in or Sign up

Blog: Andrew Gelman, "However noble the goal, research findings should be reported accurately......"

Andy Committee Member & Outreach

Share This Page

Useful Searches