Yesterday (14/4/20) I submitted a few comments to to the IAG email address (ie, Hilda Bastian) too, largely based on watching the Cochrane presentation about the review update at the CMRC conference. I hope you don't mind me sharing. I gather from the background information that all correspondence to that address will be archived and available after the project has finished anyway.
Hi there
I have a few comments on the pilot.
https://community.cochrane.org/orga...eholder-engagement-high-profile-reviews-pilot
1. What is the definition of high-profile review? This particular review is only high-profile because it’s had a huge amount of criticism. How will future high-profile reviews be defined? In the same way?
2. Why is this “engagement” (relatively passive, implying interest and acceptance rather than any element of control or influence)? I thought Cochrane were interested in stakeholder involvement in reviews – ie. helping prioritise topics/scope, choosing outcomes, control and influence over methods, reporting etc. The advisory group model comes across as hands off.
3. Cochrane is committed to involvement in all reviews. Why is this pilot only focused on “high-profile” reviews?
4. The project is defined as an update of an existing review with a new more inclusive approach. Cochrane has already called the shots by assuming an update of this review is appropriate, rather than a withdrawal/retraction. The current review is out of date, it uses invalid diagnostic criteria and relies on subjective outcomes when there is evidence that lack of blinding significantly inflates effect sizes when subjective measures are used. There is still no mention of this last important issue in the amended review which continues to give credibility to exercise as a treatment option for people with ME because the null results on objective measures are ignored. One of the reasons for withdrawal of a Cochrane review
“Serious error in a Cochrane Review. Following the conclusions of the published review could result in harm to patients or populations of interest (other than known adverse effects);” (
https://documentation.cochrane.org/display/EPPR/Withdrawing+published+Cochrane+Reviews)
Clinicians who read the amended review and follow the conclusion that exercise might be helpful for people with ME could (and still do) prescribe it where harm has been documented in numerous studies. The latest survey was done in 2019
https://www.meassociation.org.uk/20...urvey-on-cbt-and-get-in-me-cfs-03-april-2019/
5. It seems the IAG is to provide approval/oversight of a process already started by and ultimately controlled by Cochrane.
6. Why does Karla Soares-Weiser have the ultimate decision making power if the review authors and the IAG disagree? Cochrane appointed you to lead an independent group, but can overrule the group if the authors don’t agree with the advice? I understand Karla could decide in the IAG’s favour, but that would mean the authors could also down tools and we would be back to square one. Why can’t the IAG author the update (or propose a new review title) itself?
All the best
Caroline