Yet there is no admission of the serious failures with the review. Or apologies for misleading
The PACE authors themselves used the term 'post-hoc' in describing their own preferred analysis, not 'some readers'....and some readers therefore claim the study should be viewed as being a post hoc study.
We have updated the methods according to recommendations provided in the 2011 version of the Cochrane Handbook for Systematic
Reviews of Interventions (Higgins 2011c). For the first version of this review (Edmonds 2004), the review authors conducted assessment
of methodological quality according to contemporary criteria of the handbook of The Cochrane Collaboration (Alderson 2004). Review
authors rated the adequacy of allocation concealment as adequate (A), unclear (B) or inadequate (C) or as not used (D), and applied the
Cochrane Collaboration Depression, Anxiety and Neurosis (CCDAN) Quality Rating System (Moncrieff 2001). For this update, we re-extracted
data on risk of bias to comply with current recommendations, and we used concealment of allocation as the main quality criterion for
included studies (Higgins 2011a).
Re-expressing standardised mean differences and defining minimal important differences
If available studies measured the same outcome using different scales or different versions of the same scale, we presented the pooled
effect estimates in terms of standardised mean differences (SMD). SMD units may be hard to interpret, and based on feedback from the
Cochrane Editorial and Methods Department we have also calculated/re-expressed SMD using more familiar instruments. Chapter 12 in
the Cochrane Handbook for Systematic Reviews of Interventions (Schünemann 2011), recommends using standard deviation from a representative
observational study as a basis for the recalculation, and we therefore use standard deviations reported in Crawley 2013 for this
purpose.
Post hoc, we have also been encouraged to define minimal important differences (MID) for commonly used outcome measures. MID thresholds
and relevant research literature are reported under Measures of treatment effect in the Methods section.
Clinical studies and meta-analysis can detect small differences in
outcomes with little or no importance to individual participants.
Moreover, the interpretation of what is considered an important
difference may vary between patients, researchers and clinical experts
(Wyrwich 2007). We therefore identified research literature to
help quantify minimal important differences (MID) for important
outcome measures. For fatigue, one study among people with systemic
lupus erythematosus (Goligher 2008), reported a threshold
around 2.3 points for a minimally important change on the 33-point
Chalder Fatigue Scale, an effect size that corresponds to an SMD of
about 0.36 (Goligher 2008).
Studies in people with rheumatoid arthritis or chronic heart disease
suggest that the threshold for MID on the physical functioning
subscale of SF-36 can be set around 7 points (Ward 2014; Wyrwich
2007). Studies based on data from patients with chronic obstructive
pulmonary disease have also investigated MID for HADS and
suggest MIDs around 1.5 points for the HADS anxiety and the HADS
depression scale (Puhan 2008; Smid 2017). We did not detect studies
that established a common MID for the Jenkins Sleep Scale, but
decided to view a 20% change in sleep scores as a clinically important
difference.
They continue to classify the PACE Trial as having a low risk of bias in terms of selective reporting which is hard to accept.
Impressive linguistic gymnastics if nothing else.There is moderate‐certainty evidence that exercise therapy probably increases the number of people who report at least some degree of improvement in self‐perception of overall health at end of treatment
So maybe the most effective thing to do to ensure that this review goes into the dustbin of history is to get a Cochrane review done on studies of exercise therapy that selected people with ME/CFS (ie with PEM)? Is anyone working on that? I think there was talk about it.
So would our best bet now be to make sure the 'right' patient-advocacy groups get into the promised independent advisory group - we can probably (oops, did I say 'probably'?) think of some 'wrong' ones we don't want to be involved? They, the 'right' patient-advocacy groups, could then push for any new protocol to specify that studies included need to look at PwME with PEM, plus attempt to address all the other weakness in the current review - they'll have their work cut out...today we are committing to the production of a full update of this Cochrane Review, beginning with a comprehensive review of the protocol, which will be developed in consultation with an independent advisory group that we intend to convene. This group will involve partners from patient-advocacy groups from different parts of the world who will help us to embed a patient-focused, contemporary perspective on the review question, methods and findings.
Bump.I notice that “CFS” is listed under both mental health and neurology. Has it always been that way? Have they decided to simply add CFS to neurology without removing it from mental health?
https://blogs.plos.org/absolutely-m...n-of-the-cochrane-review-on-exercise-and-cfs/It’s tough, watching this play out slowly, step by painful step. As I’ve blogged before, ME/CFS consumer advocates have been hammering away to get this Cochrane systematic review on exercise and CFS fundamentally changed since 2015. I think they’re right. And now, they have achieved something pretty remarkable…
Kudos to Robert Courtney (now deceased), who got this ball rolling, and those who picked up the baton, especially Tom Kindlon and George Faulkner. But why do I think it’s only a start?
Firstly, I need to disclose that I’ve been directly involved in recent negotiations around the fate of this review, although I didn’t see this version till after it was published. The organization released a statement along with the amended review, making it clear that this is only a first step.
https://emerge.org.au/cochrane-has-...ew-of-graded-exercise-therapy-get-for-me-cfs/Is this good news or bad news for people with ME/CFS?
It is good news that Cochrane recognised the seriousness of the complaint and the issues with GET research. Unfortunately, the updated review doesn’t really address them. The updated review concludes that there is low-moderate certainty about the evidence that GET may alleviate some symptoms of ME/CFS and recommends more research.
The updated review does acknowledge that the evidence only applies to patients diagnosed with the (very broad) Oxford or Fukuda diagnostic criteria and may not apply to people diagnosed with other criteria. Emerge Australia follows the recommendation of the NHMRC ME/CFS Advisory Committee, that ME/CFS research should be based on either the Canadian Consensus Criteria or International Consensus Criteria, which both require post-exertional malaise to be included as a key symptom for diagnosis. Oxford and Fukuda diagnostic criteria rely on fatigue as the primary symptom and therefore may capture people with a very wide range of fatiguing conditions, including depression and mental illness. It is good that Cochrane have acknowledged that the evidence is only applicable for people diagnosed with these broader criteria, but we feel that this distinction will be of little help to patients sitting with their doctor (or applying for DSP or NDIS) and trying to explain that exercise hasn’t helped or has made them feel worse.
The updated review also acknowledges that the “evidence regarding adverse effects is uncertain”. This is an improvement on the previous version of the review, which concluded that “no evidence suggests that exercise therapy may worsen outcomes”, although we believe that this still does not adequately reflect the experience of many patients.
This is particularly disappointing and disturbing.They do have to note the lack of evidence for benefit at follow-up, but people Cochrane clearly haven't taken this seriously,
The previous editor-in-chief, David Tovey, had originally proposed that the review be withdrawn, but that wasn’t well received, and it didn’t happen. An editorial note on the review points out that it is “substantially out of date”. Once that determination has been made, Cochrane reviews are supposed to be either updated or withdrawn. It’s now nearly a year since then, and a replacement review isn’t going to be galloping over the horizon any time soon. Looking at it today, with all the statements in there that look current – like saying this version has had trials added – withdrawing it seems reasonable, and not withdrawing it seems political.
This review over-estimated the strength of the evidence and its applicability, and while better, it’s still doing that. That has been having a damaging effect on people to whom the results don’t apply, but on whom the consequences of this review are visited. Yet, until Courtney’s complaint got Tovey involved, consumers had been resolutely locked out of this Cochrane review, and indeed, this amendment process too. That was against Cochrane’s stated ethos. It’s great that Soares-Weiser is going to rectify that. Consumer participation isn’t only for when it’s smooth sailing. When it’s going to rock the boat may be the most important time of all to do it.
have only gone through the main page but I counted 24 (including the plain english version)"We are uncertain..." (lots and lots).