Independent advisory group for the full update of the Cochrane review on exercise therapy and ME/CFS (2020), led by Hilda Bastian

Pretty much literally: don't ask us about the stuff we publish, we just publish it, we don't actually vet any of it.

Cochrane seems to mostly be a platform for self-promotion, frankly. How it is still considered the gold standard of clinical evidence says a lot about why clinical outcomes have not improved in decades.
 
Well yes in that the new Exercise review if it ever happens would be not in that group. But no in that the current Exercise and CBT reviews they refuse to withdraw are still in that group. It's so completely illogical, I cannot fathom it.

Do we know what group it would be in?
 
Hello All

I had a reply today to my request to Cochrane to withdraw the Exercise and CBT reviews which I made in November. The response was very vague, so I replied asking for clarification - see below


From: Rachel Marshall <rmarshall@cochrane.org>
Sent: 01 February 2021 17:35
To: Caroline Struthers <caroline.struthers@csm.ox.ac.uk>
Cc: Karla Soares-Weiser <ksoares-weiser@cochrane.org>
Subject: RE: Request for withdrawal of reviews Exercise therapy for chronic fatigue syndrome and CBT
for chronic fatigue syndrome

Dear Caroline,

Thank you again for your email regarding the Cochrane reviews on exercise therapy and cognitive
behavioural therapy (CBT) for myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS).

A sub-group of the Cochrane Editorial Board and a Co-ordinating editor have reviewed and discussed the
information from the updated NICE guideline under consultation on ME/CFS, and the associated NICE
evidence review on non-pharmacological management [review G]. The editors have agreed that the
information within does not meet Cochrane’s criteria for a serious error, and both reviews will remain
on the Cochrane Library. The two Cochrane reviews each have an editorial note within the abstract,
explaining the current status of the review. Cochrane will update the editorial note for the CBT review to
further clarify that the strength of evidence has not been evaluated using GRADE methodology, and this
change to the editorial note will be made within the next few days.

With best regards, Rachel

Rachel Marshall
Senior Editorial Officer
Editorial & Methods Department | Cochrane Central Executive


From: Caroline Struthers
Sent: 01 February 2021 21:38
To: Rachel Marshall
Cc: Karla Soares-Weiser
Subject: RE: Request for withdrawal of reviews Exercise therapy for chronic fatigue syndrome
and CBT for chronic fatigue syndrome

Hi Rachel

“The editors have agreed that the information within [the draft NICE guideline] does not meet
Cochrane’s criteria for a serious error”

This sentence doesn’t make sense.

I notified the Editor in Chief that following the conclusions of the reviews could lead to patient harm
which is one of Cochrane’s definitions of a serious error.

Can you confirm that the message below means that the editors have concluded that following the
conclusions of either of these reviews could not lead to patient harm.

This is despite the new draft NICE guideline recommending that neither intervention should be
recommended due to extremely poor evidence of effectiveness, and with recent reliable evidence of
harm.

Best wishes

Caroline


Caroline Struthers
Senior EQUATOR Research Fellow

I wrote to Hilda today (cochrane.iag@gmail.com) to get it all my correspondence with Cochrane about withdrawing the reviews on record

3 Feb 2021

Dear Hilda (cc Rachel Marshall, Karla Soares-Weiser)

I hope you are doing OK.

Please could you add the correspondence below to the archive about the update of the Exercise review?

On 19 November, after the publication on 10 November of the draft NICE guidelines for ME/CFS, I notified Karla of “a serious error” in two Cochrane reviews, the Exercise for CFS review, and the CBT for CFS review and asked for them to be withdrawn. According to the policy on withdrawal a serious error occurs if

“Following the conclusions of the review could result in harm to patients…”.

As you know, NICE has now removed the recommendation for Exercise and CBT as treatments for ME/CFS because of extremely low quality evidence of benefit and new evidence of harm. Having two Cochrane reviews which both indicate there may be benefit in these treatments is continuing to put patients in harm’s way. In the case of the Exercise review, Cochrane still rates the quality of evidence on fatigue as “moderate”, in contradiction to the NICE rating. In the case of CBT, the review is nearly 13 years out of date and does not include any studies after 2007.

On 1 February I received a short response from Rachel Marshall which didn’t make sense or address the key issue of patient harm. I responded the same day to ask for clarification which I haven’t yet received, but I realise it’s early days.

With best wishes

Caroline
 
Yes, you are doing terrific work @Caroline Struthers. Thank you.

I guess when the rewrite of the exercise review was announced, we all, including Hilda and even Cochrane, expected it would happen faster than it seems to be happening. I get that Covid-19 has slowed things down, but really, the pandemic and the appearance of Long Covid just makes the removal of incorrectly based endorsements of potentially harmful treatments all the more important.
 
. Cochrane will update the editorial note for the CBT review to
further clarify that the strength of evidence has not been evaluated using GRADE methodology, and this
change to the editorial note will be made within the next few days.

They should really put a much stronger note. If I remember correctly the rated PACE as high quality and NICE using GRADE rated it as low quality so they shouldn't just say that the evidence has not been evaluated using GRADE they should point out that when others used this methodology they got very different results than in this Cochrane review.

I notified the Editor in Chief that following the conclusions of the reviews could lead to patient harm
which is one of Cochrane’s definitions of a serious error.

It would be interesting to get more details as to what they did consider. They are fully aware that harm could be caused and have chosen to ignore it before.

I wonder if it is worth making the point that they claim a new review will happen but there is no evidence that anything is actually happening.

I do wonder if they could he found neglagent if someone was harmed by GET but I suspect its look complex an accountability chain.
 
They should really put a much stronger note. If I remember correctly the rated PACE as high quality and NICE using GRADE rated it as low quality so they shouldn't just say that the evidence has not been evaluated using GRADE they should point out that when others used this methodology they got very different results than in this Cochrane review.
NICE looked at outcomes from various non pharmacological trials, with 89% rated very low quality and the rest rate low quality. Did anyone manage to work out which outcomes related to which trials?

I do wonder if they could he found neglagent if someone was harmed by GET but I suspect its look complex an accountability chain.
@Valerie Eliot Smith are you following this thread? Do you think there could be a legal case against Cochrane?
 
They should really put a much stronger note. If I remember correctly the rated PACE as high quality and NICE using GRADE rated it as low quality so they shouldn't just say that the evidence has not been evaluated using GRADE they should point out that when others used this methodology they got very different results than in this Cochrane review.



It would be interesting to get more details as to what they did consider. They are fully aware that harm could be caused and have chosen to ignore it before.

I wonder if it is worth making the point that they claim a new review will happen but there is no evidence that anything is actually happening.

I do wonder if they could he found neglagent if someone was harmed by GET but I suspect its look complex an accountability chain.

I'd like to see a legal challenge.

Although maybe we could learn from the best and follow their playbook. First spend time doing lunch with all the right people and whisper our demands for the system to be altered in a way that will effectively give us a certain win.
 
I'd like to see a legal challenge.

Although maybe we could learn from the best and follow their playbook. First spend time doing lunch with all the right people and whisper our demands for the system to be altered in a way that will effectively give us a certain win.
Likely after the fact but Cochrane is an independent non-profit, it is not regulated and can basically publish what they want as they see fit. Their influence comes from the trust medical professionals and organizations put in them, they have no official power. Clearly misplaced trust but whatever, the organizations make their own choices and are not bound by any obligation to do any better.

Their whole reason to exist is because they claim to independently validate research. Here we see them admitting they don't even do that and find no obligation to even pretend, even when found out to have blatantly neglected their one and only mission. Nothing illegal or forbidden, it's medical institutions who give them power by not caring either about the fact that Cochrane is evidently unfit for purpose and now only exists as a medium for self-promotion.

But that's like people voting for terrible politicians who actively make their life worse. You can blame the politicians, but it takes two to promote a big lie: one to make it and one to echo it.

I don't remember if Wakefield went to prison, I think not, but Horton has never fielded any blame even though he was far more responsible than Wakefield. Yet he is still there in his position doing the same thing again. If professionals don't hold failure to account, nothing we can do, sadly, we have zero influence on what health care decides to do with us. At least for now.
 
NICE looked at outcomes from various non pharmacological trials, with 89% rated very low quality and the rest rate low quality. Did anyone manage to work out which outcomes related to which trials?

@Valerie Eliot Smith are you following this thread? Do you think there could be a legal case against Cochrane?
I will try and contact @Valerie Eliot Smith direct about this as the Charity Commission advised either re-engaging with Cochrane (tried that) or seeking legal advice as a next step. What about Monbiot?
 
The fact that they are a not-for-profit would seem to be suspect. I guess it depends on the wording of such things and how Cochrane has interpreted that.
 
NICE looked at outcomes from various non pharmacological trials, with 89% rated very low quality and the rest rate low quality. Did anyone manage to work out which outcomes related to which trials?

I think PACE is one of the better trials so I assume if any was likely to be rated higher it might be PACE. They had things like recording of adverse events - although I suspect the review committee dismissed any links to GET (I think at least one is was a CBT/GET fan) as they don't see exercise making people worse and also adverse events that worsen current symptoms tend to be taken less seriously.
 
Back
Top Bottom