I sent the following email to Hilda and the New Zealand representative of Cochrane a few hours ago.
It followed an email in which I thanked Hilda. She replied that she felt that her discussions with people in Cochrane were bearing fruit, and that many people within the organisation had not been aware of this issue. She noted that "Even many in decision-making bodies haven't realised the consequences of things they have approved."
*****
That is great to hear. In the end, this saga may help publicise the fact that exercise therapy does not fix ME/CFS. Each media article we get sends the message out clearer that the evidence isn't there. Of course, it all comes at a substantial cost to advocates and to the people treated with harmful therapies in the meantime.
I am a bit concerned that the focus of your criticism of the review relates to its indirectness though. That is, 'PEM defines ME/CFS, the studies in the review used criteria that did not require PEM, and therefore the participants in the studies may not have had PEM - and so the studies don't apply to ME/CFS'.
I noticed that #MEAction's criticism also focused on that argument.
The argument sidesteps the point that the studies are not credible evidence for anyone benefiting from the therapies, regardless of whether they had PEM or not.
It is the trial design of the studies that is the fundamental flaw, because the lack of good objective outcomes in an unblinded trial design, (especially when combined with therapies that gaslight the patient into feeling that it is their over-attention to symptoms that is the problem, a lack of attention to harms, ignoring dropouts, biased selection, magnification of both therapist allegiance and expectation of treatment efficacy, short followup times, cherry-picking from a multitude of outcomes...) is a recipe for proving almost anything sort of works.
It is face-saving for the authors of the review and for Cochrane to say that the issue is that the understanding of ME/CFS and PEM has moved on, and so therefore, while the review was a reasonable effort at the time, it is now out of date. However, that does not protect patients or ensure government funds are not wasted on ineffective therapies. It also leaves the gate wide open for those who believe fervently in interventions founded in a psychosomatic paradigm.
Those believers will just run more studies, either selecting people meeting ME/CFS criteria, or, more likely, ensuring that people are not assessed for PEM and instead are diagnosed with a vague definition of Long Covid, or Functional Neurological Disorder, or Chronic Fatigue. And the trial design recipe, perfected over the years, will do the work. When they have enough studies falsely claiming benefit from their interventions, new reviews will be written.
I wonder if there are people in Cochrane who understand this, who understand that if the profound problems with the trial design recipe of only subjective outcomes in unblinded trials were to be recognised, it would show that many of the treatments that Cochrane has endorsed for years and that friends have built their careers on are ineffective.
I also wonder if an effective argument for Cochrane executives with integrity for why the whole shoddy mess of an organisation that is supposed to be standing for good science but is actually supporting poor trial design needs to be cleaned up is the role of the insurance industry and other business in this?
Cochrane has always had a tendency to be suspicious of big pharma, probably with some reason, and instead favouring non-drug treatments. But, there is evidence of 'big insurance' propping up the psychosomatic paradigm proponents of non-drug treatments in order to avoid paying out on income protection insurance policies. Also, because the 'only subjective outcomes in unblinded trial design' recipe is so effective at proving anything works, allowing that design to get a free-ride through Cochrane's reviews means that Cochrane has no way of preventing all manner of dubious treatments that profit corporations at the expense of patients from getting that 'gold-standard' endorsement. And that must, eventually, make the 'gold-standard' and Cochrane derisory.
Another thing that we are concerned about is the acceptance that the review should not be withdrawn, and that a 'do not use' label would be enough. A number of people, and recently Trish in particular, have spent time and effort putting together arguments to show that the level of harm caused by the review is sufficient for Cochrane's standard for withdrawal to be met. We just need someone unbiased and influential in Cochrane to review those arguments. While a 'do not use' label would be a start, there needs to be recognition of the extent of harm that Cochrane has caused if the organisation is to have any chance of avoiding repeating the mistake.
Gosh, that ended up much longer than I expected. I've run out of energy for proof-reading, so sorry if there are unclear bits.
Anyway, best wishes to you. We all have an interesting year ahead. Do let us know if there are things we can do in our campaign to help you in yours.