I sent them this:
Dear Drs Flottorp, Brurberg, Knoop, Fink, Wyller and Garner,
I was saddened to see the continued attempts to discredit NICE in the Comment on the ME/CFS Guideline in the Lancet and associated messages on social media. This will perpetuate distrust between patient and medical communities. It reveals the profound lack of understanding of research methodology within the Cochrane community. (Maybe time people knew.)
I was unimpressed by the transparent insinuation that as an expert witness to the NICE committee that my view was biased – presumably reflecting some imagined vested interest. None of this matters to me – I am a retired rheumatologist who studies Leibniz – but it matters to standards in medical science. The vested interests are on your side – including direct interest in the therapies and research and in the reputation of Cochrane reviews such as those co-authored with Larun (who if I remember rightly has expressed an evangelical approach to the value of physio).
It may have been unwise to include as your reference 18 an active thread on the S4ME site. Readers can see that my interest has been entirely in evidence quality, with no favours to anyone. They may also see some interesting new posts!! (Note that the patient community has been open throughout, unlike those associated with Royal Colleges sending covert messages trying to manipulate NICE into changing tack – the actual corruption.) And if medics openly discussing research quality with patients is ‘disloyalty’ (as Michael Sharpe put it) heaven help us.
The reasons why the NICE committee were right to downgrade evidence on therapist-delivered treatments are clearly set out in my expert witness testimony. There is nothing difficult about the arguments. They reflect established fact and common sense. In my presentation, I included a slide, carrying Cochrane approval, indicating the main point – that ‘If you are reading a study that is un-blinded, with subjective outcome measures, then you may as well stop reading it and move on.’
My only regret is that at the time I had not seen Heins et al. (2013) J. Psychosomatic Res. 75, 3, 235-241 which crystallises how naive investigators are in this field. The suggestion seems to be that people feel better because they believe they are doing more - when in fact they aren’t. Any sensible person can see how ridiculous this is as a useful outcome. And a lot of people with ME/CFS are sensible.
Yes, I had formulated a view on the evidence before being asked. My view was formed after hearing Peter White making a presentation on PACE and then reading the papers. PACE shows that, even if there is a specific effect from these treatments, which looks unlikely in the context of high risk of bias, it is too small to be of value (almost certainly too small for therapists to reliably identify in routine practice). The change from 2007-2021 is simple – the evidence now indicates that there is no worthwhile effect – as emphasised at the NICE Round Table discussion.
What has shocked me most is how pervasive the lack of rigour is in the Cochrane circuit for non-pharmacological treatment, and also to see physician colleagues buy in to poor evidence for political reasons. Lynne Turner-Stokes was one of our trainees. I am disappointed to see her make groundless claims now. At the Round Table, contributions from objectors consisted mostly of sales pitches for their pet disciplines - all very tawdry. I am glad to be out of it but the public deserve better.
Yours sincerely,
Jonathan Edwards
Professor Emeritus
University College London