I was able to skim a little bit the part in this thread about directness/indirectness in PACE.
I have often struggled to grasp why the fact that PEM wasnt req'd isnt a key issue, so have been really grateful to
@Jonathan Edwards &
@Utsikt & others for discussing it here.
The RA/pain killers analogy is jolly useful. And this following quote from Jo makes total sense to me. Esp the bit I've bolded.
There would be a good case for saying that if PACE had shown a positive result for GET for chronic fatigue syndrome patients as defined by Oxford, without requiring PEM that further analysis of benefits and harms for the PEM subset was warranted. They did the analysis for benefit, which showed no difference. They did not analyse harm well. NICE was faced with having to make a decision based on the most likely interpretation of existing evidence. If PACE had a valid positive result they should perhaps have still given a caveat, but they decided that PACE did not give a usefully positive result.
So, in my own words...
Had PACE shown benefit in the wider group, then the indirectness
plus patient reports of harm, would be a strong indication that we need to look again at that subcategory. But the indirectness
alone, wouldnt say that the results
DIDNT apply to the PEM group.
Is that right?
I'm highlighting this here because I think it may be useful in what I'd like to suggest, if it hasnt been suggested already ...
Which is that as part of our 'S4 factsheets' project we also do a factsheet with simple explanations of the issues/flaws in all the CBT/GET trials.
I say this because while I think I now grasp most of the main issues with PACE etc, (switching outcomes, subjective outcomes comb'd with lack of blinding etc) I have found the Indirectness argument the one that was easiest to understand, AND, cruicially, the one I've found that people in general seem to understand easiest when i talk to them.
That may well be because my ability to explain things is crap - understanding something isnt the same as being able to teach it. But I suspect thats not the only reason, because people who're in jobs where they
ought to understand the finer points of trial design also dont seem to get it.
I think the argument that 'they studied all fruit so the results cant be extrapolated to strawberries', is initially the easiest concept to get your head around, especially if you're still under the illusion that scientific studies are always accurate & reliable if they're peer reviewed & published.
But now I see that it's not the best argument at all! Because why
wouldnt a study apply to strawberries, because strawberries are also fruit! (is this right Jonathan?)
So I'm now hoping we can get some kind of succinct description of the major flaws in BPS studies, the reasons they actually show that these interventions dont help
anybody. On a fact sheet
.
I suspect that the indirectness argument is more cognitively & emotionally comfortable in general (at least for me & the people i talk to), because the idea that 'well these studies exist & are ok, but they only show that they might help people who're merely fatigued, but we're different & they dont help us'.
That is much easier to take on board as a member of the general public, than the idea that huge swathes of so called scientific literature is so fundamentally flawed that were it all to be examined it would pull the rug out from under the majority of psychological science.
I think we especially need a factsheet on this because all outher sources seem to be using the the indirectness argument... it's the main one i see from the MEA etc.
Of course, all the relevant info is detailed & spread all over the forum scattered across thousands of posts, plus
@dave30th Virology blogs,
@Brian Hughes website & book, Graham's amazing videos etc etc etc. But i find the spread out nature of it all really difficult to utilise.
So I think it'd be amazing to have a 1 or 2 sided fact sheet with the main arguments on & links to more detailed info. Something a new patient, interested journalist, Dr, budding psychologist etc could read.
Lol... someone is now going to tell me thats already on the factsheet list to do, & i will turn over & go back into the void
p.s. sorry mods i know it's a bit off topic, but I cant find the relevant fact sheet thread to put this on