CORRESPONDENCE The PACE trial of treatments for chronic fatigue syndrome: a response to WILSHIRE et al (2019) Sharpe, Goldsmith & Chalder

We were actually invited to write a reply to this, which Tom Kindlon and I did. I'm surprised it hasn't come out at the same time as the Sharpe response. This is very distressing, as obviously, its much better to be able to reply at the same time. Hopefully, because the journal is fully online, the reply can be linked as soon as its released.

There was some confusion about the process we were supposed to follow. We were invited to reply, and send the manuscript to the editor via email, which we did. It was reviewed and we were asked to make a few small changes. I was then told the plan had changed, and the Sharpe piece and our reply would now be published as separate pieces. I was asked to resubmit my reply via the online portal (the usual way to submit a new article). I wonder whether what they meant is that it would also go through the review process - hence the delay?

I see absolutely no reason why I shouldn't share the reply with you all now. Heres a pdf. As soon as I get a chance, I'll reformat it into a prettier version and update the file here.

It also brings into question The Lancet's fast-track process, whereby trials that have lodged a protocol can then undergo an expedited review. This makes no sense if crucial elements on the protocol are then amended at publication.

Has this issue been raised with The Lancet?
[eta - apart from me banging on about it on Twitter that is]
 
Last edited:
It also brings into question The Lancet's fast-track process, whereby trials that have lodged a protocol can then undergo an expedited review. This makes no sense if crucial elements on the protocol are then amended at publication.

Has this issue been raised with The Lancet?
[eta - apart from me banging on about it on Twitter that is]
Sharpe once claimed that the reason Lancet fast-tracked it is because they pre-registered the protocol.

He also said it's not an issue that they modified their protocol from how it was registered because they prefered it this way (I can't believe this is an acceptable answer... SMH).

So the question of fast-tracking and the weirdly inexplicable enthusiasm of Horton for an unblinded, non-controlled trial with self-reported outcomes that did not adhere to their protocol really needs a thorough explanation, especially given the pre-planned media tour that Horton was looking forward to and the SMC seemed to have been preparing for well in advance.

As always it just confirms that the trial was a formality, would produce the results they wanted no matter what and that there was political will to make it skip unhindered to the finish line. This is everything science is not about, it's a massive perversion of the entire point the scientific method.
 
As always it just confirms that the trial was a formality

I'm not sure that was the case though. They made some things damn hard for themselves. It was massively over-complex and was a logistical nightmare, as the TMG minutes recount. They were clearly trying to cover all bases and not really thinking of what the participants were going to have to put up with as a consequence.
 
I'm not sure that was the case though. They made some things damn hard for themselves. It was massively over-complex and was a logistical nightmare, as the TMG minutes recount. They were clearly trying to cover all bases and not really thinking of what the participants were going to have to put up with as a consequence.
Oh, I don't mean it was easy. It's pretty hard to cheat in a way that seems legit and you're right about the TMG minutes showing how much trouble they had keeping the appearance of doing a serious trial. Reality really didn't want to conform to their expectations.

But the conclusion was reached decades ago and nothing in between would have affected that.
 
It was the fact that there was no longer any difference at long-term follow-up...
In good science this ends all their claims. Since they wont accept that ...

I still think the deliberate use of SD on SF36PF data, given the PDW 2007 paper, is evidence of deliberate scientific misconduct and needs to be formally investigated by independent and qualified investigators.
 
I still think the deliberate use of SD on SF36PF data, given the PDW 2007 paper, is evidence of deliberate scientific misconduct and needs to be formally investigated by independent and qualified investigators.
I have always thought this. Plus not disclosing in the papers the fact that 13% met the fraudulent "normal range"/"recovery" thresholds. No one has held them to account for the fact that this was in no way a "normal range" given their population data. It is a seriously overlooked point.
 
Sharpe seemed particularly sensitive to this point.
With good reason:

PACE required both primary measures (SF-36 & CFQ) to be positive to get an overall positive result for the trial.

But, as I understand it, if they calculate the SF-36 results properly it will actually deliver a null result on that measure, and hence a null result overall.

If that is correct, then the implications are just astounding.
 
We were actually invited to write a reply to this [...] Heres a pdf.

Such a great response with many well reasoned points that ought to be obvious.

One point in particular that never ceases to amaze me is where they accuse the reanalysis of 'not using an a prirori analysis plan'. So... their change is fine because they simply felt it was better this way, but if anyone else does it (which was not even the case) it is bad? I mean, yes it is bad for all the reasons mentioned as a response to THEIR changes, but come on. You cannot have your pie and eat it too.
 
Such a great response with many well reasoned points that ought to be obvious.

One point in particular that never ceases to amaze me is where they accuse the reanalysis of 'not using an a prirori analysis plan'. So... their change is fine because they simply felt it was better this way, but if anyone else does it (which was not even the case) it is bad? I mean, yes it is bad for all the reasons mentioned as a response to THEIR changes, but come on. You cannot have your pie and eat it too.
My favorite is dismissing the reanalysis because it only used partial data.

Because they withhold the data.

I don't understand how an editor finds that acceptable. Completely ridiculous.
 
Update: since I last wrote there has been much frantic action by the BMC editor to hurry our response through. I don't think there was any intention to the delay, after all it was the editor who invited me to write a response in the first place. BMC's interests are best served by hosting a discussion that presents both sides of the debate.

Thanks to @Jonathan Edwards, @Trish and all others who said nice things about our response. Its pretty softly softly, and I expect some of you might have wished we'd made some points more strongly. I do feel much more strongly than what I said in the response, but I wanted to take the scientific high ground by addressing only the science. I feel this strategy may pay better dividends in the long term.
 
Back
Top Bottom