CBT combined with music therapy for chronic fatigue following Epstein-Barr virus infection in adolescents: a feasibility study, 2020, Wyller et al

i get your point. But when you present your fully powered trial as a feasibility study, I think it's fair to call that a lie.

But the BMJ's careful investigation found that "this was not due to error on behalf of the authors"! Not even an error.

I agree. I see little point in being English and sticking to niceties when people are walking all over the rules.
I am in medical research and would once not have used the word lie but times have changed dramatically. People are lying here and maybe more than one lot.

Given the way that those complaining about problems in CFS research can still get dismissed for not sticking to niceties I worry that anything which encourages harsher language could be counter-productive. At least, unless it's all carefully laid out with an explanation of why the use of such language is now needed. I think that we need to consider how we come across to the academics who are part of a culture that would almost never accuse another researcher of lying. It seems that this sort of tone/language stuff is the main defence those doing poor quality CFS research are able to hide behind.
 
Last edited:
I think that we need to consider how we come across to the academics who are part of a culture that would almost never accuse another researcher of lying. It seems that this sort of tone/language stuff is the main defence those doing poor quality research are able to hide behind.

I have good reason to think I know how I come across to these people. (I get feedback.) Nobody has challenged me for a while now. People know that I do not say things without justification. The main effect of making critical statements in my case seems to have been to be invited into smoke-filled rooms and on to the highest advisory boards to give my opinion - something quite unfamiliar to me as it happens!

Maybe others should not follow my example but I think it is my job to say things as they are and, being genuinely free of any competing interest, I don't see how people can manipulate that.

All around people in the BPS camp are floundering, producing worse and worse drivel. And they know it. When you have Trish Greenhalgh spouting tripe daily on twitter there is no point in getting the doilies out.
 
Given the way that those complaining about problems in CFS research can still get dismissed for not sticking to niceties I worry that anything which encourages harsher language could be counter-productive.

Tolerance of bad behaviour is what allowed the situation to get so out of control.

It is impossible to explain the pattern of problems with the BPS research as unintended errors or mere incompetence. It's deliberate and the fear that many people have to call it out for what it is allows BPS researchers to keep engaging in their fraudulent and criminal behaviour.
 
Last edited:
I'm a bit puzzled by the apparent strategy of not blaming the authors, which would mean the editorial process broke in multiple ways and would require changes or reforms in response so that this does not happen again. Especially because there is a habit of it, with Crawley's multiple violations as one example.

But of course there won't be changes or reforms in the right direction to the editorial process. Because this is the process, it worked as intended for a political aim, and they got caught. I guess they assume that nobody cares and will let them eat their cake, sell it as derivative product and proudly display it at the same time. Which may be correct and frankly the real problem here: where politics and ideology desire a specific health care outcome, science is pushed aside and the normal process is simply bypassed in the pursuit of that goal, the ends justifying the means.

Bit like the research integrity or whatever authority giving a pass to the PACE team for clear research misconduct, the end product of which has been condoning, even blessing, research misconduct, in effect tarnishing the entire process and explicitly the body who delivered a cowardly judgment. It did not clear anyone, instead of sullied everything.
 
I am very happy the @Jonathan Edwards and @dave30th tell it like it is and don't wrap up criticism of shoddy research and lies in overly polite language. People who waste research money on nonsensical research and then twist the results to fit their narrative to the detriment of sick people need to be stopped.
Although I agree, the problem is not David Tuller and Jonathan Edwards, but someone not so eloquent or versed in science making the "wrong" criticism which is then used against us. I met a phd student at a course I was taking that had worked with Wyller and been told about a hate letter he received, how many haven't heard that story and doesn't bother to try to understand why someone would write it? It's not Tuller and Edwards that is mentioned when the critique ever gets mentioned in the media (or, most times). It's the hate letter.
 
Of course I don't condone hate letters to anybody, but professionals, particularly doctors, have no business blaming a whole patient group for the bad behaviour of a few unknown individuals.

I think we must not let that stop us openly making justified criticism.

It's the whole Sharpe, Wessely, Crawley 'vexatious patients' narrative again to try to avoid anyone listening to criticism of their work.

I hope you told your fellow student how ridiculous it is to condemn a whole patient population on the basis of one individual's action.
 
It is interesting to reflect on whether the behaviour of BPS researchers should be considered a crime.

The goal of the studies in question would be to produce useful knowledge. If the study is intentionally designed to not be fit for this purpose, but for the purpose of advancing the careers or some business interests then what the investigators are doing in my view is essentially defrauding the funder which is typically the taxpayer as far as I know. The sums involved are often large. Then there is the potential for harm, potentially much greater, that could come from people acting on these misleading study results. One misleading study can also inspire several other similar studies which can waste even more money.

Much smaller offences than this lead to jail sentences.

The difficulty here is proving the intent. Perhaps that's why the BPS people act like fraudsters but play the believer who just cannot see that they have done anything wrong.
 
Last edited:
yes, of course--the journal needs to make basic checks and they're at fault also. What I meant was that you can't blame the journal for lies told by authors.

Yes, I get that. The point I was trying to make is that it's odd that both the reviewer and the editors somehow managed to ignore the title of the submitted paper. In the light of the note that the journal is concerned to not blame the authors that seems even odder to me.

Probably I'm being unfair, but that the reviewer addressed only the most obvious muddle could have been due to her wanting the paper not to look too muddled so that the first sentence of the abstract could still sound convincing:

"Cognitive behaviour therapy (CBT) is effective in chronic fatigue syndrome."

(She didn't ask the authors to clarify that, did she?)
 
@dave30th
I realize you covered most or probably all of that in your blog articles, but not able to search now all of them. Have just found again and re-read the one that includes the letter to the reviewer.

This part appears to me particularly relevant:

"Perceptive editors would have noticed that this response was non-responsive. The reviewer did not ask how the study 'should be regarded' now that it was already done. The reviewer asked whether the study started out as a fully powered trial or as a feasibility study. She wanted the authors to clarify this point, not to fudge it."

https://www.virology.ws/2020/05/28/...eer-reviewer-of-bmjs-cbt-music-therapy-paper/

Also, you point out that the title of the first submitted paper included the term "exploratory randomized trial".

I'm afraid I don't know what an "exploratory randomized trial" actually is. It seems to be not the same as a feasibility study, but just somewhat weaker than a fully powered RT?

The reviewer referred in her criticism of the conclusion to the study as an " underpowered exploratory study." Could this mean, she was aware of the title of the paper?

Anyway -- I would be interested but didn't find out whether she responded to your excellent questions:

"Are you surprised that the investigators responded to your comments by reporting how they thought the study 'should be regarded' after it was done rather than how they originally designed it?
"If you reviewed and approved the revised version, do you stand by that approval?"
 
Anyway -- I would be interested but didn't find out whether she responded to your excellent questions:

Hi, of course I never heard back. I have no idea what an "exploratory randomized trial." I assume they used to the term to indicate that it was a trial but that it was "exploratory" so they could then apply for more money since they didn't have enough participants to make it "fully powered." BMJ is making it up that it's all the fault of BMJ. The authors bear huge responsibility for rewriting the history and purpose of their research. You can't do that. It's called research misconduct in most normal situations.
 
Link to BMJ's retraction note is now live:
https://bmjpaedsopen.bmj.com/content/4/1/e000620ret

The above link states: “This has undergone editorial and peer review as a new submission. It has been published with the DOI http://dx.doi.org/10.1136/bmjpo-2020-000797, and clearly links back to this retracted version so that the history of the paper can be seen.”

Clearly links?
in the footnotes:
You did well to find that hidden away at the bottom of the full text, @Kalliope, below the references, in the bit that most people don’t read.

Anyone coming to this paper new will have no idea that it was previously retracted. Also, because it is a new publication, Michiel’s letter is no longer listed as a response. Can I suggest that you resubmit an amended version of your previous letter, @Michiel Tack?

It also seems odd that they have simultaneously retracted and republished. The decision to retract must have been taken some time ago but for some reason they have chosen to leave a paper which they know to be factually incorrect until a new the revised paper has been drafted, peer-reviewed and published. There can be no excuse for that delay.

Conclusion in retracted paper:
An intervention study of combined CBT and music therapy in postinfectious CF is feasible, and appears acceptable to the participants. The tendencies towards positive effects on patients’ symptoms and recovery might justify a full-scale clinical trial.

Conclusion in revised paper:
An intervention study of combined CBT and music therapy in postinfectious CF is feasible. A fully powered trial is needed to evaluate efficacy; participants’ concern regarding school absence should be properly addressed to secure recruitment.

I don’t understand how the editors could have read Michiel’s comments and agreed to publish this revised version of the paper in good faith.

Finally, thanks to Michiel, @dave30th and others for their work on this.
 
It seems the the 'review history' for this new version is not linked to.

They say:

BMJ Paediatrics Open is committed to open peer review. As part of this commitment we make the peer review history of every article we publish publicly available.

When an article is published we post the peer reviewers’ comments and the authors’ responses online. We also post the versions of the paper that were used during peer review. These are the versions that the peer review comments apply to.

The versions of the paper that follow are the versions that were submitted during the peer review process. They are not the versions of record or the final published versions. They should not be cited or distributed as the published version of this manuscript.

Their commitment to open peer review might be helpful for understanding exactly what happened here, once they've been reminded that their new peer reviews seem to be missing from this paper.
 
They say:



Their commitment to open peer review might be helpful for understanding exactly what happened here, once they've been reminded that their new peer reviews seem to be missing from this paper.

maybe those are coming soon? Fiona Godlee did let me know once about BMJ's serious IT challenges, which apparently made it difficult to change the notice on the Lightning Process paper from an obscure page to the main one.
 
"That said, the increased recovery rate after 15 months in the intervention group might indicate that mental training for postinfectious CF is clinically useful."

Still including the results from only the dropouts when talking about this, sigh. Both in the results and the discussion, which is funny as they've removed the results from the abstract. No mention in the table textd that it is a per-protocol analysis.

"Such a trial should be sufficiently powered to determine effects in the subgroup of CF individuals that adhere to diagnostic criteria of CFS." That was your original application! All participants should already had developed CFS :banghead:
 
Back
Top Bottom