Caroline Struthers' correspondence and blog on the Cochrane Review: 'Exercise therapy for chronic fatigue syndrome, 2017 and 2019, Larun et al.

I might next try submitting a complaint on the review itself about the author representative (Atle Fretheim) not following the advice of Gordon Guyatt to add text to the review emphasizing that the potential size of the effect of exercise was not clinically significant. I will use a pseudonym

I am compiling a summary timeline of the whole complaint including "interventions" by Charity Commission and COPE which I will submit to the APPG and publicly
 
@Caroline Struthers, it would be interesting to know how Cochrane responds to complaints on other issues; is their avoidance, prevarication and misdirection standard practice or confined to how they deal with the issues around their CFS Exercise Review?

Are they more generally belligerent or do they reserve it for issues relating to ME/CFS where they have demonstrably fallen short of what one could reasonably expect of an charitable organisation set up to promote evidenced based medicine?
 
And I received the following from the Funding Regulator on Monday in response to my complaint to them.

Dear Ms. Struthers,

Thank-you for contacting the Fundraising Regulator to report your concern about The Cochrane Collaboration. From reviewing the information, I don’t think this is a complaint which falls within our remit. I would like to explain why in further detail.

Your complaint

You have explained: “I am concerned that the charity is prioritising its own reputation over its beneficiaries by refusing to investigate an allegation of editorial misconduct which has led to a misleading and substandard publication. Trust in the editorial process and sales of publications is the charity's main source of income so allegations of editorial misconduct potentially leading to a misleading publication and harm to patients should be taken seriously. The charity has refused to investigate my complaint thoroughly and independently.”

Our role and remit

Part of our role is to investigate complaints from members of the public about charitable fundraising practice where these cannot be resolved by the fundraising organisations themselves. We do so by considering whether the fundraising organisation has complied with the Code of Fundraising Practice (the code), which outlines the legal requirements and best practice expected of all charitable fundraising organisations across the UK. Where poor fundraising practice is judged to have taken place, we can make recommendations for remedy and implement changes to the code.

The information you have provided indicates that your concern is about what you consider to be poor decision-making within the charity in relation to one of its income revenue streams. This would be considered a matter of governance in relation to how the charity is seeking to achieve its charitable objectives, rather than fundraising activity. Therefore, your complaint is not within our remit to consider.

Next steps

It’s not unusual for us to see complaints that fall outside of our scope. In these cases, we try to signpost complainants to the appropriate body or alternative regulator who may be able to help.

In this instance, you may wish to report your concerns to the Charity Commission for England and Wales. You can do so via its website: https://www.gov.uk/complain-about-charity

I’m sorry we were not able to assist directly on this occasion, and I hope the information provided above is useful.

Kind regards

upload_2024-5-23_22-28-15-png.21899

I have written back to them pointing out I have already complained to the Charity Commission. I attached various documents supporting the argument that it's not a governance issue, but an editorial decision which has led to a knowingly misleading and harmful product being sold to raise funds for a charity.
 
I have written back to them pointing out I have already complained to the Charity Commission. I attached various documents supporting the argument that it's not a governance issue, but an editorial decision which has led to a knowingly misleading and harmful product being sold to raise funds for a charity.
I think this needs msm publicity .
Where else would this be acceptable ?
 
I decided, wearily, to respond to Cochrane as well as the fundraising regulator.

"At the time of my allegation of misconduct in 2023 your policy was to address complaints about the Editor in Chief to the CEO, which I did. I corresponded with her alone about it, and at no point did she say she was following the complaints resolution procedure which was for members and supporters of Cochrane, which I am not. Nor did she say there was a time limit for asking for a review of the case. You cannot retrospectively apply rules to suit your desire to close this case.

You state that "Our procedure requires complaints about the Editor In Chief to be referred to the Chairs of the Governing Board. That is the editor’s overseeing body, in line with COPE’s guidance on complaints made about editors: https://publicationethics.org/files/2008 Code of Conduct.pdf". As COPE said, this guidance is out of date and Cochrane should instead follow the Core Practices in place since 2017 https://publicationethics.org/news/core-practices and https://publicationethics.org/misconduct.

Please could you point me to when and where this "procedure" on referring complaints about the Editor in Chief to the Chairs of the Governing Board was written down? Catherine Spencer clearly had no procedure to work from in March 23 and took advice directly from the Trustees rather than by referring to COPE Core practices. See attached correspondence. She admits there is no procedure in place and acknowledges the need for an independent investigation. At no point did she say she was following any procedure at all, and so using my failure to ask for a review of the case within a time limit I was not aware of and had not been told about is unacceptable.

I have asked a simple question about why the complaint didn't follow the guidance set out by the funding regulator, cited in your complaints procedure. This is not "additional information". You can answer this without reference to any other ongoing complaints.

https://www.fundraisingregulator.org.uk/more-from-us/resources/complaints-handling-guidance

For example

1. Why were the Cochrane co-chairs considered sufficiently independent of the events complained about to determine there would be no investigation?
2. Why was it not possible for Cochrane to ask for a third party outside of the organisation to investigate the complaint?
3. Why was I not informed whether the respondent had been made aware of the complaint or whether they had been given an opportunity to respond?
4. Why was my complaint not investigated thoroughly and fairly to establish the facts of the case including reviewing all relevant evidence, speaking to me, to the respondent and to third parties?
5. Why was I not provided clear, evidence-based reasons for the decision to close the case without a thorough investigation?
6. Why have I had no response to any of the substantive points raised in the complaint explaining why the organisation considers the points justified or not?"
 

Attachments

I have asked a simple question about why the complaint didn't follow the guidance set out by the funding regulator, cited in your complaints procedure. This is not "additional information". You can answer this without reference to any other ongoing complaints.
Just realised I hadn't read Cochrane's email properly...so this repeating of the question doesn't really make sense, but never mind. I am losing concentration!! I will proceed with the timeline which I can make public.
 
Here's the latest correspondence with Cochrane. CEO Catherine Spencer wrote to me yesterday and I replied copying in COPE and Cochrane's Research Integrity Team

Dear Catherine, COPE and COI arbiter

If my points had been adequately addressed, I wouldn’t keep writing to you

If you were following the procedure in April 2023, why didn’t you tell me you were at the time? You simply told me that you’d “noted” the complaint and were not going to do anything (see attached). No mention of any procedure having been followed. Just an email closing the case.

I then complained to COPE about the lack of procedure. You sent COPE some information indicating that you did have a procedure (i.e.. refer to the unaccountable and un-independent co-chairs) and had followed it. This was news to me.

When I complained again to COPE, they said a complaint about editorial misconduct wasn’t in their remit after all, as it related to your handling of the alleged misconduct of an editor rather than journal processes. They also said they understood that you did have procedures for dealing with such allegations. They gave the example of the COI panel (see attached). But the COI panel also refused to investigate my complaint. I would be grateful if you or COPE could let me know what these other procedures you have in place are.

Selling reviews raises funds for your charity. Knowingly publishing a substandard, misleading, and harmful product which you sell to raise funds for your charity is misconduct . The fundraising regulator is still considering the case

All the best

Caroline

From: Catherine Spencer
Sent: Wednesday, June 12, 2024 10:27 AM
To: Caroline Struthers
Subject: Complaint

Dear Ms Struthers

The points you raise have been addressed in previous correspondence. We note that:

The policy we referred you to stated that "This procedure is intended for use by: Anyone making a complaint about the conduct or behavior of a Cochrane member or supporter..." as well as for Cochrane members and supporters. It was in force, and followed, at the time.
  • As COPE informed you and Cochrane in response to your complaint when they closed this matter, COPE reviewed whether Cochrane complied with COPE Core Practices outlining that journals require a documented complaints process, concluding "Based on the information we have received, Cochrane has a documented and public summary of their process for complaints and followed this in relation to the matter you raised."
  • The policy we referred you to, and which was incorporated in our response to COPE, stated that complaints about the behaviour of the Chief Executive Officer or the Editor in Chief should be sent to the Governing Board Co-Chairs in the footnote to the second box.
We note that this complaint was not related to fundraising, and complaints processes for journals are in COPE's scope. As we said, we have noted your requests for further information, and we will notify you when there are relevant further public reports about complaints related to this review.

Kind regards

Catherine Spencer MBA OBE
Chief Executive Officer
Cochrane Central Executive Team
 
Here's the latest correspondence with Cochrane. CEO Catherine Spencer wrote to me yesterday and I replied copying in COPE and Cochrane's Research Integrity Team

Dear Catherine, COPE and COI arbiter

If my points had been adequately addressed, I wouldn’t keep writing to you

If you were following the procedure in April 2023, why didn’t you tell me you were at the time? You simply told me that you’d “noted” the complaint and were not going to do anything (see attached). No mention of any procedure having been followed. Just an email closing the case.

I then complained to COPE about the lack of procedure. You sent COPE some information indicating that you did have a procedure (i.e.. refer to the unaccountable and un-independent co-chairs) and had followed it. This was news to me.

When I complained again to COPE, they said a complaint about editorial misconduct wasn’t in their remit after all, as it related to your handling of the alleged misconduct of an editor rather than journal processes. They also said they understood that you did have procedures for dealing with such allegations. They gave the example of the COI panel (see attached). But the COI panel also refused to investigate my complaint. I would be grateful if you or COPE could let me know what these other procedures you have in place are.

Selling reviews raises funds for your charity. Knowingly publishing a substandard, misleading, and harmful product which you sell to raise funds for your charity is misconduct . The fundraising regulator is still considering the case

All the best

Caroline

From: Catherine Spencer
Sent: Wednesday, June 12, 2024 10:27 AM
To: Caroline Struthers
Subject: Complaint

Dear Ms Struthers

The points you raise have been addressed in previous correspondence. We note that:

The policy we referred you to stated that "This procedure is intended for use by: Anyone making a complaint about the conduct or behavior of a Cochrane member or supporter..." as well as for Cochrane members and supporters. It was in force, and followed, at the time.
  • As COPE informed you and Cochrane in response to your complaint when they closed this matter, COPE reviewed whether Cochrane complied with COPE Core Practices outlining that journals require a documented complaints process, concluding "Based on the information we have received, Cochrane has a documented and public summary of their process for complaints and followed this in relation to the matter you raised."
  • The policy we referred you to, and which was incorporated in our response to COPE, stated that complaints about the behaviour of the Chief Executive Officer or the Editor in Chief should be sent to the Governing Board Co-Chairs in the footnote to the second box.
We note that this complaint was not related to fundraising, and complaints processes for journals are in COPE's scope. As we said, we have noted your requests for further information, and we will notify you when there are relevant further public reports about complaints related to this review.

Kind regards

Catherine Spencer MBA OBE
Chief Executive Officer
Cochrane Central Executive Team
Thank you for all you and others are doing, I really appreciate it. I hope I may be in a position to help more at some stage.
 
My latest gambit is to try complaining to Wiley (Cochrane's publisher) who had a research integrity guru called Chris Graf who wrote about the value of whistle-blowers. https://www.wiley.com/en-us/network...we-need-whistleblowing-for-research-integrity. Graf is now on the UK Committee on research integrity https://ukcori.org/our-people/. The focus for Graf is research integrity rather than editorial integrity. This focus seems to make editors pretty much untouchable to behave exactly as they please with no repercussions - case in point Richard Horton

Wiley have a publication ethics address, so I thought I'd give it a whirl. Deborah Pentesco is Cochrane's named Wiley publishing director and has been copied in on previous correspondence but has never responded to anything before.

upload_2024-7-18_22-58-12.png
 
As I haven't heard back from Wiley, I did a chasing message yesterday (29 July 2024)

Dear Wiley Publications Ethics Team (cc COPE, Deborah Pentesco)

Please could you acknowledge receipt of my allegation of misconduct sent 18 July, and let me know the procedure you’ll follow to investigate it.

COPE makes it clear that publishers should take allegations of misconduct seriously however they are brought to the journal or publisher’s attention. They should also have a clearly described process for handling allegations, including a whistleblower policy. https://publicationethics.org/misconduct.

I note that Chris Graf, former Director of Research Integrity in the Open Research team at Wiley, wrote a blog about the importance of whistleblowers in 2018. https://www.wiley.com/en-us/network...we-need-whistleblowing-for-research-integrity

He mentions in the blog that Wiley has a dedicated Publication Ethics Helpdesk specifically to respond to concerns, which is why I contacted you.

I provided specific and detailed evidence to support my claim. According to the COPE flowchart, you should respond to me saying that you are going to investigate and will let me know the outcome

https://publicationethics.org/sites/default/files/respond-whistleblowers-concerns-cope-flowchart.pdf

Please respond at your earliest convenience

Best wishes

Caroline
 
I finally heard from Wiley today after filling in an online form reiterating what I'd said in my emails. I will supply the correspondence to them tomorrow. Will have lots of fun sorting out the various email trails of fob offs I have received over the past year and a bit! I don't know why people insist on awarding me a doctorate every time I write to them...I think maybe I should be awarded a doctorate in complainology.

From: researchintegrity@wiley.com

Dear Dr Caroline Struthers,

We would like to confirm receipt of your allegation of editorial misconduct against the Editor-in-Chief of the Cochrane Library, Dr. Karla Soares-Weiser. We understand that your concerns relate to Dr. Soares-Weiser’s editorial handling of a review in the Cochrane Database of Systematic Reviews, which is published by Wiley. The Integrity Assurance & Case Resolution (IACR) team at Wiley will investigate your concerns and will report back to you with their findings.

As you have indicated that you have already raised your allegations with Cochrane, including most recently on 1 May 2024 under their new complaints procedure, we would like to ask you for more information about the responses you received. This will be helpful for us to review whether Cochrane followed the correct processes in handling your complaints. Would you be willing to share the recent correspondence you have had with Cochrane? This can be sent via a response to this email.

Kind regards,
The IACR Team at Wiley
 
@Caroline Struthers, it would be interesting to know how Cochrane responds to complaints on other issues; is their avoidance, prevarication and misdirection standard practice or confined to how they deal with the issues around their CFS Exercise Review?

Are they more generally belligerent or do they reserve it for issues relating to ME/CFS where they have demonstrably fallen short of what one could reasonably expect of an charitable organisation set up to promote evidenced based medicine?
That’s a very good question?!
 
I have assembled all the correspondence with Cochrane and others since I first submitted the complaint about Karla Soares-Weiser in March 2023. The emails are all prefixed with the date in YY/MM/DD format which means you can download and sort them into chronological order and re-live it with me should you so wish - I wouldn't recommend it ;-).
This is what I've sent to Wiley to help them with their investigation, which hopefully, they will actually do!

https://drive.google.com/drive/folders/1Aab1W6ve11ZPWzx0IBduRkCtVQG7mDHw?usp=sharing
 
Hello everyone...I have finally heard back from Wiley (Cochrane's publisher) and they confirm they are independently investigating my complaint about Karla Soares-Weiser. And taking their time. But at least they're doing it! @Trish

From: Caroline Struthers
Sent: 26 November 2024 09:05
To: Wiley Research Integrity
Cc: dpentesc@wiley.com; cope_assistant@publicationethics.org
Subject: RE: Allegation of misconduct of Editor in Chief of Cochrane Library

Dear Dr Williams

Thank you very much for this response. I do understand that an investigation like this can take some time, and I am pleased to hear that it’s underway.

With best wishes

Caroline

Caroline Struthers
Senior EQUATOR Research Fellow

From: Wiley Research Integrity <researchintegrity@wiley.com>
Sent: 26 November 2024 03:08
To: Caroline Struthers <caroline.struthers@csm.ox.ac.uk>
Cc: dpentesc@wiley.com; cope_assistant@publicationethics.org
Subject: Re: Allegation of misconduct of Editor in Chief of Cochrane Library

Dear Ms. Struthers,

I am writing to you from the Integrity Assurance & Case Resolution (IACR) team at Wiley regarding your allegation of editorial misconduct against the Editor-in-Chief of the Cochrane Library, Dr. Karla
Soares-Weiser. My apologies for the delay in getting back to you.

As the publisher's (Wiley's) integrity team, the IACR has been independently investigating the case to ensure that Cochrane followed the correct processes regarding your complaint to them. To be clear,
Cochrane has the primary responsibility to handle complaints regarding their publications. However, Wiley and the IACR do have a role in making sure that Cochrane's own guidelines and, more broadly,
COPE principles were followed. This is what we are focused on in this investigation.

While I understand that this can be frustrating, investigations such as these can unfortunately take quite some time. We are not always able to give prompt status updates or specific timelines.
However, I will do my best to keep you updated, and I will report our findings to you when our investigation is concluded.

Kind regards,

Dr. Max Owen Williams

Max Williams
Associate Research Integrity Auditor
Integrity Assurance & Case Resolution

On Sat, 16 Nov at 4:15 PM , Caroline Struthers <caroline.struthers@csm.ox.ac.uk>
wrote:
Dear Indu (cc Deborah Pentesco, COPE)

On 8 August, one of your team wrote to me saying that “The Integrity Assurance & Case Resolution (IACR) team at Wiley will investigate your concerns and will report back to you with their findings”. As the team have failed to do this, despite chasing, I would like to make an official complaint. Please let me know your complaints procedure and give me the assurance that it will be handled
independently.

With best wishes

Caroline

Caroline Struthers
Senior EQUATOR Research Fellow
 
Hi @Caroline Struthers, I'm starting to prepare for a possible next step in the S4ME campaign, probably a complaint to the Charity Commission on the grounds of harm to vulnerable people, and to Cochrane's reputation, and failure to follow their own rules and promises, or something like that.

I'm very short on energy to work on this, and it would clearly be helpful to have an overview of all the steps you have taken to complain to various bodies about the Larun review. I've tried following the letter trail, but have got completely lost about what the basis of your complaints is/are and the outcomes.

Do you have a blog post or something that summarises your complaint(s) and all the steps you've taken and responses?
Edit: I have gone back through your posts on your blog which finish in Feb 2021.
https://healthycontrolblog.wordpress.com/2021/02/10/cochrane-refuse-to-withdraw-cfs-reviews/
Is there a summary of what you've done since then.
 
Last edited:
Hi @Caroline Struthers, I'm starting to prepare for a possible next step in the S4ME campaign, probably a complaint to the Charity Commission on the grounds of harm to vulnerable people, and to Cochrane's reputation, and failure to follow their own rules and promises, or something like that.

I'm very short on energy to work on this, and it would clearly be helpful to have an overview of all the steps you have taken to complain to various bodies about the Larun review. I've tried following the letter trail, but have got completely lost about what the basis of your complaints is/are and the outcomes.

Do you have a blog post or something that summarises your complaint(s) and all the steps you've taken and responses?
Edit: I have gone back through your posts on your blog which finish in Feb 2021.
https://healthycontrolblog.wordpress.com/2021/02/10/cochrane-refuse-to-withdraw-cfs-reviews/
Is there a summary of what you've done since then.
Hi there. I am working this week on finishing the grant application for Trialblazers, but will be able to give you a summary of the saga after that...and post on the blog
 
Hello everyone...I have finally heard back from Wiley (Cochrane's publisher) and they confirm they are independently investigating my complaint about Karla Soares-Weiser. And taking their time. But at least they're doing it! @Trish

From: Caroline Struthers
Sent: 26 November 2024 09:05
To: Wiley Research Integrity
Cc: dpentesc@wiley.com; cope_assistant@publicationethics.org
Subject: RE: Allegation of misconduct of Editor in Chief of Cochrane Library

Dear Dr Williams

Thank you very much for this response. I do understand that an investigation like this can take some time, and I am pleased to hear that it’s underway.

With best wishes

Caroline

Caroline Struthers
Senior EQUATOR Research Fellow

From: Wiley Research Integrity <researchintegrity@wiley.com>
Sent: 26 November 2024 03:08
To: Caroline Struthers <caroline.struthers@csm.ox.ac.uk>
Cc: dpentesc@wiley.com; cope_assistant@publicationethics.org
Subject: Re: Allegation of misconduct of Editor in Chief of Cochrane Library

Dear Ms. Struthers,

I am writing to you from the Integrity Assurance & Case Resolution (IACR) team at Wiley regarding your allegation of editorial misconduct against the Editor-in-Chief of the Cochrane Library, Dr. Karla
Soares-Weiser. My apologies for the delay in getting back to you.

As the publisher's (Wiley's) integrity team, the IACR has been independently investigating the case to ensure that Cochrane followed the correct processes regarding your complaint to them. To be clear,
Cochrane has the primary responsibility to handle complaints regarding their publications. However, Wiley and the IACR do have a role in making sure that Cochrane's own guidelines and, more broadly,
COPE principles were followed. This is what we are focused on in this investigation.

While I understand that this can be frustrating, investigations such as these can unfortunately take quite some time. We are not always able to give prompt status updates or specific timelines.
However, I will do my best to keep you updated, and I will report our findings to you when our investigation is concluded.

Kind regards,

Dr. Max Owen Williams

Max Williams
Associate Research Integrity Auditor
Integrity Assurance & Case Resolution

On Sat, 16 Nov at 4:15 PM , Caroline Struthers <caroline.struthers@csm.ox.ac.uk>
wrote:
Dear Indu (cc Deborah Pentesco, COPE)

On 8 August, one of your team wrote to me saying that “The Integrity Assurance & Case Resolution (IACR) team at Wiley will investigate your concerns and will report back to you with their findings”. As the team have failed to do this, despite chasing, I would like to make an official complaint. Please let me know your complaints procedure and give me the assurance that it will be handled
independently.

With best wishes

Caroline

Caroline Struthers
Senior EQUATOR Research Fellow
This is the chap in charge of the independent investigation! https://apac.wiley.com/contributor/max-owen-williams
 
Back
Top Bottom