Use of EEfRT in the NIH study: Deep phenotyping of PI-ME/CFS, 2024, Walitt et al

@EndME I know you've read a bunch of EEfRT papers at this point, have any of these studies asserted that EEfRT is meant to measure "effort preference"? As far as I can tell, Wallit seems to have invented the construct as they make no reference to any studies that actually use the term "effort preference". In fact, the only study Wallit ever cites when discussing effort preference is Treadway 2009, which never uses the term.

If there isn't any evidence that other reserachers have used EEfRT to measure "effort preference" (and it certainly wasn't what Treadway designed it to measure), then I think that's an important critique to highlight in conjunction with the 65% completion of hard task issue.

I agree with what others have said that at this point, it's probably better to not focus on the exclusion of HV F since they'll always have some plausible deniability there (at least for the letter to the editor).
 
There's history and precedent of booting out the data of people who try to maximise their payout, as shown in the next two screengrabs. This should be evidence EEfRT is a mess. But in terms of a fight over whether HVF's data should have been excluded, it's likely to weigh on Wallitt's side.

It is further evidence the best approach is to focus on rates of hard task non-completion by fatigued participants.

1.

View attachment 21289

2. This is where footnote 37 in the above screenshot leads:
Neuropsychopharmacology. 2021 May; 46(6): 1078–1085.

Dose-response effects of d-amphetamine on effort-based decision-making and reinforcement learning
View attachment 21290
That's an odd framing. This strategy doesn't artificially increase payouts, it effectively increases payouts. It's just bad game design if they do that.
 
I'm putting a link to this post from @Karen Kirke which includes SF-36 info

Deep phenotyping of post-infectious myalgic encephalomyelitis/chronic fatigue syndrome, 2024, Walitt et al | Page 26 | Science for ME (s4me.info)

I'm sure there might be other disability-related scales somewhere we can also use to scan vs this, but it struck me when I saw the range within ME-CFS on this and vs HVs that the pattern on non-completion of hards and how to me it seems to 'group' seems reflective of this.

WHich to me would indicate a disability-issue with not having eg pre-calibrated the level of hard to individualise it for disability or something similar in as part of the checks process properly done etc
@Karen Kirke any chance you could share the SF-36 data file with me or let me know how I could request a copy? Is my understanding correct that it wasn't included with the Wallit 2024 data so you had to request it separately?

~EDIT: Never mind, I found your post about how to request access, thanks! ~

I think @bobbler raises a good point and I'd like to run an analysis to see if the there's a relationship between SF-36 and ability to complete the hard task on EEfRT (i.e. was ability here correlated with self-reported disability)
 
Last edited:
Just sharing this message today from Koroshetz, for visibility, when I had asked for paper amendment of ‘effort preference’ term (mods I left in both channels but feel free to edit or delete where you see fit).

“Understand the anxiety but it’s very important that the community understands the finding.

To simplify how the brain works I could say that the brain circuits are constantly estimating the difference between the effort required and the reward to be gained from executing an action. This applies to all behaviors, even to what I am typing now. This is easier to understand in estimating the degree of force you need to exert to pick something up something, but even the more automatic behaviors like whether we are “hungry” enough to eat. So the finding is very important. In the persons with ME/CFS the circuits that do this estimation of effort are malfunctioning. They even see an abnormality in brain activation related to this finding. They see alterations in dopamine metabolites (potentially related to the reward signals). And they speculate that it is abnormalities in the immune system that are driving the abnormality.

So this has nothing to do with “psychological”, this is a real abnormal finding in how our neural systems are supposed to work.

Planning a hybrid workshop to explain the findings to the subjects and the general community soon.”
 
Just sharing this message today from Koroshetz, for visibility, when I had asked for paper amendment of ‘effort preference’ term (mods I left in both channels but feel free to edit or delete where you see fit).

“Understand the anxiety but it’s very important that the community understands the finding.

To simplify how the brain works I could say that the brain circuits are constantly estimating the difference between the effort required and the reward to be gained from executing an action. This applies to all behaviors, even to what I am typing now. This is easier to understand in estimating the degree of force you need to exert to pick something up something, but even the more automatic behaviors like whether we are “hungry” enough to eat. So the finding is very important. In the persons with ME/CFS the circuits that do this estimation of effort are malfunctioning. They even see an abnormality in brain activation related to this finding. They see alterations in dopamine metabolites (potentially related to the reward signals). And they speculate that it is abnormalities in the immune system that are driving the abnormality.

So this has nothing to do with “psychological”, this is a real abnormal finding in how our neural systems are supposed to work.

Planning a hybrid workshop to explain the findings to the subjects and the general community soon.”

Hmm interesting, I've as a very lay non-expert, questions on a few issues here.

Could you point me to what you specifically said when you asked for this?

Apologies as this is just a bit of a riffing/brainstorming thoughts. It seems another case of having to 'get to the bottom of' what is being talked about here, as if understanding the EEfRT wasn't enough of an odyssey. I probably also need to look at the grip strength stuff they've combined in too (and that thread), but there is also the papers where they've combined the two trying to claim '5 ways of looking at effort' or something.

Firstly the response seems to have side-stepped the 'operationalisation of wanting' focus of the EEfRT and be trying to focus (clue being in 'force') on the grip-strength side of things. Whilst then mixing in bits about reward that they didn't measure in the grip test (only in the EEfRT test) and that they failed to contextualise properly (as evidenced by the completion rate findings)?

If we are going to have to go down this road with unpicking it getting mixed in with these terms with the grip-strength stuff...

I can't remember the exact name of the module back then but the closest now seems to be something like neuropsychology of action/movement.

Anyway even in that undergraduate module the thing that was clear is that 'how the brain works' is that it has both forward and backward processing when executing an action. Examples used were indeed people who perhaps had a stroke or a disease where their balance was off or they were reaching to the left of the actual object, said people then get information going back to the brain that they'd 'missed the object' from eg what their hand felt or didn't feel when it went to grip, as well of course 'sight' seeing the vase smash to the ground.

Isn't it that backward processing that probably means the mirror-trick works for phantom limb syndrome? : Mirror Therapy for Phantom Limb Pain | NEJM

EDIT: I feel compelled here to note that the mirror (in those it does help) can only fix 'the pains' and doesn't, of course, solve the missing leg - a metaphor/misunderstanding that I can't help but think of re: certain areas vs ME/CFS.

ANd we all know hunger is about leptin and grellin. Again forward and backward information as you eat something and feel full-up and satisfied or don't appropriately. Problems with either of these can cause issues. But you can also have eg an IBD that means you aren't absorbing things or there are digestion issues in other ways and so on that would be likely to produce some sort of feedback into the loop?
EDIT: but I'm not sure what that one 'has got to do with the price of eggs' [ What does that have to do with the price of eggs - Idioms by The Free Dictionary ] here at all?

Anyway as your body gets used to disability that information will impute into the calculations too. Sorry this isn't strictly right, but as it popped into my head for a moment as levity I thought I'd say it: I've got a picture in my head of when you get a puppy that grows really fast into being a pretty huge dog and still thinks it can curl up on the small lap of a person. Who is swamped under them. When I think of their 'mismatch' stuff.

Anyway
None of the tasks used were a 'one-off reach for the vase', or 'put it down on x marks the spot' so that backwards loop is even more relevant in their examples used than their forward one. And I'm not sure if it was a forward processing issue that you would have seen a downward curve rather than too low a force right off the bat? That backwards loop will of course be the one that is communicating the fatiguability information and I'm not convinced they've managed to nail the inference that information 'must be wrong' or that the effort calculation has somehow got the wrong multipliers in there or something.

And a grip strength test is less about holding a vase and then dropping it because your brain didn't calculate how hard you need to grip it, and more like eg how long can you hold the hot saucepan handle? the feedback sensations related to fatiguing/fatiguability, and a test where something heavy isn't going to drop on your foot, or something smash as part of the calculations of the 'pros vs cons' (and in the case of those two scenarios, how long you've got to put it down somewhere calculation for action)?

Anyway eventually your 'automatic' function (if your conscious one also doesn't) should if it is working right release your grip from that hot saucepan handle when it begins to burn the hand too badly. Even if you are just cm from getting to the sink. There is a lot less of a downside of loosening a grip on a grip-test where people are just looking at what you can do than hot water going down your legs

So, apologies if lots of other people are more up with understanding this but I'm trying to put together the pieces of info that they did measure and what they mean as a bit of a jigsaw puzzle of this mismatch thing


It's all very well trying to minimise out disability (which seems to be one issue with the completion stuff for EEfRT) and use a tone inferring you are doing it 'because the reader must be unable to understand' but that clearly isn't why they are saying things that are incorrect.

The dopamine note is interesting, but is that being interpreted in the 'psych-neuro' sense rather than being seen potentially as a 'downstream' given that there are lots of conditions where dopamine is affected and of course said conditions (like Parkinsons) have specific motor issues.
 
Last edited:
I wrote to Koroshetz:

“I am writing today with concern on the recent NIH ME/CFS publication. I’m asking that the term “effort preference” be removed from the paper immediately, so that it is not framed as a cause of ME/CFS. As a person living with this disease, I hope you will sincerely consider this ask.”
 
Sorry but for Person with ME the decision how much energy to spend on any given activity isn’t a simple effort v reward calculation described by Korosshetz if I do this I will get 2 dollars, it is reward gained less harm/cost incurred for any given use of energy. Harm/cost being a range of impacts including increased severity of illness pain and wother symptoms resulting in , inability to carry out other activities, if I do this I will get 2 dollars but I won’t be able to do activity tomorrow or in x days or weeks. When my symptoms get worse how can they say my effort calculation wrong too low. If they were saying the person with ME is overestimating their ability to exert I could see the point because if we were underestimating nobody would get PEMbut thats not what Walitt is saying is it?

(Sorry bit rambling).

eta also Koroschetz it’s not about the community not properly understanding it is either that’s what Walitt really means or he hasn’t explained it effectively. He is the one with responsibility for the communication not the community.
 
Last edited:
I wrote to Koroshetz:

“I am writing today with concern on the recent NIH ME/CFS publication. I’m asking that the term “effort preference” be removed from the paper immediately, so that it is not framed as a cause of ME/CFS. As a person living with this disease, I hope you will sincerely consider this ask.”

PS Please don't take any of my trying to work out what to make of this as suggestions on what to reply, or indeed that it should involve any kind of rebuttal (I'm just trying to work out in the first place what they are trying to suggest in what they've said).

I'm just trying to think myself up to speed on the issue itself, then there is the question about what is the sensible or strategic thing to do - I hope that doesn't come across as insensitive as I know that leaves you holding the 'hot potato' so to speak?

I think the angle/question of those who are noting it might be damage control etc is just as important on the conversation about that one
 
@EndME I know you've read a bunch of EEfRT papers at this point, have any of these studies asserted that EEfRT is meant to measure "effort preference"? As far as I can tell, Wallit seems to have invented the construct as they make no reference to any studies that actually use the term "effort preference". In fact, the only study Wallit ever cites when discussing effort preference is Treadway 2009, which never uses the term.

If there isn't any evidence that other reserachers have used EEfRT to measure "effort preference" (and it certainly wasn't what Treadway designed it to measure), then I think that's an important critique to highlight in conjunction with the 65% completion of hard task issue.

I agree with what others have said that at this point, it's probably better to not focus on the exclusion of HV F since they'll always have some plausible deniability there (at least for the letter to the editor).

I'm sure @EndME has probably got more useful pointers here, but thought in the mean time I'd point you towards these two papers which is the closest I've found to it starting to be used in the 'effort sense':

Effort-Based Decision-Making Paradigms for Clinical Trials in Schizophrenia: Part 1—Psychometric Characteristics of 5 Paradigms | Schizophrenia Bulletin | Oxford Academic (oup.com)
Effort-Based Decision-Making Paradigms for Clinical Trials in Schizophrenia: Part 2—External Validity and Correlates | Schizophrenia Bulletin | Oxford Academic (oup.com)

It's interesting that they have both EEfRT and grip-strength (along with 3 other tests) in the tests they've chosen - and reading this struck me I wondered whether this is what Walitt was gesturing towards?
 
I'm sure @EndME has probably got more useful pointers here, but thought in the mean time I'd point you towards these two papers which is the closest I've found to it starting to be used in the 'effort sense':

Effort-Based Decision-Making Paradigms for Clinical Trials in Schizophrenia: Part 1—Psychometric Characteristics of 5 Paradigms | Schizophrenia Bulletin | Oxford Academic (oup.com)
Effort-Based Decision-Making Paradigms for Clinical Trials in Schizophrenia: Part 2—External Validity and Correlates | Schizophrenia Bulletin | Oxford Academic (oup.com)

It's interesting that they have both EEfRT and grip-strength (along with 3 other tests) in the tests they've chosen - and reading this struck me I wondered whether this is what Walitt was gesturing towards?

@andrewkq
I've noticed that Treadway is a co-author on the first one, but doesn't appear to be on the second one (which looks at external validity etc). I don't know what the likelihood is of there being history of commentary from someone who is a co-author of any kind (as they wouldn't be a peer-reviewer, but might reply to comments or there be other conversations) or how one might seek it if they had fuller access to databases of those kinds of things. Or whether on the second where he isn't a co-author it is worth looking for comments from said paper from him there?
 
Last edited:
To simplify how the brain works I could say that the brain circuits are constantly estimating the difference between the effort required and the reward to be gained from executing an action. This applies to all behaviors, even to what I am typing now. This is easier to understand in estimating the degree of force you need to exert to pick something up something, but even the more automatic behaviors like whether we are “hungry” enough to eat. So the finding is very important. In the persons with ME/CFS the circuits that do this estimation of effort are malfunctioning. They even see an abnormality in brain activation related to this finding. They see alterations in dopamine metabolites (potentially related to the reward signals). And they speculate that it is abnormalities in the immune system that are driving the abnormality.

This looks to me like complete bullshit. What finding? What meaningful result?
Estimating reward does not come in to falling on the floor feeling sick.

There may be a difference in brain activation but who is to say it is an 'abnormality'?

If abnormalities in the immune system are driving it maybe it is a normally functioning response. You don't plan to feel ill. You may plan to try to feel less ill.
 
Just sharing this message today from Koroshetz, for visibility, when I had asked for paper amendment of ‘effort preference’ term (mods I left in both channels but feel free to edit or delete where you see fit).

“Understand the anxiety but it’s very important that the community understands the finding.

To simplify how the brain works I could say that the brain circuits are constantly estimating the difference between the effort required and the reward to be gained from executing an action. This applies to all behaviors, even to what I am typing now. This is easier to understand in estimating the degree of force you need to exert to pick something up something, but even the more automatic behaviors like whether we are “hungry” enough to eat. So the finding is very important. In the persons with ME/CFS the circuits that do this estimation of effort are malfunctioning. They even see an abnormality in brain activation related to this finding. They see alterations in dopamine metabolites (potentially related to the reward signals). And they speculate that it is abnormalities in the immune system that are driving the abnormality.

So this has nothing to do with “psychological”, this is a real abnormal finding in how our neural systems are supposed to work.

Planning a hybrid workshop to explain the findings to the subjects and the general community soon.”
We understand the findings perfectly well. The issue is that we disagree with their weaponizing of pseudoscience to string together a theory that has no basis in reality. I honestly don't know how I would respond to this, it feels very condescending.
 
I think it is worth while to look at issues at all levels. I tend to focus on the broad brush but I think the detail is equally important.

One simple thing I am wondering about:
The paper proposes the general interpretation that peripheral tissues are essentially normal and that the problem is that central signals either prevent activities or make them seriously unpleasant. That to me is a reasonable idea but Nath's comments suggest confusion between two different types of central signalling.

In flu, signals due to cytokines either make actions impossible (you actually fall over if you try to stand) or make actions induce unpleasant symptoms like nausea or 'fatigue'. My understanding is that in ME the situation is similar, in both forms, except that whereas in flu unpleasant symptoms occur within a couple of minutes (plus maybe more payback after an hour or so) in ME the reaction is delayed and can be very long lasting.

What the effort tests test for, however, is either unconscious conditioned responses or deliberate conscious responses, acquired because of experiencing the 'flu signals'. These responses would constitute a second and quite different set of signals. (There may or may not be valid evidence for such responses.)

We have two sets of signals we might call flu signals and pacing signals. What is blindingly obvious with flu and Covid is that flu signals cause the pacing signals. But suggesting effort task data provide an explanation implies that pacing signals are responsible for flu signals, or just are flu signals, which is unjustified.

Put differently, whether or not PWME make different effort choices provides no explanation for being disabled.


And for the sub-group who made the same choices, but couldn't complete the clicks on said hard tasks, then still continued to choose them ?
 
Back
Top Bottom