Sam Carter
Established Member (Voting Rights)
... Walit et al. report that given equal levels ...
There's one tiny typo in an otherwise fantastic letter @ME/CFS Skeptic, "Walit" should be "Walitt".
... Walit et al. report that given equal levels ...
I used data shared by @Karen Kirke in this post:
https://www.s4me.info/threads/use-o...s-2024-walitt-et-al.37463/page-19#post-519652
I have amended my original post to include this info as well.Please include the following citations when using these data:
- Walitt, B., et al. “Deep phenotyping of Post-infectious Myalgic Encephalomyelitis/Chronic Fatigue Syndrome.” Nature Communications. February 21, 2024. DOI: 10.1038/s41467-024-45107-3
- Mathur, R.* & Carnes, M.U.*, et al. mapMECFS: a portal to enhance data discovery across biological disciplines and collaborative sites. J Transl Med 19, 461 (2021). https://doi.org/10.1186/s12967-021-03127-3
*contributed equally and are designated co-first authors
If you/others do want to cite my original post in the references, then it may sound like a contradiction - "severely disabled" in the draft text but in my post the mean places the average patient just on the moderate side of the border of moderate and severe ME/CFS. Two different things - disability and ME/CFS - but it could still jump out to any reader who follows the link. You could get around that by using a word other than "severely".PI-ME/CFS patients were severely disabled with a mean SF-36 physical function score of 31.8 compared to a score of 97.9 for the control group.
I don't know if this thread has just slowed down or if others are working on a letter behind the scenes. I think a lot of valid points were raised that prove that Walitt et al.'s interpretation of the EEfRT data is seriously flawed.
I have written a first draft for a letter to be sent to the authors, asking for a correction. Pretty much all arguments have already been made by others on this thread so I take no credit for them - just want to help to string them toghether.
I have no concrete plan to send the letter. I would prefer that others who have more statistical knowledge and academic qualifications than me will take this further.
Incorrect interpretation of ME/CFS patients’ effort preference
In a comprehensive study of patients with post-infectious myalgic encephalomyelitis/chronic fatigue syndrome (PI-ME/CFS), Walitt et al. claim that “an alteration of effort preference, rather than physical or central fatigue” is a defining feature of the illness.1 Effort preference was defined as “how much effort a person subjectively wants to exert” and measured using the Effort-Expenditure for Rewards Task (EEfRT). The interpretation of EEfRT results by Walitt and colleagues, however, is highly problematic as it fails to consider that tasks required more effort from patients than from healthy controls.
The EEfRT is a multi-trial experiment that has been used to measure reward motivation in patients with anhedonia, schizophrenia, and other mental disorders. In Walitt et al.’s study of 15 PI-ME/CFS and 17 healthy the EEfRT lasted 15 minutes. In each of the successive trials, participants were instructed to choose between an easy and hard task. Both required several button presses within a limited time frame for successful completion: 30 button presses in 7 seconds for the easy task and 98 button presses in 21 seconds for the hard task. If participants completed the hard task successfully, they had a chance of receiving a higher reward than for completing the easy task. The reward values and probability of receiving it varied across trials and this information was provided to participants before they made their choice. Effort preference was estimated by the proportion of hard task choices. Walitt et al. report that given equal levels and probabilities of reward, healthy controls chose more hard tasks than PI-ME/CFS patients (Odds Ratio, OR = 1.65 [1.03, 2.65], p = 0.04).
The EEfRT requires however that participants can complete the tasks successfully and that the effort needed is equivalent in patients and controls. Treadway et al., the research team that developed the EEfRT and whose protocol was implemented by Walitt et al. with minor modifications, cautioned: “An important requirement for the EEfRT is that it measure individual differences in motivation for rewards, rather than individual differences in ability or fatigue. The task was specifically designed to require a meaningful difference in effort between hard and easy-task choices while still being simple enough to ensure that all subjects were capable of completing either task, and that subjects would not reach a point of exhaustion.” 2
Several techniques have been introduced in the EEfRT literature to ensure that the test measures reward motivation rather than differences in effort or ability. These include individually calibrating the required number of button presses3, controlling for participants’ motoric ability4, and evaluating whether participants had an adequate completion rate.2
Although Walitt et al. implemented four test trials before the EEfRT started, they did not implement measures to ensure that the effort required to complete tasks was similar in patients and controls. Consequently, PI-ME/CFS patients could only complete 67% of the hard tasks successfully compared to 98% in controls. This was a much larger difference (OR = 27.23 [6.33, 117.14], p < 0.0001) than the group difference in choosing hard over easy tasks. This problem was already evident in the four test trials during which PI-ME/CFS patients could only complete 42% of the hard tasks compared to 82% for controls. When we added successful completion rate to the statistical model, the difference in hard task choices was no longer significant (OR = 1.19 [0.79, 1.81]).
Walitt et al. did note that during the EEfRT there was no difference in the decline in button-press rate over time for either group for hard tasks. This might indicate that task-related fatigue did not influence the results. There was however a decline in button-press-rate in PI-ME/CFS patients for easy tasks that was not seen in controls. In addition, these measurements only reflect fatigue induced by the 15-minute button-pressing test, not the symptoms and debility participants already had at the start of the EEfRT.
PI-ME/CFS patients were severely disabled with a mean SF-36 physical function score of 31.8 compared to a score of 97.9 for the control group. Reduced psychomotor function5 and impairments in fingertip dexterity and gross movement of the hand, fingers, and arm6 have been reported in ME/CFS patients. Walitt et al. also found that patients in their cohort were unable to maintain force during a hand grip task.1 It is therefore likely that the EEfRT required more effort from PI-ME/CFS patients than from controls. Walitt et al. also reported a strong correlation (R=0.57) between PI-ME/CFS patients’ hard task choices and the ability to maintain force during the grip test. This supports our conclusion that patients’ EEfRT choices reflected motor ability as well as effort preference. No such correlation was found in healthy controls (R=-0.04).
The fact that the group difference in hard task choices was relatively small compared to the larger difference in completion rate, suggests that patients kept trying to succeed on hard tasks, despite past failures. Figure 1 shows the recorded button presses and completion rate per trial for all 31 participants. Several PI-ME/CFS patients had repeated failed attempts to complete the hard tasks (seen as repeated high red bars on the graph), a pattern that was not seen in controls. These findings are contrary to Walitt et al.’s hypothesis that ME/CFS patients prefer to exert themselves less than healthy controls.
View attachment 21419
Figure 1. Button presses per participant for each of the trials they managed to complete during the 15-minute EEfRT. Successful completions are pictured in green while failed attempts are indicated in red.
In conclusion, the EEfRT data indicates that the button-pressing tasks were more difficult for PI-ME/CFS patients than for controls, not that the former have abnormal effort preferences. In the past, ME/CFS patients have repeatedly been ‘victim blamed’ when behavioral consequences of their illness were incorrectly proposed as the cause of their symptoms.7 Considering the negative impact such misattributions may have, we kindly ask Walitt et al to correct their erroneous account of the EEfRT results.
References
1. Walitt, B. et al. Deep phenotyping of post-infectious myalgic encephalomyelitis/chronic fatigue syndrome. Nat Commun 15, 907 (2024).
2. Treadway, M. T., Buckholtz, J. W., Schwartzman, A. N., Lambert, W. E. & Zald, D. H. Worth the ‘EEfRT’? The Effort Expenditure for Rewards Task as an Objective Measure of Motivation and Anhedonia. PLOS ONE 4, e6598 (2009).
3. Fervaha, G. et al. Incentive motivation deficits in schizophrenia reflect effort computation impairments during cost-benefit decision-making. J Psychiatr Res 47, 1590–1596 (2013).
4. Ohmann, H. A., Kuper, N. & Wacker, J. A low dosage of the dopamine D2-receptor antagonist sulpiride affects effort allocation for reward regardless of trait extraversion. Personal Neurosci 3, e7 (2020).
5. Schrijvers, D. et al. Psychomotor functioning in chronic fatigue syndrome and major depressive disorder: a comparative study. J Affect Disord 115, 46–53 (2009).
6. Sanal-Hayes, N. E. M., Hayes, L. D., Mclaughlin, M., Berry, E. C. J. & Sculthorpe, N. F. People with Long Covid and ME/CFS Exhibit Similarly Impaired Dexterity and Bimanual Coordination: A Case-Case-Control Study. Am J Med S0002-9343(24)00091–3 (2024) doi:10.1016/j.amjmed.2024.02.003.
7. Thoma, M. et al. Why the Psychosomatic View on Myalgic Encephalomyelitis/Chronic Fatigue Syndrome Is Inconsistent with Current Evidence and Harmful to Patients. Medicina 60, 83 (2024).
I don't know if this thread has just slowed down or if others are working on a letter behind the scenes. I think a lot of valid points were raised that prove that Walitt et al.'s interpretation of the EEfRT data is seriously flawed.
I have written a first draft for a letter to be sent to the authors, asking for a correction. Pretty much all arguments have already been made by others on this thread so I take no credit for them - just want to help to string them toghether.
I have no concrete plan to send the letter. I would prefer that others who have more statistical knowledge and academic qualifications than me will take this further.
Incorrect interpretation of ME/CFS patients’ effort preference
In a comprehensive study of patients with post-infectious myalgic encephalomyelitis/chronic fatigue syndrome (PI-ME/CFS), Walitt et al. claim that “an alteration of effort preference, rather than physical or central fatigue” is a defining feature of the illness.1 Effort preference was defined as “how much effort a person subjectively wants to exert” and measured using the Effort-Expenditure for Rewards Task (EEfRT). The interpretation of EEfRT results by Walitt and colleagues, however, is highly problematic as it fails to consider that tasks required more effort from patients than from healthy controls.
The EEfRT is a multi-trial experiment that has been used to measure reward motivation in patients with anhedonia, schizophrenia, and other mental disorders. In Walitt et al.’s study of 15 PI-ME/CFS and 17 healthy the EEfRT lasted 15 minutes. In each of the successive trials, participants were instructed to choose between an easy and hard task. Both required several button presses within a limited time frame for successful completion: 30 button presses in 7 seconds for the easy task and 98 button presses in 21 seconds for the hard task. If participants completed the hard task successfully, they had a chance of receiving a higher reward than for completing the easy task. The reward values and probability of receiving it varied across trials and this information was provided to participants before they made their choice. Effort preference was estimated by the proportion of hard task choices. Walitt et al. report that given equal levels and probabilities of reward, healthy controls chose more hard tasks than PI-ME/CFS patients (Odds Ratio, OR = 1.65 [1.03, 2.65], p = 0.04).
The EEfRT requires however that participants can complete the tasks successfully and that the effort needed is equivalent in patients and controls. Treadway et al., the research team that developed the EEfRT and whose protocol was implemented by Walitt et al. with minor modifications, cautioned: “An important requirement for the EEfRT is that it measure individual differences in motivation for rewards, rather than individual differences in ability or fatigue. The task was specifically designed to require a meaningful difference in effort between hard and easy-task choices while still being simple enough to ensure that all subjects were capable of completing either task, and that subjects would not reach a point of exhaustion.” 2
Several techniques have been introduced in the EEfRT literature to ensure that the test measures reward motivation rather than differences in effort or ability. These include individually calibrating the required number of button presses3, controlling for participants’ motoric ability4, and evaluating whether participants had an adequate completion rate.2
Although Walitt et al. implemented four test trials before the EEfRT started, they did not implement measures to ensure that the effort required to complete tasks was similar in patients and controls. Consequently, PI-ME/CFS patients could only complete 67% of the hard tasks successfully compared to 98% in controls. This was a much larger difference (OR = 27.23 [6.33, 117.14], p < 0.0001) than the group difference in choosing hard over easy tasks. This problem was already evident in the four test trials during which PI-ME/CFS patients could only complete 42% of the hard tasks compared to 82% for controls. When we added successful completion rate to the statistical model, the difference in hard task choices was no longer significant (OR = 1.19 [0.79, 1.81]).
Walitt et al. did note that during the EEfRT there was no difference in the decline in button-press rate over time for either group for hard tasks. This might indicate that task-related fatigue did not influence the results. There was however a decline in button-press-rate in PI-ME/CFS patients for easy tasks that was not seen in controls. In addition, these measurements only reflect fatigue induced by the 15-minute button-pressing test, not the symptoms and debility participants already had at the start of the EEfRT.
PI-ME/CFS patients were severely disabled with a mean SF-36 physical function score of 31.8 compared to a score of 97.9 for the control group. Reduced psychomotor function5 and impairments in fingertip dexterity and gross movement of the hand, fingers, and arm6 have been reported in ME/CFS patients. Walitt et al. also found that patients in their cohort were unable to maintain force during a hand grip task.1 It is therefore likely that the EEfRT required more effort from PI-ME/CFS patients than from controls. Walitt et al. also reported a strong correlation (R=0.57) between PI-ME/CFS patients’ hard task choices and the ability to maintain force during the grip test. This supports our conclusion that patients’ EEfRT choices reflected motor ability as well as effort preference. No such correlation was found in healthy controls (R=-0.04).
The fact that the group difference in hard task choices was relatively small compared to the larger difference in completion rate, suggests that patients kept trying to succeed on hard tasks, despite past failures. Figure 1 shows the recorded button presses and completion rate per trial for all 31 participants. Several PI-ME/CFS patients had repeated failed attempts to complete the hard tasks (seen as repeated high red bars on the graph), a pattern that was not seen in controls. These findings are contrary to Walitt et al.’s hypothesis that ME/CFS patients prefer to exert themselves less than healthy controls.
View attachment 21419
Figure 1. Button presses per participant for each of the trials they managed to complete during the 15-minute EEfRT. Successful completions are pictured in green while failed attempts are indicated in red.
In conclusion, the EEfRT data indicates that the button-pressing tasks were more difficult for PI-ME/CFS patients than for controls, not that the former have abnormal effort preferences. In the past, ME/CFS patients have repeatedly been ‘victim blamed’ when behavioral consequences of their illness were incorrectly proposed as the cause of their symptoms.7 Considering the negative impact such misattributions may have, we kindly ask Walitt et al to correct their erroneous account of the EEfRT results.
References
1. Walitt, B. et al. Deep phenotyping of post-infectious myalgic encephalomyelitis/chronic fatigue syndrome. Nat Commun 15, 907 (2024).
2. Treadway, M. T., Buckholtz, J. W., Schwartzman, A. N., Lambert, W. E. & Zald, D. H. Worth the ‘EEfRT’? The Effort Expenditure for Rewards Task as an Objective Measure of Motivation and Anhedonia. PLOS ONE 4, e6598 (2009).
3. Fervaha, G. et al. Incentive motivation deficits in schizophrenia reflect effort computation impairments during cost-benefit decision-making. J Psychiatr Res 47, 1590–1596 (2013).
4. Ohmann, H. A., Kuper, N. & Wacker, J. A low dosage of the dopamine D2-receptor antagonist sulpiride affects effort allocation for reward regardless of trait extraversion. Personal Neurosci 3, e7 (2020).
5. Schrijvers, D. et al. Psychomotor functioning in chronic fatigue syndrome and major depressive disorder: a comparative study. J Affect Disord 115, 46–53 (2009).
6. Sanal-Hayes, N. E. M., Hayes, L. D., Mclaughlin, M., Berry, E. C. J. & Sculthorpe, N. F. People with Long Covid and ME/CFS Exhibit Similarly Impaired Dexterity and Bimanual Coordination: A Case-Case-Control Study. Am J Med S0002-9343(24)00091–3 (2024) doi:10.1016/j.amjmed.2024.02.003.
7. Thoma, M. et al. Why the Psychosomatic View on Myalgic Encephalomyelitis/Chronic Fatigue Syndrome Is Inconsistent with Current Evidence and Harmful to Patients. Medicina 60, 83 (2024).
Great news! I unfortunately (due to personal circumstances) will not be able to sign or co-sign a letter as I prefer to remain anonymous. So I hope that you, Andrew and others can take this further. Feel free to use or change anything from the draft above (I'm also happy to help out with further research and analysis behind the scenes if needed).I've had to take a quick break, but am still very much looking into the data and analysing it and deciding what response to write, so is @andrewkq I believe.
I think I made an error here because Andrew did not add successful completion rate to the model as I initially thought but a new binary category 'hard_task_completer' that refers to having a success rate of hard tasks above 90% (1) or not (0).When we added successful completion rate to the statistical model, the difference in hard task choices was no longer significant (OR = 1.19 [0.79, 1.81]).
Yes good point. Perhaps it's worth a try to add the actual completion rates to the model, not just having a +90% completion rate. Maybe that results in a clearer correlation.My guess is that the authors will probably respond to such a letter with something along the lines of "inability to complete tasks does not predict lower choice of hard tasks for pwME within this trial, indeed those with the lowest completetion rate chose hard most often in pwME, as such we have shown that these results are due to "effort preference" and not due to lower completion rates".
Fantastic letter. I hope it gets published. Can a letter be published as coming from the forum itself? Without names?I don't know if this thread has just slowed down or if others are working on a letter behind the scenes. I think a lot of valid points were raised that prove that Walitt et al.'s interpretation of the EEfRT data is seriously flawed.
I have written a first draft for a letter to be sent to the authors, asking for a correction. Pretty much all arguments have already been made by others on this thread so I take no credit for them - just want to help to string them toghether.
EDIT: I unfortunately will not be able to sign or co-sign a letter as (due to personal circumstances) I prefer to remain anonymous at the moment.
I thus have no concrete plan to send the letter. I hope that others who have more statistical knowledge and academic qualifications than me will take this further.
Incorrect interpretation of ME/CFS patients’ effort preference
In a comprehensive study of patients with post-infectious myalgic encephalomyelitis/chronic fatigue syndrome (PI-ME/CFS), Walitt et al. claim that “an alteration of effort preference, rather than physical or central fatigue” is a defining feature of the illness.1 Effort preference was defined as “how much effort a person subjectively wants to exert” and measured using the Effort-Expenditure for Rewards Task (EEfRT). The interpretation of EEfRT results by Walitt and colleagues, however, is highly problematic as it fails to consider that tasks required more effort from patients than from healthy controls.
The EEfRT is a multi-trial experiment that has been used to measure reward motivation in patients with anhedonia, schizophrenia, and other mental disorders. In Walitt et al.’s study of 15 PI-ME/CFS and 17 healthy the EEfRT lasted 15 minutes. In each of the successive trials, participants were instructed to choose between an easy and hard task. Both required several button presses within a limited time frame for successful completion: 30 button presses in 7 seconds for the easy task and 98 button presses in 21 seconds for the hard task. If participants completed the hard task successfully, they had a chance of receiving a higher reward than for completing the easy task. The reward values and probability of receiving it varied across trials and this information was provided to participants before they made their choice. Effort preference was estimated by the proportion of hard task choices. Walitt et al. report that given equal levels and probabilities of reward, healthy controls chose more hard tasks than PI-ME/CFS patients (Odds Ratio, OR = 1.65 [1.03, 2.65], p = 0.04).
The EEfRT requires however that participants can complete the tasks successfully and that the effort needed is equivalent in patients and controls. Treadway et al., the research team that developed the EEfRT and whose protocol was implemented by Walitt et al. with minor modifications, cautioned: “An important requirement for the EEfRT is that it measure individual differences in motivation for rewards, rather than individual differences in ability or fatigue. The task was specifically designed to require a meaningful difference in effort between hard and easy-task choices while still being simple enough to ensure that all subjects were capable of completing either task, and that subjects would not reach a point of exhaustion.” 2
Several techniques have been introduced in the EEfRT literature to ensure that the test measures reward motivation rather than differences in effort or ability. These include individually calibrating the required number of button presses3, controlling for participants’ motoric ability4, and evaluating whether participants had an adequate completion rate.2
Although Walitt et al. implemented four test trials before the EEfRT started, they did not implement measures to ensure that the effort required to complete tasks was similar in patients and controls. Consequently, PI-ME/CFS patients could only complete 67% of the hard tasks successfully compared to 98% in controls. This was a much larger difference (OR = 27.23 [6.33, 117.14], p < 0.0001) than the group difference in choosing hard over easy tasks. This problem was already evident in the four test trials during which PI-ME/CFS patients could only complete 42% of the hard tasks compared to 82% for controls.When we added successful completion rate to the statistical model, the difference in hard task choices was no longer significant (OR = 1.19 [0.79, 1.81]).
Walitt et al. did note that during the EEfRT there was no difference in the decline in button-press rate over time for either group for hard tasks. This might indicate that task-related fatigue did not influence the results. There was however a decline in button-press-rate in PI-ME/CFS patients for easy tasks that was not seen in controls. In addition, these measurements only reflect fatigue induced by the 15-minute button-pressing test, not the symptoms and debility participants already had at the start of the EEfRT.
PI-ME/CFS patients were severely disabled with a mean SF-36 physical function score of 31.8 compared to a score of 97.9 for the control group. Reduced psychomotor function5 and impairments in fingertip dexterity and gross movement of the hand, fingers, and arm6 have been reported in ME/CFS patients. Walitt et al. also found that patients in their cohort were unable to maintain force during a hand grip task.1 It is therefore likely that the EEfRT required more effort from PI-ME/CFS patients than from controls. Walitt et al. also reported a strong correlation (R=0.57) between PI-ME/CFS patients’ hard task choices and the ability to maintain force during the grip test. This supports our conclusion that patients’ EEfRT choices reflected motor ability as well as effort preference. No such correlation was found in healthy controls (R=-0.04).
The fact that the group difference in hard task choices was relatively small compared to the larger difference in completion rate, suggests that patients kept trying to succeed on hard tasks, despite past failures. Figure 1 shows the recorded button presses and completion rate per trial for all 31 participants. Several PI-ME/CFS patients had repeated failed attempts to complete the hard tasks (seen as repeated high red bars on the graph), a pattern that was not seen in controls. These findings are contrary to Walitt et al.’s hypothesis that ME/CFS patients prefer to exert themselves less than healthy controls.
View attachment 21419
Figure 1. Button presses per participant for each of the trials they managed to complete during the 15-minute EEfRT. Successful completions are pictured in green while failed attempts are indicated in red.
In conclusion, the EEfRT data indicates that the button-pressing tasks were more difficult for PI-ME/CFS patients than for controls, not that the former have abnormal effort preferences. In the past, ME/CFS patients have repeatedly been ‘victim blamed’ when behavioral consequences of their illness were incorrectly proposed as the cause of their symptoms.7 Considering the negative impact such misattributions may have, we kindly ask Walitt et al to correct their erroneous account of the EEfRT results.
References
1. Walitt, B. et al. Deep phenotyping of post-infectious myalgic encephalomyelitis/chronic fatigue syndrome. Nat Commun 15, 907 (2024).
2. Treadway, M. T., Buckholtz, J. W., Schwartzman, A. N., Lambert, W. E. & Zald, D. H. Worth the ‘EEfRT’? The Effort Expenditure for Rewards Task as an Objective Measure of Motivation and Anhedonia. PLOS ONE 4, e6598 (2009).
3. Fervaha, G. et al. Incentive motivation deficits in schizophrenia reflect effort computation impairments during cost-benefit decision-making. J Psychiatr Res 47, 1590–1596 (2013).
4. Ohmann, H. A., Kuper, N. & Wacker, J. A low dosage of the dopamine D2-receptor antagonist sulpiride affects effort allocation for reward regardless of trait extraversion. Personal Neurosci 3, e7 (2020).
5. Schrijvers, D. et al. Psychomotor functioning in chronic fatigue syndrome and major depressive disorder: a comparative study. J Affect Disord 115, 46–53 (2009).
6. Sanal-Hayes, N. E. M., Hayes, L. D., Mclaughlin, M., Berry, E. C. J. & Sculthorpe, N. F. People with Long Covid and ME/CFS Exhibit Similarly Impaired Dexterity and Bimanual Coordination: A Case-Case-Control Study. Am J Med S0002-9343(24)00091–3 (2024) doi:10.1016/j.amjmed.2024.02.003.
7. Thoma, M. et al. Why the Psychosomatic View on Myalgic Encephalomyelitis/Chronic Fatigue Syndrome Is Inconsistent with Current Evidence and Harmful to Patients. Medicina 60, 83 (2024).
@Hutan I for example looked at the highest amount of hard rounds played in a row per player (for the first 35 rounds, excluding HV F).
For the HV you get the numbers: 2 2 2 3 5 3 12 2 2 5 2 4 2 2 5 5
For ME/CFS you get the numbers: 3 2 5 5 3 5 1 6 2 2 5 2 4 2 2
That means the mean of the highest amount of hard rounds played in a row (for the first 35 rounds) for HVs is 3.625 whilst for pwME it is 3.2, a small difference driven by HV H (the same HV H that also largely drives the end results of the study, i.e. the higher mean in choosing hard).
Of course this one statistic really captures very little or close to nothing of the dynamics of the game and how often one has to take breaks.
If you look at the highest amount of hard rounds played in a row that were won per player (for the first 35 rounds, without HV F) you would expect something more significant because pwME have a much lower percentage of completion of hard tasks. That is also precisely what you get.
For the HV you get the idential numbers: 2 2 2 3 5 3 12 2 2 5 2 4 2 2 5 5
For ME/CFS you get the numbers: 1 1 5 1 3 5 1 1 2 5 2 4 2 2
That means the mean of highest amount of hard rounds successfully completed in a row (for the first 35) rounds for HVs is 3.625 whilst for pwME it is 2.3, which is a rather large difference which already shows us quite a bit.
Now these number don't cover nearly the full "rhythm-dynamics" in which the game is played because people play hard multiple times, more often than just the one time they do their maximum and so forth. It's a bit more complicated to try to capture the full dynamics of taking "breaks". The easiest thing would be too look at the above but instead of taking just the maximum per player you take all of the occurrences, i.e. whenever someone plays hard more than once in a row you count how often that happens in a row and add all of those occurences up, that's something I haven't done yet. Alternatively one easily could look at how often do people go from easy to hard in total.
I did "come up" with a metric, that is conceptually easy, but very time consuming to implement, to capture the full dynamics of each players "breaks" which ends up giving you one final value (a number) for the amount of "breaks" for each player takes and which does account for the rhythm in which the game is played in (rather than just "playing easy=one break"). For that you plot graphs per player for the number of times people play hard/easy as the game progresses, the y axis will cature your dynamics and the x axis is just the rounds of trials. If someone plays hard multiple times in a row they get added +1 on that graph for all of those games from where they were previously standing and the first time someone goes to easy you then add -1 to their current value for that game. If they continue with easy they are given the additional value -1 (which is the difference between playing hard multiple times where you don't accumulate +1's, but for easy you do accumulate -1's, because the end metric is supposed to count the pauses/breaks you need), if they go with easy again then you go to -2, if they then play hard you go up by +1 and so forth. The metric one then uses to count the breaks per player is something mathematics call total variation and essentially measures the total height of your graph. You can then add up all total varitations of the individual players to get the mean for each group (ME/CFS and HV). You do the same thing for games in a row as well as games succesfully played in a row (with the difference here being that successes for easy count the same way as just choosing easy, since both are a break).
I'm somewhat confident this captures taking "breaks" reasonably well over the full duration of the game (but I still have to think about it properly and am not even sure about if the whole thing does what you want it to do) and gives you one number at the end of everything that also captures the dynamics of the game (I'm also fairly confident I explained it very badly and posting a graph would better explain what I mean). I think one will be able to come up with something better or even something better by just looking at the easy rounds, because these are the breaks, but I haven't really come up with something yet that also accounts for the rhythm in which the game is played. I also still have to think about whether the above thing is the right way to go about this and whether it really captures everything you want to capture and if that is even meaningful at all.
Whether that would end up giving you something valuable I currently don't know, especially because the variation in what pwME do in this trial is so high and there is no obvious "rhythm" in how the game is played rather than just different people doing completely different things.
The end idea would probably be to have some notion "how often does someone have to take breaks but yet still choose to do hard, even if he can't". But I'm not sure if any of the above means anything and I'm guessing that it doesn't, because the whole setup of the game is very unrobust.
Yes good point. Perhaps it's worth a try to add the actual completion rates to the model, not just having a +90% completion rate. Maybe that results in a clearer correlation.
In the paper "effort preference" purely refers to percentage of hard tasks chosen (rather than choosing hard despite failure, even though that of course makes little sense overall and also doesn't agree with their press releases where Walitt has said “Rather than physical exhaustion or a lack of motivation, fatigue may arise from a mismatch between what someone thinks they can achieve and what their bodies perform”, because clearly there isn't a mismatch, as they can perform less and choose hard less, but I think we have to stick to what the paper says rather than what was said in press releases). Currently I think it might be hard to construct arguments around the other explanations you proposed because thus far we haven't seen much data to strengthen these ideas, because all the different differences between ME and HV seems to be driven by outliers rather than anything consistent, which is why the results are so "wishy-washy" to begin with. For example I find it very hard to conclude anything from this data about the motivation of participants and that is also what I would expect with data from a seemingly unrobust experiment where outliers plays a large role when the sample size is this small.If not, then I think the explanation is that many patients kept trying on the hard task, despite repeated failure (so the opposite of their view that ME/CFS patients have lower effort preferences). The tasks were much harder for ME/CFS patients (resulting in a large difference in completion rate) but the difference in hard task choices was relatively small because patients compensated by being more motivated, more willing to try, more willing to spend effort etc. And that weakened the correlation between the two. That would be my guess.
Some more data on the correlation between hard task choices and successful completion rates.
View attachment 21437
I found a value of r= 0.12, that is not significant with this sample size.
View attachment 21436
Patient D, H and A constitute the 3 dots at the bottom of the graph with low successful completion rates and a large proportion of hard trials. They are the patients that had the many high red bars and kept trying to complete hard tasks despite repeated failure.
... Given that I had previously discussed that "effort preference" is a bad marker for ME/CFS as it cannot seperate ME from HV (half of ME patients sitting above the HV "effort preference" mean and half of HV sitting below the ME/CFS "effort preference" mean) ...
Isn't this the key rebuttal? As in, if the effort preference of a good chunk of ME patients is no different to the healthies (and in many cases exceeds them), then it can't be a central, defining feature of ME.
And if Walitt wants to argue that low effort preference eventually leads to deconditioning, then why haven't the healthy volunteers with low effort preference become deconditioned and developed an ME-like syndrome?
You noted that the study had a low number of participants and that it appears to have neglected studying post-exertional malaise (PEM). PEM was a criterion for participation in the study. The Q&A link mentioned above provides information on PEM-related findings. The study was designed to examine a small group of well-defined patients that could be studied in depth.
... And if Walitt wants to argue that low effort preference eventually leads to deconditioning, then why haven't the healthy volunteers with low effort preference become deconditioned and developed an ME-like syndrome? ...
They don't argue this (at least not in the paper), so there's no contradiction there. ..
In the paper they write: "Both the autonomic and central motor dysfunction result in a reduction in physical activity. With time, the reduction in physical activity leads to muscular and cardiovascular deconditioning, and functional disability."
It's the trailing "and functional disability" in the sentence that troubles me, as though there is no disability prior to the deconditioning, and that the disability is "functional" (whatever that means). Had they written "and further disability" it would have removed some of the ambiguity. But why include it in the first place? It must occur in other energy or mobility limiting condition like Parkinson's or MS, yet it surely wouldn't merit inclusion in deep phenotyping studies of those conditions?
Again, is it because there is a problem with the neural system itself, or with what it is being asked to do? They are fundamentally different phenomenon.Therefore, the term does not describe a psychological difference in people with ME/CFS and people without ME/CFS; it describes an actual abnormal finding in how the body’s neural system is supposed to function.
Give them time, they are working towards making it part of the general psychosomatic model, to be applied to [checks notes] everything.It must occur in other energy or mobility limiting condition like Parkinson's or MS, yet it surely wouldn't merit inclusion in deep phenotyping studies of those conditions?