Was DecodeME (and other studies) wrong to ask participants to fill in a questionnaire that included questions intended to check for PEM, and to only include samples from those who answered yes to the PEM questions in the study?
No, they were right, because they wanted their participants to fulfill Canadian +/-IOM/NAM criteria which require PEM, and they could not get the numbers they needed assessed by physicians, so questionnaires were the only way. The two PEM questions were consistent with the Canadian criteria. You could quibble that the IOM criteria don't specifically require PEM to last 24 hours or more, but there are enough mentions of "prolonged" that this is reasonable, and there is at least some supportive evidence that duration of longer than 24 hours may be more specific for ME/CFS. They were right to try to get the participants to fulfill some criteria, so that they might be studying a similar population to other studies using the same criteria. So the two questions they asked were completely justified.
What we don't know is whether those who reported having been diagnosed with ME/CFS by a physician, but did not fulfill the PEM criteria in DecodeME, would have been genetically different from those who reported a diagnosis and did fulfill the PEM criteria.
I agree with Jonathan:
I think the GWAS context is very atypical. The hope is that by adding a questionnaire you get close enough to a biologically meaningful category of subjects to get a statistically significant result on signals you know are going to be causal with big numbers. For nearly all other research the situation is worse. DecodeME showed that its entry criteria for ME/CFS picked out a distinct biological pattern but whether our current concepts of what that pattern is are anywhere near appropriate is still very much up in the air. The PEM question may have refined the category or diluted it - we don't know. A different questionnaire that we think more closely reflects our concepts of PEM might do better or less well - who knows?
The problem for me is the assumptions underlying much of the discussion:
- we know what "true PEM" is
- people with other conditions do not have "true PEM"
- if we just get the questions right, it will pick out us and only us
- with the right questions, there would be less under- and overdiagnosis in ME/CFS
- the consequences of our questionnaire would be good, whereas other questionnaires cause harm
I can't get on board with any of those assumptions.
If this thread had asked: "If a study were done to explore post-exertional phenomena in ME/CFS compared to other fatiguing illnesses, what questions would you ask participants?" then I would have said "Finally!" and looked forward to a discussion on
exploratory questions so that we would get good data about triggers, duration, onset, the lot. To do a good study we would have to not be tied to what the results might be. All assumptions have to be thrown out. We have to be open to everything.
When we have enough good quality data to actually know what the situation is, then in theory an alternative set of questions might be put together for the very unusual DecodeME situation, and clinicians might be educated about which open-ended questions might be more likely to elicit pertinent info, and to prick their ears a little more if certain things were said in responses to their open-ended questions.
I think we need to be much less territorial about PEM in order to find out the approximate boundaries of our territory and whether we're an island or a landlocked country with a lot of neighbours and blurry borders, plus, in either scenario, the endless possibilities of minorities, dual citizens etc.
What I really want to see are more experimental studies that compare post-exertion responses in ME/CFS and other diseases. A few teams were getting somewhere around 2010/2011 and then nobody took up the baton - a shame, as so many patients were doing GET in the decade that followed that we might well have had actual experimental evidence of lack of benefit or harm from it.