UK:ME Association funds research for a new clinical assessment toolkit in NHS ME/CFS specialist services, 2023

Which really brings things back to the question as to why things are being measured

When it comes to assessing the services, I wonder if there are any useful models in other NHS clinics where there are few or no curative or disease-modifying treatment options?

I'm thinking of the lipoedema clinic I visited. For most patients in the early stages it was a diagnose-and-discharge model, but all the same I couldn't have felt more supported or listened to. I saw a consultant, a registrar, and a specialist nurse, all of whom made different contributions, and it was made clear that I was welcome to self-refer back any time I needed advice about progression or new symptoms.

ME patients need more input than that because there's a much bigger impact on their ability to work, study, and parent than in uncomplicated lipoedema. All the same, they'd give their eye teeth for access to that sort of expertise, compassion, and honesty.
 
There is evidence that in PACE the research team abandoned the end of trial actometer data collection that was in the original protocol because they found out that in a smaller study there was no improvement shown, whereas subjective outcomes showed some apparent improvement. Their conclusion, because they wanted a specific outcome, was that actometers are less accurate than questionnaires.
In fact actometers are much more objective because they can't be influenced to the same extent by therapist effect. At least if you wear them for long enough - for some pwME it's possible to maintain higher activity levels for a while, but that will eventually lead to a crash, so step count will drop precipitiously. We need that kind of objectivity in outcome measures for clinical trials. Pretending questionnaires about activity levels are more relevant to real life, reliable and accurate than actometers is ideology, not science.



I've been puzzling about this, as I think different purposes may require different measures. As I understand it, diagnosis and monitoring of patients requires getting information about
- symptoms
- functional limitations
- signs that are observable or measurable by the clinician using observation, physical testiing, biochemical testing, scans etc.

The area being talked about here is presumably just the symptoms and functional limitations parts.

There are 3 ways to find out about symptoms

- ask the patient directly in face to face consulation and take notes

- get them to fill in a questionnaire, which may be tick boxes, for existence of a symptom and some sort of scale for severity, or more open ended, eg what symptoms bother you most, or what can you no longer do.

- get them to keep a daily symptom diary for a week or more
_____________

There are 5 ways to find out about functional limitations

- ask the patient in face to face consultation

- questionnaire, again with tick boxes for can or can't do something or scales for how easy or difficult, how often you can repeat etc, or open ended. Also things like the Bell severity level scale for overall functional limitation

- get the patient to fill in a daily activity diary for a week or more

- observe/measure while performing a function
eg step test, 6 minute walk test, CPET, NASA lean test etc., cognitive testing including both function and fatiguability.

- wearable measuring device that continuously records activity - either simple step counter or more sophisticated movement and position detector.

_______________

Then there is the question of for what purpose such data needs to be collected. I can think of different contexts in which each of the above might be useful.

For the individual patient
Initial diagnosis - is this ME/CFS?
Initial symptom management planning with help of clinician
Monitoring and adjusting management by patient or with clinician

For the clinic
- Record keeping to help with monitoring individuals
- Service evaluation

For research
- finding out more about ME/CFS - eg whether symptom data correlates with biochemical test results
- clinical treatment trials - outcome measures.
_____________________

So my question would be do we need PROMS/questionnaires for any of these, or can we find objective measures of physical and cognitive function and hopefully eventually biomarkers that can replace PROMS/questionnaires?

I think PROMS/questionnaires have huge downsides:

- questionnaires require patients either
- to report a snapshot of that day's symptoms or function, and to assess the severity of that symptom of functional restriction on some sort of scale which relies too much on memory and imagination of how bad is bad, and comparison with past experience.
- or to recall accurately over a period of time how much the were affected by a symptom or how often they were able to perform an activity.

- They can be influenced by all sorts of things - wanting to please the therapist, persuasion that a symptom or functional restriction isn't really as bad as it is, or that you're catastrophising, fauity memory, wishful thinking etc.

- They often include unanswerable, irrelevant, misunderstood or uninterpretable questions for the patient

- misinterpretation of answers by the clinician. eg depression questionnnaires include questions about things that can be caused by ME, not by depression.

- Cherry picking and other misuses of questionnaire data.

- Claims that questionnaires are verified for a particular patient population on the grounds that their results correlate fairly well with other questionnaires
But both may be equally inappropriate, only focusing on one relatively minor or misunderstood symptom such as fatigue that is not the core or most disabling part of the disease.

- Questionnaires on function that only ask of you can do something once, without taking into account the cumulative effect of a whole day's activities give a false sense of functional capacity.
__________-

Are there any useful functions for questionnaires in ME/CFS?
________________

I think we all know all of the above. I just wanted to put it down here to organise my thoughts.
As ever Trish, a masterful response. Very helpful. Thanks. B
 
We are past 100 posts in this thread, and I think we are still floundering around trying to understand what the project is aiming to do, and why.

What has been described as 'psychometric tests' seems to be the main output and it sounds as though the researchers have already done some preliminary work which makes them feel as though they know what is needed and how to go about it.

@sarahtyson or someone from the MEA, could you share the project description that resulted in the awarding of the funds? I think then, we would all be rather closer to on the same page as to what is being proposed. We might then find that we agree with the MEA, that it is a worthwhile exercise. Or, if we disagree, at least we can zero in on the issues accurately, and see if some solutions can be found.
 
There is evidence that in PACE the research team abandoned the end of trial actometer data collection that was in the original protocol because they found out that in a smaller study there was no improvement shown, whereas subjective outcomes showed some apparent improvement. Their conclusion, because they wanted a specific outcome, was that actometers are less accurate than questionnaires.
In fact actometers are much more objective because they can't be influenced to the same extent by therapist effect. At least if you wear them for long enough - for some pwME it's possible to maintain higher activity levels for a while, but that will eventually lead to a crash, so step count will drop precipitiously. We need that kind of objectivity in outcome measures for clinical trials. Pretending questionnaires about activity levels are more relevant to real life, reliable and accurate than actometers is ideology, not science.
Yes. And all these years later, we have just reviewed a recent study on CBT in Long Covid that used actometers to allocate the participants into groups of low and higher activity, in order to provide them with more personalised instruction on how to reframe their thinking about fatigue and get over a purported fear of movement, among other things, in order to increase their activity. Despite an undertaking in the protocol to later measure activity again (which appears to have been forced upon them by reviewers of the protocol), in order to give some evidence that there was some useful impact of the CBT intervention, the researchers have not reported the before and after activity measurement. It's not even clear if they did the second activity measurement.

I agree with you Trish, actometers are certainly more relevant to real life and more accurate and reliable than a survey about activity levels. They are useful in the diagnostic process for providing a baseline, for later comparisons. @sarahtyson, you say that wearables aren't sufficiently accurate as a measure of activity. That statement is hard to understand. Can you explain it a bit more?
 
I agree, @Michelle, I find it hard to see that they do not at least give a rough idea of major change in a more objective way than asking questions. My wife uses one and it gives pretty reasonable account of activity.
I couldn't find any because I can't remember or figure out how to search for it, but over the last few years I've seen several long haulers who had pre-illness daily steps count from a smart watch/actimeter and compared to the period they were ill the difference is extreme, you can see the precipitous drop that marks a clear change. I saw many and of course I can't find a single one but we're talking about a 90%+ drop, impossible to miss and does not need to be statistically massaged in any way to show.

And I've seen the opposite, people who had been ill for months or longer and whose condition improved, and you can see the dramatic change in daily steps count, from tiny blips to sustained activity. Of course actimetry data is relevant here, there is no question about that.

As you say, not showing much change from trials only tells us that those treatments are useless, because the data reflect the change when it's there. And we are being played yet again with the recent Knoop trial where they, again, covered up the bad actimetry data, which they would have massively hyped had it been positive. I don't think anyone can seriously argue against that.

And although that's usually not measured, I'd also add pace velocity to it. I used to walk fast everywhere, long fast strides. The difference in speed is dramatic. I not only walk a lot less, I walk so much slower and that is also change that does not need any statistical massaging, it's a huge drop.

We don't just need more data, we also need better data, more substantial, more precise and with way more depth. That's beyond the scope here but it always shocks me how superficial the data we get from most studies is. That can't come from questionnaires.
 
Last edited:
Thanks Sarah,

I did do a quick read of his page and noted these things - and nice to have you confirm he is a top bloke and you know him well. I assumed his focus on this would, as those papers were, be the psychometric scale part. I thought it would be nice to get a sense of what the 'psychometric' would focus on, hence looking up his research - I have a psychology background, so I'm aware that this can be a pretty broad area in applicability/context (eg as far as things used for job interviews or air traffic control). But note his background in exercise science and health/medicine but recent focus on the stats stuff so didn't know how much to assume re: that

Am I right in taking from your answer that what you mean is that he is 'a fresh start' so the data and measures from him would start from scratch rather than drawing on past psychometrics he might have worked on with others in other contexts? and be driven by your starting from fresh as your own team - and wouldn't be building on other scales in similar literatures?

Or, if it is going to be drawn on, I'd be interested in answers re: my question was about the recent study he was involved in, that was about Covid-19, but specifically Long Covid/Post-covid (The modified COVID-19 Yorkshire Rehabilitation Scale (C19-YRSm) patient-reported outcome measure for Long Covid or Post-COVID-19 syndrome)
- which seems to have measures in it too, so it would be good to know if it is this sort of thing that would give us a 'flavour' of what might be being looked at in that area?

The paper itself is here: https://pubmed.ncbi.nlm.nih.gov/35603810/

and there is also one focused on the psychometric analysis here: https://pubmed.ncbi.nlm.nih.gov/34676578/

which has the following quote in its abstract:


So I did wonder whether given this, the psychometrics might be for this project likely to be along similar types of lines/these papers might provide some flavour etc?

I'm sure that you can see why it is an obvious and straightforward question in my mind to ask, even just given how literature often works (building on other existing scales in similar areas) - is this study and its scales/measures similar or going to be any type of starting point for yours?

The COvid-19 scale is a general overall measure. It may be useful to show overall change over time to measure outcome and useful for service evaluation and development, also reporting treatment outcome but lacks the detail we seek which will (probably) cover symptomology, activity, needs, Possibly mood and sleep as separate scales to symptomology, patients' needs and patient experience/satisfaction. The statistical approach is the same as that used in the C19 measure but the content will be very different
 
I agree. It is absolutely imperative that any assessment of people with ME/CFS that is being developed in 2023 involves wearable technologies/actimetry and real time symptom logging. Surveys are time consuming and very subject to manipulation and poor memory. Will you be asking people with ME/CFS how they are monitoring their illness? If you do, I am sure that you will find that many people are using technology to do that. @SNT Gatchaman, perhaps you have a comment on this.

We desperately need some measures in the assessment toolkit (and in research) to be as objective as they can be. If you do get a strong message from people with ME/CFS that wearable technology should be part of the assessment tools, is there scope within your project to investigate these? Or are the only outcomes that are possible surveys?

Im not disagreeing that the prospect of using 'wearables' to measure activity in everyday life is very appealing, which is why I have spent about 20 years trying to do so in both clinical trials and clinical practice. To cut a very long story short, in my experience there are none available that have the level of approval to use in the health care setting (the MRHA in the UK); produce the quality of data needed for use as an outcome or clinical measure; and/or is accessible and compatible with NHS or university IT systems; cover the parameters that are important to sufficient numbers/ breadth of patients to be useful as a clinical measure; reliable/feasible and acceptable for all patients to use; are of a suitable cost; quick and easy to collect, download and interpret the data at a service level. etc etc etc etc.

I know that many pwME use technologies to monitor and better understand their condition, I do myself. But one does not have to spend very long on discussion groups about them to realise there is huge variety in what people use and how they use them. They can be very useful for individuals to use (although there are also many reports of pwME not finding them useful in the same forums) but there is a huge difference between something being used for a individual level and at a service level.

As an aside, I am about submit a paper with Physios4ME about our study looking at the feasibility of assessing physiological measures during everyday activities (as a possible alternative to 2day CPET), I can't go into details until published but we (unsurprisingly) found many abnormalities indicating a disordered physiological responce to activity but the responses were highly varied, so the choice of what to measure, when, how and when is much more complicated and variable than one would hope. There would need to be much more investigation to work out how to match up the parameter, the technology, the extent to which activity (during measurement) needs to be standardised, and interpretation. I do hope that this work will be done and that we will have a physiological biomarker one day, but in the meantime I am getting on with work that can /will make a difference to practice and pwME in much shorter time frame. It would be preferable, rather imperative, for technology to be used to measure/monitor activity if the suitable technology was available, but it isn't. If it were available, it would be used mainly as an outcome measure, which as I have explained earlier is only one small part of clinical assessment. Q'aires are actually much more useful to specify the nature and severity of patients' problems, identify needs and priorities. This is the sort of information that is needed to develop goals, formulate treatment plans, assess outcome and patient satisfaction, and develop and evaluate services.

Will we be asking whether pwME monitor their condition? Possibly, it may come up in the needs assessment.
I know q'aires can be time consuming to complete, which is why feasibility and acceptability is one of the top issues we will be addressing. The PROMS will be designed to be as quick easy as possible to complete.
No there isn't scope to include wearables/'technology' is this project as it is not part of the aim/objectives/research question, requires a different method and resources I do not have access to.
 
Last edited by a moderator:
I am struggling now, so I cant find your comments about past/moving forward/baggage & your concerns about how contructive input on the toolkit might be here, in order to quote them, but i just wanted to say that I can well imagine that you may have come on here, seen a load of comments about Dr Gladwell and I imagine it may have seemed like it was just a negative, derogatory pile on, & thats regrettable, & for my part in that i apologise & will edit my original post accordingly.

I respect you want to move forward without the baggage of past history, and that as a PwME & a carer of one too you will be all too aware of it, but sadly, we are so many of us traumatised by that history & what is still going on, its a bombardment that seems unending, decade after decade. Things have not changed at ground level and we are still suffering greatly & being regularly derided, ridiculed & abused as a result of it, so context just cant be ignored or stepped out of so easily, we are human beings.

But i think if you read the links Trish provided, and for example, our discussions around the NICE draft & others, you will see that S4 is very capable of giving constructive feedback & i hope it will be a useful collaboration. But of course i recognise you are ill too and have caring responsibilities & will not be able to read everything.

All that is to say i hope you wont be put off by initial concerns. The forum is hot on not allowing personal attacks, but of course our familiarity with each other gives us a sense of the tone of the post that will be different when read by someone who doesnt know us, particularly when the persons work being discussed is their own or of a colleague/friend. We would do well to remember that i will certainly try.

I likely wont be able to engage again for a while as i used all my budget on thinking & typing now, but i do wish you well with the project & hope to chat again as it moves forward.
thank you
 
There is evidence that in PACE the research team abandoned the end of trial actometer data collection that was in the original protocol because they found out that in a smaller study there was no improvement shown, whereas subjective outcomes showed some apparent improvement. Their conclusion, because they wanted a specific outcome, was that actometers are less accurate than questionnaires.
In fact actometers are much more objective because they can't be influenced to the same extent by therapist effect. At least if you wear them for long enough - for some pwME it's possible to maintain higher activity levels for a while, but that will eventually lead to a crash, so step count will drop precipitiously. We need that kind of objectivity in outcome measures for clinical trials. Pretending questionnaires about activity levels are more relevant to real life, reliable and accurate than actometers is ideology, not science.



I've been puzzling about this, as I think different purposes may require different measures. As I understand it, diagnosis and monitoring of patients requires getting information about
- symptoms
- functional limitations
- signs that are observable or measurable by the clinician using observation, physical testiing, biochemical testing, scans etc.

The area being talked about here is presumably just the symptoms and functional limitations parts.

There are 3 ways to find out about symptoms

- ask the patient directly in face to face consulation and take notes

- get them to fill in a questionnaire, which may be tick boxes, for existence of a symptom and some sort of scale for severity, or more open ended, eg what symptoms bother you most, or what can you no longer do.

- get them to keep a daily symptom diary for a week or more
_____________

There are 5 ways to find out about functional limitations

- ask the patient in face to face consultation

- questionnaire, again with tick boxes for can or can't do something or scales for how easy or difficult, how often you can repeat etc, or open ended. Also things like the Bell severity level scale for overall functional limitation

- get the patient to fill in a daily activity diary for a week or more

- observe/measure while performing a function
eg step test, 6 minute walk test, CPET, NASA lean test etc., cognitive testing including both function and fatiguability.

- wearable measuring device that continuously records activity - either simple step counter or more sophisticated movement and position detector.

_______________

Then there is the question of for what purpose such data needs to be collected. I can think of different contexts in which each of the above might be useful.

For the individual patient
Initial diagnosis - is this ME/CFS?
Initial symptom management planning with help of clinician
Monitoring and adjusting management by patient or with clinician

For the clinic
- Record keeping to help with monitoring individuals
- Service evaluation

For research
- finding out more about ME/CFS - eg whether symptom data correlates with biochemical test results
- clinical treatment trials - outcome measures.
_____________________

So my question would be do we need PROMS/questionnaires for any of these, or can we find objective measures of physical and cognitive function and hopefully eventually biomarkers that can replace PROMS/questionnaires?

I think PROMS/questionnaires have huge downsides:

- questionnaires require patients either
- to report a snapshot of that day's symptoms or function, and to assess the severity of that symptom of functional restriction on some sort of scale which relies too much on memory and imagination of how bad is bad, and comparison with past experience.
- or to recall accurately over a period of time how much the were affected by a symptom or how often they were able to perform an activity.

- They can be influenced by all sorts of things - wanting to please the therapist, persuasion that a symptom or functional restriction isn't really as bad as it is, or that you're catastrophising, fauity memory, wishful thinking etc.

- They often include unanswerable, irrelevant, misunderstood or uninterpretable questions for the patient

- misinterpretation of answers by the clinician. eg depression questionnnaires include questions about things that can be caused by ME, not by depression.

- Cherry picking and other misuses of questionnaire data.

- Claims that questionnaires are verified for a particular patient population on the grounds that their results correlate fairly well with other questionnaires
But both may be equally inappropriate, only focusing on one relatively minor or misunderstood symptom such as fatigue that is not the core or most disabling part of the disease.

- Questionnaires on function that only ask of you can do something once, without taking into account the cumulative effect of a whole day's activities give a false sense of functional capacity.
__________-

Are there any useful functions for questionnaires in ME/CFS?
________________

I think we all know all of the above. I just wanted to put it down here to organise my thoughts.


I’m sorry I haven’t read your comment in full yet (but looking forward to doing so when I have a moment where I’m better set up to make the most of it :)

I did get a moment of inspiration on the actimeter bit as reading through that part of your comment (eg PACE) that one thing worth adding into the debate now is the fact that the tech is here and so commonly used by most non-pwme people that it is almost going to have to be addressed on basis of people will do it anyway but advice on the more misleading stuff etc vs ignoring elephant in room I imagine is the ‘state of play’ position

A total side note to a maybe more specific debate on that topic (actimeters of the type measuring 24-7) I worry about privacy, intrusiveness and controlling behaviour/advice ie how it is done when judging someone’s day which might be dictated by their illness and what they prioritise has in the past had the potential for ‘shoulds’ and diaries and the like to give me the willies someone might try and timetable my whole life. And the understanding eg on PEM and rest vs the old sleep hygiene presumptions doesn’t seem to have been fully cleared down with the paradigm change (which it should have but seems to for many have been seen as ‘just applies to exercise’). So if you had someone overly keen on sleep hygiene then demanding that data it would be scary.

ADDED PARA: Or even just the many who prefer to go 'behavioural' and think micro-managing a pwme, rather than supporting to 'live as well as can' ie respectfully as someone with a debilitating energy-limited condition (in a world where all isn't controllable) is what they should be doing as a job/profession. In those hands having data downloads of someone's most intimate body data has all sorts of worrying potential (for people who see someone not getting better as the person's fault for somehow not controlling their body because they still incorrectly/deludedly think their behavioural treatment can cure such things, or worse 'x is only ill because they don't go to bed early enough' type attitude, I hate to think of the possibilities if got into employer Occupational Health or benefits type arenas etc).

There are ways round all of this of course /third ways in that people with these things on their phones, wrists etc might well use these to inform their answers on questionnaires anyway - as some have said above to check out their curiosity that they might feel better.

so I’ve no genius answers here re specific scales, just musings on this re task ahead vs context and how such things might be implicitly working their way in anyway and there being downsides if managed wrongly that protocols could actually warn against. So really starting to see the potential benefit of this discussion/thinking process of what clinics might/do do etc
 
Last edited:
When it comes to assessing the services, I wonder if there are any useful models in other NHS clinics where there are few or no curative or disease-modifying treatment options?

I'm thinking of the lipoedema clinic I visited. For most patients in the early stages it was a diagnose-and-discharge model, but all the same I couldn't have felt more supported or listened to. I saw a consultant, a registrar, and a specialist nurse, all of whom made different contributions, and it was made clear that I was welcome to self-refer back any time I needed advice about progression or new symptoms.

ME patients need more input than that because there's a much bigger impact on their ability to work, study, and parent than in uncomplicated lipoedema. All the same, they'd give their eye teeth for access to that sort of expertise, compassion, and honesty.
the aim of the project is not to assess services, it is to work with pwME and clinicians to develop good quality tools to do so.
 
I appreciate you are sceptical, but assuming your experience is limited to ME, then you won't have experience of well-developed, psychometrically robust measurement tools so it perhaps not surprising.
Mike leads the Leeds Psychometric Lab. He is the world's 'go to' expert on Rasch analysis. This is the statistical approach we will use to assess the psychometrics of the measurement tools. He and I have worked together for years to develop several clinical measurement tools.
Please can you link to one or two such robust measurement tools for other conditions that you have developed, and the research papers showing how they were developed and tested for robustness, so we can discuss them and understand the process you will be going through better.

The COvid-19 scale is a general overall measure. It may be useful to show overall change over time to measure outcome and useful for service evaluation and development, also reporting treatment outcome but lacks the detail we seek which will (probably) cover symptomology, activity, needs, Possibly mood and sleep as separate scales to symptomology, patients' needs and patient experience/satisfaction. The statistical approach is the same as that used in the C19 measure but the content will be very different
I'm not sure whether we have a thread on this here. Can someone please check - I've run out of energy. If not, perhaps Sarah could give us a link so we can discuss it.
 
The modified COVID-19 Yorkshire Rehabilitation Scale (C19-YRSm) patient-reported outcome measure for Long Covid or Post-COVID-19 syndrome, 2022, Sivan
There's this one here @Trish, for Long Covid. It seems pretty much ok, as far as a survey of symptoms goes. They missed things like PEM and orthostatic intolerance to start with, but got those in on the second round. I'll put some comments on that thread. I'm assuming the ME/CFS one will be pretty much a cut and paste, with a bit of the coughing stuff taken out.
 
Last edited:
I know that many pwME use technologies to monitor and better understand their condition, I do myself. But one does not have to spend very long on discussion groups about them to realise there is huge variety in what people use and how they use them. They can be very useful for individuals to use (although there are also many reports of pwME not finding them useful in the same forums) but there is a huge difference between something being used for a individual level and at a service level.
It's a fact that there are wearables that can measure to a reasonable level of accuracy numbers of hours 'sleeping', 'awake but not moving' and 'awake and moving', and daily numbers of steps per day, along with a lot else. Hopefully someone will have the will and capability to do some research on these, because some good core objective outcomes are desperately needed for research.

If you are developing an assessment toolkit for clinics, without doubt, wearable technology should be part of it. I think the heading the announcement - "a new assessment toolkit" - is part of the mismatch between our expectations and yours. If the project was described as an assessment survey, part of a clinic assessment toolkit, then we all would have been on the same page more quickly. If you are just developing a pre-assessment survey that can be given before the person turns up at the clinic, and again periodically while the person is at the clinic (as the Covid Rehabilitation Scale appears to be), then that's fine. Presumably then, it should cover symptoms that are not characteristic of ME/CFS, so that the diagnosis process is done effectively?

This is the sort of information that is needed to develop goals, formulate treatment plans, assess outcome and patient satisfaction, and develop and evaluate services.
Can you give a few examples of what sort of goals people with ME/CFS should be developing? What sort of treatment plans would be formulated?
 
Last edited:
Can you give a few examples of what sort of goals people with ME/CFS should be developing? What sort of treatment plans would be formulated?

I read this as being about what goals the services should be developing—which would be fine, and appropriate—but like you, I worry when treatment plans are mentioned. There are no treatments, and if we can't be honest about that from the outset, both the clinics and the study are set up to fail.

I don't want to see either fail. I want to see clinics that are prepared to listen and respond to people's needs and priorities, are able to develop expertise over time in partnership with patients, and where it's understood that the most important outcome measure is not causing harm.
 
We've heard at the German ME/CFS conference from the Norwegian researchers, Fluge and Mella, about how they have successfully used Fitbits. They published a paper on it last year:
Activity monitoring and patient-reported outcome measures in Myalgic Encephalomyelitis/Chronic Fatigue Syndrome patients, 2022, Rekeland et al

They are planning to use Fitbits to track resting heart rate and steps per day as objective outcomes in intervention trials. There is no reason why ME/CFS intervention trials can't use objective outcomes; funders, advocacy groups, everyone who can, should not be accepting ME/CFS trials that don't have objective trials measured over a usefully long duration. It's not tenable for people to claim that the technology is not at a state where this is possible - it is both effective and affordable.

Similarly, for clinic evaluations, there must be objective outcomes of patient function included in the outcomes monitored. It is entirely possible.

I think there should also be monitoring of outcomes related to work and school - but having those as short term outcomes for clinic evaluation could be counter productive. People often need to reduce work hours when they first become ill. I'm not sure how work and school outcomes could safely be part of a clinic evaluation. Possibly they might work if they are 3 year followup measures, but the dropout rate might make the data unusable. Perhaps a combination of the 3 year followup and the dropout rate would work - and would provide an incentive for clinics to keep in contact with patients. We have seen clinics push people through a CBT course to fix their beliefs and then wave goodbye, with the clinicians happy that the subjective evaluation forms tell them that they have done a great job.
 
Last edited:
Perhaps a combination of the 3 year followup and the dropout rate would work - and would provide an incentive for clinics to keep in contact with patients. We have seen clinics push people through a CBT course to fix their beliefs and then wave goodbye, with the clinicians happy that the subjective evaluation forms tell them that they have done a great job.
The NHS ME/CFS service in my area is aimed so1e1y at new patients, there is no 1ong term fo11ow up, much 1ess a service for the most severe. I think this is typica1 in Eng1and at present. At 1east Somerset are honest that a11 they can offer is to he1p patients adjust to 1iving with the condition (this actua11y makes it easier when dea1ing with DWP benefits, as they make it c1ear there are no effective treatments for my ME).

Somerset CFS/ME Service is a County-wide service. The aim of the service is to help adults 18 years+ with mild to moderate CFS/ME develop strategies and skills to better manage their condition so that their overall quality of life and independence is improved.
We currently only accept referrals from GP’s.
The team consists of a Health Psychologist, Administrator and 2 Occupational Therapists. We are a team of specialists with many years of experience of helping people live as well as possible with the condition.
Since the pandemic we have been offering clients appointments via the telephone or video consultation. We will continue to review the guidelines related to returning to face-to-face appointments. As a service we do not offer home visits.

https://bacme.info/services/somerset-cfs-me-service/

I think this questionnaire research needs to be seen in this context, it isn't going to produce anything appropriate for use in c1inica1 tria1s, at 1east not for primary outcomes. Of course that doesn't mean that it won't get misused in future research - think Craw1ey's use of 'service outcomes' for her research papers. Indeed think about IAPTs misuse of the GAD and PHQ sca1es in their service outcome statistics (which was designed into it from its inception*).

*see the fo11owing website for more detai1 the prob1ems with IAPT -

http://www.cbtwatch.com/category/iapt/
 
Last edited:
I think this research needs to be seen in this context, it isn't going to produce anything appropriate for c1inica1 tria1s.
Sure, but the project is described as producing a Clinical Assessment Toolkit, certainly to be used several times on the same patient, and potentially contributing to clinic evaluations (e.g. is the benefit produced worth what the government is spending on it?; do outcomes vary by service?).

@sarahtyson has been adamant on this thread that wearable technology has no place in assessment because of its inaccuracy, expense and difficulty for patients. But that's just not true. We need objective outcomes to be part of research, but also to be part of patient assessment. We know that subjective assessments are biased.

I don't object to the development of a symptom survey that is used before, during and after an initial period of care in a clinic. And, from looking at the Long Covid one, it looks as though the people on the team have the skills to make a decent one. I just hope that they remember that the specialist clinics should also be screening for conditions that aren't ME/CFS. And that they don't claim that surveys alone constitute a 'Clinical Assessment Toolkit'.
 
We've heard at the German ME/CFS conference from the Norwegian researchers, Fluge and Mella, about how they have successfully used Fitbits. The published a paper on it last year:
Activity monitoring and patient-reported outcome measures in Myalgic Encephalomyelitis/Chronic Fatigue Syndrome patients, 2022, Rekeland et al

They are planning to use Fitbits to track resting heart rate and steps per day as objective outcomes in intervention trials. There is no reason why ME/CFS intervention trials can't use objective outcomes; funders, advocacy groups, everyone who can, should not be accepting ME/CFS trials that don't have objective trials measured over a usefully long duration. It's not tenable for people to claim that the technology is not at a state where this is possible - it is both effective and affordable.

Similarly, for clinic evaluations, there must be objective outcomes of patient wellbeing included in the outcomes monitored. It is entirely possible.

I think there should also be monitoring of outcomes related to work and school - but having those as short term outcomes for clinic evaluation could be counter productive. People often need to reduce work hours when they first become ill. I'm not sure how work and school outcomes could safely be part of a clinic evaluation. Possibly they might work if they are 3 year followup measures, but the dropout rate might make the data unusable. Perhaps a combination of the 3 year followup and the dropout rate would work - and would provide an incentive for clinics to keep in contact with patients. We have seen clinics push people through a CBT course to fix their beliefs and then wave goodbye, with the clinicians happy that the subjective evaluation forms tell them that they have done a great job.


100% agree on trials. In fact this should be over e.g. 2yrs follow up (and someone should be able to come up with a way it is a 'pattern' downloaded so that privacy issues and blips are ironed out but you can see whether e.g. 6mnths after someone thinking they are doing better they then enter a relapse where their activity pattern is at a 'lower threshold') and used as a yellow-card type requirement for all ME/CFS trials in order that they prove their treatment really isn't making people worse.

The tech is reliable enough to at least be able to use it to show if a certain % are basically declining at 6mnth, 12mnth, and how long this persists for. No claimed effect is 'real' until you've tested whether it is a 'false flag thinking you feel better when you are just pushing your boundaries too much' until you've checked the actual effects 6 and 12months on.

I can understand maybe there might be reliability issues for anything more detailed where you are trying to prove 'improvements' (which is often the focus of researchers behind the studies) but doing it the opposite way I don't think this holds for using this tech and it being at the stage where it can be reliable for checking for harm. Particularly when harm comes in the form of PEM but then relapse which reduces threshold if you are doing it consistently. All is needed is 'averages' checks for this. And it wouldn't mean someone wearing the tech for 2yrs continually if they didn't want to but having designated weeks within this time period. If, like all trials should have, there are controls, then with half-decent power in sample size these checks should be simple to make. Red flag anyone who drops and report how many and by how much.


My next bit is rambly as I've had a terrible week but I've started it off as it covers concerns worth trying to get my head around elucidating on 'context' for the clinics side of things. Bearing in mind e.g. some of these are spin-offs offering e.g. 6 sessions of CBT to mild pwme, who will be looking at keeping their funding for continuing to do that when they see whatever new measures are thrown at them. I'm trying to imagine how such measures will 'drop' or 'overlay' onto the current landscape and culture and what that will actually result in, vs if there is anything clever that can be done where such measures could 'drive' changes to these things and get rid of the 'framing' issues that I think is the mismatch-issue currently between ME/CFS provision vs the condition.

One worry I do have with clinic assessments is the idea that - if these then relate to 'goals' or 'impacts' we are going to have clinics that push people into things which are detrimental to their health in order to tick the box of 'that being the achievement'. I don't trust such situations not resulting in the focus being keeping at school/work at all costs to health - and the short-term focus and short-course focus will also never change because they will all know that doing such things will mean they might get their stats short term but they then wreck people and mean they never work again long-term so certainly won't want to change to a proper medical model of being responsible long term.

I just can't get my head away from the fact that it would be asking those whose career and pay is what they think they do as 'therapies' in the set-up for most of these centres, and we are expecting that having them either doing these assessments or being able to still do their therapies and effectively will 'work to these outputs' won't cause some huge warping of these vs the intented reason for having them. Because clinics will be looking to 'prove improvement' which will necessitate playing the game on the stats I think that it is vital to think about these in that context. I'm almost minded to say clinics should only have their funding linked to 5yr+ outcomes only, in order to cut out the risk associated with short-termism if you imagine how people could get pushed into doing to much which causes detriment longer term.

I don't know how we make the clinics more meaningful and avoid such risks without that change of making them responsible for long-term outcomes for a condition like ME/CFS because it is a condition that is so open to being played - although I guess if you took people with RA or cancer you could do the same by forcing them to stay at work and increase their activity for 6mnths to get your stats up then not have ownership of that meaning their 2,5,10yr prognosis has been made so much worse by having done so.

I also know that we need to be very careful that any measures which can be gerrymandered 'behaviourally' ie by those who use behavioural/manipulation techniques (I don't think for the record most of them think/realise this is what they are - the old 'good intentions' issue) rather than focusing on health and adjustments to then wait for that to mean there might be objective impacts which show through e.g. people being able to do more or at least not declining, will lead to the same old ‘bully/jolly/reframe the patients thinking about it to be more positive or brave’the patient to perform focus from too many - because I do not see signs of penny-drop nevermind culture change as there has been no proper come to Jesus moment, and the paradigm would require such a level of adjustment.

SO we do have to assume this is how most, who come from the background of that being their job and focus and mindset - to 'jolly the patients to achieve their goals' genuinely see their job and 'help'. And that’s of course what they’ve been hired to do so I say it with no inference that it isn’t - these things are what their job description or bid tender have asked for. They actually can't objectively see what they actually do any more clearly than before because of their own CBT reframed mindset reframing what they do into 'positive twist'. Because I have to say this merely because that has been and is the set-up for most so has to be assumed that will be what they will assume is wanted and 'good' unless someone is giving it a serious programme of change and enforcing it, and whilst some of the more obvious stuff might have been removed or sanitised I don't see the embedded stuff which is really the most problematic getting unpicked.

Which leaves me with a huge dilemma, of understanding the pragmatic need of if someone doesn't do something to at least nudge things to be better done then they will do their own/it will happen anyway, but I also know what isn't liked ends up being ignored often (cherry-picking), and having to think how such things might actually end up being played out in context. If patients are in clinics that offer little treatment and then have goals I can't see their position as effective 'pawns', instead of in the real healthcare system with medics being people with a disease that needs to be managed and a package of support to make surviving and living more possible, changing where such people running the show are reporting KPIs to keep their funding.

I think the reason I'm getting so confused about this and .. I think it is a worthy and needed project because of all these question ... what it actually is - is probably because it lies right at the heart of whether such measures are going to apply to the old system as it is, or be used smartly to bring that system into a new focus. And because I don't know whether there will be other changes that will go alongside it or if we have to imagine this is just a new marking scheme for the same people with the same conditioning - and which one of these two it is presents very different things.

How do we change who and where these things are being measured and what they are reporting into in order to make sure there are more 'outcomes' than either a supply-led service reporting 'work done' (whether it was useful or not we threw 5 mindfulness courses at them) as its achievement or reporting 'satisfaction' or 'change achieved' and the risks there being a focus on pressuring 'performance' behaviour that causes harm over 'step back to step forward'?

Because at the moment these clinics aren't offering anything treatment-wise that changes this description (step back to step forward), but do get funding 'based on therapies' so will be focusing on their own stats in relation to keeping funding for those, and what we really need is the entire type of clinic to change to being proper scientific medical monitoring centres. Is it as simple as the funding following only the monitoring ie stop paying for the 'therapy' and make sure that if it is offered or done these monitoring centres are completely independent of these, to reduce conflict of interest?
 
Last edited:
the project is described as producing a Clinical Assessment Toolkit, certainly to be used several times on the same patient

The last part of this is one of the reasons I think wearables are viable. Yes, of course they're going to vary by brand, operating system, algorithm set, etc.; and yes, it's difficult to know whether they're recording quite the same thing on people with different movement styles and physical abilities.

But they're extremely unlikely to be fatally inaccurate when the same device is used on the same patient throughout. What we need to see is the trend over time, and in some ways it almost doesn't matter what the metric is. Does it show the patient's activity level is greater, lower, or the same? Is it reasonably sustained across several weeks, or does it come in bursts with very long gaps in between?

It would be infinitely more reliable than my memory of it, for sure. You could ask me the same set of questions at three different times on the same day, and it would sound like the answers were for three different people.
 
Back
Top Bottom