UK:ME Association funds research for a new clinical assessment toolkit in NHS ME/CFS specialist services, 2023

Discussion in 'ME/CFS research news' started by InitialConditions, May 8, 2023.

  1. Amw66

    Amw66 Senior Member (Voting Rights)

    Messages:
    6,491
    I don't know how many people could answer this off the top of their head unless they were quite mildly affected and had had a definite setback.
     
    Louie41, Missense, alktipping and 5 others like this.
  2. rvallee

    rvallee Senior Member (Voting Rights)

    Messages:
    12,848
    Location:
    Canada
    Bit like that weird "forensic" paper we saw the other day. There is still this idea that they can catch people contradicting themselves and that it means something. And this is from the ME Association so it's not even antagonistic, but the idea that catching people in a contradiction is meaningful, I guess. Even in a fluctuating illness. Even in an illness defined by being wildly fluctuating.

    Because this is basically how researchers "validate" questionnaires, and clinicians validate the reliability of patients' responses. Which ironically is not a valid way of validating things. It could be significant to get the same answer multiple times using some instrument. It's what you expect of a measure. But 15C is 15C, it doesn't change, so it shouldn't change upon measure. But they're not measuring something fixed. Subjecting well-being, symptoms and so on aren't meant to be consistent, but the underlying idea that the only valid way of assessing is if it gives the same answer multiple times. Even in an illness defined by being wildly fluctuating. Even from people who should know better.

    There's just no plan B, no psychological or cognitive flexibility built into how health care works. They work more from tradition and rote, dismissing the very kind of flexibility that is the basis of true intelligence.
     
    Ash, Louie41, obeat and 13 others like this.
  3. Kitty

    Kitty Senior Member (Voting Rights)

    Messages:
    5,858
    Location:
    UK
    I can actually see a use for a measure. Keeping a score from week to week might help more recently diagnosed people work out whether they're on an upward, downward or even trend.

    It can be hard to get a sense of this because the data are so noisy. Bouts of PEM, coughs and colds, hormonal shifts, IBS flares, stressful events, the onset of hay fever...there are all sorts of things that can make people feel worse than usual, but they don't necessarily tell them what they need to know: whether or not their current activity levels are sustainable.

    A simple score out of 5 or 10 for physical and cognitive function would suffice, though, it doesn't need an extensive questionnaire.
     
    Louie41, obeat, bobbler and 9 others like this.
  4. NelliePledge

    NelliePledge Moderator Staff Member

    Messages:
    13,666
    Location:
    UK West Midlands
    Not a fan of Apps in general but something along the lines of Visible captures changes in symptoms reasonably well.
     
    Kiristar, MEMarge, Missense and 9 others like this.
  5. Trish

    Trish Moderator Staff Member

    Messages:
    53,228
    Location:
    UK
    I think it's worth going back to the initial article by the MEA describing this project:
    https://meassociation.org.uk/2023/0...nt-toolkit-in-nhs-me-cfs-specialist-services/
    It is clear from this that the aim is not just to produce an efficient way of patients noting key aspects of their current health in order to facilitate more productive medical consultations, but is also intended to 'measure' and provide records of 'accurate data' that can be used for service evaluation.

    Given that emphasis on measuring and data, there is presumably the intention that PASS will provide a number that is supposed to measure a patient's PEM over the last month.

    To me that is meaningless. What is it measuring - time lapsed from triggering exertion, duration, frequency of episodes of PEM, how much exertion triggers PEM episodes? How many symptoms get worse in PEM, how many new symptoms arise just in PEM, how severe they are, how much more debilitated is the pwME during PEM, what is their severity level during PEM?. Is this to be recorded as a single number? If so, how is it calculated - additive, multiplicative, weighted...? And how do you interpret that number?

    And that's before we get started with all the other problems with PASS that we have spelled out already, including the muddling together of fatiguabilty and PEM.

    PEM isn't a symptom, it's a phenomenon of becoming much sicker for days or longer.
     
    Ash, Fero, Arvo and 13 others like this.
  6. Kitty

    Kitty Senior Member (Voting Rights)

    Messages:
    5,858
    Location:
    UK
    I'm not sure you do. I suspect it's not for you, it's to justify the existence of a service.

    If it were for you, you wouldn't need a questionnaire. You could scribble a PEM score out of 10 on a calendar every day, and that would tell you whether you have more or less than a month ago.

    It'd still be fairly useless in practical terms unless you'd experienced a change in severity and needed to reassess your physical and cognitive capacity, but I don't see why it would be any less accurate.
     
    Ash, bobbler, Fero and 9 others like this.
  7. Hutan

    Hutan Moderator Staff Member

    Messages:
    27,591
    Location:
    Aotearoa New Zealand
    The aim of the study is to produce a "clinical assessment toolkit", one that can be used in clinical care, but also in the evaluation of both existing and new services.
    And yet, Sarah Tyson seems to refuse to accept that objective measures need to be a core part of the clinical assessment toolkit. Perhaps it is because she finds working with wearable technology difficult? Perhaps it is because she truly feels that subjective outcomes are all that are needed to assess outcomes in clinical situations where the patient desperately wants to believe that they have improved, and where the clinician wants to believe that they have helped and desperately wants to show that their service is useful so that they continue to be funded.

    Peter Gladwell of BACME, a co-investigator, must be thrilled at the prospect of MEA endorsed subjective outcomes "co-produced" with people with ME/CFS. Gladwell is also on the Cochrane IAG. Here's his biography from there (apologies if this has already been posted on this thread). Note that he prefers the name CFS/ME and does not mention his BACME involvement.
    Here's his bio from 'The Mindfulness Network':


    I think that the MEA may be walking into a trap of ending up endorsing PROMS that will be used against the ME/CFS community. We've seen similar things happen before:
    People at the MEA seem to have forgotten that objective outcomes are our strongest defence against services and interventions that don't work.

    (sorry, edits to add more info on Gladwell)
     
    Last edited: Mar 14, 2024
  8. Hutan

    Hutan Moderator Staff Member

    Messages:
    27,591
    Location:
    Aotearoa New Zealand
    As a reminder of what Peter Gladwell's years of providing care to people with ME/CFS have led him to believe about good clinical services, the AfME Pacing booklet provides a good insight. 'Pacing for people with M.E.' Action for ME booklet - revised and updated January 2020.

    In that thread, MEMarge notes that the Bristol Service that Gladwell has been associated with since 2004 did not seem to be getting rave reviews from people reporting on their experience in an MEAction survey.
     
    Ash, JohnTheJack, Binkie4 and 9 others like this.
  9. Jonathan Edwards

    Jonathan Edwards Senior Member (Voting Rights)

    Messages:
    13,886
    Location:
    London, UK
    In my experience as a clinician, outcome measures never provided a basis for assessment of service provision. Maybe they should but I find it hard to see how it could have been organised. What happened was that there was properly controlled trials of treatments and those treatments that were found to be beneficial were offered to patients. Nobody expected to be able to tell from outcome measures whether a clinic was functioning well because there were no control observations to allow outcomes to be interpreted.

    Surgeons have for a long time had their practice assessed with outcome measures. That makes sense since there have been in the past obvious differences in technical competence and post-operative care quality. But it has still always been a matter of identifying serious outliers.

    Recently we have seen service evaluations of things like IAPT psychotherapy and noted how hopeless it is.

    I worry if these measures are supposed to be for that purpose because I cannot see any way that they can be made sense of without any control observations - in fact without any well designed trials showing efficacy.
     
    Ash, JohnTheJack, Arnie Pye and 14 others like this.
  10. Eleanor

    Eleanor Senior Member (Voting Rights)

    Messages:
    118
    what's the saying: When a measure becomes a target it ceases to be a good measure?
     
    Ash, Arnie Pye, hotblack and 12 others like this.
  11. Kitty

    Kitty Senior Member (Voting Rights)

    Messages:
    5,858
    Location:
    UK
    I wonder if the difference is that there aren't any treatments or drug trials, and nobody really knows how to go about delivering these services? I suspect in some respects it's not even clear what they're for, beyond initial diagnosis and offering management advice to new patients. There don't appear to be any doctors involved.

    If it is that kind of model, which possibly has more in common with an alternative therapy centre than a hospital outpatient clinic, maybe it's part of the reason for wanting 'service evaluation'.
     
    hotblack, Lou B Lou, MEMarge and 9 others like this.
  12. Sean

    Sean Moderator Staff Member

    Messages:
    7,450
    Location:
    Australia
    Worth repeating.
     
    Ash, Fero, Hutan and 9 others like this.
  13. Jonathan Edwards

    Jonathan Edwards Senior Member (Voting Rights)

    Messages:
    13,886
    Location:
    London, UK
    I think so I am afraid.

    For a rheumatoid clinic service evaluation must be easy:

    Expenditure £4,765,000
    Of which: Drug budget £2,210,000 (controlled trial based, NICE approved - tick)
    Physicians to prescribe drugs £650,000 (NICE approved - tick)
    Orthopaedic surgical referrals £1,300,000 (trial based, NICE approved - tick)
    Laboratory investigations....

    Tick.
    Carry on guys.

    ME clinical service:

    Expenditure £2,400,000

    Staff for providing a care plan? £2,400,000
    Could we manage with a bit less? Does the care plan do any good?
    Er, um.

    There is a problem but not one solved by PROMS. It is solved by a realistic understanding of the need to provide people with advice and support. Replacing that with an artificial case based on PROMS seems to me very dangerous. We need care to be based on a realistic understanding of the need for advice and support. That is what we based rheumatoid clinic funding on in 1975 and that also allowed us to make progress.
     
    Ash, Kiristar, JohnTheJack and 13 others like this.
  14. Andy

    Andy Committee Member

    Messages:
    22,236
    Location:
    Hampshire, UK
    I contacted the ME Association over Sarah Tyson's unprofessional and abusive attitude and comments made in this thread 18 days ago. Over the course of a week's exchange of emails, they chose to focus on the difference of opinions over the value of this project, and even went so far as to repeatedly suggest that someone from the forum "provide a short summary of the main concerns and objections to the questionnaire that your members have been raising".

    I had to push for them to acknowledge that these kinds of insults
    might be something that they might have to address.

    My last communication with them was on the 1st March, where they indicated that they were taking the matter forward - since then I have heard nothing more. Given that silence from them, I can therefore only assume that the ME Association condone or otherwise believe that Sarah Tyson's comments were justified. I am beyond disappointed with them.
     
    Ash, Fero, Tara Green and 22 others like this.
  15. Kitty

    Kitty Senior Member (Voting Rights)

    Messages:
    5,858
    Location:
    UK
    But if we had indulged in "hysterical projection, catastrophising, conspiracy theories, overt hostility and insults", wouldn't we edit the worst bits out?

    Investigations of behaviour look at what happened and in what context, and it's unusually easy in this case. There's no need for witness accounts, every word's available to read.
     
    Fero, Arnie Pye, Hutan and 10 others like this.
  16. Andy

    Andy Committee Member

    Messages:
    22,236
    Location:
    Hampshire, UK
    They obviously didn't want to address the behaviour and wanted to focus on the disagreements about the project - it was a deliberate re-focus.
     
    Ash, Tara Green, JohnTheJack and 13 others like this.
  17. Peter Trewhitt

    Peter Trewhitt Senior Member (Voting Rights)

    Messages:
    3,771
    Thank you @Andy for raising this with the MEA, I had foolishly assumed that Sarah Tyson would have returned to try to resolve the issues once she had reflected on this. But I am more disappointed if the MEA are deliberately sidetracking this too.
     
    Ash, JohnTheJack, Arnie Pye and 16 others like this.
  18. Trish

    Trish Moderator Staff Member

    Messages:
    53,228
    Location:
    UK
    I have been thinking about what sort of record keeping and data collection I think would be most helpful to me as a pwME for a specialist service to collect:

    An alternative proposal

    A proposed alternative set of PROMS, questionnaires and data collection to be useful for clinical care visits and long term monitoring and daily monitoring by the pwME to help with pacing:

    Daily records of real time data for help with pacing and summary to go on patient records and be available for clinical consultations

    Patient's daily records:

    a) via an app that collects:
    i) wearable data (steps/HR/HRV)
    ii) daily single figure severity score using one of the existing severity scales (MEA, AfME or Bell), or separated into physical and cognitive severity.

    or

    b) If the pwME doesn't have access to smartphone and wearable activity/HR trackers, a simple daily chart with just the severity scale score would suffice to show fluctuations and long term trends.

    and

    c) Optional recording of daily symptoms and activities could be available in chart or app form for those patients able and interested in doing so.

    d) daily tick box on the app or on paper to show whether the pwME is in PEM, and space for a note on what they think triggered it. This should correlate with the objective data for the day.

    For clinical consultations and clinic records

    1. Summary data from the app or paper record of daily fluctuations

    2. One page questionnaire to be filled in by the patient before each clinical consultation:

    A. A simple list of about 10 most common symptoms or groups of symptoms, eg, OI, sleep, pain, digestive system, sensory, etc, with tick boxes for which symptom group the pwME wants clinical input at that consultation.

    B. A simple list of types activities of daily living with tick boxes for which activities they need support with, eg eating, walking, workplace adjustments, personal care etc, to focus the consultation on arranging for relevant specialist services to be provided, eg OT, dietitian, personal carers or other home or work help, equipment and adjustments.

    C. A single tick box for whether the patient is having any mental health issues they want/need support with, so the clinician can advise and/or referral can be made.

    3. The clinician's own notes of the consultation and any prescriptions and referrals and care plan if relevant.

    4. Results of any testing, eg cognitive function tests, CPET, 6 minute walk, blood and urine tests etc.
    _________________

    The 'outcome measures' the clinic would collect would be from the wearables and daily severity score, and any tests done, eg bloods and cognitive testing.
     
    Last edited: Mar 21, 2024
    MEMarge, Hutan, Sean and 5 others like this.
  19. Trish

    Trish Moderator Staff Member

    Messages:
    53,228
    Location:
    UK
    This sort of home real time record keeping is becoming more common with chronic illnesses. I have very mild asthma, and was invited by my GP practice asthma nurse via email to sign up to an asthma app. I didn't bother, as it's only occasional allergic asthma, so doesn't need daily monitoring, but I can see how useful it is for both patient and specialist nurse to keep track. Similarly I assume there is an app for diabetes, especially now people are using 'wearable' glucose monitors etc.

    The production of multiple questionnaire PROMS seems like a step back to the past. Developments now should be forward looking. Most people have a smart phone, and wearable monitors could be provided for those who can't afford them and want to use them to help with pacing and to help inform their clinicians.
     
    MEMarge, Hutan, Missense and 6 others like this.
  20. JellyBabyKid

    JellyBabyKid Senior Member (Voting Rights)

    Messages:
    271
    This sounds like a really great proposal @Trish

    I use a bullet journal and there seems a large chronic illness subsection of that community

    I use a monthly tracker and include a sleep tracker and boxes for visible score, mood, pain, fatigue (the latter on a 1-5 numerical score where 1 = normal for me and 5 = crash / unable to function due to MH or pain) IBS, whether I managed to shower or get down the stairs (I live in a flat) and I photocopied it for my most recent PIP

    I can also add notes for my asthma / anxiety / painkillers etc

    because I keep daily notes of activities I can see why each of my measures has tanked or improved

    Edit to add: I also wear a smart watch which shows that LC left me with that weird "not quite PoTS random heart rate spikes of triple figures" thing that no one seems curious about investigating.
     
    Ash, MEMarge, Hutan and 8 others like this.

Share This Page