Outcome Measures: Difference between revisions

No edit summary
(Added COSMIN resource)
 
(48 intermediate revisions by 15 users not shown)
Line 1: Line 1:
An '''outcome measure''' is the result of a test that is used to objectively determine the baseline function of a patient at the beginning of treatment. Once treatment has commenced, the same instrument can be used to determine progress and treatment efficacy. With the move towards [[Evidence Based Practice (EBP)]] in the health sciences, objective measures of outcome are important to provide credible and reliable justification for treatment. The instrument should also be convenient to apply for the therapist and comfortable for the patient.<br>
<div class="editorbox">
'''Original Editor ''' [[User:User Name|Rachael Lowe]]


== Reliability, validity and responsiveness  ==
'''Top Contributors''' - {{Special:Contributors/{{FULLPAGENAME}}}} &nbsp;
</div>
== Introduction ==
An '''outcome measure''' is a tool  used to assess a patient’s current status. <ref name=":0">Fetters L, Tilson J. Evidence based physical therapy. FA Davis; 2012 May 5.</ref> Outcome measures may provide a score, an interpretation of results and at times a risk categorization of the patient. Prior to providing any intervention, an outcome measure provides baseline data. The initial results may help determine the course of treatment intervention. Once treatment has commenced, the same tool may be used in serial assessments to determine whether the patient has demonstrated change.


The outcome measure should have been shown to test the particular aspect of function that it is reported to test (validity) and the results should be the same (or similar) regardless of who administers the test or when it is administered (reliability). Finally, the test or scale should actually be able to test change over time in whatever is being tested (responsiveness). The Chartered Society of Physiotherapists in the United Kingdom makes it clear that standardised outcome measures should be used routinely in normal practice:  
With the move towards [[Evidence Based Practice (EBP)]] in health care, outcome measures provide credible and reliable justification for treatment on an individual patient level. The results from outcome measures may also be grouped for aggregated analysis focused on determining quality of care. When outcome measures are used in an aggregated data situation to compare results, a risk adjustment process is required to fairly compare results.<ref>Gvozdyev BV, Carreon LY, Graves CM, Riley SA, McGraw KE, Head RJ, Dimar JR, Glassman SD. [https://www.ncbi.nlm.nih.gov/pubmed/28753065 Patient-reported outcome scores underestimate the impact of major complications in patients undergoing spine surgery for degenerative conditions]. Journal of Neurosurgery: Spine. 2017 Oct 1;27(4):397-402.</ref><ref>Deutscher D, Werneke MW, Hayes D, Mioduski JE, Cook KF, Fritz JM, Woodhouse LJ, Stratford PW. [https://www.jospt.org/doi/10.2519/jospt.2018.7981 Impact of risk adjustment on provider ranking for patients with low back pain receiving physical therapy]. Journal of Orthopaedic & Sports Physical Therapy. 2018 Aug;48(8):637-48.</ref>
== Classification ==
[[File:Patient_reported_outcome_measure.jpg|thumb|Patient Reported Outcome Measure|alt=|200x200px]]Outcome measures that we use in clinical practice are divided into four categories:
# Self-report measures
# Performance-based measures
# Observer-reported measures
# Clinician-reported measures


''"Taking account of the patient’s problems, a published, standardised, valid, reliable and responsive outcome measure is used to evaluate the change in the patient’s health status" (Core standards of physiotherapy practice, 2005).''<br>  
=== Self-report measures ===
Self-report measures are typically captured in the form of a questionnaire. The questionnaires are scored by applying a predetermined point system to the patient's responses. Although self-report measures seem subjective in nature, self-report measures objectify a patient's perception. Historically, the questionnaires required that either a therapist interviewed the patient or the patient independently completed the questionnaire. Self-report outcome measures that use paper and pencil for completion are considered a fixed-form questionnaire. Computer based or electronic self-report measures are available. Electronic measures may be fixed-form or adaptive.  Computerized adaptive testing is a method of testing that determines the questions for a response based on the patient's previous responses.<ref>McCabe E, Gross DP, Bulut O. [https://www.ncbi.nlm.nih.gov/pubmed/29881895 Procedures to develop a computerized adaptive test to assess patient-reported physical functioning]. Quality of Life Research. 2018 Sep 1;27(9):2393-402.</ref> The questionnaires where the patient reports on health or physical function are known as  '''patient-reported outcomes (PRO)'''.<ref>Kyte DG, Calvert M, Van der Wees PJ, Ten Hove R, Tolan S, Hill JC. [https://www.ncbi.nlm.nih.gov/pubmed/25620440 An introduction to patient-reported outcome measures (PROMs) in physiotherapy]. Physiotherapy. 2015 Jun 1;101(2):119-25.</ref> PROs can be categorized as disease specific or generic. PROs have been defined as "any report of the status of a patient's health condition that comes directly from the patient, without interpretation of the patient's response by a clinician or anyone else."<ref>Black N. [https://www.ncbi.nlm.nih.gov/pubmed/23358487 Patient reported outcome measures could help transform healthcare]. BMJ: British Medical Journal. 2013;346.</ref>


== Statistical analysis  ==
=== Performance-based measures ===
Performance-based measures require the patient to perform a set of movements or tasks. Scores for performance-based measures can be based on either an objective measurement (e.g., time to complete a task) or a qualitative assessment that is assigned a score (e.g., normal or abnormal mechanics for a given task).


Some outcome measures have been statistically tested to determine actual validity and reliability and it must be noted that some are more valid and reliable than others. Analysis should also be performed to determine if the change in score on the test is a result of the intervention (treatment), or not.  
Performance-based measures and patient reported measures both capture a current status. These measures do not typically equate with each other. Performance-based measures tend to bring to light physiologic factors. Patient reported outcome measures may capture a patient's perception, beliefs, social factors and/or health factors. <ref>Bean JF, Ölveczky DD, Kiely DK, LaRose SI, Jette AM. [https://www.ncbi.nlm.nih.gov/pubmed/22003163 Performance-based versus patient-reported physical function: what are the underlying predictors?] Physical Therapy. 2011 Dec 1;91(12):1804-11.</ref>
 
=== Observer-reported measures ===
Observer-reported measures are measurements completed by a parent, caregiver or someone who regularly observes the patient on a daily basis.
 
=== Clinician-reported measures ===
Clinician-reported measures are measurements that are completed by a health care professional. The professional uses clinical judgement and reports on patient behaviors or signs that are observed by the professional.
 
== Statistical Aspects ==
 
Important features of an outcome measure that need to be taken into account when using an outcome measure are its [[Clinical Meaningfulness of an Outcome Measure|psychometric properties]]. 
 
'''Psychometric properties''' are the intrinsic properties of an outcome measure. Ideally, the psychometric properties of an outcome measure used in practice should have been developed and tested through a series of research studies. These properties include validity, inter-rater reliability, intra-rater reliability, responsiveness, ceiling effects, floor effects and minimal clinically important difference. Validity refers to the how accurately the test actually measures what it is supposed to measure. High validity means the measure is consistently stable in its ability to measure its intended focus. Inter-rater reliability takes into consideration the consistency of the results of the measure when two different people are evaluating the results of a common subject. With performance-based measures, if two physiotherapists scored the performance, high inter-rater reliability would mean that both determined similar scores on the performance evaluated. For patient reported outcome measures, a high intra-rater reliability indicates that the patient consistently responds to attain the same results (this would be more relevant with serial testing and no intervention or change in status. Intra-rater reliability falls under test-retest reliability). Responsiveness refers to the ability for the measure to be able to capture change in status. Ceiling effect occurs when the majority of patients are able to complete the measure and score within the highest range of the measurement. (The test is too easy and is not capturing their full capability.) Floor effect occurs when the majority of the patients score within the lowest range of the measurement. (The test is too hard and does not have enough easier items to distinguish varying levels of status.) When determining if change is relevant, the p-value has no value. For outcome measures, the clinician needs to know the minimal important difference. Minimal important difference refers to the amount of change that is relevant from the patient's perspective. ([[Clinical Meaningfulness of an Outcome Measure|clinical meaningfulness]]).
 
== Clinical Utility of an Outcome Measure  ==
 
Choosing appropriate outcome measures for your patients is critical to understanding their status and progress over time.<ref>Hefford C, Abbott JH, Baxter GD Arnold R. [https://www.tandfonline.com/doi/full/10.1179/1743288X11Y.0000000004 Outcome measurement in clinical practice: practical and theoretical issues for health related quality of life (HRQOL) questionnaires]. Physical Therapy Reviews. 2011;16(3):155-167.</ref> 
 
== Guide to Selecting Outcome Measures  ==
 
[http://www.physio-pedia.com/Guide_to_Selecting_Outcome_Measures Guide to Selecting Outcome Measures]


== Outcome Measures  ==
== Outcome Measures  ==


*[[Achilles Tendon Total Rupture Score|Achilles Tendon Total Rupture Score]]
[[:Category:Outcome Measures|See the list of Outcome Measures on Physiopedia here]]<br>
*[[Bath Assessment of Walking Inventory|Bath Assessment of Walking Inventory]]  
 
*[[Berg Balance Scale]]
[https://www.physio-pedia.com/Neurological_Outcome_Measures See list of Neurology Outcome Measures on Physiopedia here]  
*[[Brigham and Women's Carpal Tunnel Questionnaire|Brigham and Women's Carpal Tunnel Questionnaire]]
 
*[[Constant-Murley Shoulder Outcome Score|Constant-Murley Shoulder Outcome Score]]  
== Resources  ==
*[[DASH Outcome Measure|DASH Outcome Measure]]
 
*[[Dynamic Gait Index|Dynamic Gait Index]]
[https://www.cosmin.nl/ COSMIN]: International Consensus-based Standards for the Selection of Health Measurement Instruments
*[[4-item Dynamic Gait Index|4-item Dynamic Gait Index]]
 
*[[EQ-5D-5L]]
[http://www.orthoscores.com/ Orthopaedic Scores]: a free outcome measure calculation service for certain orthopaedic outcome measures.
*[[Fear‐Avoidance Belief Questionnaire|Fear‐Avoidance Belief Questionnaire]]
 
*[[Foot and Ankle Ability Measure|Foot and Ankle Ability Measure]]&nbsp;(FAAM)
[http://www.rehabmeasures.org/default.aspx Rehabilitation measures database]:&nbsp;developed to help clinicians and researchers identify reliable and valid instruments used to assess patient outcomes during all phases of rehabilitation.
*[[Foot and Ankle Disability Index|Foot and Ankle Disability Index]]&nbsp;(FADI)
 
*[[Focus On Therapeutic Outcomes (FOTOinc)|Focus On Therapeutic Outcomes (FOTOinc)]]
[http://phi.uhce.ox.ac.uk/ Patient-Reported Health Instruments]: includes over 8,600 records with keyword search capability.
*[[Functional Ability Description Tool|Functional Ability Description Tool]]
 
*[[Foot Posture Index (FP1-6)|Foot Posture Index (FP1-6)]]
[https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4179871/Patient-Reported Outcomes Measurement Information System]: PROMIS: provides a web-based repository of valid and reliable PRO measures of health concepts relevant to clinician and researchers.
*[[Foot Function Index (FFI)]]
*[[Functional Gait Assessment|Functional Gait Assessment]]
*[[Gartland and Werley Score|Gartland and Werley Score]]
*[http://www3.interscience.wiley.com/resolve/openurl?genre=article&sid=nlm:pubmed&issn=0002-8614&date=2009&volume=57&issue=3&spage=470 Geriatric Self-Efficacy Index for Urinary Incontinence]
*[[Hip Disability and Osteoarthritis Outcome Score|Hip Disability and Osteoarthritis Outcome Score]]
*[[Knee Injury and Osteoarthritis Outcome Score|Knee Injury and Osteoarthritis Outcome Score]]
*[[Neck Disability Index|Neck Disability Index]]
*[[Neck Pain and Disability Scale|Neck Pain and Disability Scale]]
*[[Oswestry Disability Index|Oswestry Disability Index]]
*[[Ottawa Knee Rules|Ottawa Knee Rules]]
*[[Patient Global Impression of Improvement (PGI-I)|Patient Global Impression of Improvement (PGI-I)]]  
*[[Patient Global Impression of Severity (PGI-S)|Paient Global Impression of Severity (PGI-S)]]
*[[Pelvic Floor Distress Inventoy (PFDI - 20)|Pelvic Floor Distress Inventory (PFDI-20)]]
*[[Pelvic Floor Incontinence Questionnaire (PFIQ - 7)|Pelvic Floor Impact Questionnaire (PFIQ-7)]]
*[[Pelvic Girdle Questionnaire (PGQ)]]
*[[Postural Assessment Scale for Stroke|Postural Assessment Scale for Stroke]]
*[[PRWE Score|PRWE Score]]
*[[Roland‐Morris Disability Questionnaire|Roland‐Morris Disability Questionnaire]]
*[[Short-form McGill Pain Questionnaire|Short-form McGill Pain Questionnaire (SF-MPQ-2)]]
*[[The Assessment of Pain and Occupational Performance|The Assessment of Pain and Occupational Performance]] <br>


<br>
[http://www.pedro.org.au/english/about-us/cebp/ CEBP: Centre for Evidence Based Physiotherapy]: provides an extensive database of physiotherapy outcome measures.


== Resources<br> ==
[http://www.neuropt.org/professional-resources/neurology-section-outcome-measures-recommendations The Neurology Section]: recommendations for outcome measures used in neurological clinical practice, research and education.  


[http://academic.regis.edu/clinicaleducation/Clinical%20Education%20Forms.htm Regis University site for outcomes information]:&nbsp; This is an excellent site that includes analysis of practice forms, outcome measures and the evidence for a variety of clinical topics.&nbsp; At the very bottom you will find the “health assessment outcomes indicators”, an 80+ page document that gives an overview of MANY outcomes tools. <br>  
==References==
<references />


[[Category:Open_Physio]][[Category:Articles]][[Category:Outcome Measures]]
[[Category:Open_Physio]]  
[[Category:Outcome_Measures]]  
[[Category:EBP]]
[[Category:Rehabilitation Foundations]]
[[Category:Thoracic Spine - Outcome Measures]]
[[Category:Research]]

Latest revision as of 08:10, 14 May 2023

Introduction[edit | edit source]

An outcome measure is a tool used to assess a patient’s current status. [1] Outcome measures may provide a score, an interpretation of results and at times a risk categorization of the patient. Prior to providing any intervention, an outcome measure provides baseline data. The initial results may help determine the course of treatment intervention. Once treatment has commenced, the same tool may be used in serial assessments to determine whether the patient has demonstrated change.

With the move towards Evidence Based Practice (EBP) in health care, outcome measures provide credible and reliable justification for treatment on an individual patient level. The results from outcome measures may also be grouped for aggregated analysis focused on determining quality of care. When outcome measures are used in an aggregated data situation to compare results, a risk adjustment process is required to fairly compare results.[2][3]

Classification[edit | edit source]

Patient Reported Outcome Measure

Outcome measures that we use in clinical practice are divided into four categories:

  1. Self-report measures
  2. Performance-based measures
  3. Observer-reported measures
  4. Clinician-reported measures

Self-report measures[edit | edit source]

Self-report measures are typically captured in the form of a questionnaire. The questionnaires are scored by applying a predetermined point system to the patient's responses. Although self-report measures seem subjective in nature, self-report measures objectify a patient's perception. Historically, the questionnaires required that either a therapist interviewed the patient or the patient independently completed the questionnaire. Self-report outcome measures that use paper and pencil for completion are considered a fixed-form questionnaire. Computer based or electronic self-report measures are available. Electronic measures may be fixed-form or adaptive. Computerized adaptive testing is a method of testing that determines the questions for a response based on the patient's previous responses.[4] The questionnaires where the patient reports on health or physical function are known as patient-reported outcomes (PRO).[5] PROs can be categorized as disease specific or generic. PROs have been defined as "any report of the status of a patient's health condition that comes directly from the patient, without interpretation of the patient's response by a clinician or anyone else."[6]

Performance-based measures[edit | edit source]

Performance-based measures require the patient to perform a set of movements or tasks. Scores for performance-based measures can be based on either an objective measurement (e.g., time to complete a task) or a qualitative assessment that is assigned a score (e.g., normal or abnormal mechanics for a given task).

Performance-based measures and patient reported measures both capture a current status. These measures do not typically equate with each other. Performance-based measures tend to bring to light physiologic factors. Patient reported outcome measures may capture a patient's perception, beliefs, social factors and/or health factors. [7]

Observer-reported measures[edit | edit source]

Observer-reported measures are measurements completed by a parent, caregiver or someone who regularly observes the patient on a daily basis.

Clinician-reported measures[edit | edit source]

Clinician-reported measures are measurements that are completed by a health care professional. The professional uses clinical judgement and reports on patient behaviors or signs that are observed by the professional.

Statistical Aspects[edit | edit source]

Important features of an outcome measure that need to be taken into account when using an outcome measure are its psychometric properties.

Psychometric properties are the intrinsic properties of an outcome measure. Ideally, the psychometric properties of an outcome measure used in practice should have been developed and tested through a series of research studies. These properties include validity, inter-rater reliability, intra-rater reliability, responsiveness, ceiling effects, floor effects and minimal clinically important difference. Validity refers to the how accurately the test actually measures what it is supposed to measure. High validity means the measure is consistently stable in its ability to measure its intended focus. Inter-rater reliability takes into consideration the consistency of the results of the measure when two different people are evaluating the results of a common subject. With performance-based measures, if two physiotherapists scored the performance, high inter-rater reliability would mean that both determined similar scores on the performance evaluated. For patient reported outcome measures, a high intra-rater reliability indicates that the patient consistently responds to attain the same results (this would be more relevant with serial testing and no intervention or change in status. Intra-rater reliability falls under test-retest reliability). Responsiveness refers to the ability for the measure to be able to capture change in status. Ceiling effect occurs when the majority of patients are able to complete the measure and score within the highest range of the measurement. (The test is too easy and is not capturing their full capability.) Floor effect occurs when the majority of the patients score within the lowest range of the measurement. (The test is too hard and does not have enough easier items to distinguish varying levels of status.) When determining if change is relevant, the p-value has no value. For outcome measures, the clinician needs to know the minimal important difference. Minimal important difference refers to the amount of change that is relevant from the patient's perspective. (clinical meaningfulness).

Clinical Utility of an Outcome Measure[edit | edit source]

Choosing appropriate outcome measures for your patients is critical to understanding their status and progress over time.[8]

Guide to Selecting Outcome Measures[edit | edit source]

Guide to Selecting Outcome Measures

Outcome Measures[edit | edit source]

See the list of Outcome Measures on Physiopedia here

See list of Neurology Outcome Measures on Physiopedia here

Resources[edit | edit source]

COSMIN: International Consensus-based Standards for the Selection of Health Measurement Instruments

Orthopaedic Scores: a free outcome measure calculation service for certain orthopaedic outcome measures.

Rehabilitation measures database: developed to help clinicians and researchers identify reliable and valid instruments used to assess patient outcomes during all phases of rehabilitation.

Patient-Reported Health Instruments: includes over 8,600 records with keyword search capability.

Outcomes Measurement Information System: PROMIS: provides a web-based repository of valid and reliable PRO measures of health concepts relevant to clinician and researchers.

CEBP: Centre for Evidence Based Physiotherapy: provides an extensive database of physiotherapy outcome measures.

The Neurology Section: recommendations for outcome measures used in neurological clinical practice, research and education.

References[edit | edit source]

  1. Fetters L, Tilson J. Evidence based physical therapy. FA Davis; 2012 May 5.
  2. Gvozdyev BV, Carreon LY, Graves CM, Riley SA, McGraw KE, Head RJ, Dimar JR, Glassman SD. Patient-reported outcome scores underestimate the impact of major complications in patients undergoing spine surgery for degenerative conditions. Journal of Neurosurgery: Spine. 2017 Oct 1;27(4):397-402.
  3. Deutscher D, Werneke MW, Hayes D, Mioduski JE, Cook KF, Fritz JM, Woodhouse LJ, Stratford PW. Impact of risk adjustment on provider ranking for patients with low back pain receiving physical therapy. Journal of Orthopaedic & Sports Physical Therapy. 2018 Aug;48(8):637-48.
  4. McCabe E, Gross DP, Bulut O. Procedures to develop a computerized adaptive test to assess patient-reported physical functioning. Quality of Life Research. 2018 Sep 1;27(9):2393-402.
  5. Kyte DG, Calvert M, Van der Wees PJ, Ten Hove R, Tolan S, Hill JC. An introduction to patient-reported outcome measures (PROMs) in physiotherapy. Physiotherapy. 2015 Jun 1;101(2):119-25.
  6. Black N. Patient reported outcome measures could help transform healthcare. BMJ: British Medical Journal. 2013;346.
  7. Bean JF, Ölveczky DD, Kiely DK, LaRose SI, Jette AM. Performance-based versus patient-reported physical function: what are the underlying predictors? Physical Therapy. 2011 Dec 1;91(12):1804-11.
  8. Hefford C, Abbott JH, Baxter GD Arnold R. Outcome measurement in clinical practice: practical and theoretical issues for health related quality of life (HRQOL) questionnaires. Physical Therapy Reviews. 2011;16(3):155-167.