The problem with health measurement.

Stefan J Cano, Jeremy C Hobart
Author Information
  1. Stefan J Cano: Clinical Neurology Research Group, Peninsula College of Medicine and Dentistry, Tamar Science Park, Plymouth, UK.

Abstract

In this review we discuss health measurement with a focus on psychometric methods and methodology. In particular, we examine some of the key issues currently facing the use of clinician and patient rating scales to measure the health outcomes of disease and treatment. We present three key facts and flag one crucial problem. First, the numbers generated by scales are increasingly used as the measurements of the central dependent variables upon which clinical decisions are frequently made. The rising profile of rating scales has significant implications for scale construction, evaluation, and selection, as well as for interpreting studies. Second, rating scale science is well established. Therefore, it is important to learn the lessons from those who have built and established the science over the last century. Finally, the goal of a rating scale is to measure. As such, over the last half century, developments in rating scale (psychometric) methods have caused a refocus in the way we should be measuring health. In particular, newer methods have significant clinical advantages over traditional approaches. These should be seriously considered for inclusion in everyday practice. This leads us to the central problem with health measurement, which is that we cannot currently be sure what most rating scales are measuring. This is because the methods we have in place to ensure the validity of rating scales fall short of what is actually required. We expand on this point, and provide some potential routes forward to help address this important problem.

Keywords

References

  1. BMJ. 1993 Oct 16;307(6910):994-6 [PMID: 8241915]
  2. Qual Life Res. 1997 Aug;6(6):595-600 [PMID: 9330558]
  3. Science. 1946 Jun 7;103(2684):677-80 [PMID: 17750512]
  4. Med Care. 2003 May;41(5):571-4 [PMID: 12719678]
  5. J Plast Reconstr Aesthet Surg. 2006;59(1):65-73 [PMID: 16482791]
  6. Med Care. 2004 Jan;42(1 Suppl):I25-36 [PMID: 14707753]
  7. Brain. 2001 May;124(Pt 5):962-73 [PMID: 11335698]
  8. Psychometrika. 1945;10:255-82 [PMID: 21007983]
  9. Plast Reconstr Surg. 2009 Mar;123(3):98e-106e [PMID: 19319025]
  10. Brain. 2006 Jan;129(Pt 1):224-34 [PMID: 16280352]
  11. Psychol Bull. 1955 Jul;52(4):281-302 [PMID: 13245896]
  12. Psychol Med. 1979 Feb;9(1):139-45 [PMID: 424481]
  13. Qual Life Res. 2002 May;11(3):193-205 [PMID: 12074258]
  14. Annu Rev Public Health. 1987;8:191-210 [PMID: 3555521]
  15. Qual Health Care. 1996 Jun;5(2):81-8 [PMID: 10158596]
  16. Spine (Phila Pa 1976). 1998 Mar 1;23(5):629-33 [PMID: 9530796]
  17. JAMA. 1989 Aug 18;262(7):907-13 [PMID: 2754790]
  18. Mult Scler. 1995 Apr;1(1):37-47 [PMID: 9345468]
  19. Qual Life Res. 2010 May;19(4):539-49 [PMID: 20169472]
  20. Qual Life Res. 1995 Aug;4(4):293-307 [PMID: 7550178]
  21. Qual Life Res. 1997 Apr;6(3):205-12 [PMID: 9226977]
  22. J Neurol Neurosurg Psychiatry. 2010 Dec;81(12):1363-8 [PMID: 20881017]
  23. J Clin Epidemiol. 1997 Apr;50(4):451-61 [PMID: 9179104]
  24. Med Care. 2004 Jan;42(1 Suppl):I7-16 [PMID: 14707751]
  25. Mult Scler. 2005 Dec;11(6):708-12 [PMID: 16320732]
  26. Lancet. 2007 Feb 17;369(9561):540-2 [PMID: 17307086]
  27. Lancet Neurol. 2007 Dec;6(12):1094-105 [PMID: 18031706]
  28. J Natl Cancer Inst. 1993 Mar 3;85(5):365-76 [PMID: 8433390]
  29. Br J Surg. 1993 Feb;80(2):163-9 [PMID: 8443640]
  30. Expert Rev Pharmacoecon Outcomes Res. 2010 Oct;10(5):583-94 [PMID: 20950073]
  31. J Neurol Neurosurg Psychiatry. 1996 Feb;60(2):127-30 [PMID: 8708638]
  32. Am J Psychol. 1987 Fall-Winter;100(3-4):441-71 [PMID: 3322052]
  33. Med Care. 1989 Mar;27(3 Suppl):S217-32 [PMID: 2646490]
  34. Acta Psychiatr Scand. 1983 Jun;67(6):361-70 [PMID: 6880820]
  35. Disabil Rehabil. 2005 Jan 7-21;27(1-2):7-18 [PMID: 15799141]
  36. Br J Plast Surg. 2004 Jan;57(1):1-11 [PMID: 14672672]
  37. Mov Disord. 2005 Dec;20(12):1585-91 [PMID: 16114019]
  38. Gerontologist. 1970 Spring;10(1):20-30 [PMID: 5420677]
  39. J Rheumatol. 2009 Sep;36(9):2061-6 [PMID: 19738214]
  40. Plast Reconstr Surg. 2009 Jun;123(6):1819-1827 [PMID: 19483584]
  41. J Appl Meas. 2006;7(3):307-22 [PMID: 16807496]
  42. Med Care. 2000 Sep;38(9 Suppl):II73-82 [PMID: 10982092]
  43. Med Care. 1992 Jun;30(6):473-83 [PMID: 1593914]
  44. Health Qual Life Outcomes. 2003 Jul 28;1:27 [PMID: 12952544]
  45. BMJ. 1992 Nov 7;305(6862):1145-8 [PMID: 1463954]
  46. Health Technol Assess. 1998;2(14):i-iv, 1-74 [PMID: 9812244]
  47. Psychol Bull. 1959 Mar;56(2):81-105 [PMID: 13634291]
  48. Optom Vis Sci. 2002 Aug;79(8):516-52 [PMID: 12199545]
  49. Med Care. 1976 Jan;14(1):57-67 [PMID: 950811]
  50. Nature. 1968 Aug 24;219(5156):870-2 [PMID: 5673356]
  51. Int J Technol Assess Health Care. 1990;6(2):307-25 [PMID: 2203705]
  52. Brain. 2000 May;123 ( Pt 5):1027-40 [PMID: 10775547]
  53. Arch Phys Med Rehabil. 1989 Nov;70(12):857-60 [PMID: 2818162]
  54. Breast J. 2010 Nov-Dec;16(6):587-97 [PMID: 21070435]
  55. Rheumatol Int. 2006 May;26(7):614-21 [PMID: 16179999]
  56. Health Technol Assess. 2009 Feb;13(12):iii, ix-x, 1-177 [PMID: 19216837]
  57. J Clin Oncol. 2007 Nov 10;25(32):5106-12 [PMID: 17991929]
  58. Otolaryngol Head Neck Surg. 2007 Apr;136(4):525-35 [PMID: 17418246]
  59. Mov Disord. 2004 Sep;19(9):1054-9 [PMID: 15372595]
  60. Med Care. 1994 Nov;32(11):1109-26 [PMID: 7967852]
  61. Ann R Coll Surg Engl. 1948 Nov;3(5):266-84 [PMID: 18112082]

Word Cloud

Created with Highcharts 10.0.0ratinghealthscalesmethodsproblemscalemeasurementpsychometricparticularkeycurrentlymeasurecentralclinicalsignificantwellscienceestablishedimportantlastcenturymeasuringoutcomereviewdiscussfocusmethodologyexamineissuesfacinguseclinicianpatientoutcomesdiseasetreatmentpresentthreefactsflagonecrucialFirstnumbersgeneratedincreasinglyusedmeasurementsdependentvariablesupondecisionsfrequentlymaderisingprofileimplicationsconstructionevaluationselectioninterpretingstudiesSecondThereforelearnlessonsbuiltFinallygoalhalfdevelopmentscausedrefocuswayneweradvantagestraditionalapproachesseriouslyconsideredinclusioneverydaypracticeleadsussureplaceensurevalidityfallshortactuallyrequiredexpandpointprovidepotentialroutesforwardhelpaddresscarehealth-relatedqualitylifeassessmentpatient-reportedinstrumentspsychometricsquestionnaires

Similar Articles

Cited By