Characterizing the Validity and Real-World Utility of Health Technology Assessments in Healthcare: Future Directions Comment on "Problems and Promises of Health Technologies: The Role of Early Health Economic Modelling".

Nadine K Zawadzki, Joel W Hay
Author Information
  1. Nadine K Zawadzki: Schaeffer Center for Health Policy and Economics, Department of Pharmaceutical and Health Economics, School of Pharmacy, University of Southern California, Los Angeles, CA, USA. ORCID
  2. Joel W Hay: USC Clinical Economics Research and Education Program (CEREP), Los Angeles, CA, USA. ORCID

Abstract

With their article, Grutters et al raise an important question: What do successful health technology assessments (HTAs) look like, and what is their real-world utility in decision-making? While many HTAs are published in peer-reviewed journals, many are considered proprietary and their attributes remain confidential, limiting researchers' ability to answer these questions. Models for economic evaluations like cost-effectiveness analyses (CEAs) synthesize a wide range of evidence, are often statistically and mathematically sophisticated, and require untestable assumptions. As such, there is nearly universal agreement among researchers that enhancing transparency is an important issue in health economic modeling. However, the definition of transparency and guidelines for its implementation vary. Model registration combined with a linked database of model-based economic evaluations has been proposed as a solution, whereby registered models and their accompanying technical and nontechnical documentation are sourced into a single publicly-available repository, ideally in a standardized format to ensure consistent and complete representation of features, code, data sources, results, validation exercises, and policy recommendations. When such a repository is ultimately created, modelers will not have to reinvent the wheel for every new drug launched or new treatment pathway. These more open and transparent approaches will have substantial implications for model accuracy, reliability, and validity, improving trust and acceptance by healthcare decision-makers.

Keywords

References

  1. N Engl J Med. 2014 Jul 17;371(3):203-12 [PMID: 25014686]
  2. Value Health. 2019 Dec;22(12):1402-1409 [PMID: 31806197]
  3. Pharmacoeconomics. 2018 Sep;36(9):1125-1134 [PMID: 29725871]
  4. Value Health. 2019 May;22(5):564-569 [PMID: 31104735]
  5. Emerg Med J. 2002 Jul;19(4):301-4 [PMID: 12101135]
  6. Pharmacoeconomics. 2000 May;17(5):501-13 [PMID: 10977390]
  7. JAMA. 1990 Dec 19;264(23):3007-12 [PMID: 2243428]
  8. J Manag Care Pharm. 2003 Jan-Feb;9(1):53-61 [PMID: 14613362]
  9. Pharmacoeconomics. 2019 Nov;37(11):1305-1312 [PMID: 31347104]
  10. Value Health. 2018 Jun;21(6):724-731 [PMID: 29909878]
  11. Med Care. 2017 Nov;55(11):907-908 [PMID: 29028752]
  12. Pharmacoeconomics. 2018 Mar;36(3):359-368 [PMID: 29214389]
  13. Science. 2012 Apr 13;336(6078):159-60 [PMID: 22499926]
  14. N Engl J Med. 2011 Dec 15;365(24):2255-67 [PMID: 22085343]
  15. JAMA Netw Open. 2019 Apr 5;2(4):e192224 [PMID: 30977858]
  16. Int J Health Policy Manag. 2019 Aug 01;8(10):575-582 [PMID: 31657184]
  17. Med Care. 2017 Nov;55(11):909-911 [PMID: 29028753]
  18. Int J Technol Assess Health Care. 2019;35(4):346-350 [PMID: 31198129]
  19. J Am Coll Cardiol. 2008 Apr 22;51(16):1564-72 [PMID: 18420099]
  20. Chin Med J (Engl). 2009 Jul 20;122(14):1615-20 [PMID: 19719960]
  21. Value Health. 2013 Mar-Apr;16(2):231-50 [PMID: 23538175]
  22. Med Care. 2017 Nov;55(11):912-914 [PMID: 29028754]
  23. Angiology. 1995 Apr;46(4):269-80 [PMID: 7726447]
  24. Ann Intern Med. 2017 Aug 15;167(4):268-274 [PMID: 28693043]
  25. Med Decis Making. 2012 Sep-Oct;32(5):733-43 [PMID: 22990088]
  26. Pharmacoeconomics. 2019 Nov;37(11):1371-1381 [PMID: 31531833]
  27. Med Decis Making. 2018 Oct;38(7):767-777 [PMID: 30248277]

MeSH Term

Cost-Benefit Analysis
Delivery of Health Care
Humans
Models, Economic
Reproducibility of Results
Technology Assessment, Biomedical

Word Cloud

Created with Highcharts 10.0.0HealtheconomicimportanthealthHTAslikemanyevaluationstransparencyrepositorywillnewTechnologyEconomicarticleGruttersetalraisequestion:successfultechnologyassessmentslookreal-worldutilitydecision-making?publishedpeer-reviewedjournalsconsideredproprietaryattributesremainconfidentiallimitingresearchers'abilityanswerquestionsModelscost-effectivenessanalysesCEAssynthesizewiderangeevidenceoftenstatisticallymathematicallysophisticatedrequireuntestableassumptionsnearlyuniversalagreementamongresearchersenhancingissuemodelingHoweverdefinitionguidelinesimplementationvaryModelregistrationcombinedlinkeddatabasemodel-basedproposedsolutionwherebyregisteredmodelsaccompanyingtechnicalnontechnicaldocumentationsourcedsinglepublicly-availableideallystandardizedformatensureconsistentcompleterepresentationfeaturescodedatasourcesresultsvalidationexercisespolicyrecommendationsultimatelycreatedmodelersreinventwheeleverydruglaunchedtreatmentpathwayopentransparentapproachessubstantialimplicationsmodelaccuracyreliabilityvalidityimprovingtrustacceptancehealthcaredecision-makersCharacterizingValidityReal-WorldUtilityAssessmentsHealthcare:FutureDirectionsComment"ProblemsPromisesTechnologies:RoleEarlyModelling"Cost-EffectivenessModelingAssessmentTransparency

Similar Articles

Cited By

No available data.