The statistical approach in trial-based economic evaluations matters: get your statistics together!

Elizabeth N Mutubuki, Mohamed El Alili, Judith E Bosmans, Teddy Oosterhuis, Frank J Snoek, Raymond W J G Ostelo, Maurits W van Tulder, Johanna M van Dongen
Author Information
  1. Elizabeth N Mutubuki: Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam Movement Sciences Research Institute, Amsterdam, the Netherlands.
  2. Mohamed El Alili: Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands. m.elalili@vu.nl.
  3. Judith E Bosmans: Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands.
  4. Teddy Oosterhuis: Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands.
  5. Frank J Snoek: Department of Medical Psychology, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands.
  6. Raymond W J G Ostelo: Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam Movement Sciences Research Institute, Amsterdam, the Netherlands.
  7. Maurits W van Tulder: Department of Physiotherapy & Occupational Therapy, Aarhus University Hospital, Aarhus, Denmark.
  8. Johanna M van Dongen: Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam Movement Sciences Research Institute, Amsterdam, the Netherlands.

Abstract

BACKGROUND: Baseline imbalances, skewed costs, the correlation between costs and effects, and missing data are statistical challenges that are often not adequately accounted for in the analysis of cost-effectiveness data. This study aims to illustrate the impact of accounting for these statistical challenges in trial-based economic evaluations.
METHODS: Data from two trial-based economic evaluations, the REALISE and HypoAware studies, were used. In total, 14 full cost-effectiveness analyses were performed per study, in which the four statistical challenges in trial-based economic evaluations were taken into account step-by-step. Statistical approaches were compared in terms of the resulting cost and effect differences, ICERs, and probabilities of cost-effectiveness.
RESULTS: In the REALISE study and HypoAware study, the ICER ranged from 636,744€/QALY and 90,989€/QALY when ignoring all statistical challenges to - 7502€/QALY and 46,592€/QALY when accounting for all statistical challenges, respectively. The probabilities of the intervention being cost-effective at 0€/ QALY gained were 0.67 and 0.59 when ignoring all statistical challenges, and 0.54 and 0.27 when all of the statistical challenges were taken into account for the REALISE study and HypoAware study, respectively.
CONCLUSIONS: Not accounting for baseline imbalances, skewed costs, correlated costs and effects, and missing data in trial-based economic evaluations may notably impact results. Therefore, when conducting trial-based economic evaluations, it is important to align the statistical approach with the identified statistical challenges in cost-effectiveness data. To facilitate researchers in handling statistical challenges in trial-based economic evaluations, software code is provided.

Keywords

References

  1. BMJ. 2000 Apr 29;320(7243):1197-200 [PMID: 10784550]
  2. Diabet Med. 2018 Feb;35(2):214-222 [PMID: 29150861]
  3. Med Decis Making. 2010 Mar-Apr;30(2):163-75 [PMID: 19675321]
  4. Health Econ. 2018 Nov;27(11):1670-1683 [PMID: 29969834]
  5. J Health Serv Res Policy. 2004 Oct;9(4):197-204 [PMID: 15509405]
  6. Stat Med. 2019 Apr 15;38(8):1399-1420 [PMID: 30565727]
  7. Eur J Health Econ. 2018 Sep;19(7):993-1008 [PMID: 29260341]
  8. Pharmacoeconomics. 2020 Nov;38(11):1247-1261 [PMID: 32729091]
  9. BMJ. 2011 Apr 07;342:d1548 [PMID: 21474510]
  10. J R Stat Soc Ser A Stat Soc. 2009 Jan;172(1):3-20 [PMID: 20585409]
  11. Value Health. 2015 Mar;18(2):161-72 [PMID: 25773551]
  12. Value Health. 2014 Nov;17(7):A584 [PMID: 27201981]
  13. J Clin Epidemiol. 2013 Sep;66(9):1022-8 [PMID: 23790725]
  14. Pharmacoeconomics. 2015 Oct;33(10):1083-90 [PMID: 25957531]
  15. Health Econ. 2003 Jan;12(1):33-49 [PMID: 12483759]
  16. BMC Musculoskelet Disord. 2013 Apr 05;14:124 [PMID: 23560810]
  17. Pharmacoeconomics. 2017 Oct;35(10):1007-1033 [PMID: 28674846]
  18. Med Decis Making. 2005 Jul-Aug;25(4):416-23 [PMID: 16061893]
  19. Diabetes Care. 2016 Dec;39(12):2190-2196 [PMID: 27797931]
  20. Expert Rev Pharmacoecon Outcomes Res. 2020 Feb;20(1):27-37 [PMID: 31731882]
  21. Stat Med. 2011 Feb 20;30(4):377-99 [PMID: 21225900]
  22. Med Decis Making. 2012 Jan-Feb;32(1):209-20 [PMID: 21610256]
  23. Pharmacoeconomics. 2003;21(15):1103-12 [PMID: 14596629]
  24. Health Econ. 1994 Sep-Oct;3(5):309-19 [PMID: 7827647]
  25. Ned Tijdschr Geneeskd. 2005 Jul 9;149(28):1574-8 [PMID: 16038162]
  26. Eur J Health Econ. 2016 Nov;17(8):939-950 [PMID: 26497027]
  27. Expert Rev Pharmacoecon Outcomes Res. 2006 Jun;6(3):337-46 [PMID: 20528526]
  28. Eur J Health Econ. 2016 Nov;17(8):927-938 [PMID: 26445961]
  29. Stat Med. 2000 Dec 15;19(23):3219-36 [PMID: 11113956]
  30. Health Econ. 2020 Feb;29(2):171-184 [PMID: 31845455]
  31. Health Econ. 1997 Jul-Aug;6(4):327-40 [PMID: 9285227]
  32. BMC Endocr Disord. 2015 Aug 21;15:43 [PMID: 26292674]
  33. J Clin Epidemiol. 2014 Mar;67(3):335-42 [PMID: 24291505]
  34. Health Econ. 2003 May;12(5):377-92 [PMID: 12720255]
  35. Health Econ. 2005 May;14(5):487-96 [PMID: 15497198]
  36. Health Econ. 2012 Jun;21(6):695-714 [PMID: 21633989]
  37. Health Econ. 2005 Aug;14(8):763-76 [PMID: 15729743]
  38. Pharmacoeconomics. 2014 Dec;32(12):1157-70 [PMID: 25069632]
  39. BMJ. 2009 Jun 29;338:b2393 [PMID: 19564179]
  40. Pharmacoeconomics. 2009;27(6):519-28 [PMID: 19640014]
  41. Pharmacoeconomics. 2015 Apr;33(4):355-66 [PMID: 25595871]
  42. Health Econ. 2005 Dec;14(12):1217-29 [PMID: 15945043]
  43. Stat Med. 2010 Dec 10;29(28):2920-31 [PMID: 20842622]
  44. Health Econ Rev. 2013 Mar 28;3(1):8 [PMID: 23537421]
  45. J Occup Environ Med. 2014 Apr;56(4):441-5 [PMID: 24662952]
  46. BMC Clin Pharmacol. 2010 Jan 12;10:2 [PMID: 20067642]
  47. Health Econ. 2004 May;13(5):405-15 [PMID: 15127421]
  48. Health Econ. 2002 Jul;11(5):415-30 [PMID: 12112491]
  49. Pharmacoecon Open. 2017 Jun;1(2):79-97 [PMID: 29442336]
  50. Ann Transl Med. 2016 Jan;4(1):9 [PMID: 26855945]
  51. Health Econ. 1997 May-Jun;6(3):243-52 [PMID: 9226142]
  52. J Occup Environ Med. 2014 Jun;56(6):563-72 [PMID: 24854249]
  53. Clin Trials. 2014 Oct;11(5):590-600 [PMID: 24902924]
  54. Pharmacoeconomics. 2018 Aug;36(8):889-901 [PMID: 29679317]
  55. Multivariate Behav Res. 1998 Oct 1;33(4):545-71 [PMID: 26753828]
  56. Arch Dermatol. 2000 Mar;136(3):381-5 [PMID: 10724201]
  57. Health Econ. 2004 May;13(5):461-75 [PMID: 15127426]
  58. Health Econ. 2012 Feb;21(2):187-200 [PMID: 22223561]
  59. Med Decis Making. 2012 Mar-Apr;32(2):350-61 [PMID: 22016450]
  60. Health Econ. 2000 Oct;9(7):599-609 [PMID: 11103926]
  61. Clin Trials. 2007;4(2):154-61 [PMID: 17456514]
  62. Value Health. 2006 Sep-Oct;9(5):334-40 [PMID: 16961551]
  63. Health Econ. 2010 Mar;19(3):316-33 [PMID: 19378353]
  64. Stat Med. 2019 May 20;38(11):2074-2102 [PMID: 30652356]
  65. Stat Med. 2006 May 15;25(9):1561-76 [PMID: 16158412]
  66. Health Econ. 2018 Jun;27(6):1024-1040 [PMID: 29573044]
  67. Value Health. 2010 Dec;13(8):1028-37 [PMID: 20667054]

MeSH Term

Cost-Benefit Analysis
Humans
Quality-Adjusted Life Years

Word Cloud

Created with Highcharts 10.0.0statisticalchallengestrial-basedeconomicevaluationsdatastudycostscost-effectiveness0imbalancesaccountingREALISEHypoAwareskewedeffectsmissinganalysisimpacttakenaccountStatisticalprobabilitiesignoringrespectivelyapproachBACKGROUND:BaselinecorrelationoftenadequatelyaccountedaimsillustrateMETHODS:Datatwostudiesusedtotal14fullanalysesperformedperfourstep-by-stepapproachescomparedtermsresultingcosteffectdifferencesICERsRESULTS:ICERranged636744€/QALY90989€/QALY- 7502€/QALY46592€/QALYinterventioncost-effective0€/QALYgained67595427CONCLUSIONS:baselinecorrelatedmaynotablyresultsThereforeconductingimportantalignidentifiedfacilitateresearchershandlingsoftwarecodeprovidedmatters:getstatisticstogether!BaselineClinicaltrialCost-benefitMissingSkewedmethods

Similar Articles

Cited By