An epidemiological network model for disease outbreak detection.

Ben Y Reis, Isaac S Kohane, Kenneth D Mandl
Author Information
  1. Ben Y Reis: Children's Hospital Informatics Program, Harvard-MIT Division of Health Sciences and Technology, Children's Hospital, Harvard Medical School, Boston, Massachusetts, United States of America. ben_reis@harvard.edu

Abstract

BACKGROUND: Advanced disease-surveillance systems have been deployed worldwide to provide early detection of infectious disease outbreaks and bioterrorist attacks. New methods that improve the overall detection capabilities of these systems can have a broad practical impact. Furthermore, most current generation surveillance systems are vulnerable to dramatic and unpredictable shifts in the health-care data that they monitor. These shifts can occur during major public events, such as the Olympics, as a result of population surges and public closures. Shifts can also occur during epidemics and pandemics as a result of quarantines, the worried-well flooding emergency departments or, conversely, the public staying away from hospitals for fear of nosocomial infection. Most surveillance systems are not robust to such shifts in health-care utilization, either because they do not adjust baselines and alert-thresholds to new utilization levels, or because the utilization shifts themselves may trigger an alarm. As a result, public-health crises and major public events threaten to undermine health-surveillance systems at the very times they are needed most.
METHODS AND FINDINGS: To address this challenge, we introduce a class of epidemiological network models that monitor the relationships among different health-care data streams instead of monitoring the data streams themselves. By extracting the extra information present in the relationships between the data streams, these models have the potential to improve the detection capabilities of a system. Furthermore, the models' relational nature has the potential to increase a system's robustness to unpredictable baseline shifts. We implemented these models and evaluated their effectiveness using historical emergency department data from five hospitals in a single metropolitan area, recorded over a period of 4.5 y by the Automated Epidemiological Geotemporal Integrated Surveillance real-time public health-surveillance system, developed by the Children's Hospital Informatics Program at the Harvard-MIT Division of Health Sciences and Technology on behalf of the Massachusetts Department of Public Health. We performed experiments with semi-synthetic outbreaks of different magnitudes and simulated baseline shifts of different types and magnitudes. The results show that the network models provide better detection of localized outbreaks, and greater robustness to unpredictable shifts than a reference time-series modeling approach.
CONCLUSIONS: The integrated network models of epidemiological data streams and their interrelationships have the potential to improve current surveillance efforts, providing better localized outbreak detection under normal circumstances, as well as more robust performance in the face of shifts in health-care utilization during epidemics and major public events.

References

  1. JAMA. 1998 May 13;279(18):1463-8 [PMID: 9600481]
  2. J Biomed Inform. 2005 Apr;38(2):99-113 [PMID: 15797000]
  3. MMWR Suppl. 2004 Sep 24;53:130-6 [PMID: 15714642]
  4. BMC Med Inform Decis Mak. 2003 Jan 23;3:2 [PMID: 12542838]
  5. J Am Med Inform Assoc. 2004 Mar-Apr;11(2):141-50 [PMID: 14633933]
  6. Nature. 2005 Sep 8;437(7056):209-14 [PMID: 16079797]
  7. Emerg Infect Dis. 2004 Feb;10(2):185-94 [PMID: 15030681]
  8. Nature. 2003 Feb 6;421(6923):564 [PMID: 12571558]
  9. Ann Intern Med. 2004 Jun 1;140(11):910-22 [PMID: 15172906]
  10. Emerg Infect Dis. 2004 May;10(5):858-64 [PMID: 15200820]
  11. Nature. 2004 Dec 16;432(7019):901-4 [PMID: 15602561]
  12. Proc Natl Acad Sci U S A. 2003 Feb 18;100(4):1961-5 [PMID: 12574522]
  13. Am J Epidemiol. 1995 Mar 1;141(5):386-94; discussion 385 [PMID: 7879783]
  14. MMWR Suppl. 2004 Sep 24;53:86-94 [PMID: 15714635]
  15. Emerg Infect Dis. 2005 Mar;11(3):417-24 [PMID: 15757557]
  16. Epidemiol Infect. 2006 Feb;134(1):13-20 [PMID: 16409646]
  17. Emerg Infect Dis. 2006 Jan;12(1):88-94 [PMID: 16494723]
  18. Am J Epidemiol. 2005 Oct 1;162(7):686-93 [PMID: 16107568]
  19. AMIA Annu Symp Proc. 2003;:549-53 [PMID: 14728233]
  20. Emerg Infect Dis. 2004 Oct;10(10):1806-11 [PMID: 15504267]
  21. Nature. 2004 Dec 16;432(7019):904-6 [PMID: 15602562]
  22. MMWR Suppl. 2005 Aug 26;54:11-9 [PMID: 16177687]
  23. PLoS Med. 2005 Mar;2(3):e59 [PMID: 15719066]
  24. MMWR Suppl. 2004 Sep 24;53:59-66 [PMID: 15714631]
  25. Science. 2005 Aug 12;309(5737):1083-7 [PMID: 16079251]
  26. Emerg Infect Dis. 1997 Jul-Sep;3(3):395-400 [PMID: 9284390]
  27. Nature. 2003 Oct 16;425(6959):681-5 [PMID: 14562094]
  28. MMWR Suppl. 2004 Sep 24;53:40-2 [PMID: 15714625]
  29. MMWR Suppl. 2005 Aug 26;54:55-62 [PMID: 16177694]

Grants

  1. R01 LM007677/NLM NIH HHS
  2. R01 PH000040/PHPPO CDC HHS
  3. R01 LM007677-01/NLM NIH HHS
  4. R01 PH000040-01/PHPPO CDC HHS

MeSH Term

Disease Outbreaks
Hospital Information Systems
Humans
Models, Statistical
Public Health Informatics

Word Cloud

Created with Highcharts 10.0.0shiftsdetectiondatapublicsystemsmodelshealth-careutilizationnetworkstreamsoutbreaksimprovecansurveillanceunpredictablemajoreventsresultepidemiologicaldifferentpotentialprovidediseasecapabilitiesFurthermorecurrentmonitoroccurepidemicsemergencyhospitalsrobusthealth-surveillancerelationshipssystemrobustnessbaselineHealthmagnitudesbetterlocalizedoutbreakBACKGROUND:Advanceddisease-surveillancedeployedworldwideearlyinfectiousbioterroristattacksNewmethodsoverallbroadpracticalimpactgenerationvulnerabledramaticOlympicspopulationsurgesclosuresShiftsalsopandemicsquarantinesworried-wellfloodingdepartmentsconverselystayingawayfearnosocomialinfectioneitheradjustbaselinesalert-thresholdsnewlevelsmaytriggeralarmpublic-healthcrisesthreatenunderminetimesneededmostMETHODSANDFINDINGS:addresschallengeintroduceclassamonginsteadmonitoringextractingextrainformationpresentmodels'relationalnatureincreasesystem'simplementedevaluatedeffectivenessusinghistoricaldepartmentfivesinglemetropolitanarearecordedperiod45yAutomatedEpidemiologicalGeotemporalIntegratedSurveillancereal-timedevelopedChildren'sHospitalInformaticsProgramHarvard-MITDivisionSciencesTechnologybehalfMassachusettsDepartmentPublicperformedexperimentssemi-syntheticsimulatedtypesresultsshowgreaterreferencetime-seriesmodelingapproachCONCLUSIONS:integratedinterrelationshipseffortsprovidingnormalcircumstanceswellperformancefacemodel

Similar Articles

Cited By (24)