Equine syndromic surveillance in Colorado using veterinary laboratory testing order data.
Abstract: The Risk Identification Unit (RIU) of the US Dept. of Agriculture's Center for Epidemiology and Animal Health (CEAH) conducts weekly surveillance of national livestock health data and routine coordination with agricultural stakeholders. As part of an initiative to increase the number of species, health issues, and data sources monitored, CEAH epidemiologists are building a surveillance system based on weekly syndromic counts of laboratory test orders in consultation with Colorado State University laboratorians and statistical analysts from the Johns Hopkins University Applied Physics Laboratory. Initial efforts focused on 12 years of equine test records from three state labs. Trial syndrome groups were formed based on RIU experience and published literature. Exploratory analysis, stakeholder input, and laboratory workflow details were needed to modify these groups and filter the corresponding data to eliminate alerting bias. Customized statistical detection methods were sought for effective monitoring based on specialized laboratory information characteristics and on the likely presentation and animal health significance of diseases associated with each syndrome. Data transformation and syndrome formation focused on test battery type, test name, submitter source organization, and specimen type. We analyzed time series of weekly counts of tests included in candidate syndrome groups and conducted an iterative process of data analysis and veterinary consultation for syndrome refinement and record filters. This process produced a rule set in which records were directly classified into syndromes using only test name when possible, and otherwise, the specimen type or related body system was used with test name to determine the syndrome. Test orders associated with government regulatory programs, veterinary teaching hospital testing protocols, or research projects, rather than clinical concerns, were excluded. We constructed a testbed for sets of 1000 statistical trials and applied a stochastic injection process assuming lognormally distributed incubation periods to choose an alerting algorithm with the syndrome-required sensitivity and an alert rate within the specified acceptable range for each resulting syndrome. Alerting performance of the EARS C3 algorithm traditionally used by CEAH was compared to modified C2, CuSUM, and EWMA methods, with and without outlier removal and adjustments for the total weekly number of non-mandatory tests. The equine syndrome groups adopted for monitoring were abortion/reproductive, diarrhea/GI, necropsy, neurological, respiratory, systemic fungal, and tickborne. Data scales, seasonality, and variance differed widely among the weekly time series. Removal of mandatory and regulatory tests reduced weekly observed counts significantly-by >80% for diarrhea/GI syndrome. The RIU group studied outcomes associated with each syndrome and called for detection of single-week signals for most syndromes with expected false-alert intervals >8 and <52 weeks, 8-week signals for neurological and tickborne monitoring (requiring enhanced sensitivity), 6-week signals for respiratory, and 4-week signals for systemic fungal. From the test-bed trials, recommended methods, settings and thresholds were derived. Understanding of laboratory submission sources, laboratory workflow, and of syndrome-related outcomes are crucial to form syndrome groups for routine monitoring without artifactual alerting. Choices of methods, parameters, and thresholds varied by syndrome and depended strongly on veterinary epidemiologist-specified performance requirements.
Publication Date: 2019-03-01 PubMed ID: 30822346PubMed Central: PMC6396905DOI: 10.1371/journal.pone.0211335Google Scholar: Lookup
The Equine Research Bank provides access to a large database of publicly available scientific literature. Inclusion in the Research Bank does not imply endorsement of study methods or findings by Mad Barn.
- Journal Article
- Research Support
- Non-U.S. Gov't
- Animal Health
- Diagnosis
- Disease control
- Disease Diagnosis
- Disease Etiology
- Disease Management
- Disease Outbreaks
- Disease Prevention
- Disease Surveillance
- Disease Transmission
- Disease Treatment
- Epidemiology
- Equine Diseases
- Equine Health
- Horses
- Laboratory Methods
- Public Health
- Veterinary Care
- Veterinary Medicine
- Veterinary Research
- Veterinary Science
Summary
This research summary has been generated with artificial intelligence and may contain errors and omissions. Refer to the original study to confirm details provided. Submit correction.
The research focuses on building an equine surveillance system in Colorado to monitor livestock health data. The system is based on weekly counts of laboratory test orders to detect outbreaks of diseases in horses using statistical methods. Data from 12 years of equine test records was analysed and groups formed based on the risk identification unit (RIU) experience and published literature.
Methods
- Initial efforts focused on 12 years of equine test records from three state labs.
- The team formed trial syndrome groups based on experience and published literature.
- The data was analysed and the groups modified with stakeholder input and laboratory workflow details to eliminate bias.
- Customized detection methods were identified for effective monitoring based on the expected presentation and health significance of diseases associated with each syndrome.
- Test orders associated with government regulations, teaching hospital protocols, or research projects were excluded.
- A rule set was produced where records were directly classified into syndromes using the test name where possible and otherwise, the body system related to the specimen type was used with test name.
Data Analysis
- Weekly counts of tests included in the candidate syndrome groups were analyzed.
- This was followed by an iterative process of data analysis and veterinary consultation for syndrome refinement and record filters.
- Data transformation and formation of syndromes focused on test battery types, test names, the organization submitting the tests, and the type of specimen.
Testing and Results
- A testbed was constructed for sets of 1,000 statistical trials and a stochastic injection process was applied to choose an alerting algorithm required for each resulting syndrome.
- The research team studied the outcomes associated with each syndrome and specified the detection of single-week signals for most syndromes, 8-week signals for neurological and tick-borne monitoring, 6-week signals for respiratory, and 4-week signals for systemic fungal.
- The recommended methods, settings, and thresholds were derived from the test-bed trials.
Conclusion
- Understanding of laboratory submission sources, laboratory workflow and syndrome-related outcomes are crucial to form syndrome groups for routine monitoring without artifactual alerting.
- The choices of methods, parameters, and thresholds for the surveillance system varied by syndrome and depended strongly on the specifications set by veterinary epidemiologists.
Cite This Article
APA
Burkom H, Estberg L, Akkina J, Elbert Y, Zepeda C, Baszler T.
(2019).
Equine syndromic surveillance in Colorado using veterinary laboratory testing order data.
PLoS One, 14(3), e0211335.
https://doi.org/10.1371/journal.pone.0211335 Publication
Researcher Affiliations
- The Johns Hopkins University Applied Physics Laboratory, Laurel, Maryland, United States of America.
- Center for Epidemiology and Animal Health, US Department of Agriculture, Ft. Collins, Colorado, United States of America.
- Center for Epidemiology and Animal Health, US Department of Agriculture, Ft. Collins, Colorado, United States of America.
- The Johns Hopkins University Applied Physics Laboratory, Laurel, Maryland, United States of America.
- Center for Epidemiology and Animal Health, US Department of Agriculture, Ft. Collins, Colorado, United States of America.
- Veterinary Diagnostic Laboratory, College of Veterinary Medicine and Biomedical Sciences, Colorado State University, Fort Collins, Colorado, United States of America.
MeSH Terms
- Algorithms
- Animals
- Clinical Laboratory Techniques / trends
- Clinical Laboratory Techniques / veterinary
- Colorado
- Disease Outbreaks / veterinary
- Horse Diseases / diagnosis
- Horses
- Population Surveillance
- Sentinel Surveillance / veterinary
Conflict of Interest Statement
The authors have declared that no competing interests exist.
References
This article includes 18 references
- Dórea FC, Sanchez J, Revie CW. Veterinary syndromic surveillance: Current initiatives and potential for development.. Prev Vet Med 2011 Aug 1;101(1-2):1-17.
- Dórea FC, Muckle CA, Kelton D, McClure JT, McEwen BJ, McNab WB, Sanchez J, Revie CW. Exploratory analysis of methods for automated classification of laboratory test orders into syndromic groups in veterinary medicine.. PLoS One 2013;8(3):e57334.
- Dórea FC, McEwen BJ, McNab WB, Sanchez J, Revie CW. Syndromic surveillance using veterinary laboratory data: algorithm combination and customization of alerts.. PLoS One 2013;8(12):e82183.
- Warns-Petit E, Morignat E, Artois M, Calavas D. Unsupervised clustering of wildlife necropsy data for syndromic surveillance.. BMC Vet Res 2010 Dec 16;6:56.
- Ely ER, Nicholson RE, Snow LC, Strugnell BW, Williamson SM, Milnes AS, Watson EN, Hoinville LJ. Evaluation of methods for measuring coverage and representativeness of an early-warning disease surveillance system.. Vet Rec 2012 Oct 27;171(17):423.
- Hoinville LJ, Alban L, Drewe JA, Gibbens JC, Gustafson L, Häsler B, Saegerman C, Salman M, Stärk KD. Proposed terms and concepts for describing and evaluating animal-health surveillance systems.. Prev Vet Med 2013 Oct 1;112(1-2):1-12.
- Hutwagner L, Thompson W, Seeman GM, Treadwell T. The bioterrorism preparedness and response Early Aberration Reporting System (EARS).. J Urban Health 2003 Jun;80(2 Suppl 1):i89-96.
- Tokars JI, Burkom H, Xing J, English R, Bloom S, Cox K, Pavlin JA. Enhancing time-series detection algorithms for automated biosurveillance.. Emerg Infect Dis 2009 Apr;15(4):533-9.
- Burkom HS. Alerting Algorithms for Biosurveillance In: Lombardo JS, Buckeridge David L., editor. Disease surveillance: a public health informatics approach. Hoboken, N.J: Wiley-Interscience; 2007. p. 143–92.
- Wallenstein S, Naus J. Scan statistics for temporal surveillance for biologic terrorism.. MMWR Suppl 2004 Sep 24;53:74-8.
- Stroup DF, Wharton M, Kafadar K, Dean AG. Evaluation of a method for detecting aberrations in public health surveillance data.. Am J Epidemiol 1993 Feb 1;137(3):373-80.
- Zhou H, Burkom H, Winston CA, Dey A, Ajani U. Practical comparison of aberration detection algorithms for biosurveillance systems.. J Biomed Inform 2015 Oct;57:446-55.
- Jackson ML, Baer A, Painter I, Duchin J. A simulation study comparing aberration detection algorithms for syndromic surveillance.. BMC Med Inform Decis Mak 2007 Mar 1;7:6.
- Reis BY, Mandl KD. Syndromic surveillance: the effects of syndrome grouping on model accuracy and outbreak detection.. Ann Emerg Med 2004 Sep;44(3):235-41.
- International Health Terminology Standards Development Organisation. Using LOINC with SNOMED CT 2017 [cited 2018 November 15, 2018]. http://snomed.org/loinc.
- Magruder SF, Lewis SH, Najmi A, Florio E. Progress in understanding and using over-the-counter pharmaceuticals for syndromic surveillance.. MMWR Suppl 2004 Sep 24;53:117-22.
- Wallstrom GL, Hogan WR. Unsupervised clustering of over-the-counter healthcare products into product categories.. J Biomed Inform 2007 Dec;40(6):642-8.
- Conway M, Dowling JN, Chapman WW. Using chief complaints for syndromic surveillance: a review of chief complaint based classifiers in North America.. J Biomed Inform 2013 Aug;46(4):734-43.
Citations
This article has been cited 3 times.- Lustgarten JL, Zehnder A, Shipman W, Gancher E, Webb TL. Veterinary informatics: forging the future between veterinary medicine, human medicine, and One Health initiatives-a joint paper by the Association for Veterinary Informatics (AVI) and the CTSA One Health Alliance (COHA). JAMIA Open 2020 Jul;3(2):306-317.
- De Nardi M, Küker S, Salah S, Qtananni I, Rosso F, Baiomy S. Animal health syndromic surveillance system in Jordan, a road map for a pilot model. Front Vet Sci 2025;12:1538347.
- Oliveira VHS, Dórea FC, Dean KR, Bang Jensen B. Exploring Options for Syndromic Surveillance in Aquaculture: Outbreak Detection of Salmon Pancreas Disease Using Production Data from Norwegian Farms. Transbound Emerg Dis 2024;2024:9861677.
Use Nutrition Calculator
Check if your horse's diet meets their nutrition requirements with our easy-to-use tool Check your horse's diet with our easy-to-use tool
Talk to a Nutritionist
Discuss your horse's feeding plan with our experts over a free phone consultation Discuss your horse's diet over a phone consultation
Submit Diet Evaluation
Get a customized feeding plan for your horse formulated by our equine nutritionists Get a custom feeding plan formulated by our nutritionists