Assessment of agreement using the equine glandular gastric disease grading system in 84 cases.
Abstract: Equine glandular gastric disease (EGGD) is a common condition causing signs of gastric pain although lesions are highly variable in their appearance. The only definitive method to diagnose EGGD ante-mortem is gastroscopy. The current recommended method for describing these lesions is the European College of Equine Internal Medicine (ECEIM) guidelines; however, repeatability between users is variable. This study aimed to validate the reliability of lesion descriptions using ECEIM consensus guidelines, using four blinded equine internal medicine diplomates. Ninety-two horses with EGGD with pre- and post-treatment gastroscopy images were identified using the electronic record at a UK equine hospital between 2012 and 2019. Eight horses were excluded due to non-diagnostic images. Four blinded observers used the recommended grading system to describe images and outcomes. Intraclass correlation coefficients and Krippendorff's alpha were used to determine reliability and agreement, respectively. Intraclass correlation coefficient for severity was 0.782 (95% confidence interval [CI] 0.722-0.832), for distribution was 0.671 (95% CI 0.540-0.763), for the descriptor raised was 0.635 (95% CI 0.479-0.741), fibrinosuppurative was 0.745 (95% CI 0.651-0.812), haemorrhagic was 0.648 (95% CI 0.513-0.744), hyperaemic was 0.389 (95% CI 0.232-0.522) and for outcome was 0.677 (95% CI 0.559-0.770). Krippendorff's alpha for severity was 0.466 (95% CI 0.466-0.418), for distribution was 0.304 (95% CI 0.234-0.374), for the descriptor raised was 0.268 (95% CI 0.207-0.329), fibrinosuppurative was 0.406 (95% CI 0.347-0.463), haemorrhagic was 0.287 (95% CI 0.229-0.344), hyperaemic was 0.112 (95% CI 0.034-0.188) and for outcome was 0.315 (95% CI 0.218-0.408). There was moderate reliability determined between observers using intra-class correlation coefficients and unacceptable agreement determined between observers using Krippendorff's alpha. These results suggest that the current grading system is not comparable between observers, indicating the need to review the grading system or define more robust criteria.
© 2022 The Authors. Veterinary Medicine and Science published by John Wiley & Sons Ltd.
Publication Date: 2022-04-12 PubMed ID: 35412651PubMed Central: PMC9297748DOI: 10.1002/vms3.807Google Scholar: Lookup
The Equine Research Bank provides access to a large database of publicly available scientific literature. Inclusion in the Research Bank does not imply endorsement of study methods or findings by Mad Barn.
- Journal Article
- Clinical Examination
- Clinical Findings
- Clinical Pathology
- Clinical Study
- Clinical Symptoms
- Comparative Study
- Diagnosis
- Diagnostic Technique
- Disease Diagnosis
- Disease Etiology
- Epidemiology
- Equine Diseases
- Equine Health
- Gastrointestinal Health
- Horses
- Observational Study
- Reproduction
- Ulcers
- Veterinary Medicine
- Veterinary Practice
- Veterinary Research
Summary
This research summary has been generated with artificial intelligence and may contain errors and omissions. Refer to the original study to confirm details provided. Submit correction.
The research article assesses the reliability of the current grading system for diagnosing and categorizing equine glandular gastric disease (EGGD). Using a sample of 92 horses and four independent observers, the study finds moderate reliability but poor agreement between observers, suggesting the system requires review.
Research Context and Aim
- Equine glandular gastric disease (EGGD) is a common ailment in horses, usually diagnosed through gastroscopy. The disease presents in a variety of ways and diagnosis can be subjective.
- The current accepted method for categorizing these lesions is the European College of Equine Internal Medicine (ECEIM) guidelines. However, there has been inconsistency in the application of these guidelines between users, raising questions about their reliability.
- The goal of this research was to evaluate the ECEIM guideline’s reliability by checking the agreement of independent observers in describing EGGD lesions.
Methodology
- A sample of 92 horses with EGGD, who were treated in a UK hospital, were chosen for this study.
- The horses were selected based on pre- and post-treatment gastroscopy images available from the hospital record.
- Eight horses were later excluded due to poor quality of the images, leaving 84 horses in the study.
- Four blinded observers, all diplomates specialized in equine internal medicine, used the ECEIM guidelines to analyze and grade the EGGD lesions depicted in the images.
- The study used statistical measures, specifically the intraclass correlation coefficients and Krippendorff’s alpha, to determine the degree of reliability and agreement among observations from the four observers.
Results
- The intraclass correlation coefficients showed moderate reliability among the observers while grading the severity, distribution, and properties of the lesions along with the treatment outcomes.
- However, Krippendorff’s alpha, a measure of agreement, demonstrated low agreement between the observers in their assessments.
- The results suggest variability in the interpretations of the ECEIM guidelines, leading to inconsistencies in assessments.
Conclusions
- The present grading criteria for EGGD lesions are not adequately precise or consistent, leading to considerable variation in diagnoses and grading.
- This lack of consistent agreement indicates that the grading system should either be revised or more definite criterias should be developed to ensure uniformity in diagnosing and grading EGGD.
Cite This Article
APA
Pratt S, Bowen I, Hallowell G, Shipman E, Redpath A.
(2022).
Assessment of agreement using the equine glandular gastric disease grading system in 84 cases.
Vet Med Sci, 8(4), 1472-1477.
https://doi.org/10.1002/vms3.807 Publication
Researcher Affiliations
- School of Veterinary Medicine and Science, University of Nottingham, Nottingham, UK.
- School of Veterinary Medicine and Science, University of Nottingham, Nottingham, UK.
- School of Veterinary Medicine and Science, University of Nottingham, Nottingham, UK.
- School of Veterinary Medicine and Science, University of Nottingham, Nottingham, UK.
- School of Veterinary Medicine and Science, University of Nottingham, Nottingham, UK.
MeSH Terms
- Animals
- Gastroscopy / veterinary
- Horse Diseases / pathology
- Horses
- Humans
- Reproducibility of Results
- Stomach Diseases / diagnosis
- Stomach Diseases / veterinary
Conflict of Interest Statement
The authors declare no conflict of interest.
References
This article includes 31 references
- Andrews F, Bernard W, Byars D, Cohen N, Divers T, Macallister C, Mcgladdery A, Merritt A, Murray M, Orsini J. Recommendations for the diagnosis and treatment of equine gastric ulcer syndrome (EGUS). Equine Veterinary Education 11, 262–272.
- Banse HE, Andrews FM. Equine glandular gastric disease: prevalence, impact and management strategies.. Vet Med (Auckl) 2019;10:69-76.
- Begg LM, O'Sullivan CB. The prevalence and distribution of gastric ulceration in 345 racehorses.. Aust Vet J 2003 Apr;81(4):199-201.
- Bell RJ, Kingston JK, Mogg TD. A comparison of two scoring systems for endoscopic grading of gastric ulceration in horses.. N Z Vet J 2007 Feb;55(1):19-22.
- Bowen M. Equine glandular gastric disease recommendations. Equine Health 2018, 29–33.
- Crumpton SM, Baiker K, Hallowell GD, Habershon-Butcher JL, Bowen IM. Clinical Research Abstracts of the British Equine Veterinary Association Congress 2015.. Equine Vet J 2015 Sep;47 Suppl 48:9.
- Hallowell G. Pathogenesis of equine squamous and glandular gastric disease. UK‐Vet Equine 2, 70–75.
- Hepburn R. Endoscopic examination of the squamous and glandular gastric mucosa in sport and leisure horses: 684 horses (2005‐2011). The Eleventh International Equine Colic Research Symposium July 7–10, 2014 in Dublin, Ireland.
- Hepburn R, Proudman C. Treatment of ulceration of the gastric glandular mucosa: Retrospective evaluation of omeprazole and sucralfate combination therapy in 204 sport and leisure horses. The Eleventh International Equine Colic Research Symposium July 7–10, 2014 in Dublin, Ireland.
- Hewetson M, Sykes BW, Hallowell GD, Tulamo RM. Diagnostic accuracy of blood sucrose as a screening test for equine gastric ulcer syndrome (EGUS) in adult horses.. Acta Vet Scand 2017 Mar 11;59(1):15.
- Hewetson M, Venner M, Volquardsen J, Sykes BW, Hallowell GD, Vervuert I, Fosgate GT, Tulamo RM. Diagnostic accuracy of blood sucrose as a screening test for equine gastric ulcer syndrome (EGUS) in weanling foals.. Acta Vet Scand 2018 Apr 13;60(1):24.
- Husted L, Jensen TK, Olsen SN, Mølbak L. Examination of equine glandular stomach lesions for bacteria, including Helicobacter spp by fluorescence in situ hybridisation.. BMC Microbiol 2010 Mar 19;10:84.
- Koo TK, Li MY. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research.. J Chiropr Med 2016 Jun;15(2):155-63.
- Luthersson N, Nielsen KH, Harris P, Parkin TD. The prevalence and anatomical distribution of equine gastric ulceration syndrome (EGUS) in 201 horses in Denmark.. Equine Vet J 2009 Sep;41(7):619-24.
- MacAllister CG, Andrews FM, Deegan E, Ruoff W, Olovson SG. A scoring system for gastric ulcers in the horse.. Equine Vet J 1997 Nov;29(6):430-3.
- Martineau H, Thompson H, Taylor D. Pathology of gastritis and gastric ulceration in the horse. Part 1: range of lesions present in 21 mature individuals.. Equine Vet J 2009 Sep;41(7):638-44.
- Pedersen SK, Cribb AE, Windeyer MC, Read EK, French D, Banse HE. Risk factors for equine glandular and squamous gastric disease in show jumping Warmbloods.. Equine Vet J 2018 Nov;50(6):747-751.
- Rendle D, Bowen M, Brazil T, Hallowell G, Hewetson M, Sykes B, Hepburn R, Conwell R. Recommendations for the management of equine glandular gastric disease. UK‐Vet Equine 2, 2–11.
- Shabankhani B, Yazdani Charati J, Shabankhani K, Kaviani Cherati S. Survey of agreement between raters for nominal data using krippendorff's Alpha. Archives of Pharmacy Practice 10, 160–164.
- Spanton JA, Smith L, Mair TS. Is Serum Amyloid A elevated in horses with equine gastric ulcer syndrome?. Equine Veterinary Education 32, 16–19.
- Sykes B, Jokisalo J. Rethinking equine gastric ulcer syndrome: Part 1–Terminology, clinical signs and diagnosis. Equine Veterinary Education 26, 543–547.
- Sykes B, Jokisalo J, Hallowell G. Evaluation of a commercial faecal blood test for the diagnosis of gastric ulceration in Thoroughbred racehorses: A preliminary report [abstract]. The Eleventh International Equine Colic Research Symposium July 7–10, 2014 in Dublin, Ireland.
- Sykes BW, Kathawala K, Song Y, Garg S, Page SW, Underwood C, Mills PC. Preliminary investigations into a novel, long-acting, injectable, intramuscular formulation of omeprazole in the horse.. Equine Vet J 2017 Nov;49(6):795-801.
- Sykes BW, Sykes KM, Hallowell GD. A comparison of two doses of omeprazole in the treatment of equine gastric ulcer syndrome: a blinded, randomised, clinical trial.. Equine Vet J 2014 Jul;46(4):416-21.
- Sykes BW, Bowen M, Habershon-Butcher JL, Green M, Hallowell GD. Management factors and clinical implications of glandular and squamous gastric disease in horses.. J Vet Intern Med 2019 Jan;33(1):233-240.
- Sykes BW, Hewetson M, Hepburn RJ, Luthersson N, Tamzali Y. European College of Equine Internal Medicine Consensus Statement--Equine Gastric Ulcer Syndrome in Adult Horses.. J Vet Intern Med 2015 Sep-Oct;29(5):1288-99.
- Sykes BW, Sykes KM, Hallowell GD. A comparison of three doses of omeprazole in the treatment of equine gastric ulcer syndrome: A blinded, randomised, dose-response clinical trial.. Equine Vet J 2015 May;47(3):285-90.
- Tallon R, Hewetson M. Inter-observer variability of two grading systems for equine glandular gastric disease.. Equine Vet J 2021 May;53(3):495-502.
- Tesena P, Yingchutrakul Y, Roytrakul S, Taylor J, Angkanaporn K, Wongtawan T. Searching for serum protein markers of equine squamous gastric disease using gel electrophoresis and mass spectrometry.. Equine Vet J 2019 Sep;51(5):581-586.
- Varley G, Bowen IM, Habershon-Butcher JL, Nicholls V, Hallowell GD. Misoprostol is superior to combined omeprazole-sucralfate for the treatment of equine gastric glandular disease.. Equine Vet J 2019 Sep;51(5):575-580.
- Wise JC, Wilkes EJA, Raidal SL, Xie G, Crosby DE, Hale JN, Hughes KJ. Interobserver and intraobserver reliability for 2 grading systems for gastric ulcer syndrome in horses.. J Vet Intern Med 2021 Jan;35(1):571-579.
Citations
This article has been cited 2 times.- Vokes J, Lovett A, Sykes B. Equine Gastric Ulcer Syndrome: An Update on Current Knowledge.. Animals (Basel) 2023 Apr 5;13(7).
- Pratt SL, Bowen M, Hallowell GH, Shipman E, Bailey J, Redpath A. Does lesion type or severity predict outcome of therapy for horses with equine glandular gastric disease? - A retrospective study.. Vet Med Sci 2023 Jan;9(1):150-157.
Use Nutrition Calculator
Check if your horse's diet meets their nutrition requirements with our easy-to-use tool Check your horse's diet with our easy-to-use tool
Talk to a Nutritionist
Discuss your horse's feeding plan with our experts over a free phone consultation Discuss your horse's diet over a phone consultation
Submit Diet Evaluation
Get a customized feeding plan for your horse formulated by our equine nutritionists Get a custom feeding plan formulated by our nutritionists