Reliability of an injury scoring system for horses.
Abstract: The risk of injuries is of major concern when keeping horses in groups and there is a need for a system to record external injuries in a standardised and simple way. The objective of this study, therefore, was to develop and validate a system for injury recording in horses and to test its reliability and feasibility under field conditions. Methods: Injuries were classified into five categories according to severity. The scoring system was tested for intra- and inter-observer agreement as well as agreement with a 'golden standard' (diagnosis established by a veterinarian). The scoring was done by 43 agricultural students who classified 40 photographs presented to them twice in a random order, 10 days apart. Attribute agreement analysis was performed using Kendall's coefficient of concordance (Kendall's W), Kendall's correlation coefficient (Kendall's τ) and Fleiss' kappa. The system was also tested on a sample of 100 horses kept in groups where injury location was recorded as well. Results: Intra-observer agreement showed Kendall's W ranging from 0.94 to 0.99 and 86% of observers had kappa values above 0.66 (substantial agreement). Inter-observer agreement had an overall Kendall's W of 0.91 and the mean kappa value was 0.59 (moderate). Agreement for all observers versus the 'golden standard' had Kendall's τ of 0.88 and the mean kappa value was 0.66 (substantial). The system was easy to use for trained persons under field conditions. Injuries of the more serious categories were not found in the field trial. Conclusions: The proposed injury scoring system is easy to learn and use also for people without a veterinary education, it shows high reliability, and it is clinically useful. The injury scoring system could be a valuable tool in future clinical and epidemiological studies.
Publication Date: 2010-12-31 PubMed ID: 21194451PubMed Central: PMC3023730DOI: 10.1186/1751-0147-52-68Google Scholar: Lookup
The Equine Research Bank provides access to a large database of publicly available scientific literature. Inclusion in the Research Bank does not imply endorsement of study methods or findings by Mad Barn.
- Journal Article
- Research Support
- Non-U.S. Gov't
Summary
This research summary has been generated with artificial intelligence and may contain errors and omissions. Refer to the original study to confirm details provided. Submit correction.
The research article primarily focuses on developing and validating a standardized system for recording horse injuries to help manage risks faced by these animals when housed in groups. This newly developed system underwent various tests for reliability and feasibility in real-world conditions.
Research Methods
- The injuries were categorized into five different levels based on their severity.
- 43 agricultural students tested the scoring system’s intra- and inter-observer agreement, as well as its alignment with a “golden standard” diagnosis made by a professional veterinarian.
- The students classified 40 photographs of the injuries, presented randomly twice with 10 days interval in between.
- The scoring system was tested on a sample of 100 horses living in groups, along with the recording of the location of the injuries.
- The attribute agreement analysis was done using Kendall’s coefficient of concordance (Kendall’s W), Kendall’s correlation coefficient (Kendall’s τ), and Fleiss’ kappa.
Research Results
- The intra-observer agreement had a Kendall’s W range between 0.94 and 0.99, and 86% of observers showed kappa values above 0.66, implying a substantial degree of agreement.
- The inter-observer agreement showcased an overall Kendall’s W of 0.91, and the mean kappa value stood at 0.59, indicating a moderate level of agreement.
- Agreement between all observers and the defined ‘golden standard’ ranged at a Kendall’s τ of 0.88, with a mean kappa value of 0.66, which suggests substantial agreement.
- The system was found to be user-friendly for trained individuals in field conditions.
- In the field trial, no injuries belonging to the more serious categories were discovered.
Research Conclusions
- The proposed injury scoring system is simple to learn and can be operated by non-veterinarians, demonstrating high reliability and practical usefulness.
- The system has the potential to serve as a beneficial tool in future clinical and epidemiology research involving horses.
Cite This Article
APA
Mejdell CM, Jørgensen GH, Rehn T, Fremstad K, Keeling L, Bøe KE.
(2010).
Reliability of an injury scoring system for horses.
Acta Vet Scand, 52(1), 68.
https://doi.org/10.1186/1751-0147-52-68 Publication
Researcher Affiliations
- Section for Domestic Animal Health and Welfare, National Veterinary Institute, Sentrum, Oslo, Norway. cecilie.mejdell@vetinst.no
MeSH Terms
- Animals
- Horse Diseases / classification
- Horses / injuries
- Observer Variation
- Research Design
- Wounds and Injuries / classification
- Wounds and Injuries / veterinary
References
This article includes 21 references
- Bachmann I, Staᆲher M. [Housing and use of horses in Switzerland: a representative analysis of the status quo].. Schweiz Arch Tierheilkd 2002 Jul;144(7):331-47.
- Jørgensen GHM, Borsheim L, Kirkeby TL, Bøe KE. Stabling of trotting horses in Norway - results from an inquiry [in Norwegian]. Nor Vet Tidsskr 2010;122:295–301.
- Fürst A, Knubben J, Kurtz A, Auer J, Staᆲher M. Group housing of horses: Veterinary considerations with a focus on the prevention of bite and kick injuries. Pferdeheilkd 2006;22:254–258.
- Derungs SB, Furst AE, Hassig M, Auer JA. Frequency, consequences and clinical outcome of kick injuries in horses: 256 cases (1992-2000). Wien Tierarzt Mschr 2004;91:114–119.
- Knubben JM, Furst A, Gygax L, Staᆲher M. Bite and kick injuries in horses: prevalence, risk factors and prevention.. Equine Vet J 2008 May;40(3):219-23.
- Grandin T, McGee K, Lanier JL. Prevalence of severe welfare problems in horses that arrive at slaughter plants.. J Am Vet Med Assoc 1999 May 15;214(10):1531-3.
- Grogan EH, McDonnell SM. Injuries and blemishes in a semi-feral herd of ponies. J Equine Vet Sci 2005;25:26–30.
- Jørgensen GHM, Borsheim L, Mejdell CM, Søndergaard E, Bøe KE. Grouping horses according to gender - effects on aggression, spacing and injuries. Appl Anim Behav Sci 2009;120:94–99.
- Keeling LJ, Søndergaard E, Hyyppä S, Bøe KE, Jørgensen G, Mejdell C, Ladewig J, Särkijärvi S, Janssen H, Rundgren M, Hartmann E. Group housing of horses: Strategies to improve horse welfare and human safety. Proceedings of the 44th Congress of the International Society for Applied Ethology (ISAE) 2010;4-7 August; Uppsala, Sweden; p. 102.
- Henneke DR, Potter GD, Kreider JL, Yeates BF. Relationship between condition score, physical measurements and body fat percentage in mares.. Equine Vet J 1983 Oct;15(4):371-2.
- Kestin SC, Knowles TG, Tinch AE, Gregory NG. Prevalence of leg weakness in broiler chickens and its relationship with genotype.. Vet Rec 1992 Aug 29;131(9):190-4.
- Pritchard JC, Lindberg AC, Main DC, Whay HR. Assessment of the welfare of working horses, mules and donkeys, using health and behaviour parameters.. Prev Vet Med 2005 Jul 12;69(3-4):265-83.
- Thomsen PT, Baadsgaard NP. Intra- and inter-observer agreement of a protocol for clinical examination of dairy cows.. Prev Vet Med 2006 Jul 17;75(1-2):133-9.
- Kaler J, Wassink GJ, Green LE. The inter- and intra-observer reliability of a locomotion scoring scale for sheep.. Vet J 2009 May;180(2):189-94.
- Fuller CJ, Bladon BM, Driver AJ, Barr AR. The intra- and inter-assessor reliability of measurement of functional outcome by lameness scoring in horses.. Vet J 2006 Mar;171(2):281-6.
- Kristensen E, Dueholm L, Vink D, Andersen JE, Jakobsen EB, Illum-Nielsen S, Petersen FA, Enevoldsen C. Within- and across-person uniformity of body condition scoring in Danish Holstein cattle.. J Dairy Sci 2006 Sep;89(9):3721-8.
- Thomsen PT, Munksgaard L, Tøgersen FA. Evaluation of a lameness scoring system for dairy cows.. J Dairy Sci 2008 Jan;91(1):119-26.
- Burn CC, Prichard JC, Whay HR. Observer reliability for working welfare assessment: problems with high prevalences of certain results. Animal Welfare 2009;18:177–187.
- Landis JR, Koch GG. The measurement of observer agreement for categorical data.. Biometrics 1977 Mar;33(1):159-74.
- Sim J, Wright CC. The kappa statistic in reliability studies: use, interpretation, and sample size requirements.. Phys Ther 2005 Mar;85(3):257-68.
- Erceg A, De Jong EM, Van Lingen RG, De Boo TM, Van De Kerkhof PC, Seyger MM. Validation of clinical and image skin scoring systems for a single chronic discoid lupus erythematosus lesion.. J Dermatolog Treat 2009;20(1):32-5.
Citations
This article has been cited 6 times.- Zollinger A, Wyss C, Bardou D, Bachmann I. Social Box: A New Housing System Increases Social Interactions among Stallions. Animals (Basel) 2023 Apr 20;13(8).
- Hildebrandt F, Büttner K, Salau J, Krieter J, Czycholl I. Area and Resource Utilization of Group-Housed Horses in an Active Stable. Animals (Basel) 2021 Sep 23;11(10).
- Pfeiffenberger M, Bartsch J, Hoff P, Ponomarev I, Barnewitz D, Thöne-Reineke C, Buttgereit F, Gaber T, Lang A. Hypoxia and mesenchymal stromal cells as key drivers of initial fracture healing in an equine in vitro fracture hematoma model. PLoS One 2019;14(4):e0214276.
- Akwar H, Kloeze H, Mukhi S. Development and Validation of a Standardized Tool for Prioritization of Information Sources. Online J Public Health Inform 2016;8(2):e187.
- Pedersen KS, Strunz AM. Evaluation of farmers' diagnostic performance for detection of diarrhoea in nursery pigs using digital pictures of faecal pools. Acta Vet Scand 2013 Oct 18;55(1):72.
- Foddai A, Green LE, Mason SA, Kaler J. Evaluating observer agreement of scoring systems for foot integrity and footrot lesions in sheep. BMC Vet Res 2012 May 25;8:65.
Use Nutrition Calculator
Check if your horse's diet meets their nutrition requirements with our easy-to-use tool Check your horse's diet with our easy-to-use tool
Talk to a Nutritionist
Discuss your horse's feeding plan with our experts over a free phone consultation Discuss your horse's diet over a phone consultation
Submit Diet Evaluation
Get a customized feeding plan for your horse formulated by our equine nutritionists Get a custom feeding plan formulated by our nutritionists