FREE SHIPPING over $40
OVER 10000 FIVE-STAR REVIEWS
5% OFF ALL SUBSCRIPTIONS
100% HAPPINESS GUARANTEE
Analyze Diet
0
Frontiers in veterinary science2021; 8; 595455; doi: 10.3389/fvets.2021.595455

Inter-evaluator and Intra-evaluator Reliability of a Software Program Used to Extract Kinematic Variables Obtained by an Extremity-Mounted Inertial Measurement Unit System in Sound Horses at the Trot Under Soft and Hard Ground Conditions and Treadmill Exercise.

Abstract: To assess the inter-evaluator and intra-evaluator reliability of a software program used to extract kinematic variables by a commercially available extremity-mounted inertial measurement unit system in sound horses at the trot under soft and hard ground conditions and treadmill exercise. Thirty adult, sound and healthy French Montagne stallions. Data collection was performed with six IMUs strapped to the distal, metacarpal, metatarsal and tibial regions of every horse. Per surface (treadmill, soft and hard ground) 10 stallions were trotted three times. Prior to the analysis done by six evaluators (three experienced, three inexperienced) the data was blinded and copied three times. For every analysis a minimum of five strides had to be selected. To assess the intra- and inter-evaluator reliability a selection of gait variables was used to calculate intra and inter correlation coefficients (ICCs) as well as variance partitioning coefficients (VPCs). All of the tested gait variables showed high levels of reliability. There was no mentionable difference considering the correlation coefficients between the intra and inter reliability as well as between the three different surfaces. VPCs showed that the factor horse is by far the most responsible for any appearing variance. The experience of the evaluator had no influence on the results. The software program tested in this study has a high inter- and intra-evaluator reliability under the chosen conditions for the selected variables and acts independent of the ground situation and the experience of the evaluator. On the condition of a correct application it has the potential to become a clinically relevant and reliable gait analysis tool.
Copyright © 2021 Schwarz, Vidondo, Maninchedda, Sprick, Schöpfer and Cruz.
Get Full Text
Publication Date: 2021-03-04 PubMed ID: 33748204PubMed Central: PMC7969790DOI: 10.3389/fvets.2021.595455Google Scholar: Lookup
The Equine Research Bank provides access to a large database of publicly available scientific literature. Inclusion in the Research Bank does not imply endorsement of study methods or findings by Mad Barn.
LinkedInCopy
  • Journal Article

Summary

This research summary has been generated with artificial intelligence and may contain errors and omissions. Refer to the original study to confirm details provided. Submit correction.

This research evaluates the reliability of a software program used with a body-worn sensor system to analyze the movement of horses as they trot on different surfaces. The study found the software to be reliable regardless of the evaluator’s experience or ground condition, suggesting its potential as a useful tool in clinical gait analysis.

Introduction and Objective

This research study primarily aimed to assess the inter-evaluator (among different evaluators) and intra-evaluator (within the same evaluator) reliability of a software program designed to interpret readings from an ‘extremity-mounted inertial measurement unit’ (IMU) system. These systems are used to analyze the movement, among healthy horses, across various ground conditions (soft, hard, and treadmill) during trotting.

Methods

  • Thirty healthy adult French Montagne stallions were involved in this study.
  • Six IMUs were strapped to the distal, metacarpal, metatarsal, and tibial regions of each horse.
  • At each surface (treadmill, soft and hard ground) 10 horses were trotted three times each.
  • The collected data was blinded and copied three times before being analyzed by six evaluators, half of whom were experienced and half inexperienced.
  • To assess the reliability of the software, a variety of variables related to the horses’ gait were analyzed using ‘inter correlation coefficients’ (ICCs) and ‘variance partitioning coefficients’ (VPCs).

Results

  • The study reported high levels of reliability for all analyzed gait variables.
  • No significant difference was observed between intra and inter reliability or among the different surfaces when considering the correlation coefficients.
  • As per the VPCs, the largest variance was attributed to the horse factor, indicating that individual horse characteristics accounted for most differences in the data.
  • The experience level of the evaluator did not significantly affect the results.

Conclusion

The software program demonstrated high inter and intra evaluator reliability under the tested conditions and for the selected variables, indicating it is robust against factors like the ground conditions and evaluator experience. Provided it is applied correctly, the software has the potential to be a clinically relevant and reliable tool for gait analysis in horses.

Cite This Article

APA
Schwarz J, Vidondo B, Maninchedda UE, Sprick M, Schöpfer MC, Cruz AM. (2021). Inter-evaluator and Intra-evaluator Reliability of a Software Program Used to Extract Kinematic Variables Obtained by an Extremity-Mounted Inertial Measurement Unit System in Sound Horses at the Trot Under Soft and Hard Ground Conditions and Treadmill Exercise. Front Vet Sci, 8, 595455. https://doi.org/10.3389/fvets.2021.595455

Publication

Frontiers in veterinary science
ISSN: 2297-1769
NlmUniqueID: 101666658
Country: Switzerland
Language: English
Volume: 8
Pages: 595455
PII: 595455

Researcher Affiliations

Schwarz, Julia
  • Vetsuisse Faculty, Institut Suisse de Medicine Equine, University of Bern, Bern, Switzerland.
Vidondo, Beatriz
  • Vetsuisse Faculty, Veterinary Public Health Institute, University of Bern, Bern, Switzerland.
Maninchedda, Ugo E
  • Vetsuisse Faculty, Institut Suisse de Medicine Equine, University of Bern, Bern, Switzerland.
Sprick, Miriam
  • Vetsuisse Faculty, Institut Suisse de Medicine Equine, University of Bern, Bern, Switzerland.
Schöpfer, Melina C
  • Vetsuisse Faculty, Institut Suisse de Medicine Equine, University of Bern, Bern, Switzerland.
Cruz, Antonio M
  • Vetsuisse Faculty, Institut Suisse de Medicine Equine, University of Bern, Bern, Switzerland.
  • Clinic of Equine Surgery, Faculty of Veterinary Medicine, Justus-Liebig-University Giessen, Giessen, Germany.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

This article includes 30 references
  1. Keegan KG, Dent EV, Wilson DA, Janicek J, Kramer J, Lacarrubba A, Walsh DM, Cassells MW, Esther TM, Schiltz P, Frees KE, Wilhite CL, Clark JM, Pollitt CC, Shaw R, Norris T. Repeatability of subjective evaluation of lameness in horses.. Equine Vet J 2010 Mar;42(2):92-7.
    doi: 10.2746/042516409X479568pubmed: 20156242google scholar: lookup
  2. Keegan KG, Wilson DA, Wilson DJ, Smith B, Gaughan EM, Pleasant RS, Lillich JD, Kramer J, Howard RD, Bacon-Miller C, Davis EG, May KA, Cheramie HS, Valentino WL, van Harreveld PD. Evaluation of mild lameness in horses trotting on a treadmill by clinicians and interns or residents and correlation of their assessments with kinematic gait analysis.. Am J Vet Res 1998 Nov;59(11):1370-7.
    pubmed: 9829392
  3. McCracken MJ, Kramer J, Keegan KG, Lopes M, Wilson DA, Reed SK, LaCarrubba A, Rasch M. Comparison of an inertial sensor system of lameness quantification with subjective lameness evaluation.. Equine Vet J 2012 Nov;44(6):652-6.
    doi: 10.1111/j.2042-3306.2012.00571.xpubmed: 22563674google scholar: lookup
  4. Clayton HM, Schamhardt HC. Measurement techniques for gait analysis. In: Back W, Clayton HM. editors. Equine Locomotion. 2nd ed. Philadelphi, PA: Philadelphia Saunders Elsevier; (2013). p. 31–60.
  5. What is an IMU? Available online at: https://www.spartonnavex.com/imu (accessed August, 2018).
  6. Cuesta-Vargas AI, Galán-Mercant A, Williams JM. The use of inertial sensors system for human motion analysis.. Phys Ther Rev 2010 Dec;15(6):462-473.
    doi: 10.1179/1743288X11Y.0000000006pmc: PMC3566464pubmed: 23565045google scholar: lookup
  7. Moreno JC, Rocon de Lima E, Ruíz AF, Brunetti FJ, Pons JL. Design and implementation of an inertial measurement unit for control of artificial limbs: application on leg orthoses. Sens Actuators B (2006) 118:333–7.
    doi: 10.1016/j.snb.2006.04.039google scholar: lookup
  8. Dejnabadi H, Jolles BM, Aminian K. A new approach to accurate measurement of uniaxial joint angles based on a combination of accelerometers and gyroscopes.. IEEE Trans Biomed Eng 2005 Aug;52(8):1478-84.
    doi: 10.1109/TBME.2005.851475pubmed: 16119244google scholar: lookup
  9. Lee RY, Laprade J, Fung EH. A real-time gyroscopic system for three-dimensional measurement of lumbar spine motion.. Med Eng Phys 2003 Dec;25(10):817-24.
    doi: 10.1016/S1350-4533(03)00115-2pubmed: 14630469google scholar: lookup
  10. Jasiewicz JM, Treleaven J, Condie P, Jull G. Wireless orientation sensors: their suitability to measure head movement for neck pain assessment.. Man Ther 2007 Nov;12(4):380-5.
    doi: 10.1016/j.math.2006.07.005pubmed: 16971158google scholar: lookup
  11. Keegan KG, Yonezawa Y, Pai PF, Wilson DA, Kramer J. Evaluation of a sensor-based system of motion analysis for detection and quantification of forelimb and hind limb lameness in horses.. Am J Vet Res 2004 May;65(5):665-70.
    doi: 10.2460/ajvr.2004.65.665pubmed: 15141889google scholar: lookup
  12. Cruz AM, Maninchedda UE, Burger D, Wanda S, Vidondo B. Repeatability of gait pattern variables measured by use of extremity-mounted inertial measurement units in nonlame horses during trotting.. Am J Vet Res 2017 Sep;78(9):1011-1018.
    doi: 10.2460/ajvr.78.9.1011pubmed: 28836845google scholar: lookup
  13. Keegan KG, Kramer J, Yonezawa Y, Maki H, Pai PF, Dent EV, Kellerman TE, Wilson DA, Reed SK. Assessment of repeatability of a wireless, inertial sensor-based lameness evaluation system for horses.. Am J Vet Res 2011 Sep;72(9):1156-63.
    doi: 10.2460/ajvr.72.9.1156pubmed: 21879972google scholar: lookup
  14. Keegan KG, MacAllister CG, Wilson DA, Gedon CA, Kramer J, Yonezawa Y, Maki H, Pai PF. Comparison of an inertial sensor system with a stationary force plate for evaluation of horses with bilateral forelimb lameness.. Am J Vet Res 2012 Mar;73(3):368-74.
    doi: 10.2460/ajvr.73.3.368pubmed: 22369528google scholar: lookup
  15. Olsen E, Andersen PH, Pfau T. Accuracy and precision of equine gait event detection during walking with limb and trunk mounted inertial sensors.. Sensors (Basel) 2012;12(6):8145-56.
    doi: 10.3390/s120608145pmc: PMC3436021pubmed: 22969392google scholar: lookup
  16. Marshall JF, Lund DG, Voute LC. Use of a wireless, inertial sensor-based system to objectively evaluate flexion tests in the horse.. Equine Vet J Suppl 2012 Dec;(43):8-11.
    doi: 10.1111/j.2042-3306.2012.00611.xpubmed: 23447870google scholar: lookup
  17. Whalley A, Hodgins D. Assessment of Gait. Patent number US 8,715,208 B2. United States of America, United States Patent and Trademark Office; (2014).
  18. Roepstorff L, Wiestner T, Weishaupt MA, Egenvall E. Comparison of microgyro-based measurements of equine metatarsal/metacarpal bone to a high speed video locomotion analysis system during treadmill locomotion.. Vet J 2013 Dec;198 Suppl 1:e157-60.
    doi: 10.1016/j.tvjl.2013.09.052pubmed: 24360759google scholar: lookup
  19. Cooper G, Sheret I, McMillan L, Siliverdis K, Sha N, Hodgins D, Kenney L, Howard D. Inertial sensor-based knee flexion/extension angle estimation.. J Biomech 2009 Dec 11;42(16):2678-85.
    doi: 10.1016/j.jbiomech.2009.08.004pubmed: 19782986google scholar: lookup
  20. Hildebrand M. Symmetrical gaits of horses.. Science 1965 Nov 5;150(3697):701-8.
    doi: 10.1126/science.150.3697.701pubmed: 5844074google scholar: lookup
  21. Drevemo S, Dalin G, Fredricson I, Hjertén G. Equine locomotion; 1. The analysis of linear and temporal stride characteristics of trotting standardbreds.. Equine Vet J 1980 Apr;12(2):60-5.
    doi: 10.1111/j.2042-3306.1980.tb02310.xpubmed: 7371611google scholar: lookup
  22. . Reliability. In: De Vet HCW, Terwee CB, Mokkink LB, Knol DL. editors. Measurement in Medicine. 1st ed. Cambridge: Cambridge University Press; (2011). p. 96–149.
  23. Calculating Coverage Intervals Variance Partition Coefficients (VPCs) and Intraclass Correlation Coefficients (ICCs) . Available online at: https://www.cmm.bris.ac.uk/lemma (accessed August 2018).
  24. Bartlett JW, Frost C. Reliability, repeatability and reproducibility: analysis of measurement errors in continuous variables.. Ultrasound Obstet Gynecol 2008 Apr;31(4):466-75.
    doi: 10.1002/uog.5256pubmed: 18306169google scholar: lookup
  25. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability.. Psychol Bull 1979 Mar;86(2):420-8.
    doi: 10.1037/0033-2909.86.2.420pubmed: 18839484google scholar: lookup
  26. Buchner HH, Savelberg HH, Schamhardt HC, Merkens HW, Barneveld A. Kinematics of treadmill versus overground locomotion in horses.. Vet Q 1994 May;16 Suppl 2:S87-90.
    doi: 10.1080/01652176.1994.9694509pubmed: 7801509google scholar: lookup
  27. Barrey E, Galloux P, Valette JP, Auvinet B, Wolter R. Stride characteristics of overground versus treadmill locomotion in the saddle horse.. Acta Anat (Basel) 1993;146(2-3):90-4.
    doi: 10.1159/000147427pubmed: 8470471google scholar: lookup
  28. Sloet van Oldruitenborgh-Oosterbaan MM, Clayton HM. Advantages and disadvantages of track vs. treadmill tests.. Equine Vet J Suppl 1999 Jul;(30):645-7.
    doi: 10.1111/j.2042-3306.1999.tb05305.xpubmed: 10659339google scholar: lookup
  29. Goldstein H, Browne W, Rasbash J. Partitioning variation in multilevel models. Underst Stat (2002) 1:223–31.
    doi: 10.1207/S15328031US0104_02google scholar: lookup
  30. Zügner R, Tranberg R, Timperley J, Hodgins D, Mohaddes M, Kärrholm J. Validation of inertial measurement units with optical tracking system in patients operated with Total hip arthroplasty.. BMC Musculoskelet Disord 2019 Feb 6;20(1):52.
    doi: 10.1186/s12891-019-2416-4pmc: PMC6364439pubmed: 30727979google scholar: lookup

Citations

This article has been cited 0 times.
Subscribe to our newsletter
Join 99,727 horse owners like you who receive our email updates on horse health and nutrition.