Assessment of Intra- and Inter-observer Measurement Variability in a Radiographic Metacarpophalangeal Joint Osteophytosis Scoring System for the Horse.
Abstract: The study evaluated the intra- and inter-observer measurement variability of an osteophytosis metacarpophalangeal joint scoring system. Ten () dorso/palmar, latero/medial, and oblique views of equine metacarpophalangeal joints affected by osteoarthritis were examined. Nine assessment points were graded (scale: 0-3) twice by five veterinary students (inexperienced group, I) and four equine veterinary surgeons (expert group, E). The grades for each of the nine factors were summed to obtain the osteophytosis score. The variability between the two measurements was -2.04 ± 3.5, 95% CI -3.04 to -1.03 for the I group. For the E group, they were 0 ± 1.43, 95% CI -0.45 to 0.45. In the evaluation of the same radiographs, the I group had a coefficient of variability (CV) of 37.29%. The correlation was r = 0.90%. The CV between groups was 28.85%. The mean difference between the two observations was -0.03 ± 0.29 in the E group and 0.22 ± 0.77 in the I group. The I group showed a greater CV when the score was low (r = -0.78) compared to the E group, where the CV was independent of severity of osteophytosis (r = -0.47). The osteophytosis scoring system is an easily applicable and feasible system to be used by observers with different levels of experience, but inexpert observers may need additional training or may need to be helped by reference images. These data are validated by the low inter- and intra-observer measurement variability results in the E group. Therefore, the scoring system proposed seems to be a repeatable instrument applicable to the radiographic score of the severity of metacarpophalangeal joint osteoarthritis.
Publication Date: 2020-04-06 PubMed ID: 32268589PubMed Central: PMC7357069DOI: 10.3390/vetsci7020039Google Scholar: Lookup
The Equine Research Bank provides access to a large database of publicly available scientific literature. Inclusion in the Research Bank does not imply endorsement of study methods or findings by Mad Barn.
- Journal Article
Summary
This research summary has been generated with artificial intelligence and may contain errors and omissions. Refer to the original study to confirm details provided. Submit correction.
The research evaluates the consistency and variability of observations made by different assessors using a scoring system developed for evaluating osteoarthritis severity in the metacarpophalangeal joints of horses.
Research Objective
- The study was primarily designed to assess the intra- and inter-observer measurement variability of an osteoarthritic metacarpophalangeal joint scoring system. It sought to explore whether this scoring system yielded consistent results when used by different observers and to what degree these results may vary.
Research Methodology
- The study utilized samples of ten equine metacarpophalangeal joints affected by osteoarthritis. These samples were observed from three different angles (dorso/palmar, Latero/medial, and oblique).
- Nine assessment points on these samples were graded twice, once by five veterinary students (marked as the inexperienced group, I) and once more by four professional equine veterinary surgeons (the expert group, E).
- The grades attributed by the respondents to each of these nine factors were then summed up to arrive at the osteophytosis score.
Findings
- The results showed a discrepancy in scoring between the novice and experienced groups, pointing to the need for standardized training or reference images. The range in score difference between the two measurements was -2.04 ± 3.5 for the inexperienced group while for the experienced group, it was 0 ± 1.43.
- When evaluating same radiographs, the inexperienced group demonstrated more variance, as reflected in the coefficient of variability (CV) of 37.29%. This group also showed more variability in scores when the assessed osteophytosis severity was low, compared with the expert group whose CV was less impacted by the condition’s severity.
- Overall, the expert group displayed less inter- and intra-observer measurement variability, validating the scoring system’s effectiveness when used by appropriately trained personnel.
Conclusion
- The research concluded that the osteophytosis scoring system is a feasible method of assessing the severity of metacarpophalangeal joint osteoarthritis, especially when used by experienced individuals.
- For less experienced observers, the system may require supplemental training resources or reference images to standardize and improve their scoring accuracy.
Cite This Article
APA
(2020).
Assessment of Intra- and Inter-observer Measurement Variability in a Radiographic Metacarpophalangeal Joint Osteophytosis Scoring System for the Horse.
Vet Sci, 7(2), 39.
https://doi.org/10.3390/vetsci7020039 Publication
Researcher Affiliations
Conflict of Interest Statement
The authors declare no conflict of interest.
References
This article includes 19 references
- Thrall D. Textbook of Veterinary Diagnostic Radiology. 6th ed. Saunders; Phyladelphia, PA, USA: 2012.
- Frisbie DD, Ghivizzani SC, Robbins PD, Evans CH, McIlwraith CW. Treatment of experimental equine osteoarthritis by in vivo delivery of the equine interleukin-1 receptor antagonist gene.. Gene Ther 2002 Jan;9(1):12-20.
- Frisbie DD, Kawcak CE, Baxter GM, Trotter GW, Powers BE, Lassen ED, McIlwraith CW. Effects of 6alpha-methylprednisolone acetate on an equine osteochondral fragment exercise model.. Am J Vet Res 1998 Dec;59(12):1619-28.
- Frisbie DD, Kawcak CE, Werpy NM, Park RD, McIlwraith CW. Clinical, biochemical, and histologic effects of intra-articular administration of autologous conditioned serum in horses with experimentally induced osteoarthritis.. Am J Vet Res 2007 Mar;68(3):290-6.
- Kawcak CE, Frisbie DD, McIlwraith CW, Werpy NM, Park RD. Evaluation of avocado and soybean unsaponifiable extracts for treatment of horses with experimentally induced osteoarthritis.. Am J Vet Res 2007 Jun;68(6):598-604.
- Kawcak CE, Frisbie DD, Werpy NM, Park RD, McIlwraith CW. Effects of exercise vs experimental osteoarthritis on imaging outcomes.. Osteoarthritis Cartilage 2008 Dec;16(12):1519-25.
- Olive J, D'Anjou MA, Alexander K, Laverty S, Theoret C. Comparison of magnetic resonance imaging, computed tomography, and radiography for assessment of noncartilaginous changes in equine metacarpophalangeal osteoarthritis.. Vet Radiol Ultrasound 2010 May-Jun;51(3):267-79.
- D'Anjou MA, Moreau M, Troncy E, Martel-Pelletier J, Abram F, Raynauld JP, Pelletier JP. Osteophytosis, subchondral bone sclerosis, joint effusion and soft tissue thickening in canine experimental stifle osteoarthritis: comparison between 1.5 T magnetic resonance imaging and computed radiography.. Vet Surg 2008 Feb;37(2):166-77.
- Günther KP, Sun Y. Reliability of radiographic assessment in hip and knee osteoarthritis.. Osteoarthritis Cartilage 1999 Mar;7(2):239-46.
- Innes JF, Costello M, Barr FJ, Rudorf H, Barr AR. Radiographic progression of osteoarthritis of the canine stifle joint: a prospective study.. Vet Radiol Ultrasound 2004 Mar-Apr;45(2):143-8.
- Rayward RM, Thomson DG, Davies JV, Innes JF, Whitelock RG. Progression of osteoarthritis following TPLO surgery: a prospective radiographic study of 40 dogs.. J Small Anim Pract 2004 Feb;45(2):92-7.
- Roemer FW, Eckstein F, Hayashi D, Guermazi A. The role of imaging in osteoarthritis.. Best Pract Res Clin Rheumatol 2014 Feb;28(1):31-60.
- Morgan JP. Radiological pathology and diagnosis of degenerative joint disease in the stifle joint of the dog.. J Small Anim Pract 1969 Nov;10(9):541-4.
- Wessely M, Brühschwein A, Schnabl-Feichter E. Evaluation of Intra- and Inter-observer Measurement Variability of a Radiographic Stifle Osteoarthritis Scoring System in Dogs.. Vet Comp Orthop Traumatol 2017 Nov;30(6):377-384.
- Junker S, Krumbholz G, Frommer KW, Rehart S, Steinmeyer J, Rickert M, Schett G, Müller-Ladner U, Neumann E. Differentiation of osteophyte types in osteoarthritis - proposal of a histological classification.. Joint Bone Spine 2016 Jan;83(1):63-7.
- van der Kraan PM, van den Berg WB. Osteophytes: relevance and biology.. Osteoarthritis Cartilage 2007 Mar;15(3):237-44.
- Felson DT, McAlindon TE, Anderson JJ, Naimark A, Weissman BW, Aliabadi P, Evans S, Levy D, LaValley MP. Defining radiographic osteoarthritis for the whole knee.. Osteoarthritis Cartilage 1997 Jul;5(4):241-50.
- McIlwraith CW, Frisbie DD, Kawcak CE, Fuller CJ, Hurtig M, Cruz A. The OARSI histopathology initiative - recommendations for histological assessments of osteoarthritis in the horse.. Osteoarthritis Cartilage 2010 Oct;18 Suppl 3:S93-105.
- Lazar TP, Berry CR, deHaan JJ, Peck JN, Correa M. Long-term radiographic comparison of tibial plateau leveling osteotomy versus extracapsular stabilization for cranial cruciate ligament rupture in the dog.. Vet Surg 2005 Mar-Apr;34(2):133-41.
Citations
This article has been cited 2 times.- Guerri G, Palozzo A, Straticò P, Varasano V, Celani G, Di Francesco P, Vignoli M, Petrizzi L. 2D-SWE of the Metacarpophalangeal Joint Capsule in Horses.. Vet Sci 2022 Sep 4;9(9).
- Straticò P, Guerri G, Palozzo A, Di Francesco P, Vignoli M, Varasano V, Petrizzi L. Elastosonographic features of the metacarpophalangeal joint capsule in horses.. BMC Vet Res 2021 May 29;17(1):202.
Use Nutrition Calculator
Check if your horse's diet meets their nutrition requirements with our easy-to-use tool Check your horse's diet with our easy-to-use tool
Talk to a Nutritionist
Discuss your horse's feeding plan with our experts over a free phone consultation Discuss your horse's diet over a phone consultation
Submit Diet Evaluation
Get a customized feeding plan for your horse formulated by our equine nutritionists Get a custom feeding plan formulated by our nutritionists
