Subjective and objective evaluations of horses for fit-to-compete or unfit-to-compete judgement.

The research analyses the accuracy of ‘fit-to-compete’ judgments made by Fédération Equestre Internationale (FEI) veterinary inspectors during competitions using both subjective evaluations and objective gait measurements. Despite the experience of the inspectors, there were noticeable inconsistencies in their evaluations, highlighting the potential value of more objective, data-led approaches in determining a horse’s fitness for competition.

Objective and Subjective Assessments in Fit-to-Compete Judgement

• The study investigated inconsistencies in judging a horse as fit or unfit to compete in FEI competitions. Traditionally, these judgments have been made through the subjective evaluation of vets, with the study highlighting an element of discord even among experienced Veterinary Delegates (VDs).
• The findings show that the inter-observer agreement between the live evaluations of the three experienced VDs and one specialist was only fair at a 58% agreement score with a kappa statistic (κ) of 0.395. Kappa statistic is a quantitative measure of inter-rater agreement that factors in the agreement occurring by chance.
• In addition to this, the study highlighted that the same vet evaluating the same horse at different times (one month and twelve months apart) produced an intra-observer agreement between live observations and video evaluations of 71% and 73% respectively.

Quantitative Gait Analysis and its Application

• As part of the research, alongside the subjective evaluations, quantitative gait analysis measurements were also taken simultaneously. This quantitative method of evaluating the movement symmetry of the horses worked as an objective counterpart to the various subjective assessments.
• The results of this objective approach were then compared with the consensus of all observers acting as a reference. The sensitivity and specificity of the motion symmetry measured with the quantitative gait analysis system were 83.3% and 66.7% respectively.
• This suggests that a gait analysis system can provide valuable data-led insights that can act as a reliable aid in determining a horse’s fitness for competition, potentially reducing inconsistencies in judgment due to subjective bias.

Implications and Recommendations

• The findings of the study seem to suggest that the use of one or a small number of VDs for live evaluations could result in inconsistent fit-to-compete judgement due to subjectivity and human error.
• Utilizing a larger number of VDs or incorporating more quantitative, data-driven methods like gait analysis, could potentially enhance the consistency and objectivity of these determinations, ensuring that horses are correctly identified as fit to compete.
• As a result, the study provides compelling evidence for integrating data-driven, objective methods into traditionally subjective fields, heralding potential improvements in the accuracy and fairness of evaluations.