Identifying Sources of Potential Bias When Using Online Survey Data to Explore Horse Training, Management, and Behaviour: A Systematic Literature Review.
Abstract: Owner-reported behavioural observations form an essential part of the veterinarians' diagnosis and treatment plan. The way we train and manage horses affects their behaviour and, in turn, their health and welfare. Current horse training and management practices are largely driven by traditional techniques and longstanding methodologies. These approaches generally lack an evidence base for evaluation purposes. The absence of evidence and evaluation contributes to the persistent use of risky practices and this, in turn, increases risk of potential harms for both horse and rider, and fuels questioning of the equine industry's current social license to operate. Objective evidence is required to make training and management decisions based on demonstrable best practice. Large-scale experimental or intervention studies using horses are generally not practical because of the associated costs and logistics of gaining ethical approval. Small studies generally lack statistical power and are subject to the effects of many forms of bias that demand caution in the interpretation of any observed effects. An alternative to collecting large amounts of empirical data is the use of owner-reported observations via online survey. Horse owners are ideally placed to report on the domestic equine triad of training, management, and behaviour. The current article highlights three sources of potential bias in a systematic review of literature on large-scale online studies of horse owners' observational reports that met the following selection criteria: English-language, published, peer-reviewed articles reporting on studies with over 1000 respondents and open access to the survey instrument. The online surveys were evaluated for three common forms of bias: recall, confirmation, and sampling bias. This review reveals that online surveys are useful for gathering data on the triad of horse training, management, and behaviour. However, current use of online surveys to collect data on equitation science (including horse training, management, and behaviour) could be improved by using a standardised and validated tool. Such a tool would facilitate comparisons among equine and equitation science studies, thus advancing our understanding of the impacts of training and management on horse behaviour. The authors of the current review suggest the use of a standardised behavioural and management assessment tool for horses. Such a tool would help define what constitutes normal behaviour within geographically disparate populations of horses, leading to improvements in rider safety and horse welfare.
The Equine Research Bank provides access to a large database of publicly available scientific literature. Inclusion in the Research Bank does not imply endorsement of study methods or findings by Mad Barn.
This research summary has been generated with artificial intelligence and may contain errors and omissions. Refer to the original study to confirm details provided. Submit correction.
This research article is focused on the exploration of potential bias in using online survey data to investigate horse training, management, and behaviour. By conducting a systematic review of existing literature on this topic, the authors propose the development of a standardized tool to enhance the reliability of online surveys, thus ensuring more accurate horse management practices and ultimately improving both rider safety and horse welfare.
Objective and Methodology
The study was designed to investigate potential sources of bias in online surveys that solicit owner-reported observations on horse training, management, and behaviour.
Online surveys are increasingly used to gather data due to the cost and logistical challenges of large-scale experimental studies with horses.
The authors conducted a systematic review of English-language, peer-reviewed articles reporting on studies with over 1000 respondents and open access to the survey instrument.
The focus was on identifying three common forms of bias: recall bias (errors due to the lapse in time between an event and recall of that event), confirmation bias (tendency to accept information supporting existing ideas and reject contrasting evidence), and sampling bias (occurs when a sample is not representative of the population it’s supposed to represent).
Findings and Implications
Based on the review, the authors concluded that online surveys have potential in gathering large amounts of data on horse training, management, and behaviour.
However, the authors also identified serious flaws due to recall, confirmation, and sampling bias in existing studies using online surveys in equitation science.
To address these biases, the authors proposed the use of a standardized behavioural and management assessment tool for horse owners filling out surveys.
Such a tool would allow for more accurate comparisons among different equine science studies and improve the understanding of the impacts of training and management on horse behaviour.
The authors argue that having more accurate, standardized data could help define what is considered normal horse behaviour across different geographic populations.
The overall aim is to improve rider safety and horse welfare through the identification and use of evidence-based best practices in horse training and management.
Cite This Article
APA
Fenner K, Hyde M, Crean A, McGreevy P.
(2020).
Identifying Sources of Potential Bias When Using Online Survey Data to Explore Horse Training, Management, and Behaviour: A Systematic Literature Review.
Vet Sci, 7(3), 140.
https://doi.org/10.3390/vetsci7030140
McGreevy P. Equine Behavior: A Guide for Veterinarians and Equine Scientists. 2nd ed. W. B. Saunders; London, UK: 2012.
Parkin T, Brown J, Mcacdonald E. Occupational risks of working with horses: A questionnaire survey of equine veterinary surgeons. Equine Vet. Educ. 2018;30:200–205.
Lansade L, Bonneau C, Parias C, Biau S. Horse’s emotional state and rider safety during grooming practices, a field study. Appl. Anim. Behav. Sci. 2019;217:43–47.
McLean A.N, McGreevy P.D. Horse-training techniques that may defy the principles of learning theory and compromise welfare. J. Vet. Behav. Clin. Appl. Res. 2010;5:187–195.
Fenner K, McLean A, McGreevy P. Cutting to the chase: How round-pen, lunging and high-speed liberty work may compromise horse welfare. J. Vet. Behav. Clin. Appl. Res. 2019;29:88–94.
Fiedler J. Sport Horse Welfare and Social Licence to Operate: Informing a Social Licence to Operate Communication Framework: Attitudes to Sport Horse Welfare. Ph.D. Thesis. Central Queensland University; Queensland, Australia: 2020.
Heleski C, Stowe C, Fiedler J, Peterson M, Brady C, Wickens C, MacLeod J. Thoroughbred Racehorse Welfare through the Lens of ‘Social License to Operate—With an Emphasis on a U.S. Perspective. Sustainability 2020;12:1706.
Von Borstel U.U., Duncan I.J.H., Shoveller A.K., Merkies K, Keeling L.J., Millman S.T. Impact of riding in a coercively obtained Rollkur posture on welfare and fear of performance horses. Appl. Anim. Behav. Sci. 2009;116:228–236.
Weller D, Franklin S, Shea G, White P, Fenner K, Wilson B, Wilkins C, McGreevy P. The Reported Use of Nosebands in Racing and Equestrian Pursuits.. Animals (Basel) 2020 Apr 30;10(5).
Fowler V, Kennedy M, Marlin D. A comparison of the Monty Roberts technique with a conventional UK technique for initial training of riding horses. Anthrozoos 2015;25:301–321.
Momozawa Y, Ono T, Sato F, Kikusui T, Takeuchi Y, Mori Y, Kusunose R. Assessment of equine temperament by a questionnaire survey to caretakers and evaluation of its reliability by simultaneous behavior test. Appl. Anim. Behav. Sci. 2003;84:127–138.
Parker M, Goodwin D, Redhead E.S. Survey of breeders’ management of horses in Europe, North America and Australia: Comparison of factors associated with the development of abnormal behaviour. Appl. Anim. Behav. Sci. 2008;114:206–215.
Fenner K, Freire R, McLean A, McGreevy P. Behavioral, demographic and management influences on equine responses to negative reinforcement. J. Vet. Behav. Clin. Appl. Res. 2019;29:11–17.
Widi T, Rakasiwi G, Nugroho T, Widyas N. Personality assessment of different horse breeds trained for military purposes. IOP Conference Series: Earth and Environmental Science Bali, Indonesia. 20–21 October 2018; pp. 1–7.
Dashper K, Fenner K, Hyde M, Probyn-Rapsey M, Casper G, Henshall C, McGreevy P. The anthropomorphic application of human-based gender stereotypes to animals. Anthrozoos 2018;31:673–684.
Visser E, Van Wijk-Jansen E. Diversity in horse enthusiasts with respect to horse welfare: An explorative study. J. Vet. Behav. Clin. Appl. Res. 2012;7:295–304.
Smith V, Devane D, Begley CM, Clarke M. Methodology in conducting a systematic review of systematic reviews of healthcare interventions.. BMC Med Res Methodol 2011 Feb 3;11(1):15.
Hill E, McGreevy P, Caspar G, White P, McLean A. Apparatus use in popular equestrian disciplines in Australia. J. Vet. Behav. Clin. Appl. Res. 2015;10:147–152.
Hockenhull J, Creighton E. Management practices associated with owner-reported stable-related and handling behaviour problems in UK leisure horses. Appl. Anim. Behav. Sci. 2014;155:49.
Hockenhull J, Creighton E. The day-to-day management of UK leisure horses and the prevalence of owner-reported stable-related and handling behaviour problems. Anim. Welf. 2015;24:29–36.
Hockenhull J, Creighton E. Unwanted oral investigative behaviour in horses: A note on the relationship between mugging behaviour, hand-feeding titbits and clicker training. Appl. Anim. Behav. Sci. 2010;127:104–107.
Hockenhull J, Creighton E. The strengths of statistical techniques in identifying patterns underlying apparently random behavioral problems in horses. J. Vet. Behav. Clin. Appl. Res. 2012;7:305–310.
Lloyd A.S., Martin J.E., Bornett-Gauci H.L.I., Wilkinson R.G. Evaluation of a novel method of horse personality assessment: Rater-agreement and links to behaviour. Appl. Anim. Behav. Sci. 2007;105:205–222.
Liu J, Qu B, Hu B, Jiang N, Wang D. The quality of life of men who have sex with men in China: reliability and validity testing of the SF-36 questionnaire.. PLoS One 2013;8(12):e83362.
Duffy DL, de Moura RTD, Serpell JA. Development and evaluation of the Fe-BARQ: A new survey instrument for measuring behavior in domestic cats (Felis s. catus).. Behav Processes 2017 Aug;141(Pt 3):329-341.
Behr D. Translating Answers to Open-ended Survey Questions in Cross-cultural Research: A Case Study on the Interplay between Translation, Coding, and Analysis. Field Methods 2015;27:284–299.
. Engaging Volunteers: Guide to Engaging Volunteers in Citizen Science Projects. [(accessed on 11 June 2020)]; Available online: https://www.tcv.org.uk/wp-content/uploads/2014/11/EngagingVolunteersCitizenScience.pdf.
Sellon DC, Marcellin-Little DJ, McFarlane D, McCue M, Pechette Markley A, Shoben A. Adverse health events and recommended health research priorities in agility dogs as reported by dog owners. Front Vet Sci 2023;10:1127632.
Hayes C, Mears M, Rowan S, Dong F, Andrews E. Academic performance and attitudes of dental students impacted by COVID-19. J Dent Educ 2022 Jul;86(7):874-882.
Sellon DC, Marcellin-Little DJ. Risk factors for cranial cruciate ligament rupture in dogs participating in canine agility. BMC Vet Res 2022 Jan 15;18(1):39.
Brincat BL, McGreevy PD, Bowell VA, Packer RMA. Who's Getting a Head Start? Mesocephalic Dogs in Still Images Are Attributed More Positively Valenced Emotions Than Dogs of Other Cephalic Index Groups. Animals (Basel) 2021 Dec 27;12(1).
Blackman SA, Wilson BJ, Reed AR, McGreevy PD. Reported Motivations and Aims of Australian Dog Breeders-A Pilot Study. Animals (Basel) 2020 Dec 7;10(12).
Edwards-Callaway L, Davis M, Dean L, McBride B. Stakeholder Perceptions of Animal Welfare as a Component of Sustainable Beef Programs in the United States-A Pilot Study. Animals (Basel) 2024 Apr 30;14(9).
Essner A, Kjellerstedt C, Hesbach AL, Igelström H. Injuries and Associated Factors in Swedish Sporting and Utility Trial Dogs-A Cross-Sectional Study. Animals (Basel) 2024 Jan 26;14(3).