Identifying Sources of Potential Bias When Using Online Survey Data to Explore Horse Training, Management, and Behaviour: A Systematic Literature Review.
Abstract: Owner-reported behavioural observations form an essential part of the veterinarians' diagnosis and treatment plan. The way we train and manage horses affects their behaviour and, in turn, their health and welfare. Current horse training and management practices are largely driven by traditional techniques and longstanding methodologies. These approaches generally lack an evidence base for evaluation purposes. The absence of evidence and evaluation contributes to the persistent use of risky practices and this, in turn, increases risk of potential harms for both horse and rider, and fuels questioning of the equine industry's current social license to operate. Objective evidence is required to make training and management decisions based on demonstrable best practice. Large-scale experimental or intervention studies using horses are generally not practical because of the associated costs and logistics of gaining ethical approval. Small studies generally lack statistical power and are subject to the effects of many forms of bias that demand caution in the interpretation of any observed effects. An alternative to collecting large amounts of empirical data is the use of owner-reported observations via online survey. Horse owners are ideally placed to report on the domestic equine triad of training, management, and behaviour. The current article highlights three sources of potential bias in a systematic review of literature on large-scale online studies of horse owners' observational reports that met the following selection criteria: English-language, published, peer-reviewed articles reporting on studies with over 1000 respondents and open access to the survey instrument. The online surveys were evaluated for three common forms of bias: recall, confirmation, and sampling bias. This review reveals that online surveys are useful for gathering data on the triad of horse training, management, and behaviour. However, current use of online surveys to collect data on equitation science (including horse training, management, and behaviour) could be improved by using a standardised and validated tool. Such a tool would facilitate comparisons among equine and equitation science studies, thus advancing our understanding of the impacts of training and management on horse behaviour. The authors of the current review suggest the use of a standardised behavioural and management assessment tool for horses. Such a tool would help define what constitutes normal behaviour within geographically disparate populations of horses, leading to improvements in rider safety and horse welfare.
Publication Date: 2020-09-22 PubMed ID: 32971754PubMed Central: PMC7558402DOI: 10.3390/vetsci7030140Google Scholar: Lookup
The Equine Research Bank provides access to a large database of publicly available scientific literature. Inclusion in the Research Bank does not imply endorsement of study methods or findings by Mad Barn.
- Journal Article
- Review
Summary
This research summary has been generated with artificial intelligence and may contain errors and omissions. Refer to the original study to confirm details provided. Submit correction.
This research article is focused on the exploration of potential bias in using online survey data to investigate horse training, management, and behaviour. By conducting a systematic review of existing literature on this topic, the authors propose the development of a standardized tool to enhance the reliability of online surveys, thus ensuring more accurate horse management practices and ultimately improving both rider safety and horse welfare.
Objective and Methodology
- The study was designed to investigate potential sources of bias in online surveys that solicit owner-reported observations on horse training, management, and behaviour.
- Online surveys are increasingly used to gather data due to the cost and logistical challenges of large-scale experimental studies with horses.
- The authors conducted a systematic review of English-language, peer-reviewed articles reporting on studies with over 1000 respondents and open access to the survey instrument.
- The focus was on identifying three common forms of bias: recall bias (errors due to the lapse in time between an event and recall of that event), confirmation bias (tendency to accept information supporting existing ideas and reject contrasting evidence), and sampling bias (occurs when a sample is not representative of the population it’s supposed to represent).
Findings and Implications
- Based on the review, the authors concluded that online surveys have potential in gathering large amounts of data on horse training, management, and behaviour.
- However, the authors also identified serious flaws due to recall, confirmation, and sampling bias in existing studies using online surveys in equitation science.
- To address these biases, the authors proposed the use of a standardized behavioural and management assessment tool for horse owners filling out surveys.
- Such a tool would allow for more accurate comparisons among different equine science studies and improve the understanding of the impacts of training and management on horse behaviour.
- The authors argue that having more accurate, standardized data could help define what is considered normal horse behaviour across different geographic populations.
- The overall aim is to improve rider safety and horse welfare through the identification and use of evidence-based best practices in horse training and management.
Cite This Article
APA
Fenner K, Hyde M, Crean A, McGreevy P.
(2020).
Identifying Sources of Potential Bias When Using Online Survey Data to Explore Horse Training, Management, and Behaviour: A Systematic Literature Review.
Vet Sci, 7(3), 140.
https://doi.org/10.3390/vetsci7030140 Publication
Researcher Affiliations
- Sydney School of Veterinary Science, Faculty of Science, University of Sydney, Sydney, NSW 2006, Australia.
- Sydney School of Veterinary Science, Faculty of Science, University of Sydney, Sydney, NSW 2006, Australia.
- Sydney School of Veterinary Science, Faculty of Science, University of Sydney, Sydney, NSW 2006, Australia.
- Sydney School of Veterinary Science, Faculty of Science, University of Sydney, Sydney, NSW 2006, Australia.
Conflict of Interest Statement
The authors declare no conflict of interest.
References
This article includes 57 references
- Munsters CC, Visser KE, van den Broek J, Sloet van Oldruitenborgh-Oosterbaan MM. The influence of challenging objects and horse-rider matching on heart rate, heart rate variability and behavioural score in riding horses.. Vet J 2012 Apr;192(1):75-80.
- McGreevy P. Equine Behavior: A Guide for Veterinarians and Equine Scientists. 2nd ed. W. B. Saunders; London, UK: 2012.
- Parkin T, Brown J, Mcacdonald E. Occupational risks of working with horses: A questionnaire survey of equine veterinary surgeons. Equine Vet. Educ. 2018;30:200–205.
- Lansade L, Bonneau C, Parias C, Biau S. Horse’s emotional state and rider safety during grooming practices, a field study. Appl. Anim. Behav. Sci. 2019;217:43–47.
- McGreevy P, Berger J, de Brauwere N, Doherty O, Harrison A, Fiedler J, Jones C, McDonnell S, McLean A, Nakonechny L, Nicol C, Preshaw L, Thomson P, Tzioumis V, Webster J, Wolfensohn S, Yeates J, Jones B. Using the Five Domains Model to Assess the Adverse Impacts of Husbandry, Veterinary, and Equitation Interventions on Horse Welfare.. Animals (Basel) 2018 Mar 18;8(3).
- McLean A.N, McGreevy P.D. Horse-training techniques that may defy the principles of learning theory and compromise welfare. J. Vet. Behav. Clin. Appl. Res. 2010;5:187–195.
- Fenner K, McLean A, McGreevy P. Cutting to the chase: How round-pen, lunging and high-speed liberty work may compromise horse welfare. J. Vet. Behav. Clin. Appl. Res. 2019;29:88–94.
- Todd Z. Barriers to the adoption of humane dog training methods. J. Vet. Behav. 2018;25:28–34.
- Perez BC, Mehrkam LR, Foltz AR, Dorey NR. Effects of Enrichment Presentation and Other Factors on Behavioral Welfare of Pantropical Spotted Dolphin (Stenella attenuata).. J Appl Anim Welf Sci 2018 Apr-Jun;21(2):130-140.
- Fiedler J. Sport Horse Welfare and Social Licence to Operate: Informing a Social Licence to Operate Communication Framework: Attitudes to Sport Horse Welfare. Ph.D. Thesis. Central Queensland University; Queensland, Australia: 2020.
- Heleski C, Stowe C, Fiedler J, Peterson M, Brady C, Wickens C, MacLeod J. Thoroughbred Racehorse Welfare through the Lens of ‘Social License to Operate—With an Emphasis on a U.S. Perspective. Sustainability 2020;12:1706.
- Fiedler JM, McGreevy PD. Reconciling Horse Welfare, Worker Safety, and Public Expectations: Horse Event Incident Management Systems in Australia.. Animals (Basel) 2016 Feb 24;6(3).
- Von Borstel U.U., Duncan I.J.H., Shoveller A.K., Merkies K, Keeling L.J., Millman S.T. Impact of riding in a coercively obtained Rollkur posture on welfare and fear of performance horses. Appl. Anim. Behav. Sci. 2009;116:228–236.
- Wilson B, Jones B, McGreevy P. Longitudinal trends in the frequency of medium and fast race winning times in Australian harness racing: Relationships with rules moderating whip use.. PLoS One 2018;13(3):e0184091.
- Weller D, Franklin S, Shea G, White P, Fenner K, Wilson B, Wilkins C, McGreevy P. The Reported Use of Nosebands in Racing and Equestrian Pursuits.. Animals (Basel) 2020 Apr 30;10(5).
- Thomson PC, Hayek AR, Jones B, Evans DL, McGreevy PD. Number, causes and destinations of horses leaving the Australian Thoroughbred and Standardbred racing industries.. Aust Vet J 2014 Aug;92(8):303-11.
- Fowler V, Kennedy M, Marlin D. A comparison of the Monty Roberts technique with a conventional UK technique for initial training of riding horses. Anthrozoos 2015;25:301–321.
- Momozawa Y, Ono T, Sato F, Kikusui T, Takeuchi Y, Mori Y, Kusunose R. Assessment of equine temperament by a questionnaire survey to caretakers and evaluation of its reliability by simultaneous behavior test. Appl. Anim. Behav. Sci. 2003;84:127–138.
- Baker JR, Leyland A. Histological survey of tumours of the horse, with particular reference to those ofthe skin.. Vet Rec 1975 May 10;96(19):419-22.
- Parker M, Goodwin D, Redhead E.S. Survey of breeders’ management of horses in Europe, North America and Australia: Comparison of factors associated with the development of abnormal behaviour. Appl. Anim. Behav. Sci. 2008;114:206–215.
- McGreevy PD, French NP, Nicol CJ. The prevalence of abnormal behaviours in dressage, eventing and endurance horses in relation to stabling.. Vet Rec 1995 Jul 8;137(2):36-7.
- Fenner K, Freire R, McLean A, McGreevy P. Behavioral, demographic and management influences on equine responses to negative reinforcement. J. Vet. Behav. Clin. Appl. Res. 2019;29:11–17.
- Padalino B, Raidal SL, Hall E, Knight P, Celi P, Jeffcott L, Muscatello G. Risk factors in equine transport-related health problems: A survey of the Australian equine industry.. Equine Vet J 2017 Jul;49(4):507-511.
- Albright JD, Mohammed HO, Heleski CR, Wickens CL, Houpt KA. Crib-biting in US horses: breed predispositions and owner perceptions of aetiology.. Equine Vet J 2009 May;41(5):455-8.
- Henriksson J, Sauveroche M, Roth LSV. Effects of size and personality on social learning and human-directed behaviour in horses (Equus caballus).. Anim Cogn 2019 Nov;22(6):1001-1011.
- Widi T, Rakasiwi G, Nugroho T, Widyas N. Personality assessment of different horse breeds trained for military purposes. IOP Conference Series: Earth and Environmental Science Bali, Indonesia. 20–21 October 2018; pp. 1–7.
- Dashper K, Fenner K, Hyde M, Probyn-Rapsey M, Casper G, Henshall C, McGreevy P. The anthropomorphic application of human-based gender stereotypes to animals. Anthrozoos 2018;31:673–684.
- Visser E, Van Wijk-Jansen E. Diversity in horse enthusiasts with respect to horse welfare: An explorative study. J. Vet. Behav. Clin. Appl. Res. 2012;7:295–304.
- Luna D, Vásquez RA, Rojas M, Tadich TA. Welfare Status of Working Horses and Owners' Perceptions of Their Animals.. Animals (Basel) 2017 Aug 1;7(8).
- McGreevy PD, Oddie C, Burton FL, McLean AN. The horse-human dyad: can we align horse training and handling activities with the equid social ethogram?. Vet J 2009 Jul;181(1):12-8.
- Bethlehem J. Selection Bias in Web Surveys. Int. Stat. Rev. 2010;78:161–188.
- Fergusson DM, Boden JM. Exploring issues arising from survey non-response.. Addiction 2015 Sep;110(9):1513-4.
- Smith V, Devane D, Begley CM, Clarke M. Methodology in conducting a systematic review of systematic reviews of healthcare interventions.. BMC Med Res Methodol 2011 Feb 3;11(1):15.
- Hill E, McGreevy P, Caspar G, White P, McLean A. Apparatus use in popular equestrian disciplines in Australia. J. Vet. Behav. Clin. Appl. Res. 2015;10:147–152.
- Aune A, Fenner K, Wilson B, Cameron E, McLean A, McGreevy P. Reported Behavioural Differences between Geldings and Mares Challenge Sex-Driven Stereotypes in Ridden Equine Behaviour.. Animals (Basel) 2020 Mar 2;10(3).
- Althubaiti A. Information bias in health research: definition, pitfalls, and adjustment methods.. J Multidiscip Healthc 2016;9:211-7.
- Lloyd A.S., Martin J.E., Bornett-Gauci H.L.I., Wilkinson R.G. Horse personality: Variation between breeds. Appl. Anim. Behav. Sci. 2008;112:369–383.
- Hockenhull J, Creighton E. Management practices associated with owner-reported stable-related and handling behaviour problems in UK leisure horses. Appl. Anim. Behav. Sci. 2014;155:49.
- Hockenhull J, Creighton E. The day-to-day management of UK leisure horses and the prevalence of owner-reported stable-related and handling behaviour problems. Anim. Welf. 2015;24:29–36.
- Hockenhull J, Creighton E. The use of equipment and training practices and the prevalence of owner-reported ridden behaviour problems in UK leisure horses.. Equine Vet J 2013 Jan;45(1):15-9.
- Hockenhull J, Creighton E. Pre-feeding behaviour in UK leisure horses and associated feeding routine risk factors. Anim. Welf. 2014;23:297–308.
- Hockenhull J, Creighton E. Unwanted oral investigative behaviour in horses: A note on the relationship between mugging behaviour, hand-feeding titbits and clicker training. Appl. Anim. Behav. Sci. 2010;127:104–107.
- Hartmann E, Bøe KE, Christensen JW, Hyyppä S, Jansson H, Jørgensen GH, Ladewig J, Mejdell CM, Norling Y, Rundgren M, Särkijärvi S, Søndergaard E, Keeling LJ. A Nordic survey of management practices and owners' attitudes towards keeping horses in groups.. J Anim Sci 2015 Sep;93(9):4564-74.
- Gronqvist G, Rogers C, Gee E. The Management of Horses during Fireworks in New Zealand.. Animals (Basel) 2016 Mar 9;6(3).
- Hartmann E, Bøe KE, Jørgensen GH, Mejdell CM, Dahlborn K. Management of horses with focus on blanketing and clipping practices reported by members of the Swedish and Norwegian equestrian community.. J Anim Sci 2017 Mar;95(3):1104-1117.
- Hockenhull J, Creighton E. The strengths of statistical techniques in identifying patterns underlying apparently random behavioral problems in horses. J. Vet. Behav. Clin. Appl. Res. 2012;7:305–310.
- Ross SE, Murray JK, Roberts VLH. Prevalence of headshaking within the equine population in the UK.. Equine Vet J 2018 Jan;50(1):73-78.
- Hartmann E, Christensen J, McGreevy P. Dominance and Leadership: Useful Concepts in Human–Horse Interactions?. J. Equine Vet. Sci. 2017;52:1–9.
- Lloyd A.S., Martin J.E., Bornett-Gauci H.L.I., Wilkinson R.G. Evaluation of a novel method of horse personality assessment: Rater-agreement and links to behaviour. Appl. Anim. Behav. Sci. 2007;105:205–222.
- McGreevy PD. The advent of equitation science.. Vet J 2007 Nov;174(3):492-500.
- Godlonton S, Hernandez M, Murphy M. Anchoring Bias in Recall Data: Evidence from Central America. Am. J. Agric. Econ. 2018;100.
- Seitzinger PJ, Tataryn J, Osgood N, Waldner C. Foodborne Outbreak Investigation: Effect of Recall Inaccuracies on Food Histories.. J Food Prot 2019 Jun;82(6):931-939.
- Liu J, Qu B, Hu B, Jiang N, Wang D. The quality of life of men who have sex with men in China: reliability and validity testing of the SF-36 questionnaire.. PLoS One 2013;8(12):e83362.
- Duffy DL, de Moura RTD, Serpell JA. Development and evaluation of the Fe-BARQ: A new survey instrument for measuring behavior in domestic cats (Felis s. catus).. Behav Processes 2017 Aug;141(Pt 3):329-341.
- Behr D. Translating Answers to Open-ended Survey Questions in Cross-cultural Research: A Case Study on the Interplay between Translation, Coding, and Analysis. Field Methods 2015;27:284–299.
- . Engaging Volunteers: Guide to Engaging Volunteers in Citizen Science Projects. [(accessed on 11 June 2020)]; Available online: https://www.tcv.org.uk/wp-content/uploads/2014/11/EngagingVolunteersCitizenScience.pdf.
- Fenner K, Dashper K, Wilkins C, Serpell J, McLean A, Wilson B, McGreevy P. Building Bridges between Theory and Practice: How Citizen Science Can Bring Equine Researchers and Practitioners Together.. Animals (Basel) 2020 Sep 13;10(9).
Citations
This article has been cited 12 times.- Olczak K, Penar W, Nowicki J, Magiera A, Klocek C. The Role of Sound in Livestock Farming-Selected Aspects.. Animals (Basel) 2023 Jul 14;13(14).
- Sellon DC, Marcellin-Little DJ, McFarlane D, McCue M, Pechette Markley A, Shoben A. Adverse health events and recommended health research priorities in agility dogs as reported by dog owners.. Front Vet Sci 2023;10:1127632.
- Siegers E, van Wijk E, van den Broek J, Sloet van Oldruitenborgh-Oosterbaan M, Munsters C. Longitudinal Training and Workload Assessment in Young Friesian Stallions in Relation to Fitness: Part 1.. Animals (Basel) 2023 Feb 16;13(4).
- Siegers E, van den Broek J, Sloet van Oldruitenborgh-Oosterbaan M, Munsters C. Longitudinal Training and Workload Assessment in Young Friesian Stallions in Relation to Fitness, Part 2-An Adapted Training Program.. Animals (Basel) 2023 Feb 14;13(4).
- Hayes C, Mears M, Rowan S, Dong F, Andrews E. Academic performance and attitudes of dental students impacted by COVID-19.. J Dent Educ 2022 Jul;86(7):874-882.
- Sellon DC, Marcellin-Little DJ. Risk factors for cranial cruciate ligament rupture in dogs participating in canine agility.. BMC Vet Res 2022 Jan 15;18(1):39.
- Brincat BL, McGreevy PD, Bowell VA, Packer RMA. Who's Getting a Head Start? Mesocephalic Dogs in Still Images Are Attributed More Positively Valenced Emotions Than Dogs of Other Cephalic Index Groups.. Animals (Basel) 2021 Dec 27;12(1).
- McKenzie J, Fenner K, Hyde M, Anzulewicz A, Burattini B, Romness N, Wilson B, McGreevy P. Equine Responses to Acceleration and Deceleration Cues May Reflect Their Exposure to Multiple Riders.. Animals (Basel) 2020 Dec 31;11(1).
- Burattini B, Fenner K, Anzulewicz A, Romness N, McKenzie J, Wilson B, McGreevy P. Age-Related Changes in the Behaviour of Domestic Horses as Reported by Owners.. Animals (Basel) 2020 Dec 7;10(12).
- Blackman SA, Wilson BJ, Reed AR, McGreevy PD. Reported Motivations and Aims of Australian Dog Breeders-A Pilot Study.. Animals (Basel) 2020 Dec 7;10(12).
- Fenner K, Matlock S, Williams J, Wilson B, McLean A, Serpell J, McGreevy P. Validation of the Equine Behaviour Assessment and Research Questionnaire (E-BARQ): A New Survey Instrument for Exploring and Monitoring the Domestic Equine Triad.. Animals (Basel) 2020 Oct 28;10(11).
- Fenner K, Dashper K, Serpell J, McLean A, Wilkins C, Klinck M, Wilson B, McGreevy P. The Development of a Novel Questionnaire Approach to the Investigation of Horse Training, Management, and Behaviour.. Animals (Basel) 2020 Oct 24;10(11).
Use Nutrition Calculator
Check if your horse's diet meets their nutrition requirements with our easy-to-use tool Check your horse's diet with our easy-to-use tool
Talk to a Nutritionist
Discuss your horse's feeding plan with our experts over a free phone consultation Discuss your horse's diet over a phone consultation
Submit Diet Evaluation
Get a customized feeding plan for your horse formulated by our equine nutritionists Get a custom feeding plan formulated by our nutritionists