Analyze Diet
Veterinary sciences2020; 7(3); 140; doi: 10.3390/vetsci7030140

Identifying Sources of Potential Bias When Using Online Survey Data to Explore Horse Training, Management, and Behaviour: A Systematic Literature Review.

Abstract: Owner-reported behavioural observations form an essential part of the veterinarians' diagnosis and treatment plan. The way we train and manage horses affects their behaviour and, in turn, their health and welfare. Current horse training and management practices are largely driven by traditional techniques and longstanding methodologies. These approaches generally lack an evidence base for evaluation purposes. The absence of evidence and evaluation contributes to the persistent use of risky practices and this, in turn, increases risk of potential harms for both horse and rider, and fuels questioning of the equine industry's current social license to operate. Objective evidence is required to make training and management decisions based on demonstrable best practice. Large-scale experimental or intervention studies using horses are generally not practical because of the associated costs and logistics of gaining ethical approval. Small studies generally lack statistical power and are subject to the effects of many forms of bias that demand caution in the interpretation of any observed effects. An alternative to collecting large amounts of empirical data is the use of owner-reported observations via online survey. Horse owners are ideally placed to report on the domestic equine triad of training, management, and behaviour. The current article highlights three sources of potential bias in a systematic review of literature on large-scale online studies of horse owners' observational reports that met the following selection criteria: English-language, published, peer-reviewed articles reporting on studies with over 1000 respondents and open access to the survey instrument. The online surveys were evaluated for three common forms of bias: recall, confirmation, and sampling bias. This review reveals that online surveys are useful for gathering data on the triad of horse training, management, and behaviour. However, current use of online surveys to collect data on equitation science (including horse training, management, and behaviour) could be improved by using a standardised and validated tool. Such a tool would facilitate comparisons among equine and equitation science studies, thus advancing our understanding of the impacts of training and management on horse behaviour. The authors of the current review suggest the use of a standardised behavioural and management assessment tool for horses. Such a tool would help define what constitutes normal behaviour within geographically disparate populations of horses, leading to improvements in rider safety and horse welfare.
Publication Date: 2020-09-22 PubMed ID: 32971754PubMed Central: PMC7558402DOI: 10.3390/vetsci7030140Google Scholar: Lookup
The Equine Research Bank provides access to a large database of publicly available scientific literature. Inclusion in the Research Bank does not imply endorsement of study methods or findings by Mad Barn.
  • Journal Article
  • Review

Summary

This research summary has been generated with artificial intelligence and may contain errors and omissions. Refer to the original study to confirm details provided. Submit correction.

This research article is focused on the exploration of potential bias in using online survey data to investigate horse training, management, and behaviour. By conducting a systematic review of existing literature on this topic, the authors propose the development of a standardized tool to enhance the reliability of online surveys, thus ensuring more accurate horse management practices and ultimately improving both rider safety and horse welfare.

Objective and Methodology

  • The study was designed to investigate potential sources of bias in online surveys that solicit owner-reported observations on horse training, management, and behaviour.
  • Online surveys are increasingly used to gather data due to the cost and logistical challenges of large-scale experimental studies with horses.
  • The authors conducted a systematic review of English-language, peer-reviewed articles reporting on studies with over 1000 respondents and open access to the survey instrument.
  • The focus was on identifying three common forms of bias: recall bias (errors due to the lapse in time between an event and recall of that event), confirmation bias (tendency to accept information supporting existing ideas and reject contrasting evidence), and sampling bias (occurs when a sample is not representative of the population it’s supposed to represent).

Findings and Implications

  • Based on the review, the authors concluded that online surveys have potential in gathering large amounts of data on horse training, management, and behaviour.
  • However, the authors also identified serious flaws due to recall, confirmation, and sampling bias in existing studies using online surveys in equitation science.
  • To address these biases, the authors proposed the use of a standardized behavioural and management assessment tool for horse owners filling out surveys.
  • Such a tool would allow for more accurate comparisons among different equine science studies and improve the understanding of the impacts of training and management on horse behaviour.
  • The authors argue that having more accurate, standardized data could help define what is considered normal horse behaviour across different geographic populations.
  • The overall aim is to improve rider safety and horse welfare through the identification and use of evidence-based best practices in horse training and management.

Cite This Article

APA
Fenner K, Hyde M, Crean A, McGreevy P. (2020). Identifying Sources of Potential Bias When Using Online Survey Data to Explore Horse Training, Management, and Behaviour: A Systematic Literature Review. Vet Sci, 7(3), 140. https://doi.org/10.3390/vetsci7030140

Publication

ISSN: 2306-7381
NlmUniqueID: 101680127
Country: Switzerland
Language: English
Volume: 7
Issue: 3
PII: 140

Researcher Affiliations

Fenner, Kate
  • Sydney School of Veterinary Science, Faculty of Science, University of Sydney, Sydney, NSW 2006, Australia.
Hyde, Michelle
  • Sydney School of Veterinary Science, Faculty of Science, University of Sydney, Sydney, NSW 2006, Australia.
Crean, Angela
  • Sydney School of Veterinary Science, Faculty of Science, University of Sydney, Sydney, NSW 2006, Australia.
McGreevy, Paul
  • Sydney School of Veterinary Science, Faculty of Science, University of Sydney, Sydney, NSW 2006, Australia.

Conflict of Interest Statement

The authors declare no conflict of interest.

References

This article includes 57 references
  1. Munsters CC, Visser KE, van den Broek J, Sloet van Oldruitenborgh-Oosterbaan MM. The influence of challenging objects and horse-rider matching on heart rate, heart rate variability and behavioural score in riding horses.. Vet J 2012 Apr;192(1):75-80.
    doi: 10.1016/j.tvjl.2011.04.011pubmed: 21612959google scholar: lookup
  2. McGreevy P. Equine Behavior: A Guide for Veterinarians and Equine Scientists. 2nd ed. W. B. Saunders; London, UK: 2012.
  3. Parkin T, Brown J, Mcacdonald E. Occupational risks of working with horses: A questionnaire survey of equine veterinary surgeons. Equine Vet. Educ. 2018;30:200–205.
    doi: 10.1111/eve.12891google scholar: lookup
  4. Lansade L, Bonneau C, Parias C, Biau S. Horse’s emotional state and rider safety during grooming practices, a field study. Appl. Anim. Behav. Sci. 2019;217:43–47.
  5. McGreevy P, Berger J, de Brauwere N, Doherty O, Harrison A, Fiedler J, Jones C, McDonnell S, McLean A, Nakonechny L, Nicol C, Preshaw L, Thomson P, Tzioumis V, Webster J, Wolfensohn S, Yeates J, Jones B. Using the Five Domains Model to Assess the Adverse Impacts of Husbandry, Veterinary, and Equitation Interventions on Horse Welfare.. Animals (Basel) 2018 Mar 18;8(3).
    doi: 10.3390/ani8030041pmc: PMC5867529pubmed: 29562654google scholar: lookup
  6. McLean A.N, McGreevy P.D. Horse-training techniques that may defy the principles of learning theory and compromise welfare. J. Vet. Behav. Clin. Appl. Res. 2010;5:187–195.
  7. Fenner K, McLean A, McGreevy P. Cutting to the chase: How round-pen, lunging and high-speed liberty work may compromise horse welfare. J. Vet. Behav. Clin. Appl. Res. 2019;29:88–94.
  8. Todd Z. Barriers to the adoption of humane dog training methods. J. Vet. Behav. 2018;25:28–34.
  9. Perez BC, Mehrkam LR, Foltz AR, Dorey NR. Effects of Enrichment Presentation and Other Factors on Behavioral Welfare of Pantropical Spotted Dolphin (Stenella attenuata).. J Appl Anim Welf Sci 2018 Apr-Jun;21(2):130-140.
    doi: 10.1080/10888705.2017.1383161pubmed: 29068704google scholar: lookup
  10. Fiedler J. Sport Horse Welfare and Social Licence to Operate: Informing a Social Licence to Operate Communication Framework: Attitudes to Sport Horse Welfare. Ph.D. Thesis. Central Queensland University; Queensland, Australia: 2020.
  11. Heleski C, Stowe C, Fiedler J, Peterson M, Brady C, Wickens C, MacLeod J. Thoroughbred Racehorse Welfare through the Lens of ‘Social License to Operate—With an Emphasis on a U.S. Perspective. Sustainability 2020;12:1706.
    doi: 10.3390/sህ1706google scholar: lookup
  12. Fiedler JM, McGreevy PD. Reconciling Horse Welfare, Worker Safety, and Public Expectations: Horse Event Incident Management Systems in Australia.. Animals (Basel) 2016 Feb 24;6(3).
    doi: 10.3390/ani6030016pmc: PMC4810044pubmed: 26927189google scholar: lookup
  13. Von Borstel U.U., Duncan I.J.H., Shoveller A.K., Merkies K, Keeling L.J., Millman S.T. Impact of riding in a coercively obtained Rollkur posture on welfare and fear of performance horses. Appl. Anim. Behav. Sci. 2009;116:228–236.
  14. Wilson B, Jones B, McGreevy P. Longitudinal trends in the frequency of medium and fast race winning times in Australian harness racing: Relationships with rules moderating whip use.. PLoS One 2018;13(3):e0184091.
  15. Weller D, Franklin S, Shea G, White P, Fenner K, Wilson B, Wilkins C, McGreevy P. The Reported Use of Nosebands in Racing and Equestrian Pursuits.. Animals (Basel) 2020 Apr 30;10(5).
    doi: 10.3390/ani10050776pmc: PMC7278451pubmed: 32365844google scholar: lookup
  16. Thomson PC, Hayek AR, Jones B, Evans DL, McGreevy PD. Number, causes and destinations of horses leaving the Australian Thoroughbred and Standardbred racing industries.. Aust Vet J 2014 Aug;92(8):303-11.
    doi: 10.1111/avj.12204pubmed: 24954530google scholar: lookup
  17. Fowler V, Kennedy M, Marlin D. A comparison of the Monty Roberts technique with a conventional UK technique for initial training of riding horses. Anthrozoos 2015;25:301–321.
  18. Momozawa Y, Ono T, Sato F, Kikusui T, Takeuchi Y, Mori Y, Kusunose R. Assessment of equine temperament by a questionnaire survey to caretakers and evaluation of its reliability by simultaneous behavior test. Appl. Anim. Behav. Sci. 2003;84:127–138.
  19. Baker JR, Leyland A. Histological survey of tumours of the horse, with particular reference to those ofthe skin.. Vet Rec 1975 May 10;96(19):419-22.
    doi: 10.1136/vr.96.19.419pubmed: 1173477google scholar: lookup
  20. Parker M, Goodwin D, Redhead E.S. Survey of breeders’ management of horses in Europe, North America and Australia: Comparison of factors associated with the development of abnormal behaviour. Appl. Anim. Behav. Sci. 2008;114:206–215.
  21. McGreevy PD, French NP, Nicol CJ. The prevalence of abnormal behaviours in dressage, eventing and endurance horses in relation to stabling.. Vet Rec 1995 Jul 8;137(2):36-7.
    doi: 10.1136/vr.137.2.36pubmed: 8525580google scholar: lookup
  22. Fenner K, Freire R, McLean A, McGreevy P. Behavioral, demographic and management influences on equine responses to negative reinforcement. J. Vet. Behav. Clin. Appl. Res. 2019;29:11–17.
  23. Padalino B, Raidal SL, Hall E, Knight P, Celi P, Jeffcott L, Muscatello G. Risk factors in equine transport-related health problems: A survey of the Australian equine industry.. Equine Vet J 2017 Jul;49(4):507-511.
    doi: 10.1111/evj.12631pubmed: 27564584google scholar: lookup
  24. Albright JD, Mohammed HO, Heleski CR, Wickens CL, Houpt KA. Crib-biting in US horses: breed predispositions and owner perceptions of aetiology.. Equine Vet J 2009 May;41(5):455-8.
    doi: 10.2746/042516409X372584pubmed: 19642405google scholar: lookup
  25. Henriksson J, Sauveroche M, Roth LSV. Effects of size and personality on social learning and human-directed behaviour in horses (Equus caballus).. Anim Cogn 2019 Nov;22(6):1001-1011.
    doi: 10.1007/s10071-019-01291-0pmc: PMC6834737pubmed: 31312981google scholar: lookup
  26. Widi T, Rakasiwi G, Nugroho T, Widyas N. Personality assessment of different horse breeds trained for military purposes. IOP Conference Series: Earth and Environmental Science Bali, Indonesia. 20–21 October 2018; pp. 1–7.
  27. Dashper K, Fenner K, Hyde M, Probyn-Rapsey M, Casper G, Henshall C, McGreevy P. The anthropomorphic application of human-based gender stereotypes to animals. Anthrozoos 2018;31:673–684.
  28. Visser E, Van Wijk-Jansen E. Diversity in horse enthusiasts with respect to horse welfare: An explorative study. J. Vet. Behav. Clin. Appl. Res. 2012;7:295–304.
  29. Luna D, Vásquez RA, Rojas M, Tadich TA. Welfare Status of Working Horses and Owners' Perceptions of Their Animals.. Animals (Basel) 2017 Aug 1;7(8).
    doi: 10.3390/ani7080056pmc: PMC5575568pubmed: 28788109google scholar: lookup
  30. McGreevy PD, Oddie C, Burton FL, McLean AN. The horse-human dyad: can we align horse training and handling activities with the equid social ethogram?. Vet J 2009 Jul;181(1):12-8.
    doi: 10.1016/j.tvjl.2009.03.005pubmed: 19375965google scholar: lookup
  31. Bethlehem J. Selection Bias in Web Surveys. Int. Stat. Rev. 2010;78:161–188.
  32. Fergusson DM, Boden JM. Exploring issues arising from survey non-response.. Addiction 2015 Sep;110(9):1513-4.
    doi: 10.1111/add.12968pubmed: 26223175google scholar: lookup
  33. Smith V, Devane D, Begley CM, Clarke M. Methodology in conducting a systematic review of systematic reviews of healthcare interventions.. BMC Med Res Methodol 2011 Feb 3;11(1):15.
    doi: 10.1186/1471-2288-11-15pmc: PMC3039637pubmed: 21291558google scholar: lookup
  34. Hill E, McGreevy P, Caspar G, White P, McLean A. Apparatus use in popular equestrian disciplines in Australia. J. Vet. Behav. Clin. Appl. Res. 2015;10:147–152.
  35. Aune A, Fenner K, Wilson B, Cameron E, McLean A, McGreevy P. Reported Behavioural Differences between Geldings and Mares Challenge Sex-Driven Stereotypes in Ridden Equine Behaviour.. Animals (Basel) 2020 Mar 2;10(3).
    doi: 10.3390/ani10030414pmc: PMC7142782pubmed: 32131444google scholar: lookup
  36. Althubaiti A. Information bias in health research: definition, pitfalls, and adjustment methods.. J Multidiscip Healthc 2016;9:211-7.
    doi: 10.2147/JMDH.S104807pmc: PMC4862344pubmed: 27217764google scholar: lookup
  37. Lloyd A.S., Martin J.E., Bornett-Gauci H.L.I., Wilkinson R.G. Horse personality: Variation between breeds. Appl. Anim. Behav. Sci. 2008;112:369–383.
  38. Hockenhull J, Creighton E. Management practices associated with owner-reported stable-related and handling behaviour problems in UK leisure horses. Appl. Anim. Behav. Sci. 2014;155:49.
  39. Hockenhull J, Creighton E. The day-to-day management of UK leisure horses and the prevalence of owner-reported stable-related and handling behaviour problems. Anim. Welf. 2015;24:29–36.
    doi: 10.7120/09627286.24.1.029google scholar: lookup
  40. Hockenhull J, Creighton E. The use of equipment and training practices and the prevalence of owner-reported ridden behaviour problems in UK leisure horses.. Equine Vet J 2013 Jan;45(1):15-9.
  41. Hockenhull J, Creighton E. Pre-feeding behaviour in UK leisure horses and associated feeding routine risk factors. Anim. Welf. 2014;23:297–308.
    doi: 10.7120/09627286.23.3.297google scholar: lookup
  42. Hockenhull J, Creighton E. Unwanted oral investigative behaviour in horses: A note on the relationship between mugging behaviour, hand-feeding titbits and clicker training. Appl. Anim. Behav. Sci. 2010;127:104–107.
  43. Hartmann E, Bøe KE, Christensen JW, Hyyppä S, Jansson H, Jørgensen GH, Ladewig J, Mejdell CM, Norling Y, Rundgren M, Särkijärvi S, Søndergaard E, Keeling LJ. A Nordic survey of management practices and owners' attitudes towards keeping horses in groups.. J Anim Sci 2015 Sep;93(9):4564-74.
    doi: 10.2527/jas.2015-9233pubmed: 26440355google scholar: lookup
  44. Gronqvist G, Rogers C, Gee E. The Management of Horses during Fireworks in New Zealand.. Animals (Basel) 2016 Mar 9;6(3).
    doi: 10.3390/ani6030020pmc: PMC4810048pubmed: 27005667google scholar: lookup
  45. Hartmann E, Bøe KE, Jørgensen GH, Mejdell CM, Dahlborn K. Management of horses with focus on blanketing and clipping practices reported by members of the Swedish and Norwegian equestrian community.. J Anim Sci 2017 Mar;95(3):1104-1117.
    doi: 10.2527/jas2016.1146pubmed: 28380504google scholar: lookup
  46. Hockenhull J, Creighton E. The strengths of statistical techniques in identifying patterns underlying apparently random behavioral problems in horses. J. Vet. Behav. Clin. Appl. Res. 2012;7:305–310.
  47. Ross SE, Murray JK, Roberts VLH. Prevalence of headshaking within the equine population in the UK.. Equine Vet J 2018 Jan;50(1):73-78.
    doi: 10.1111/evj.12708pubmed: 28608565google scholar: lookup
  48. Hartmann E, Christensen J, McGreevy P. Dominance and Leadership: Useful Concepts in Human–Horse Interactions?. J. Equine Vet. Sci. 2017;52:1–9.
  49. Lloyd A.S., Martin J.E., Bornett-Gauci H.L.I., Wilkinson R.G. Evaluation of a novel method of horse personality assessment: Rater-agreement and links to behaviour. Appl. Anim. Behav. Sci. 2007;105:205–222.
  50. McGreevy PD. The advent of equitation science.. Vet J 2007 Nov;174(3):492-500.
    doi: 10.1016/j.tvjl.2006.09.008pubmed: 17157542google scholar: lookup
  51. Godlonton S, Hernandez M, Murphy M. Anchoring Bias in Recall Data: Evidence from Central America. Am. J. Agric. Econ. 2018;100.
    doi: 10.1093/ajae/aax080google scholar: lookup
  52. Seitzinger PJ, Tataryn J, Osgood N, Waldner C. Foodborne Outbreak Investigation: Effect of Recall Inaccuracies on Food Histories.. J Food Prot 2019 Jun;82(6):931-939.
    doi: 10.4315/0362-028X.JFP-18-548pubmed: 31081690google scholar: lookup
  53. Liu J, Qu B, Hu B, Jiang N, Wang D. The quality of life of men who have sex with men in China: reliability and validity testing of the SF-36 questionnaire.. PLoS One 2013;8(12):e83362.
  54. Duffy DL, de Moura RTD, Serpell JA. Development and evaluation of the Fe-BARQ: A new survey instrument for measuring behavior in domestic cats (Felis s. catus).. Behav Processes 2017 Aug;141(Pt 3):329-341.
    doi: 10.1016/j.beproc.2017.02.010pubmed: 28232232google scholar: lookup
  55. Behr D. Translating Answers to Open-ended Survey Questions in Cross-cultural Research: A Case Study on the Interplay between Translation, Coding, and Analysis. Field Methods 2015;27:284–299.
    doi: 10.1177/1525822X14553175google scholar: lookup
  56. . Engaging Volunteers: Guide to Engaging Volunteers in Citizen Science Projects. [(accessed on 11 June 2020)]; Available online: https://www.tcv.org.uk/wp-content/uploads/2014/11/EngagingVolunteersCitizenScience.pdf.
  57. Fenner K, Dashper K, Wilkins C, Serpell J, McLean A, Wilson B, McGreevy P. Building Bridges between Theory and Practice: How Citizen Science Can Bring Equine Researchers and Practitioners Together.. Animals (Basel) 2020 Sep 13;10(9).
    doi: 10.3390/ani10091644pmc: PMC7552242pubmed: 32933118google scholar: lookup

Citations

This article has been cited 12 times.
  1. Olczak K, Penar W, Nowicki J, Magiera A, Klocek C. The Role of Sound in Livestock Farming-Selected Aspects.. Animals (Basel) 2023 Jul 14;13(14).
    doi: 10.3390/ani13142307pubmed: 37508083google scholar: lookup
  2. Sellon DC, Marcellin-Little DJ, McFarlane D, McCue M, Pechette Markley A, Shoben A. Adverse health events and recommended health research priorities in agility dogs as reported by dog owners.. Front Vet Sci 2023;10:1127632.
    doi: 10.3389/fvets.2023.1127632pubmed: 36992973google scholar: lookup
  3. Siegers E, van Wijk E, van den Broek J, Sloet van Oldruitenborgh-Oosterbaan M, Munsters C. Longitudinal Training and Workload Assessment in Young Friesian Stallions in Relation to Fitness: Part 1.. Animals (Basel) 2023 Feb 16;13(4).
    doi: 10.3390/ani13040689pubmed: 36830476google scholar: lookup
  4. Siegers E, van den Broek J, Sloet van Oldruitenborgh-Oosterbaan M, Munsters C. Longitudinal Training and Workload Assessment in Young Friesian Stallions in Relation to Fitness, Part 2-An Adapted Training Program.. Animals (Basel) 2023 Feb 14;13(4).
    doi: 10.3390/ani13040658pubmed: 36830445google scholar: lookup
  5. Hayes C, Mears M, Rowan S, Dong F, Andrews E. Academic performance and attitudes of dental students impacted by COVID-19.. J Dent Educ 2022 Jul;86(7):874-882.
    doi: 10.1002/jdd.12897pubmed: 35106782google scholar: lookup
  6. Sellon DC, Marcellin-Little DJ. Risk factors for cranial cruciate ligament rupture in dogs participating in canine agility.. BMC Vet Res 2022 Jan 15;18(1):39.
    doi: 10.1186/s12917-022-03146-2pubmed: 35033070google scholar: lookup
  7. Brincat BL, McGreevy PD, Bowell VA, Packer RMA. Who's Getting a Head Start? Mesocephalic Dogs in Still Images Are Attributed More Positively Valenced Emotions Than Dogs of Other Cephalic Index Groups.. Animals (Basel) 2021 Dec 27;12(1).
    doi: 10.3390/ani12010049pubmed: 35011155google scholar: lookup
  8. McKenzie J, Fenner K, Hyde M, Anzulewicz A, Burattini B, Romness N, Wilson B, McGreevy P. Equine Responses to Acceleration and Deceleration Cues May Reflect Their Exposure to Multiple Riders.. Animals (Basel) 2020 Dec 31;11(1).
    doi: 10.3390/ani11010066pubmed: 33396451google scholar: lookup
  9. Burattini B, Fenner K, Anzulewicz A, Romness N, McKenzie J, Wilson B, McGreevy P. Age-Related Changes in the Behaviour of Domestic Horses as Reported by Owners.. Animals (Basel) 2020 Dec 7;10(12).
    doi: 10.3390/ani10122321pubmed: 33297447google scholar: lookup
  10. Blackman SA, Wilson BJ, Reed AR, McGreevy PD. Reported Motivations and Aims of Australian Dog Breeders-A Pilot Study.. Animals (Basel) 2020 Dec 7;10(12).
    doi: 10.3390/ani10122319pubmed: 33297412google scholar: lookup
  11. Fenner K, Matlock S, Williams J, Wilson B, McLean A, Serpell J, McGreevy P. Validation of the Equine Behaviour Assessment and Research Questionnaire (E-BARQ): A New Survey Instrument for Exploring and Monitoring the Domestic Equine Triad.. Animals (Basel) 2020 Oct 28;10(11).
    doi: 10.3390/ani10111982pubmed: 33126670google scholar: lookup
  12. Fenner K, Dashper K, Serpell J, McLean A, Wilkins C, Klinck M, Wilson B, McGreevy P. The Development of a Novel Questionnaire Approach to the Investigation of Horse Training, Management, and Behaviour.. Animals (Basel) 2020 Oct 24;10(11).
    doi: 10.3390/ani10111960pubmed: 33114408google scholar: lookup