Analyze Diet
PloS one2020; 15(11); e0231608; doi: 10.1371/journal.pone.0231608

Equine Facial Action Coding System for determination of pain-related facial responses in videos of horses.

Abstract: During the last decade, a number of pain assessment tools based on facial expressions have been developed for horses. While all tools focus on moveable facial muscles related to the ears, eyes, nostrils, lips, and chin, results are difficult to compare due to differences in the research conditions, descriptions and methodologies. We used a Facial Action Coding System (FACS) modified for horses (EquiFACS) to code and analyse video recordings of acute short-term experimental pain (n = 6) and clinical cases expected to be in pain or without pain (n = 21). Statistical methods for analyses were a frequency based method adapted from human FACS approaches, and a novel method based on co-occurrence of facial actions in time slots of varying lengths. We describe for the first time changes in facial expressions using EquiFACS in video of horses with pain. The ear rotator (EAD104), nostril dilation (AD38) and lower face behaviours, particularly chin raiser (AU17), were found to be important pain indicators. The inner brow raiser (AU101) and eye white increase (AD1) had less consistent results across experimental and clinical data. Frequency statistics identified AUs, EADs and ADs that corresponded well to anatomical regions and facial expressions identified by previous horse pain research. The co-occurrence based method additionally identified lower face behaviors that were pain specific, but not frequent, and showed better generalization between experimental and clinical data. In particular, chewing (AD81) was found to be indicative of pain. Lastly, we identified increased frequency of half blink (AU47) as a new indicator of pain in the horses of this study.
Publication Date: 2020-11-03 PubMed ID: 33141852PubMed Central: PMC7608869DOI: 10.1371/journal.pone.0231608Google Scholar: Lookup
The Equine Research Bank provides access to a large database of publicly available scientific literature. Inclusion in the Research Bank does not imply endorsement of study methods or findings by Mad Barn.
  • Journal Article
  • Research Support
  • Non-U.S. Gov't

Summary

This research summary has been generated with artificial intelligence and may contain errors and omissions. Refer to the original study to confirm details provided. Submit correction.

The research focuses on the development of a system for assessing pain in horses by analyzing their facial expressions. The Facial Action Coding System (FACS), modified for horses, was used to observe and analyze video footage of horses in varied pain situations, with a focus on facial muscles related to ears, eyes, nostrils, lips, and chin.

Methodology

  • The researchers used a modified version of the Facial Action Coding System (FACS) designed for horses, known as EquiFACS.
  • The study involved the analysis of video recordings involving instances of acute short-term experimental pain (in 6 cases) and selected clinical cases (21 cases), where horses were expected to either experience pain or not.
  • The team used statistical methods to analyze the data. These methods included a frequency-based method borrowed from human FACS approaches and another innovative method based on the simultaneous occurrence of facial actions in varying time slots.

Finding

  • The researchers observed changes in crucial indicators of pain through the videos, identifying specific behaviors in the ear rotator, nostril dilator, and lower face, notably chin raiser behaviors.
  • The inner brow raiser and eye white increase behaviors showed less consistent results across experimental and clinical data collected.
  • The frequency-based approach managed to pinpoint movements or actions and behaviors that corresponded well to earlier established indicators of pain in horses.
  • Furthermore, the co-occurrence-based method highlighted more specific lower face behaviors that, while not frequent, were specific to pain expressions in horses and showed better consistency in results for both experimental and clinical data.
  • Chewing was found to be unique to horses in pain, based on the co-occurrence-based method.
  • Newly observed indicators of pain included an increased frequency of half blink in the horses studied.

Conclusion

The research highlights the potential of the EquiFACS in helping to objectively identify pain in horses by observing and decoding their facial expressions. This approach could have broader implications in the care and treatment of horses, enabling a more effective way to detect and manage pain in these animals. The new indicators of pain identified in the research can enhance existing techniques in veterinary diagnostics and treatments. They can also provide a basis for further research in the area of pain assessment in horses and other animals.

Cite This Article

APA
Rashid M, Silventoinen A, Gleerup KB, Andersen PH. (2020). Equine Facial Action Coding System for determination of pain-related facial responses in videos of horses. PLoS One, 15(11), e0231608. https://doi.org/10.1371/journal.pone.0231608

Publication

ISSN: 1932-6203
NlmUniqueID: 101285081
Country: United States
Language: English
Volume: 15
Issue: 11
Pages: e0231608

Researcher Affiliations

Rashid, Maheen
  • Dept. Computer Science, University of California Davis, Davis, California, United States of America.
Silventoinen, Alina
  • Dept. Anatomy, Physiology and Biochemistry, Swedish University of Agricultural Sciences, Uppsala, Sweden.
Gleerup, Karina Bech
  • Dept. Clinical Sciences, University of Copenhagen, Taastrup, Denmark.
Andersen, Pia Haubro
  • Dept. Clinical Sciences, Swedish University of Agricultural Sciences, Uppsala, Sweden.

MeSH Terms

  • Animals
  • Facial Expression
  • Facial Muscles / physiopathology
  • Facial Pain / diagnosis
  • Facial Pain / veterinary
  • Female
  • Horse Diseases / diagnosis
  • Horses
  • Male
  • Pain Measurement / methods
  • Video Recording

Conflict of Interest Statement

No competing interests.

References

This article includes 27 references
  1. Hadjistavropoulos T, Craig KD. A theoretical framework for understanding self-report and observational measures of pain: a communications model.. Behaviour research and therapy 2002;40(5):551–570.
    doi: 10.1016/S0005-7967(01)00072-9pubmed: 12038648google scholar: lookup
  2. Flecknell P, Leach M, Bateson M. Affective state and quality of life in mice.. Pain 2011;152(5):963–964.
    doi: 10.1016/j.pain.2011.01.030pubmed: 21292396google scholar: lookup
  3. IASP Taxonomy: International Association for the Study of Pain; 2016;. http://www.iasp-pain.org/Education/Content.aspx?ItemNumber=1698.
  4. Raekallio M, Taylor PM, Bloomfield M. A comparison of methods for evaluation of pain and distress after orthopaedic surgery in horses.. Journal of Veterinary Anaesthesia 1997;24(2):17–20.
  5. Price J, Catriona S, Welsh EM, Waran NK. Preliminary evaluation of a behaviour–based system for assessment of post–operative pain in horses following arthroscopic surgery.. Veterinary anaesthesia and analgesia 2003;30(3):124–137.
  6. Sellon DC, Roberts MC, Blikslager AT, Ulibarri C, Papich MG. Effects of continuous rate intravenous infusion of butorphanol on physiologic and outcome variables in horses after celiotomy.. Journal of Veterinary Internal Medicine 2004;18(4):555–563.
  7. Graubner C, Gerber V, Doherr M, Spadavecchia C. Clinical application and reliability of a post abdominal surgery pain assessment scale (PASPAS) in horses.. The Veterinary Journal 2011;188(2):178–183.
    doi: 10.1016/j.tvjl.2010.04.029pubmed: 20627635google scholar: lookup
  8. van Loon JP, Van Dierendonck MC. Monitoring acute equine visceral pain with the Equine Utrecht University Scale for Composite Pain Assessment (EQUUS-COMPASS) and the Equine Utrecht University Scale for Facial Assessment of Pain (EQUUS-FAP): A scale-construction study.. The Veterinary Journal 2015;206(3):356–364.
    doi: 10.1016/j.tvjl.2015.08.023pubmed: 26526526google scholar: lookup
  9. Gleerup K, Lindegaard C. Recognition and quantification of pain in horses: A tutorial review.. Equine Veterinary Education 2016;28(1):47–57.
    doi: 10.1111/eve.12383google scholar: lookup
  10. Dalla Costa E, Minero M, Lebelt D, Stucke D, Canali E, Leach MC. Development of the Horse Grimace Scale (HGS) as a pain assessment tool in horses undergoing routine castration.. PLoS one 2014;9(3):e92281.
  11. Gleerup KB, Forkman B, Lindegaard C, Andersen PH. An equine pain face.. Veterinary anesthesia and analgesia 2015;42(1):103–114.
    doi: 10.1111/vaa.12212pmc: PMC4312484pubmed: 25082060google scholar: lookup
  12. Dalla Costa E, Pascuzzo R, Leach MC, Dai F, Lebelt D, Vantini S. Can grimace scales estimate the pain status in horses and mice? A statistical approach to identify a classifier.. PloS one 2018;13(8):e0200339.
  13. Ekman P, Friesen WV, Hager JC. Facial Action Coding System. Manual and Investigator’s Guide.. 2002.
  14. Wathan J, Burrows AM, Waller BM, McComb K. EquiFACS: The Equine Facial Action Coding System.. PloS one 2015;10(8):e0131738.
  15. Sayette MA, Cohn JF, Wertz JM, Perrott MA, Parrott DJ. A psychometric evaluation of the facial action coding system for assessing spontaneous expression.. Journal of Nonverbal Behavior 2001;25(3):167–185.
    doi: 10.1023/A:1010671109788google scholar: lookup
  16. Kunz M, Meixner D, Lautenbacher S. Facial muscle movements encoding pain—a systematic review.. Pain 2019;160(3):535–549.
  17. Hampton AJ, Hadjistavropoulos T, Gagnon MM, Williams J, Clark D. The effects of emotion regulation strategies on the pain experience: a structured laboratory investigation.. Pain 2015;156(5):868–879.
  18. Prkachin KM. The consistency of facial expressions of pain: a comparison across modalities.. Pain 1992;51(3):297–306.
    doi: 10.1016/0304-3959(92)90213-Upubmed: 1491857google scholar: lookup
  19. Karmann AJ, Maihöfner C, Lautenbacher S, Sperling W, Kornhuber J, Kunz M. The role of prefrontal inhibition in regulating facial expressions of pain: a repetitive transcranial magnetic stimulation study.. The Journal of Pain 2016;17(3):383–391.
    doi: 10.1016/j.jpain.2015.12.002pubmed: 26705973google scholar: lookup
  20. Krumhuber EG, Kappas A, Manstead AS. Effects of dynamic aspects of facial expressions: A review.. Emotion Review 2013;5(1):41–46.
    doi: 10.1177/1754073912451349google scholar: lookup
  21. Lindegaard C, Thomsen MH, Larsen S, Andersen PH. Analgesic efficacy of intra-articular morphine in experimentally induced radiocarpal synovitis in horses.. Veterinary anaesthesia and analgesia 2010;37(2):171–185.
  22. ELAN. Max Planck Institute for Psycholinguistics, The Language Archive, Nijmegen, The Netherlands;.
  23. Bron C, Kerbosch J. Algorithm 457: finding all cliques of an undirected graph.. Communications of the ACM 1973;16(9):575–577.
    doi: 10.1145/362342.362367google scholar: lookup
  24. Merkies K, Ready C, Farkas L, Hodder A. Eye Blink Rates and Eyelid Twitches as a Non-Invasive Measure of Stress in the Domestic Horse.. Animals 2019;9(8):562.
    doi: 10.3390/ani9080562pmc: PMC6721043pubmed: 31443315google scholar: lookup
  25. Hintze S, Smith S, Patt A, Bachmann I, Würbel H. Are eyes a mirror of the soul? What eye wrinkles reveal about a horse’s emotional state.. PloS one 2016;11(10):e0164017.
  26. Gleerup KB, Andersen PH, Munksgaard L, Forkman B. Pain evaluation in dairy cattle.. Applied Animal Behaviour Science 2015;171:25–32.
  27. Wathan J, McComb K. The eyes and ears are visual indicators of attention in domestic horses.. Current Biology 2014;24(15):R677–R679.
    doi: 10.1016/j.cub.2014.06.023pmc: PMC4123162pubmed: 25093554google scholar: lookup

Citations

This article has been cited 16 times.
  1. Correia-Caeiro C, Zamansky A, Karl S, Bremhorst A. Research Methods for the Analysis of Visual Emotion Cues in Animals: A Workshop Report. Animals (Basel) 2025 Oct 29;15(21).
    doi: 10.3390/ani15213142pubmed: 41227471google scholar: lookup
  2. da Fé VCS, Dos Santos VMO, de Lima ACB, Hernandes MSP, Caldara FR, Gomes MNB. Auditory enrichment on facial and physiological responses of Pantaneiro geldings and mares under short-term stress. PLoS One 2025;20(5):e0323649.
    doi: 10.1371/journal.pone.0323649pubmed: 40392914google scholar: lookup
  3. Mota-Rojas D, Whittaker AL, Bienboire-Frosini C, Buenhombre J, Mora-Medina P, Domínguez-Oliva A, Martínez-Burnes J, Hernández-Avalos I, Olmos-Hernández A, Verduzco-Mendoza A, Casas-Alvarado A, Lezama-García K, Grandin T. The neurobiological basis of emotions and their connection to facial expressions in non-human mammals: insights in nonverbal communication. Front Vet Sci 2025;12:1541615.
    doi: 10.3389/fvets.2025.1541615pubmed: 40125317google scholar: lookup
  4. Lundblad J, Rhodin M, Hernlund E, Bjarnestig H, Hidén Rudander S, Haubro Andersen P. Facial expressions during compound interventions of nociception, conspecific isolation, and sedation in horses. Sci Rep 2025 Feb 13;15(1):5373.
    doi: 10.1038/s41598-025-89329-xpubmed: 39948238google scholar: lookup
  5. Chiavaccini L, Gupta A, Anclade N, Chiavaccini G, De Gennaro C, Johnson AN, Portela DA, Romano M, Vettorato E, Luethy D. Automated acute pain prediction in domestic goats using deep learning-based models on video-recordings. Sci Rep 2024 Nov 7;14(1):27104.
    doi: 10.1038/s41598-024-78494-0pubmed: 39511381google scholar: lookup
  6. Chiavaccini L, Gupta A, Chiavaccini G. From facial expressions to algorithms: a narrative review of animal pain recognition technologies. Front Vet Sci 2024;11:1436795.
    doi: 10.3389/fvets.2024.1436795pubmed: 39086767google scholar: lookup
  7. Ask K, Rhodin M, Rashid-Engström M, Hernlund E, Andersen PH. Changes in the equine facial repertoire during different orthopedic pain intensities. Sci Rep 2024 Jan 2;14(1):129.
    doi: 10.1038/s41598-023-50383-ypubmed: 38167926google scholar: lookup
  8. Tomberg C, Petagna M, de Selliers de Moranville LA. Horses (Equus caballus) facial micro-expressions: insight into discreet social information. Sci Rep 2023 May 27;13(1):8625.
    doi: 10.1038/s41598-023-35807-zpubmed: 37244937google scholar: lookup
  9. Boneh-Shitrit T, Feighelstein M, Bremhorst A, Amir S, Distelfeld T, Dassa Y, Yaroshetsky S, Riemer S, Shimshoni I, Mills DS, Zamansky A. Explainable automated recognition of emotional states from canine facial expressions: the case of positive anticipation and frustration. Sci Rep 2022 Dec 30;12(1):22611.
    doi: 10.1038/s41598-022-27079-wpubmed: 36585439google scholar: lookup
  10. McVey C, Egger D, Pinedo P. Improving the Reliability of Scale-Free Image Morphometrics in Applications with Minimally Restrained Livestock Using Projective Geometry and Unsupervised Machine Learning. Sensors (Basel) 2022 Oct 31;22(21).
    doi: 10.3390/s22218347pubmed: 36366045google scholar: lookup
  11. Carvalho JRG, Trindade PHE, Conde G, Antonioli ML, Funnicelli MIG, Dias PP, Canola PA, Chinelatto MA, Ferraz GC. Facial Expressions of Horses Using Weighted Multivariate Statistics for Assessment of Subtle Local Pain Induced by Polylactide-Based Polymers Implanted Subcutaneously. Animals (Basel) 2022 Sep 13;12(18).
    doi: 10.3390/ani12182400pubmed: 36139260google scholar: lookup
  12. Feighelstein M, Shimshoni I, Finka LR, Luna SPL, Mills DS, Zamansky A. Automated recognition of pain in cats. Sci Rep 2022 Jun 10;12(1):9575.
    doi: 10.1038/s41598-022-13348-1pubmed: 35688852google scholar: lookup
  13. Broomé S, Ask K, Rashid-Engström M, Haubro Andersen P, Kjellström H. Sharing pain: Using pain domain transfer for video recognition of low grade orthopedic pain in horses. PLoS One 2022;17(3):e0263854.
    doi: 10.1371/journal.pone.0263854pubmed: 35245288google scholar: lookup
  14. Lencioni GC, de Sousa RV, de Souza Sardinha EJ, Corrêa RR, Zanella AJ. Pain assessment in horses using automatic facial expression recognition through deep learning-based modeling. PLoS One 2021;16(10):e0258672.
    doi: 10.1371/journal.pone.0258672pubmed: 34665834google scholar: lookup
  15. Andersen PH, Broomé S, Rashid M, Lundblad J, Ask K, Li Z, Hernlund E, Rhodin M, Kjellström H. Towards Machine Recognition of Facial Expressions of Pain in Horses. Animals (Basel) 2021 Jun 1;11(6).
    doi: 10.3390/ani11061643pubmed: 34206077google scholar: lookup
  16. Lundblad J, Rashid M, Rhodin M, Haubro Andersen P. Effect of transportation and social isolation on facial expressions of healthy horses. PLoS One 2021;16(6):e0241532.
    doi: 10.1371/journal.pone.0241532pubmed: 34086704google scholar: lookup