Machine Learning-Based Sensor Data Fusion for Animal Monitoring: Scoping Review.
Abstract: The development of technology, such as the Internet of Things and artificial intelligence, has significantly advanced many fields of study. Animal research is no exception, as these technologies have enabled data collection through various sensing devices. Advanced computer systems equipped with artificial intelligence capabilities can process these data, allowing researchers to identify significant behaviors related to the detection of illnesses, discerning the emotional state of the animals, and even recognizing individual animal identities. This review includes articles in the English language published between 2011 and 2022. A total of 263 articles were retrieved, and after applying inclusion criteria, only 23 were deemed eligible for analysis. Sensor fusion algorithms were categorized into three levels: Raw or low (26%), Feature or medium (39%), and Decision or high (34%). Most articles focused on posture and activity detection, and the target species were primarily cows (32%) and horses (12%) in the three levels of fusion. The accelerometer was present at all levels. The findings indicate that the study of sensor fusion applied to animals is still in its early stages and has yet to be fully explored. There is an opportunity to research the use of sensor fusion for combining movement data with biometric sensors to develop animal welfare applications. Overall, the integration of sensor fusion and machine learning algorithms can provide a more in-depth understanding of animal behavior and contribute to better animal welfare, production efficiency, and conservation efforts.
Publication Date: 2023-06-20 PubMed ID: 37420896PubMed Central: PMC10305307DOI: 10.3390/s23125732Google Scholar: Lookup
The Equine Research Bank provides access to a large database of publicly available scientific literature. Inclusion in the Research Bank does not imply endorsement of study methods or findings by Mad Barn.
- Journal Article
- Review
Summary
This research summary has been generated with artificial intelligence and may contain errors and omissions. Refer to the original study to confirm details provided. Submit correction.
This research review analyses how modern technologies like artificial intelligence and Internet of Things, which facilitate data collection through sensors, have been used in animal research. It categorizes and analyzes the application of sensor fusion algorithms in understanding animal behavior for improved welfare, productivity and conservation efforts.
Introduction
- The research study on hand is a specialized ‘scoping review’, focusing on the applications of the fields of artificial intelligence and the Internet of Things (IoT) in animal conservation.
- The primary technologies considered in the review are sensing devices enabled with AI and IoT, that can process large volumes of data to extract significant insights about animal behavior.
- The focus is on how these technologies are used to understand behaviors related to illness detection, interpreting the emotional state of animals, and even recognizing individual animals.
Methodology
- The study included English language articles published in a time frame of over a decade, from 2011 to 2022.
- Out of 263 gathered articles, only 23 met the set inclusion criteria and were chosen for detailed analysis.
Classification and Analysis of Sensor Fusion Algorithms
- The sensor fusion algorithms extracted from the eligible articles were categorized into three levels: Raw or low-level fusion (26%), Feature or medium-level fusion (39%), and Decision or high-level fusion (34%).
- The algorithms were majorly used for detection of posture and activity in animals with cows (32%) and horses (12%) being the main target species in the three levels of fusion.
- The accelerometer, a device that measures proper acceleration, was a common feature across all levels of fusion and data collection.
Conclusion and Future Scope
- The review concludes that the exploration of sensor fusion in animal research is still in its initial stage and is ripe for further exploration and development.
- There is a substantial potential for combining movement data with biometrics to develop comprehensive animal welfare applications.
- The integration of sensor fusion and machine learning algorithms can significantly enhance the understanding of animal behavior, leading to beneficial outcomes for animal welfare, increasing production efficiency, and bolstering conservation efforts.
Cite This Article
APA
Aguilar-Lazcano CA, Espinosa-Curiel IE, Ríos-Martínez JA, Madera-Ramírez FA, Pérez-Espinosa H.
(2023).
Machine Learning-Based Sensor Data Fusion for Animal Monitoring: Scoping Review.
Sensors (Basel), 23(12), 5732.
https://doi.org/10.3390/s23125732 Publication
Researcher Affiliations
- CICESE-UT3, Tepic 63173, Mexico.
- CICESE-UT3, Tepic 63173, Mexico.
- Computer Science Department, Faculty of Mathematics, Autonomous University of Yucatan, Merida 97000, Mexico.
- Computer Science Department, Faculty of Mathematics, Autonomous University of Yucatan, Merida 97000, Mexico.
- CICESE-UT3, Tepic 63173, Mexico.
MeSH Terms
- Female
- Cattle
- Animals
- Horses
- Artificial Intelligence
- Machine Learning
- Algorithms
- Movement
- Biometry
Conflict of Interest Statement
The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.
References
This article includes 54 references
- Allam Z, Dhunny ZA. On big data, artificial intelligence and smart cities. Cities 2019;89:80–91.
- Andronie M, Lăzăroiu G, Iatagan M, Uță C, Ștefănescu R, Cocoșatu M. Artificial Intelligence-Based Decision-Making Algorithms, Internet of Things Sensing Networks, and Deep Learning-Assisted Smart Process Management in Cyber-Physical Production Systems. Electronics 2021;10:2497.
- Chui KT, Lytras MD, Visvizi A. Energy Sustainability in Smart Cities: Artificial Intelligence, Smart Monitoring, and Optimization of Energy Consumption. Energies 2018;11:2869.
- Misra NN, Dixit Y, Al-Mallahi A, Bhullar MS, Upadhyay R, Martynenko A. IoT, Big Data, and Artificial Intelligence in Agriculture and Food Industry. IEEE Internet Things J 2022;9:6305–6324.
- Zhang Z, Wen F, Sun Z, Guo X, He T, Lee C. Artificial Intelligence-Enabled Sensing Technologies in the 5G/Internet of Things Era: From Virtual Reality/Augmented Reality to the Digital Twin. Adv. Intell. Syst. 2022;4:2100228.
- Cabezas J, Yubero R, Visitación B, Navarro-García J, Algar MJ, Cano EL, Ortega F. Analysis of Accelerometer and GPS Data for Cattle Behaviour Identification and Anomalous Events Detection.. Entropy (Basel) 2022 Feb 26;24(3).
- Kasnesis P, Doulgerakis V, Uzunidis D, Kogias DG, Funcia SI, González MB, Giannousis C, Patrikakis CZ. Deep Learning Empowered Wearable-Based Behavior Recognition for Search and Rescue Dogs.. Sensors (Basel) 2022 Jan 27;22(3).
- Castanedo F. A review of data fusion techniques.. ScientificWorldJournal 2013;2013:704504.
- Alberdi A, Aztiria A, Basarab A. Towards an automatic early stress recognition system for office environments based on multimodal measurements: A review.. J Biomed Inform 2016 Feb;59:49-75.
- Novak D, Riener R. A survey of sensor fusion methods in wearable robotics. Robot. Auton. Syst. 2015;73:155–170.
- Meng T, Jing X, Yan Z, Pedrycz W. A survey on machine learning for data fusion. Inf. Fusion 2020;57:115–129.
- Elmenreich W. An Introduction to Sensor Fusion. Vienna University of Technology; Vienna, Austria: 2002; pp. 1–28.
- Feng L, Zhao Y, Sun Y, Zhao W, Tang J. Action Recognition Using a Spatial-Temporal Network for Wild Felines.. Animals (Basel) 2021 Feb 12;11(2).
- Jin Z, Guo L, Shu H, Qi J, Li Y, Xu B, Zhang W, Wang K, Wang W. Behavior Classification and Analysis of Grazing Sheep on Pasture with Different Sward Surface Heights Using Machine Learning.. Animals (Basel) 2022 Jul 7;12(14).
- Kaler J, Mitsch J, Vázquez-Diosdado JA, Bollard N, Dottorini T, Ellis KA. Automated detection of lameness in sheep using machine learning approaches: novel insights into behavioural differences among lame and non-lame sheep.. R Soc Open Sci 2020 Jan;7(1):190824.
- Leoni J, Tanelli M, Strada SC, Berger-Wolf T. Data-Driven Collaborative Intelligent System for Automatic Activities Monitoring of Wild Animals. Proceedings of the 2020 IEEE International Conference on Human-Machine Systems (ICHMS); Rome, Italy. 7–9 September 2020; pp. 1–6.
- Neethirajan S. The role of sensors, big data and machine learning in modern animal farming. Sens. Bio-Sens. Res. 2020;29:100367.
- Fuentes S, Gonzalez Viejo C, Tongson E, Dunshea FR. The livestock farming digital transformation: implementation of new and emerging technologies using artificial intelligence.. Anim Health Res Rev 2022 Jun;23(1):59-71.
- Isabelle DA, Westerlund M. A Review and Categorization of Artificial Intelligence-Based Opportunities in Wildlife, Ocean and Land Conservation. Sustainability 2022;14:1979.
- Neethirajan S. Recent advances in wearable sensors for animal health management. Sens. Bio-Sens. Res. 2017;12:15–29.
- Stygar AH, Gómez Y, Berteselli GV, Dalla Costa E, Canali E, Niemi JK, Llonch P, Pastell M. A Systematic Review on Commercially Available and Validated Sensor Technologies for Welfare Assessment of Dairy Cattle.. Front Vet Sci 2021;8:634338.
- Yaseer A, Chen H. A Review of Sensors and Machine Learning in Animal Farming. Proceedings of the 2021 IEEE 11th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER); Jiaxing, China. 27–31 July 2021; pp. 747–752.
- Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, Moher D, Peters MDJ, Horsley T, Weeks L, Hempel S, Akl EA, Chang C, McGowan J, Stewart L, Hartling L, Aldcroft A, Wilson MG, Garritty C, Lewin S, Godfrey CM, Macdonald MT, Langlois EV, Soares-Weiser K, Moriarty J, Clifford T, Tunçalp Ö, Straus SE. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation.. Ann Intern Med 2018 Oct 2;169(7):467-473.
- Kmet L, Lee R, Cook L. Standard Quality Assessment Criteria for Evaluating Primary Research Papers from a Variety of Fields. Institute of Health Economics; Dhaka, Bangladesh: 2004.
- Goodfellow I, Bengio Y, Courville A. Deep Learning. MIT Press; Cambridge, MA, USA: 2016.
- Ray S. A Quick Review of Machine Learning Algorithms. Proceedings of the 2019 International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COMITCon); Faridabad, India. 14–16 February 2019; pp. 35–39.
- Aich S, Chakraborty S, Sim JS, Jang DJ, Kim HC. The Design of an Automated System for the Analysis of the Activity and Emotional Patterns of Dogs with Wearable Sensors Using Machine Learning. Appl. Sci. 2019;9:4938.
- Arablouei R, Wang Z, Bishop-Hurley GJ, Liu J. Multimodal sensor data fusion for in-situ classification of animal behavior using accelerometry and GNSS data. arXiv 2022.
- Bocaj E, Uzunidis D, Kasnesis P, Patrikakis CZ. On the Benefits of Deep Convolutional Neural Networks on Animal Activity Recognition. Proceedings of the 2020 International Conference on Smart Systems and Technologies (SST); Osijek, Croatia. 14–16 October 2020; pp. 83–88.
- Byabazaire J, Olariu C, Taneja M, Davy A. Lameness Detection as a Service: Application of Machine Learning to an Internet of Cattle. Proceedings of the 2019 16th IEEE Annual Consumer Communications & Networking Conference (CCNC); Las Vegas, NV, USA. 11–14 January 2019; pp. 1–6.
- Corcoran E, Denman S, Hanger J, Wilson B, Hamilton G. Automated detection of koalas using low-level aerial surveillance and machine learning.. Sci Rep 2019 Mar 1;9(1):3208.
- Dziak D, Gradolewski D, Witkowski S, Kaniecki D, Jaworski A, Skakuj M, Kulesza WJ. Airport Wildlife Hazard Management System. Elektron. Ir Elektrotechnika 2022;28:45–53.
- Hou J, Strand-Amundsen R, Tronstad C, Høgetveit JO, Martinsen ØG, Tønnessen TI. Automatic Prediction of Ischemia-Reperfusion Injury of Small Intestine Using Convolutional Neural Networks: A Pilot Study.. Sensors (Basel) 2021 Oct 8;21(19).
- Huang K, Li C, Zhang J, Wang B. Cascade and Fusion: A Deep Learning Approach for Camouflaged Object Sensing.. Sensors (Basel) 2021 Aug 13;21(16).
- Luo Y, Zeng Z, Lu H, Lv E. Posture Detection of Individual Pigs Based on Lightweight Convolution Neural Networks and Efficient Channel-Wise Attention.. Sensors (Basel) 2021 Dec 15;21(24).
- Mao A, Huang E, Gan H, Parkes RSV, Xu W, Liu K. Cross-Modality Interaction Network for Equine Activity Recognition Using Imbalanced Multi-Modal Data.. Sensors (Basel) 2021 Aug 29;21(17).
- Rahman A, Smith DV, Little B, Ingham AB, Greenwood PL, Bishop-Hurley GJ. Cattle behaviour classification from collar, halter, and ear tag sensors. Inf. Process. Agric. 2018;5:124–133.
- Ren K, Bernes G, Hetta M, Karlsson J. Tracking and analysing social interactions in dairy cattle with real-time locating system and machine learning. J. Syst. Archit. 2021;116:102139.
- Rios-Navarro A, Dominguez-Morales JP, Tapiador-Morales R, Dominguez-Morales M, Jimenez-Fernandez A, Linares-Barranco A. A Sensor Fusion Horse Gait Classification by a Spiking Neural Network on SpiNNaker. In: Villa AEP, Masulli P, Pons Rivero AJ, editors. Proceedings of the Artificial Neural Networks and Machine Learning—ICANN 2016, Barcelona, Spain, 6–9 September 2016. Springer International Publishing; Cham, Switzerland: 2016. pp. 36–44.
- Schmeling L, Elmamooz G, Hoang PT, Kozar A, Nicklas D, Sünkel M, Thurner S, Rauch E. Training and Validating a Machine Learning Model for the Sensor-Based Monitoring of Lying Behavior in Dairy Cows on Pasture and in the Barn.. Animals (Basel) 2021 Sep 10;11(9).
- Sturm V, Efrosinin D, Öhlschuster M, Gusterer E, Drillich M, Iwersen M. Combination of Sensor Data and Health Monitoring for Early Detection of Subclinical Ketosis in Dairy Cows.. Sensors (Basel) 2020 Mar 8;20(5).
- Tian F, Wang J, Xiong B, Jiang L, Song Z, Li F. Real-Time Behavioral Recognition in Dairy Cows Based on Geomagnetism and Acceleration Information. IEEE Access 2021;9:109497–109509.
- Wang G, Muhammad A, Liu C, Du L, Li D. Automatic Recognition of Fish Behavior with a Fusion of RGB and Optical Flow Data Based on Deep Learning.. Animals (Basel) 2021 Sep 23;11(10).
- Xu H, Li S, Lee C, Ni W, Abbott D, Johnson M, Lea JM, Yuan J, Campbell DLM. Analysis of Cattle Social Transitional Behaviour: Attraction and Repulsion.. Sensors (Basel) 2020 Sep 18;20(18).
- Schollaert Uz S, Ames TJ, Memarsadeghi N, McDonnell SM, Blough NV, Mehta AV, McKay JR. Supporting Aquaculture in the Chesapeake Bay Using Artificial Intelligence to Detect Poor Water Quality with Remote Sensing. Proceedings of the IGARSS 2020—2020 IEEE International Geoscience and Remote Sensing Symposium; Waikoloa, HI, USA. 26 September–2 October 2020; pp. 3629–3632.
- de Chaumont F, Ey E, Torquet N, Lagache T, Dallongeville S, Imbert A, Legou T, Le Sourd AM, Faure P, Bourgeron T, Olivo-Marin JC. Real-time analysis of the behaviour of groups of mice via a depth-sensing camera and machine learning.. Nat Biomed Eng 2019 Nov;3(11):930-942.
- Narayanaswami R, Gandhe A, Tyurina A, Mehra RK. Sensor fusion and feature-based human/animal classification for Unattended Ground Sensors. Proceedings of the 2010 IEEE International Conference on Technologies for Homeland Security (HST); Waltham, MA, USA. 8–10 November 2010; pp. 344–350.
- Dick S, Bracho CC. Learning to Detect the Onset of Disease in Cattle from Feedlot Watering Behavior. Proceedings of the NAFIPS 2007—2007 Annual Meeting of the North American Fuzzy Information Processing Society; San Diego, CA. 24–27 June 2007; pp. 112–116.
- Roberts PLD, Jaffe JS, Trivedi MM. Multiview, Broadband Acoustic Classification of Marine Fish: A Machine Learning Framework and Comparative Analysis. IEEE J. Ocean. Eng. 2011;36:90–104.
- Jin X, Gupta S, Ray A, Damarla T. Multimodal sensor fusion for personnel detection. Proceedings of the 14th International Conference on Information Fusion; Chicago, IL, USA. 5–8 July 2011; pp. 1–8.
- Tian Q, Xia S, Cao M, Cheng K. Reliable Sensing Data Fusion Through Robust Multiview Prototype Learning. IEEE Trans. Ind. Inform. 2022;18:2665–2673.
- Jukan A, Masip-Bruin X, Amla N. Smart Computing and Sensing Technologies for Animal Welfare: A Systematic Review. ACM Comput. Surv. 2017;50:1–27.
- Tuia D, Kellenberger B, Beery S, Costelloe BR, Zuffi S, Risse B, Mathis A, Mathis MW, van Langevelde F, Burghardt T, Kays R, Klinck H, Wikelski M, Couzin ID, van Horn G, Crofoot MC, Stewart CV, Berger-Wolf T. Perspectives in machine learning for wildlife conservation.. Nat Commun 2022 Feb 9;13(1):792.
- Asmare B. A Review of Sensor Technologies Applicable for Domestic Livestock Production and Health Management. Adv. Agric. 2022;2022:e1599190.
Citations
This article has been cited 11 times.- Condotta ICFS, Tedeschi LO. ASAS-NANP Symposium: Mathematical modeling in animal nutrition: revolutionizing animal farming with artificial intelligence: trends, challenges, and opportunities. J Anim Sci 2026 Jan 8;104.
- Jobarteh B, Mincu-Iorga M, Gavojdian D, Neethirajan S. Integrating multi-modal data fusion approaches for analysis of dairy cattle vocalizations. Front Vet Sci 2025;12:1704031.
- Hashimoto Y, Zin TT, Tin P, Kobayashi I, Hama H. Generating Accurate Activity Patterns for Cattle Farm Management Using MCMC Simulation of Multiple-Sensor Data System. Sensors (Basel) 2025 Nov 5;25(21).
- Raza A, Hanif F, Mohammed HA. Analyzing the enhancement of CNN-YOLO and transformer based architectures for real-time animal detection in complex ecological environments. Sci Rep 2025 Nov 7;15(1):39142.
- Li G, Komi S, Sorensen JF, Berg RW. A Real-Time Vision-Based Adaptive Follow Treadmill for Animal Gait Analysis. Sensors (Basel) 2025 Jul 9;25(14).
- Liao S, Shu Y, Tian F, Zhou Y, Li G, Zhang C, Yao C, Wang Z, Che L. Multi-Modality Sheep Face Recognition Based on Deep Learning. Animals (Basel) 2025 Apr 11;15(8).
- Gao G, Ma Y, Wang J, Li Z, Wang Y, Bai H. CFR-YOLO: A Novel Cow Face Detection Network Based on YOLOv7 Improvement. Sensors (Basel) 2025 Feb 11;25(4).
- Janitri V, ArulJothi KN, Ravi Mythili VM, Singh SK, Prasher P, Gupta G, Dua K, Hanumanthappa R, Karthikeyan K, Anand K. The roles of patient-derived xenograft models and artificial intelligence toward precision medicine. MedComm (2020) 2024 Oct;5(10):e745.
- Sadrzadeh N, Foris B, Krahn J, von Keyserlingk MAG, Weary DM. Automated monitoring of brush use in dairy cattle. PLoS One 2024;19(6):e0305671.
- Imada J, Arango-Sabogal JC, Bauman C, Roche S, Kelton D. Comparison of Machine Learning Tree-Based Algorithms to Predict Future Paratuberculosis ELISA Results Using Repeat Milk Tests. Animals (Basel) 2024 Apr 5;14(7).
- Hu S, Reverter A, Arablouei R, Bishop-Hurley G, McNally J, Alvarenga F, Ingham A. Analyzing Cattle Activity Patterns with Ear Tag Accelerometer Data. Animals (Basel) 2024 Jan 18;14(2).
Use Nutrition Calculator
Check if your horse's diet meets their nutrition requirements with our easy-to-use tool Check your horse's diet with our easy-to-use tool
Talk to a Nutritionist
Discuss your horse's feeding plan with our experts over a free phone consultation Discuss your horse's diet over a phone consultation
Submit Diet Evaluation
Get a customized feeding plan for your horse formulated by our equine nutritionists Get a custom feeding plan formulated by our nutritionists