Study design synopsis: Battle in the stable: Bayesianism versus Frequentism.
- Editorial
- Review
- Analytical Methods
- Animal Science
- Animal Studies
- Bayesian Analysis
- Clinical Study
- Comparative Study
- Diagnosis
- Diagnostic Technique
- Disease Diagnosis
- Epidemiology
- Equine Diseases
- Equine Health
- Equine Science
- Statistical Analysis
- Veterinary Care
- Veterinary Medicine
- Veterinary Practice
- Veterinary Procedure
- Veterinary Research
Summary
This research article explores the contrasting statistical methods of frequentism and Bayesianism, particularly their application in analyzing complex, high-dimensional models in scientific research settings, using examples from equine veterinary medicine.
Principal Distinctions Between Bayesianism and Frequentism
The article initially distinguishes between the two prevalent statistical methods, Bayesianism and frequentism. These methods serve different purposes in statistical inferences and analyses:
- Frequentism relies on long-term frequencies and assumes probabilities as objective, fixed quantities that reflect the frequency of events.
- Bayesianism, on the other hand, treats probabilities as subjective belief or knowledge about uncertain events that are updated as new evidence becomes available.
Bayesian Statistical Reasoning
After establishing the key differences, the paper delves into the Bayesian statistical reasoning process, particularly as it applies within a research setting.
- The process starts with prior belief about the probability of an event, known as the prior distribution.
- New data are invoked to update these prior beliefs, leading to the so-called posterior distribution which reflects updated knowledge about the event.
- The article illuminates this intricate process through “toy” examples sourced from the field of equine veterinary medicine. The examples help simplify and illustrate the Bayesian process for readers.
Extension to Complex Models
The author then shows how the Bayesian approach can be extended to more intricate models, such as Bayes network.
- Bayes networks are a sophisticated kind of model that uses a graphical approach to display relationships among several variables.
- The extension is an attempt to clarify possible misconceptions and showcase how the Bayesian approach can be effective in handling highly dimensional models.
Concluding Guidelines
The article concludes by providing guidelines to help researchers apply these principles in their work. This serves to help readers to better understand the two different statistical methods and to assist them when choosing between them for conducting their research.
Cite This Article
Publication
Researcher Affiliations
- Farah - Productions durables, Universtity of Liege, Liege, Belgium.
MeSH Terms
- Animals
- Bayes Theorem
- Horses
- Research Design
References
- Sprenger J, Hartmann S. Bayesian philosophy of science. New York: Oxford University Press; 2019.
- VanderPlas J. Frequentism and Bayesianism: a Python-driven primer. Proc of the 13th Python conference in Science; 2014. Available from https://arxiv.org/abs/1411.5018
- Littell RC, Milliken GA, Stroup WW, Wolfinger RD, Schabenberger O. SAS for mixed models, 2nd edn. North Carolina: SAS Press, Cary; 2006.
- Wasserstein RL, Lazar NA. The ASA's statement on p-values: context, process, and purpose. Am. Stat. 2016;70:129-33.
- Hoeskra R, Morey RD, Rouder JN, Wagenmakers EJ. Robust misinterpretation of confidence intervals. Psychon. Bull. Rev. 2014;21:1157-64.
- Stone JV. Bayes' rule: A tutorial introduction to Bayesian analysis. England: Sebtel Press, Sheffield; 2013.
- McCue ME, Ribeiro WP, Valberg SJ. Prevalence of polysaccharide storage myopathy in horses with neuromuscular disorders. Equine Vet. J. 2006;36:340-4.
- Robert C, Younes M, Borgetto B, Barrey E. Standardized exercise test in young endurance horses. Equine Vet. J. 2014;46:S46.
- Green PJ, Latuszynski K, Pereyra M, Robert CP. Bayesian computation: a summary of the current state, and samples backwards and forwards. Stat. Comput. 2015;25:835-62.
- Geman S, Geman D. Stochastic relaxation, Gibbs distribution and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell. 1984;6:721-41.
- swMATH database. 2020 [cited 2020 July 01]. Available from http://www.swmath.org/?term=Gibbs%20sampling
- Lunn D, Spiegelhalter D, Thomas A, Best N. The BUGS project: Evolution, critique and future directions. Stat. Med. 2009;28:3049-67.
- Plummer M. JAGS: a program for analysis of Bayesian graphical models using Gibbs Sampling. Proc 3rd Int Workshop on Distributed Statistical Computing, Vienna, Austria 2003.
- Carpenter B, Gelman A, Hoffman M, Lee D, Goodrich B, Betancourt M. Stan: a probabilistic programming language. J. Stat. Softw. 2017;76:1-32.
- Morey RD, Rouder JN, Jamil T, Urbanek S, Forner K, Ly A. BayesFactor: Computation of Bayes Factors for common designs. 2018 [cited 2020 July 05]. Available from https://CRAN.R-project.org/package=BayesFactor
- Robert C, Casella G. Introducing Monte Carlo methods with R. New York, NY: Springer Science Business Media, LLC; 2010.
- Gelman A, Simpson D, Betancourt M. The prior can often only be understood in the context of the likelihood. Entropy 2017;19:555-68.
- Banner KM, Irvine KM, Rodhouse TJ. The use of Bayesian priors in Ecology: the good, the bad and the not great. Methods Ecol. Evol. 2020;11:882-9.
- de Godoi FN, Bergmann JA, Almeida FQ, Toral FL, Miranda AL. Probability of jumping success of young Brazilian sport horses assessed via kinematic analysis. Equine Vet. J. 2014;46(Suppl. 46):40.
- de Godoi FN, Toral FLB, de Miranda ALS, de Menzel HJK, Almeida FQ, Bergmann JAG. Kinematic and morphological traits and the probability of successful jumps of young Brazilian Sport Horses. Livest. Sci. 2016;185:8-16.
- Yang R, Berger J. A catalog of noninformative priors. Purdue University; 1998. Available from http://www.stats.org.uk/priors/noninformative/YangBerger1998.pdf
- Messam LLM, Branscum AJ, Collins MT, Gardner IA. Frequentist and Bayesian approaches to prevalence estimation using examples from Johne's disease. Anim. Health Res. Rev. 2008;9:1-23.
- Salem SE, El-Ghany AM, Hamad MH, Abdelaal AM, Elsheik HA, Hamid AA. Prevalence of gastrointestinal nematodes, parasite control practices and anthelmintic resistance patterns in a working horse population in Egypt. Equine Vet J. 2021;53:339-48.
- Roy V. Convergence diagnostics for Markov chain Monte Carlo. Annu. Rev. Stat. Appl. 2020;7:387-412.
- Liu J, Wong WH, Kong A. Correlation structure and convergence rate of the Gibbs sampler with various scans. J. R. Stat. Soc. Series B. Stat. Methodol. 1995;57:157-69.
- Vatcheva KV, Lee MJ, McCormick JB, Rahbar MH. Multicollinearity in regression analyses conducted in epidemiologic studies. Epidemiology (Sunnyvale) 2016;6:227.
- Ngk-Tsague G. Using Bayesian Networks to model hierarchical relationships in epidemiological studies. Epidemiol. Health. 2011;33:e2011006.
- Pearl J. Probabilistic reasoning in intelligent systems: networks of plausible inference. Morgan Kaufmann, San Mateo: California; 1988.
- Reid SW, Mair TS, Hillyer MH, Love S. Epidemiological risk factors associated with a diagnosis of clinical cyathostomiasis in the horse. Equine Vet. J. 1995;27:127-30.
- Rendle D, Auston C, Bowen M, Cameron I, Furtado T, Hodgkinson J. Equine de-worming: a consensus on current best practice. UK-Vet Equine 2019;3(Sup1):1-14.
- Conrady S, Jouffe L. Introduction to Bayesian networks and bayesiaLab. USA: Bayesia; 2013.
- Netica. Application for belief networks and influence diagrams. Norsys Software Corp; 1997. Available from https://www.norsys.com/downloads/NeticaMan_Win_105.pdf
- Elster C, Klauenberg K, Walzel M, Wubbeler G, Harris P, Cox M. A guide to Bayesian inference for regression problems. 2015.
- van Doorn J, van den Bergh D, Bohm U, Dablander F, Derks K, Draws T. The JASP guidelines for conducting and reporting a Bayesian analysis. PsyArxiv Preprint 2019.