Learning Bayesian Statistics

Alexandre Andorra

Are you a researcher or data scientist / analyst / ninja? Do you want to learn Bayesian inference, stay up to date or simply want to understand what Bayesian inference is? Then this podcast is for you! You'll hear from researchers and practitioners of all fields about how they use Bayesian statistics, and how in turn YOU can apply these methods in your modeling workflow. When I started learning Bayesian methods, I really wished there were a podcast out there that could introduce me to the methods, the projects and the people who make all that possible. So I created "Learning Bayesian Statistics", where you'll get to hear how Bayesian statistics are used to detect black matter in outer space, forecast elections or understand how diseases spread and can ultimately be stopped. But this show is not only about successes -- it's also about failures, because that's how we learn best. So you'll often hear the guests talking about what *didn't* work in their projects, why, and how they overcame these challenges. Because, in the end, we're all lifelong learners! My name is Alex Andorra by the way. By day, I'm a Senior data scientist. By night, I don't (yet) fight crime, but I'm an open-source enthusiast and core contributor to the python packages PyMC and ArviZ. I also love Nutella, but I don't like talking about it – I prefer eating it. So, whether you want to learn Bayesian statistics or hear about the latest libraries, books and applications, this podcast is for you -- just subscribe! You can also support the show and unlock exclusive Bayesian swag on Patreon!

  1. 3d ago

    #169 Bayesian Workflow for Beginners, Alex at Princeton

    Support & Resources → Support the show on Patreon → Bayesian Modeling Course (first 2 lessons free) Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work! Takeaways: Q: What does a mixed model in psychology actually assume? A: Written as a generative story, a standard repeated-measures model says participants are drawn from a shared population, each has one latent ability that stays stable across sessions, a condition effect shifts everyone by the same amount, and trials within a session are independent. Each of those is testable and can be wrong: abilities drift between sessions, some participants react more to a hard condition than others (an interaction), and performance can be autocorrelated, the way a tennis player losing several points in a row starts getting in their own head. Frequentist software like lme4 makes these assumptions silently; writing the model in PyMC puts them in the open. Q: What is the generative story of a model and why does it matter? A: The generative story is a description of how the data you observe came to be. In a typical psychology experiment: a population of people, participants drawn from it, several sessions per participant, and several trials per session. That nesting already tells you the model needs a hierarchy. In the Bayesian workflow, you build the model by translating that story line by line into distributions, which is why you can write the whole model before seeing any data, and why the model can simulate data on its own. Q: Should you start with a complex model or a simple one? A: Start with the simplest, dumbest model you can find. A complex model that doesn't sample is very hard to debug, while a simple model that samples well gives you a base to add one layer of complexity at a time. Likewise, don't start with interactions: fit the main effects first, and if one comes out with a very large posterior mean or a very wide posterior, that can be a sign an interaction is missing (unless there's a difference of scale in the data), especially in the social sciences where effects are usually modest. Full takeaways here! Chapters: 02:45 What assumptions hide under the hood of the mixed models psychologists fit? 05:58 What does Bayes' theorem say about updating your beliefs with data? 09:14 What is the generative story of your data and how does it become a model? 11:59 How do lme4, brms and PyMC express the same mixed model?15:02 How does a hierarchical model encode participants and their population? 18:03 Which hidden assumptions does a standard mixed model make? 27:17 What is a prior predictive check and why are default priors like Normal(0, 10) risky? 36:39 How do you read posterior distributions and credible intervals?40:53 What is partial pooling and why do hierarchical models shrink extreme participants? 46:02 How do you check whether a Bayesian model is well calibrated?52:20 How can an AI agent skill help you run the Bayesian workflow? Thank you to my Patrons for making this episode possible! Full links from the show here.

    #169 Bayesian Workflow for Beginners, Alex at Princeton
  2. Nov 4

    #168 Speech Perception & Multilevel Models, with Santiago Barreda

    Support & Resources → Support the show on Patreon → Bayesian Modeling Course (first 2 lessons free) Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work! Takeaways: Q: Why would a linguist switch from lme4 to Bayesian multilevel models? A: For Santiago, it was purely practical. Mixed-effects models fit with lme4 kept failing to converge, and they couldn't handle the complex repeated-measures structures his experiments needed. His friend Noah Silbert got him into Bayesian modeling around 2015, and only afterwards did he realize he agreed with the philosophy too. His analogy: the frequentist toolbox is a furniture store, and if it doesn't sell the bed you need, you settle for the nearest one; Bayesian modeling teaches you carpentry, so the model can match what you believe is going on in your data instead of squeezing the data into a standard structure. Q: Why teach Bayesian multilevel models before t-tests and ANOVA? A: Because in linguistics essentially all data are repeated measures: listeners judge hundreds of trials, and speakers produce many tokens. Yet students traditionally spend a year or more on one-sample t-tests, paired t-tests and ANOVAs they will never use in their own research. Santiago's book jumps straight to the multilevel version of the simplest case, a one-group model with many observations per listener, which he finds no harder to grasp than a t-test since there are no reference distributions or degrees of freedom to explain. Q: Do Bayesian and frequentist analyses give different results on typical phonetics data? A: With analogous models, largely no, at least with the amount of data phonetics experiments usually have. That's why the early chapters of Santiago's book end with a comparison to the equivalent frequentist analysis, to reassure readers. His rule of thumb: if you get dramatically different results, something has probably gone wrong. The gain from going Bayesian is not different point estimates, but models that actually converge, flexible error distributions and model structures, and much richer information about the so-called random effects, which in speech research describe how listeners vary within a speech community. Full takeaways here! Chapters: 09:09 Why did Santiago switch from lme4 to Bayesian multilevel models? 11:50 Why is Bayesian modeling like learning carpentry instead of shopping at IKEA? 18:10 How does Santiago's book differ from classic Bayesian textbooks? 21:11 Why do so many students wrongly decide they're bad at math? 24:01 Why is learning statistics more like learning the piano than memorizing facts? 29:53 What do listeners infer about a speaker from their voice, and why are they wrong in predictable ways? 43:59 How is vowel normalization like judging an object's size at a distance? 49:19 How do animals use their calls to signal body size? 56:15 Can we predict how accents and languages will change? 01:00:15 Why did Latin die, and what counts as a separate language? 01:07:28 What is Santiago working on next? Thank you to my Patrons for making this episode possible! Full links from the show here.

    #168 Speech Perception & Multilevel Models, with Santiago Barreda
  3. Oct 28 ·  Bonus

    How I built Learn Bayes Stats to the Top 1.5%

    This one is a bonus episode, where I was the guest, on a podcast called One Thing That Worked! Get all the insights and takeaways here. In the meantime, here is how they described it: In this insightful episode of One Thing That Worked, my guest is Alex Andorra, host of Learning Bayesian Statistics Podcast. Alex reveals how he built a top-tier show that ranks among the top 1.5% of podcasts globally out of nearly 4 million shows. Discover how Alex leveraged "The Selfish Method"—creating the exact show he needed for his own career growth—to attract a hyper-dedicated audience of technical experts. We explore his core podcast growth strategy, focusing on a specialized niche and publishing biweekly episodes like clockwork since 2019. Alex also opens up about podcast revenue, handling podcast sponsors, and funding operations via Patreon while keeping the content independent. In this conversation, we break down the power of relentless consistency, the value of solving your own problems, and why learning through public failure is a superpower for creators looking to master podcasting and build an engaged community. Chapters 0:00 - Intro 01:25 - About Learning Bayesian Statistics Podcast 05:35 - What Bayesian Statistics Is 08:44 - The Main Thing That Worked 11:03 - Building Network & Community 13:23 - Monetizing The Show 16:17 - Main Lessons from Alex Hope you like it, my dear Bayesians! As usual, you can support the show on Patreon, and reach out to me with fun ideas 🖖

    How I built Learn Bayes Stats to the Top 1.5%
  4. Oct 20

    #167 Amortized Inference & GPUs for Stan, with Paul-Christian Bürkner & Steve Bronder

    Support & Resources → Support the show on Patreon → Bayesian Modeling Course (first 2 lessons free) Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work! Takeaways: Q: What is amortized Bayesian inference and how does it differ from MCMC? Instead of running MCMC on each dataset, you train neural networks on data simulated from the model, so you don't need likelihood or prior densities. Once training is done, inference on a new dataset is essentially instant: new data in, posterior out. The price is everything neural networks bring with them, from unstable training to a lack of guarantees. Paul's stated goal is to make these methods as reliable and robust as MCMC while staying orders of magnitude faster, and he's candid that he doesn't know whether the field will ever get there. Q: Why would a Bayesian model not have a usable likelihood? A: Usually not because the likelihood can't be written down in principle, but because computing it is so expensive or numerically unstable that it's intractable in practice. Paul gives two cases. First, mechanistic models built on complicated differential equations, as in physical chemistry or biology, where you can't solve through the equations to get densities and gradients in a stable, fast way. Second, big latent variable models with thousands of latent variables between the parameters and the data, where marginalizing them out is hopeless. In both cases, simulating from the model is easy: simulate the parameters, the latents and the data, throw the latents away, and learn the relation between parameters and data from the simulations. Full takeaways here! Chapters: 15:33 What is amortized Bayesian inference and when should you use it instead of MCMC? 23:18 Why would a Bayesian model not have a usable likelihood? 26:03 What's holding back GPU computing in Stan? 31:14 What are sum-to-zero constraints and why do they make models sample faster? 35:55 What is a Jacobian adjustment in Bayesian statistics? 39:17 How do you diagnose failures in amortized Bayesian inference? 42:01 What is leave-one-group-out cross-validation for hierarchical models? 45:57 Do undertrained neural posteriors overestimate or underestimate uncertainty? 49:06 How do Stan developers use AI tools in their work? 55:47 Should Stan and brms hide the inference algorithm from users? Thank you to my Patrons for making this episode possible! Full links from the show here!

    #167 Amortized Inference & GPUs for Stan, with Paul-Christian Bürkner & Steve Bronder

Trailers

4.7
out of 5
71 Ratings

About

Are you a researcher or data scientist / analyst / ninja? Do you want to learn Bayesian inference, stay up to date or simply want to understand what Bayesian inference is? Then this podcast is for you! You'll hear from researchers and practitioners of all fields about how they use Bayesian statistics, and how in turn YOU can apply these methods in your modeling workflow. When I started learning Bayesian methods, I really wished there were a podcast out there that could introduce me to the methods, the projects and the people who make all that possible. So I created "Learning Bayesian Statistics", where you'll get to hear how Bayesian statistics are used to detect black matter in outer space, forecast elections or understand how diseases spread and can ultimately be stopped. But this show is not only about successes -- it's also about failures, because that's how we learn best. So you'll often hear the guests talking about what *didn't* work in their projects, why, and how they overcame these challenges. Because, in the end, we're all lifelong learners! My name is Alex Andorra by the way. By day, I'm a Senior data scientist. By night, I don't (yet) fight crime, but I'm an open-source enthusiast and core contributor to the python packages PyMC and ArviZ. I also love Nutella, but I don't like talking about it – I prefer eating it. So, whether you want to learn Bayesian statistics or hear about the latest libraries, books and applications, this podcast is for you -- just subscribe! You can also support the show and unlock exclusive Bayesian swag on Patreon!

You Might Also Like