The Behavioral Data Science Podcast

David J. Cox & Jacob Sosine

A podcast for those interested in what's going on at the intersection of behavior science and data science.

  1. 9月6日

    Episode 024: Are we in an AI bubble?

    "Bubbles" are an economic phenomenon characterized by a rapid increase in asset prices that far exceed the asset's underlying fundamental value, driven by speculative buying and herd behavior rather than intrinsic worth. In this episode, Jake and David ask, "Are we in an AI bubble?". And, if so, what might this mean for both individuals and organizations as they navigate the current AI strategic landscape?

    1 小时 7 分钟

  2. 8月31日

    Episode 023: Your Brain on LLMs

    In this episode, Jake and David discuss the burgeoning area of research looking at how interacting with LLMs impacts our skills and abilities in good and bad ways. As with most things in life, the effects are not black-and-white. And, we discuss strategies and tactics we can all engage in to try to get the benefits without the drawbacks.

    1 小时 14 分钟

  3. 8月9日

    Episode 022: The Ethics of LLMs that Few Talk About

    Conversations around AI ethics often focus on a suite of incredibly important topics such as data security and privacy, model bias, model transparency, and explainability. However, each time we use large AI models (e.g., diffusion models, LLMs), we reinforce a host of additional potentially unethical practices that are needed to build and maintain these systems. In this episode, Jake and David discuss some of these unsavory topics, such as human labor costs and environmental impact. Although it's a bit of a downer, it's crucial for each of us to acknowledge how our behavior impacts the larger ecosystem and recognize our role in perpetuating these practices.

    1 小时 11 分钟

  4. 8月3日

    Episode 021: Explainable AI and LLMs

    "Explainable AI", aka XAI, refers to a suite of techniques to help AI system developers and AI system users understand why inputs to the system resulted in the observed outputs. Industries such as healthcare, education, and finance require that any system using mathematical models or algorithms to influence the lives of others is transparent and explainable. In this episode, Jake and David review what XAI is, classical techniques in XAI, and the burgeoning area of XAI techniques specific to LLM-driven systems.

    1 小时 13 分钟
  5. Episode 020: Evidence-Based Practices for Prompt Engineering

    7月20日

    Episode 020: Evidence-Based Practices for Prompt Engineering

    Prompt engineering involves a lot more than simply getting smarter with how you structure the prompts you enter in an LLM browser interface. Furthermore, a growing body of peer-reviewed research provides us with best practices to improve the accuracy and reliability of LLM outputs for the specific tasks we build systems around. In this episode, Jake and David review evidence-based best practices for prompt engineering and, importantly, highlight what proper prompt engineering requires such that most of us likely cannot call ourselves prompt engineers.

    1 小时 8 分钟

  6. 7月6日

    Episode 019: LLM Evaluation Frameworks

    Lots of people like to talk about the importance of prompts, context, and what is sent to an LLM. Few discuss the even more important aspect of an LLM-driven system in evaluating its output. In this episode, we discuss traditional and modern metrics used to evaluate LLM outputs. And, we review the common frameworks for obtaining that feedback. Though evals are a lot of work (and easy to do poorly), those building (or buying) LLM-driven systems should be transparent about their process and the current state of their eval framework.

    1 小时 28 分钟

  7. 6月29日

    Episode 018: Data Privacy and Security Considerations When Working with LLMs

    Jake and David chat about best practices and considerations for those building and using AI systems that leverage LLMs.

    1 小时 12 分钟

  8. 6月22日

    Episode 017 - Demystifying how GenAI Works

    Jake and David chat about types of GenAI, and specifically how LLMs work—from input text or audio through the output you read.

    1 小时 1 分钟
查看全部 24 集

关于

A podcast for those interested in what's going on at the intersection of behavior science and data science.

信息