AI Safety - Paper Digest

Arian Abbasi, Alan Aqrawi

The podcast where we break down the latest research and developments in AI Safety - so you don’t have to. Each episode, we take a deep dive into new cutting-edge papers. Whether you’re an expert or just AI-curious, we make complex ideas accessible, engaging, and relevant. Stay ahead of the curve with AI Security Papers. Disclaimer: This podcast and its content are generated by AI. While every effort is made to ensure accuracy, please verify all information independently.

  1. 12/10/2025

    AI Agents: Adoption and Usage | Perplexity Comet

    Dive into the key findings of the first large-scale field study on the adoption, usage intensity, and use cases of general-purpose AI agents, drawing on hundreds of millions of anonymized user interactions with Perplexity’s Comet Assistant. This paper tracks the frontier shift from conversational LLM chatbots to action-oriented AI agents, which are defined as AI assistants capable of autonomously pursuing user-defined goals by planning and executing multi-step actions. Key insights from the paper include: Who is Adopting: Adopters are concentrated in digital or knowledge-intensive sectors, with Digital Technology representing the largest occupational cluster. Adoption and usage intensity show strong positive correlations with higher GDP per capita and educational attainment.What They Are Doing: Agent use cases are highly focused: Productivity & Workflow (36%) and Learning & Research (21%) collectively account for 57% of all agentic queries. The most prevalent tasks include assisting exercises and summarizing/analyzing research information.Implications: The diffusion of these increasingly capable AI agents carries important implications for researchers, businesses, policymakers, and educators.

    5 min
  2. WEF & Accenture | Advancing Responsible AI Innovation: A Playbook

    09/25/2025 · BONUS

    WEF & Accenture | Advancing Responsible AI Innovation: A Playbook

    This episode of the AI Safety Paper Digest is about the World Economic Forum's new playbook on advancing responsible AI innovation. In cooperation with Accenture, the report provides a practical roadmap for turning responsible AI from an aspiration into a competitive advantage while building public trust. Link to the Report: https://www.weforum.org/publications/advancing-responsible-ai-innovation-a-playbook/ Disclaimer: This summary was generated with the assistance of Google’s NotebookLM AI. For full technical details and comprehensive findings, please consult the original report.

    2 min
  3. Okay Waymo, Crash My Car! 🗣️ Testing Autonomous Vehicle Safety with Adversarial Driving Scenarios | LD-Scene

    08/20/2025

    Okay Waymo, Crash My Car! 🗣️ Testing Autonomous Vehicle Safety with Adversarial Driving Scenarios | LD-Scene

    How can we make autonomous driving systems safer through generative AI? In this episode, we explore LD-Scene, a novel framework that combines Large Language Models (LLMs) with Latent Diffusion Models (LDMs) to create controllable, safety-critical driving scenarios. These adversarial scenarios are essential for evaluating and stress-testing autonomous vehicles, yet they’re extremely rare in real-world data. Sources referenced in this episode: Mingxing Peng, Yuting Xie, Xusen Guo, Ruoyu Yao, Hai Yang, Jun Ma: “LD-Scene: LLM-Guided Diffusion for Controllable Generation of Adversarial Safety-Critical Driving Scenarios” Disclaimer: This podcast summary was generated with the assistance of Google’s NotebookLM AI. For full technical details and comprehensive findings, please consult the original research paper.

    18 min
  4. The Full LLM Glossary and Foundations

    08/04/2025

    The Full LLM Glossary and Foundations

    Ever wanted a clear, comprehensive explanation of all the key terms related to Large Language Models (LLMs)? This episode has you covered. In this >1-hour deep-dive, we'll guide you through the essential glossary of LLM-related terms and foundational concepts, perfect for listening while driving, working, or on the go. Whether you're new to LLMs or looking to reinforce your understanding, this episode is designed to make complex terms accessible. Sources referenced in this episode: Humza Naveed et al., "A Comprehensive Overview of Large Language Models" Tessa Gengnagel et al., "LLM Glossary (draft version)" Disclaimer: This podcast summary was generated with the help of Google's NotebookLM AI. While we aim to provide an accurate and informative overview, we encourage listeners to consult the original research papers for a deeper and more comprehensive understanding of the topics discussed.

    1h 28m
  5. Anthropic's Best-of-N: Cracking Frontier AI Across Modalities

    12/25/2024

    Anthropic's Best-of-N: Cracking Frontier AI Across Modalities

    In this special christmas episode, we delve into "Best-of-N Jailbreaking," a powerful new black-box algorithm that demonstrates the vulnerabilities of cutting-edge AI systems. This approach works by sampling numerous augmented prompts - like shuffled or capitalized text - until a harmful response is elicited. Discover how Best-of-N (BoN) Jailbreaking achieves: 89% Attack Success Rates (ASR) on GPT-4o and 78% ASR on Claude 3.5 Sonnet with 10,000 prompts. Success in bypassing advanced defenses on both closed-source and open-source models. Cross-modality attacks on vision, audio, and multimodal AI systems like GPT-4o and Gemini 1.5 Pro. We’ll also explore how BoN Jailbreaking scales with the number of prompt samples, following a power-law relationship, and how combining BoN with other techniques amplifies its effectiveness. This episode unpacks the implications of these findings for AI security and resilience. Paper: Hughes, John, et al. "Best-of-N Jailbreaking." (2024). arXiv. Disclaimer: This podcast summary was generated using Google's NotebookLM AI. While the summary aims to provide an overview, it is recommended to refer to the original research preprint for a comprehensive understanding of the study and its findings.

    13 min
  6. Auto-Rewards & Multi-Step RL for Diverse AI Attacks by OpenAI

    11/30/2024

    Auto-Rewards & Multi-Step RL for Diverse AI Attacks by OpenAI

    In this episode, we explore the latest advancements in automated red teaming from OpenAI, presented in the paper "Diverse and Effective Red Teaming with Auto-generated Rewards and Multi-step Reinforcement Learning." Automated red teaming has become essential for discovering rare failures and generating challenging test cases for large language models (LLMs). This paper tackles a core challenge: how to ensure attacks are both diverse and effective. We dive into their two-step approach: Generating Diverse Attack Goals using LLMs with tailored prompts and rule-based rewards (RBRs). Training an RL Attacker with multi-step reinforcement learning to optimize for both success and diversity in attacks. Discover how this approach improves on previous methods by generating more varied and successful attacks, including prompt injection attacks and unsafe response prompts, paving the way for more robust AI models. Paper: Beutel A, Xiao K, Heidecke J, Weng L "Diverse and Effective Red Teaming with Auto-generated Rewards and Multi-step Reinforcement Learning." (2024). OpenAI.com Disclaimer: This podcast summary was generated using Google's NotebookLM AI. While the summary aims to provide an overview, it is recommended to refer to the original research preprint for a comprehensive understanding of the study and its findings.

    11 min
  7. Battle of the Scanners: Top Red Teaming Frameworks for LLMs

    11/04/2024

    Battle of the Scanners: Top Red Teaming Frameworks for LLMs

    In this episode, we explore the findings from "Insights and Current Gaps in Open-Source LLM Vulnerability Scanners: A Comparative Analysis." As large language models (LLMs) are integrated into more applications, so do the security risks they pose, including information leaks and jailbreak attacks. This study examines four major open-source vulnerability scanners - Garak, Giskard, PyRIT, and CyberSecEval - evaluating their effectiveness and reliability in detecting these risks. We’ll discuss the unique features of each tool, uncover key gaps in their reliability, and share strategic recommendations for organizations looking to bolster their red-teaming efforts. Join us to understand how these tools stack up and what this means for the future of AI security. Paper: Brokman, Jonathan, et al. "Insights and Current Gaps in Open-Source LLM Vulnerability Scanners: A Comparative Analysis." (2024). arXiv. Disclaimer: This podcast summary was generated using Google's NotebookLM AI. While the summary aims to provide an overview, it is recommended to refer to the original research preprint for a comprehensive understanding of the study and its findings.

    15 min
  8. Watermarking LLM Output: SynthID by DeepMind

    10/24/2024

    Watermarking LLM Output: SynthID by DeepMind

    In this episode, we delve into the groundbreaking watermarking technology presented in the paper "Scalable Watermarking for Identifying Large Language Model Outputs," published in Nature. SynthID-Text, a new watermarking scheme developed for large-scale production systems, preserves text quality while enabling high detection accuracy for synthetic content. We explore how this technology tackles the challenges of text watermarking without affecting LLM performance or training, and how it’s being implemented across millions of AI-generated outputs. Join us as we discuss how SynthID-Text could reshape the future of synthetic content detection and ensure responsible use of large language models. Paper: Dathathri, Sumanth, et al. "Scalable Watermarking for Identifying Large Language Model Outputs." 2024. nature. Disclaimer: This podcast summary was generated using Google's NotebookLM AI. While the summary aims to provide an overview, it is recommended to refer to the original research paper for a comprehensive understanding of the study and its findings.

    13 min
See All (13)

About

The podcast where we break down the latest research and developments in AI Safety - so you don’t have to. Each episode, we take a deep dive into new cutting-edge papers. Whether you’re an expert or just AI-curious, we make complex ideas accessible, engaging, and relevant. Stay ahead of the curve with AI Security Papers. Disclaimer: This podcast and its content are generated by AI. While every effort is made to ensure accuracy, please verify all information independently.

Information

  • Creator
    Arian Abbasi, Alan Aqrawi
  • Years Active
    2024 - 2025
  • Episodes
    13
  • Rating
    Clean
  • Copyright
    © Arian Abbasi, Alan Aqrawi
  • Show Website
    AI Safety - Paper Digest