AI Shadow Daily

AI Shadow

The day's AI news in about ten minutes: two hosts, one British and one American, talk through the biggest stories in artificial intelligence, what happened, why it matters and what to watch next. Daily videos: https://www.youtube.com/@AIShadowLearning Listen on Spotify: https://open.spotify.com/show/2SVlqNyqJ0wAFcF2Zdg9aY / Apple Podcasts: https://podcasts.apple.com/podcast/id6826723496 / YouTube: https://www.youtube.com/@AIShadowLearning

Episodes

  1. 1d ago

    A Practical Guide, Part 8 of 15: Guardrails, Permissions and Safety

    Part 8 of our agentic AI series builds layered defences for agents that can act: the prompt injection threat model, OWASP's excessive agency, Google's three principles, Simon Willison's lethal trifecta, the new SEAL research defence, and permission rules plus sandboxing that hold even when the model is fooled. Chapters0:00 Recap and the Threat0:14 When Data Becomes Instructions1:52 Excessive Agency3:16 Three Principles, Two Layers4:44 The Lethal Trifecta6:49 Rules and Sandboxes8:14 Wrap-up Sources3 of 6 sources are primary (the company's or lab's own words, papers, filings, official sites)arXiv: Not what you've signed up for, Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection (Greshake et al., 2023)OWASP GenAI Security Project: LLM01:2025 Prompt InjectionOWASP GenAI Security Project: LLM06:2025 Excessive AgencyGoogle Research: An Introduction to Google's Approach for Secure AI Agents (Diaz, Olive, Kern, 2025)Simon Willison: The lethal trifecta for AI agentsSEAL: Sealed Queries for Local Sanitization against Indirect Prompt Injection Full transcript: https://www.mandarinshadow.app/podcast/ai/e/2026-11-02 Made with AI: the script is written and narrated with AI tools (synthetic voices). Watch the daily AI news videos: https://www.youtube.com/@AIShadowLearning Listen on Spotify: https://open.spotify.com/show/2SVlqNyqJ0wAFcF2Zdg9aY / Apple Podcasts: https://podcasts.apple.com/podcast/id6826723496 / YouTube: https://www.youtube.com/@AIShadowLearning

  2. 3d ago

    A Practical Guide, Part 6 of 15: Evaluation and Verification

    Part 6 of Agentic AI: A Practical Guide covers how to evaluate agents: trials and outcomes, code, model and human graders, pass at k versus pass to the power k on tau-bench, what SWE-bench, AgentBench and tau-bench measure, building a first eval suite, and verification inside the agent loop, plus SecurityScorecard's new repeated-trial benchmark. Chapters0:00 Welcome and Recap0:10 Trials, Outcomes, Vocabulary1:50 Code, Model and Human Graders4:16 pass@k Versus pass^k6:20 What Public Benchmarks Measure7:54 Building Your First Suite9:06 Verification Inside the Loop9:51 Takeaway and Sign-off Sources5 of 6 sources are primary (the company's or lab's own words, papers, filings, official sites)arXiv: tau-bench, A Benchmark for Tool-Agent-User Interaction in Real-World Domains (Yao et al., 2024)arXiv: SWE-bench, Can Language Models Resolve Real-World GitHub Issues? (Jimenez et al., 2023)arXiv: AgentBench, Evaluating LLMs as Agents (Liu et al., 2023)arXiv: Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena (Zheng et al., 2023)Anthropic: Demystifying evals for AI agentsSecurityScorecard Launches the World's First TPRM Benchmark to Test Whether AI Can Defend the Supply Chain and Withstand an Attack (Business Wire via Yahoo Finance) Full transcript: https://www.mandarinshadow.app/podcast/ai/e/2026-10-31 Made with AI: the script is written and narrated with AI tools (synthetic voices). Watch the daily AI news videos: https://www.youtube.com/@AIShadowLearning Listen on Spotify: https://open.spotify.com/show/2SVlqNyqJ0wAFcF2Zdg9aY / Apple Podcasts: https://podcasts.apple.com/podcast/id6826723496 / YouTube: https://www.youtube.com/@AIShadowLearning

  3. 4d ago

    A Practical Guide, Part 5 of 15: Planning and Task Decomposition

    Part 5 of our agentic AI series covers planning: from chain-of-thought, Plan-and-Solve and Tree of Thoughts, to how Anthropic's research agent plans and over-plans, how to write a subtask with clear boundaries, how Magentic-UI lets humans edit plans and what a new planning benchmark found, and when an agent should skip the plan entirely. Chapters0:00 Welcome and Part 4 Recap0:45 Planning Starts as Reasoning3:35 Planning in the Wild5:20 Writing a Good Subtask7:30 Plans Drift9:40 Knowing When Not to Plan10:23 Takeaway and Next Time Sources6 of 6 sources are primary (the company's or lab's own words, papers, filings, official sites)Chain-of-Thought Prompting Elicits Reasoning in Large Language Models (arXiv 2201.11903)Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models (arXiv 2305.04091)Tree of Thoughts: Deliberate Problem Solving with Large Language Models (arXiv 2305.10601)How we built our multi-agent research system (Anthropic)Magentic-UI, an experimental human-centered web agent (Microsoft Research)Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Full transcript: https://www.mandarinshadow.app/podcast/ai/e/2026-10-30 Made with AI: the script is written and narrated with AI tools (synthetic voices). Watch the daily AI news videos: https://www.youtube.com/@AIShadowLearning Listen on Spotify: https://open.spotify.com/show/2SVlqNyqJ0wAFcF2Zdg9aY / Apple Podcasts: https://podcasts.apple.com/podcast/id6826723496 / YouTube: https://www.youtube.com/@AIShadowLearning

  4. Oct 24

    Claude Duet: Anthropic's Agent That Works While You're Away

    Anthropic launched Claude Duet, a proactive background agent, as a research preview, entering a field with Meta's Muse and OpenAI's Dots. Also, OpenAI's models and Codex are heading to Google Cloud. Chapters0:00 Today's Lineup0:29 What Claude Duet Is1:58 Tasks, Tools and Payments3:25 Safety and Guardrails4:50 Access, Limits and Rivals6:37 OpenAI Heads to Google Cloud7:55 What We're Watching Sources1 of 10 sources are primary (the company's or lab's own words, papers, filings, official sites)Introducing Claude Duet (Anthropic official announcement)Claude Duet is Anthropic's answer to Meta Muse and OpenAI Dots (Engadget)Anthropic joins Meta and OpenAI's personal AI assistant race with Claude Duet (Fortune)Anthropic takes on Grok Bot, Meta's Muse and OpenAI's Dots with Claude Duet (The Decoder)OpenAI models are coming to Google Cloud (OpenAI Developer Community announcement)OpenAI Frontier Models and Codex Head to Google Cloud Model Garden (Securities.io)OpenAI Brings Codex and Frontier Models to Google Cloud (AlphaSignal)Anthropic announces preview of Claude Duet, a personal AI agent to take on Muse, Dots (CNBC)Anthropic Launches Claude Duet, a Proactive AI Agent (MacRumors)Claude (@claudeai) on X: Claude Duet safety and waitlist announcement Full transcript: https://www.mandarinshadow.app/podcast/ai/e/2026-10-24 Made with AI: the script is written and narrated with AI tools (synthetic voices). Watch the daily AI news videos: https://www.youtube.com/@AIShadowLearning Listen on Spotify: https://open.spotify.com/show/2SVlqNyqJ0wAFcF2Zdg9aY / Apple Podcasts: https://podcasts.apple.com/podcast/id6826723496 / YouTube: https://www.youtube.com/@AIShadowLearning

About

The day's AI news in about ten minutes: two hosts, one British and one American, talk through the biggest stories in artificial intelligence, what happened, why it matters and what to watch next. Daily videos: https://www.youtube.com/@AIShadowLearning Listen on Spotify: https://open.spotify.com/show/2SVlqNyqJ0wAFcF2Zdg9aY / Apple Podcasts: https://podcasts.apple.com/podcast/id6826723496 / YouTube: https://www.youtube.com/@AIShadowLearning