Chasing Logic Chains: Inference tracing

​Dive into the intricacies of AI observability and decision-making with host Lori MacVittie and special guest Chris Hain. Lori and Chris discuss Anthropic’s open-sourced circuit tracing Python library tool and recent studies analyzing the internal workings of large language models (LLMs) during inference. They explore the growing need for advanced observability tools and the operational challenges involved in managing AI systems. From AI's decision-making complexities to the future of semantic observability, this episode is a deep dive into the often chaotic world of emerging tech.

Paper’s referenced in this episode:

• https://transformer-circuits.pub/2025/attribution-graphs/biology.html
• https://www.anthropic.com/research/agentic-misalignment