Full-Stack AI Safety: Why Defense-in-Depth Might Work, with Far.AI CEO Adam Gleave

Adam Gleave, CEO of FAR AI, offers a cautiously optimistic perspective on navigating the path to Transformative AI safely, advocating for a "defense-in-depth" approach. He discusses potential "post-AGI equilibria," key capability thresholds, and why fully autonomous, outcompeting AI might not arrive until around 2040. The conversation delves into FAR AI's full-stack strategy, including scalable oversight projects using "lie detectors" for AI deception, interpretability research on planning algorithms, and red-teaming existing defense systems. Gleave makes a compelling case that with proper planning and meticulous design, a comprehensive defense-in-depth strategy can effectively manage AI safety risks.

Read the full transcript: https://storage.aipodcast.ing/transcripts/episode/tcr/e117b021-8170-49ba-b1c4-c8ffc5d720b0/combined_transcript.html

Sponsors:

Fin:

Fin is the #1 AI Agent for customer service, trusted by over 5000 customer service leaders and top AI companies including Anthropic and Synthesia. Fin is the highest performing agent on the market and resolves even the most complex customer queries. Try Fin today with our 90-day money-back guarantee - if you’re not 100% satisfied, get up to $1 million back. Learn more at https://fin.ai/cognitive

Claude:

Claude is the AI collaborator that understands your entire workflow and thinks with you to tackle complex problems like coding and business strategy. Sign up and get 50% off your first three months of Claude Pro at https://claude.ai/tcr

Linear:

Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr

Oracle Cloud Infrastructure:

Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive

PRODUCED BY:

https://aipodcast.ing

CHAPTERS:

(00:00) About the Episode

(03:52) Introduction and Setup

(04:57) Post-AGI Future Vision

(13:43) Gradual Disempowerment Concerns (Part 1)

(20:14) Sponsors: Fin | Claude

(24:16) Gradual Disempowerment Concerns (Part 2)

(24:25) AI Capabilities and Timelines

(34:44) Learning and Architecture Innovation (Part 1)

(41:19) Sponsors: Linear | Oracle Cloud Infrastructure

(43:57) Learning and Architecture Innovation (Part 2)

(51:21) AI Safety Defense Strategies

(59:43) Alignment and Training Methods

(01:12:49) Interpretability Research Prospects

(01:19:50) Far.AI Activities and Hiring

(01:29:00) Outro