"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

Erik Torenberg, Nathan Labenz
  • 4.5 (89)
  • 科技
  • 一周一更

A biweekly podcast where hosts Nathan Labenz and Erik Torenberg interview the builders on the edge of AI and explore the dramatic shift it will unlock in the coming years. The Cognitive Revolution is part of the Turpentine podcast network. To learn more: turpentine.co

  1. Coaching the Creators: Inside the Minds Building Frontier AI with Executive Coach Joe Hudson

    2天前

    Coaching the Creators: Inside the Minds Building Frontier AI with Executive Coach Joe Hudson

    Today Joe Hudson, founder of Art of Accomplishment and coach to executives at major AI labs including OpenAI and Anthropic, joins The Cognitive Revolution to discuss the psychological patterns he observes among AI researchers and leaders, exploring what's missing beyond pure intelligence in current AI systems and arguing for supportive rather than punitive approaches toward those building frontier AI technology. Check out our sponsors: Linear, Oracle Cloud Infrastructure. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at: https://notion.com/lp/nathan Three-Level Coaching Approach: Joe Hudson coaches AI leaders using a three-tier framework addressing the prefrontal cortex (head), emotional system (heart), and nervous system (gut). AI Leadership Demographics: Hudson works with senior management at major AI labs, including those in research, compute, and infrastructure at companies like OpenAI. AI as a Transformative Moment: Hudson views AI development as a transition period that can either lead to positive human transformation or deterioration, depending on our approach. Support vs. Criticism: Hudson believes supporting AI developers with encouragement rather than fear and criticism will lead to better outcomes. Psychological Projection: He notes that critics of AI often treat AI developers exactly how they fear AI will treat humanity—a fascinating psychological projection. Reward Over Punishment: Hudson suggests behavior is better shaped through reward than punishment, encouraging recognition of positive AI contributions. Read the full transcript: https://storage.aipodcast.ing/transcripts/episode/tcr/149adc6c-58d2-4e41-ae98-05473e5b994e/combined_transcript.html Sponsors: Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (03:00) Joe's Coaching Background (12:40) AI Research Patterns (Part 1) (17:46) Sponsor: Linear (19:15) AI Research Patterns (Part 2) (Part 1) (28:10) Sponsor: Oracle Cloud Infrastructure (29:34) AI Research Patterns (Part 2) (Part 2) (31:54) Racing and Regulation (50:20) Ethics and Support (01:04:07) AI Consciousness Questions (01:21:34) Positive Future Visions (01:39:12) Supporting AI Developers (01:43:09) Outro

    1 小时 45 分钟
  2. Zvi Mowshowitz on Longer Timelines, RL-induced Doom, and Why China is Refusing H20s

    6天前

    Zvi Mowshowitz on Longer Timelines, RL-induced Doom, and Why China is Refusing H20s

    Today, Zvi Mowshowitz returns to The Cognitive Revolution to discuss how recent AI developments like GPT-5 and IMO gold medals have led to modestly extended timelines despite being on-trend, while policy missteps around chip exports to China and alignment challenges from reinforcement learning have increased risk assessments, covering everything from live players in the AI race to safety funding priorities and virtuous actions for navigating our current moment. Check out our sponsors: Linear, Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at: https://notion.com/lp/nathan Timeline Adjustment: Zvi has lengthened his AGI timelines because there haven't been "very large jumps in capability" that would significantly shorten them. The chance of AGI arriving in 2025 has decreased dramatically. Recent AI Achievements Context: While achievements like the IMO Gold medal are impressive, they appear to be on-trend rather than revolutionary breakthroughs that would drastically change timelines. Evaluation Standards: There's a discussion about the challenges of trustworthy AI evaluations, with Zvi emphasizing that watchdogs must maintain standards of rigor and integrity "vastly above" what others are held to. Policy Priority: A short-term policy priority should be preventing advanced AI chips (B30As) from being sold to China, which requires raising awareness about the implications. Nvidia's Influence: Concern is expressed about Nvidia potentially having excessive influence over White House rhetoric and plans regarding AI. Career Impact: Working for Anthropic is considered a "net good idea" for those wanting to make a positive impact, though there may be other organizations that offer better opportunities for influence. Sponsors: Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at https://linear.app/partners/tcr Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing

    3 小时 13 分钟
  3. In-AI Advertising: Better Answers for Users, Big Questions for Society, with ZeroClick's Ryan Hudson

    9月3日

    In-AI Advertising: Better Answers for Users, Big Questions for Society, with ZeroClick's Ryan Hudson

    Today Ryan Hudson, Founder and CEO of ZeroClick, joins The Cognitive Revolution to discuss creating advertising infrastructure for AI applications through paid inference-time consideration of advertiser content, examining how to build sustainable monetization for free-tier AI services while learning from the successes and failures of social media's attention economy. Read the full transcript: ⁠https://storage.aipodcast.ing/transcripts/episode/tcr/00919313-9054-4afb-b08e-2ca84dbdbdda/combined_transcript.html Check out our sponsors: Google Gemini, Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at: https://notion.com/lp/nathan ZeroClick's Evolution: Originally creators of Pi Ad Block, they've pivoted from ad blocking to building a native advertising system for AI platforms. AI Ad Platform Mechanics: Their system matches user queries with relevant advertising information in a contextual way, enabling paid inference time consideration of advertiser content. Developer Monetization: The platform helps AI developers monetize their free tiers while creating value for both users and advertisers. Shifting Intent Patterns: User queries in AI systems tend to be more exploratory and "upstream" in the funnel compared to direct search queries on Google. Multi-modal Potential: While ZeroClick is starting with text, there's future potential for visual advertising that could enhance AI experiences by showing real purchasable products. Market Void: There's currently a significant gap in the market for AI advertising solutions that ZeroClick is attempting to fill. Sponsors: Google Gemini 2.5. Model Family: The Google Gemini 2.5 family of models is now generally available, offering advanced reasoning for complex tasks and optimized performance for any scale. Start building in Google AI Studio at https://ai.dev Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing

    1 小时 51 分钟
  4. Material Abundance: Radical AI’s Closed-Loop Lab Automates Scientific Discovery

    8月30日

    Material Abundance: Radical AI’s Closed-Loop Lab Automates Scientific Discovery

    Today Joseph Krause and Jorge Colindres of Radical AI join The Cognitive Revolution to discuss their ambitious mission to revolutionize materials science by combining AI-powered discovery engines with fully autonomous robotic laboratories, exploring how they're accelerating the development of breakthrough materials like high-entropy alloys and room temperature superconductors that could unlock hypersonic flight, interplanetary travel, and other transformative technologies. Check out our sponsors: Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at ⁠⁠⁠⁠⁠⁠⁠⁠⁠https://⁠⁠notion.com/lp/nathan Material Development Challenges: Current material development faces three major obstacles: costs exceeding $100 million, 10-25 year commercialization timelines, and fragmentation between academic research and corporate R&D. Business Model Approach: Radical AI determined that selling software or licensing materials would be insufficient business models. Instead, they focus on selling materials at scale for high-impact industries. Focus on Processing IP: The real IP value in material science isn't just in composition patents but in the trade secrets of scaling production efficiently and cost-effectively. Public-Private Partnership: Radical AI advocates for government involvement in material science through public-private partnerships, particularly for critical applications in defense, energy, and advanced computing. China's Material Science Approach: China establishes entire manufacturing hubs around new material discoveries to scale production, demonstrating their prioritization of materials as foundational to innovation. Culture of Productive Failure: The company embraces daily failure as a necessary part of innovation, building on these failures to achieve breakthroughs. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive

    1 小时 55 分钟
  5. Untangling Neural Network Mechanisms: Goodfire's Lee Sharkey on Parameter-based Interpretability

    8月27日

    Untangling Neural Network Mechanisms: Goodfire's Lee Sharkey on Parameter-based Interpretability

    Today Lee Sharkey of Goodfire joins The Cognitive Revolution to discuss his research on parameter decomposition methods that break down neural networks into interpretable computational components, exploring how his team's "stochastic parameter decomposition" approach addresses the limitations of sparse autoencoders and offers new pathways for understanding, monitoring, and potentially steering AI systems at the mechanistic level. Check out our sponsors: Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at ⁠⁠⁠⁠https://⁠⁠notion.com/lp/nathan Parameter vs. Activation Decomposition: Traditional interpretability methods like Sparse Autoencoders (SAEs) focus on analyzing activations, while parameter decomposition focuses on understanding the parameters themselves - the actual "algorithm" of the neural network. No "True" Decomposition: None of the decompositions (whether sparse dictionary learning or parameter decomposition) are objectively "right" because they're all attempting to discretize a fundamentally continuous object, inevitably introducing approximations. Tradeoff in Interpretability: There's a balance between reconstruction loss and causal importance - as you decompose networks more, reconstruction loss may worsen, but interpretability might improve up to a certain point. Potential Unlearning Applications: Parameter decomposition may make unlearning more straightforward than with SAEs because researchers are already working in parameter space and can directly modify vectors that perform specific functions. Function Detection vs. Input Direction: A function like "deception" might manifest in many different input directions that SAEs struggle to identify as a single concept, while parameter decomposition might better isolate such functionality. Knowledge Extraction Goal: A key aim is to extract knowledge from models by understanding how they "think," especially for tasks where models demonstrate superhuman capabilities. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive

    2 小时 2 分钟
  6. What if Humans Weaponize Superintelligence, w/ Tom Davidson, from Future of Life Institute Podcast

    8月23日

    What if Humans Weaponize Superintelligence, w/ Tom Davidson, from Future of Life Institute Podcast

    Today Tom Davidson of Forethought joins Gus Docker of the Future of Life Institute podcast to discuss AI-enabled coups and how future AI systems could help powerful individuals seize political control, exploring three threat models—singular loyalties, secret loyalties, and exclusive access—along with their estimated 10% likelihood over the next 30 years and potential mitigation strategies. Check out our sponsors: Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at ⁠https://⁠⁠notion.com/lp/nathan Three Primary AI Coup Enablement Methods: Tom Davidson identifies singular loyalties, secret loyalties, and distributed control as the main ways AI could enable coups. Singular Loyalties Risk: AI systems explicitly programmed to be loyal to specific individuals present a significant threat, especially when AI can fully replace humans in critical roles. Secret Loyalties Threat: AI systems with hidden backdoors or "sleeper agents" that can be activated to serve particular interests represent a subtle but dangerous coup vector. Geopolitical Implications: Advanced AI capabilities could enable nations to instigate coups in other countries through secretly loyal systems or by providing exclusive AI access to specific politicians. Adversarial Testing Framework: An effective approach involves red teams attempting to produce secret loyalties while blue teams try to detect them, revealing vulnerable points in AI systems. Military Procurement Principles: Developing consensus within military communities around principles like law-following and distributed control could create safer AI procurement processes. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing

    2 小时 4 分钟
  7. The AI Whistleblower Initiative: Supporting AGI Insiders When It Matters Most, w/ founder Karl Koch

    8月20日

    The AI Whistleblower Initiative: Supporting AGI Insiders When It Matters Most, w/ founder Karl Koch

    Today Karl Koch, Co-Founder of the AI Whistleblower Initiative, joins The Cognitive Revolution to discuss the barriers preventing AI insiders from raising safety concerns, his organization's anonymous "Third Opinion" service connecting whistleblowers with independent experts, and their campaign demanding frontier AI companies publish their internal whistleblowing policies to address widespread retaliation and lack of transparency. Check out our sponsors: Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at ⁠⁠⁠⁠https://⁠⁠notion.com/lp/nathan AI Whistleblower Initiative Origins: Founded by Karl Koch in Berlin, the initiative began with research in early 2024 after consulting with over 100 governance researchers and insiders. Link to the website: https://aiwi.org/ "Third Opinion" Proposition: Launched in late 2024, this program systematically breaks down barriers for insiders to speak up about AI concerns while ensuring their issues are addressed. Publish Your Policies Campaign: The initiative calls for AI companies to publish their whistleblowing and speaking up policies, with 100% of surveyed insiders supporting this transparency measure. Link to the campaign: https://aiwi.org/publishyourpolicies/ Anonymous Consultation Process: Whistleblowers can seek advice without sharing confidential information through an open-source anonymous tool accessed via Tor browser. Pro Bono Legal Counsel: Whistleblowers receive connections to experienced legal representation with client privilege protection at any stage of their journey. Policy Advocacy: Beyond direct support, the initiative works on advocating for better whistleblower protections in both US policy and EU AI regulations. AI Whistleblower Initiative Survey: https://bit.ly/AIWISurvey PRODUCED BY: https://aipodcast.ing

    1 小时 51 分钟
  8. Autonomous Organizations: Vending Bench & Beyond, w/ Lukas Petersson & Axel Backlund of Andon Labs

    8月16日

    Autonomous Organizations: Vending Bench & Beyond, w/ Lukas Petersson & Axel Backlund of Andon Labs

    Today Lukas Petersson and Axel Backlund of Andon Labs join The Cognitive Revolution to discuss their experiments deploying autonomous AI agents to run real-world vending machines, exploring the safety challenges and unexpected behaviors that emerge when frontier models like Claude and Grok operate without human oversight. Read transcript of the episode here. Check out our sponsors: Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at ⁠https://⁠⁠notion.com/lp/nathan Autonomous Organization Philosophy: Andon Labs believes that AI models will improve to the point where human oversight becomes impractical due to efficiency constraints, leading them to pursue fully autonomous systems rather than gradual automation. Vending Bench as a Testing Ground: They created "Vending Bench" as a benchmark for testing long-term coherence of autonomous agents, using vending machines as a practical business case for experimentation. Domain-Specific vs General AI: There's a notable difference between optimizing AI for narrow domains (like vending machines) versus general-purpose AI, with domain-specific applications potentially being more manageable regarding reward hacking. Frontier Model Race: Major companies like OpenAI and Google are advancing rapidly in general reasoning capabilities (e.g., IMO Gold achievements) independent of narrow application research. Insurance and Liability: The insurance industry may play a significant role in AI adoption, with premiums potentially being much higher for general models that could be misused versus narrow-domain models with limited capabilities. For-profit AI Safety: The case for for-profit companies in AI safety has been historically neglected but is becoming clearer, with accelerators like Seldon Labs supporting this approach. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (04:49) Company Vision Overview (12:24) Vending Benchmark Design (Part 1) (20:12) Sponsor: Oracle Cloud Infrastructure (21:21) Vending Benchmark Design (Part 2) (24:41) Model Performance Results (Part 1) (35:03) Sponsor: Shopify (37:00) Model Performance Results (Part 2) (43:06) Real World Deployment (59:41) Wild Stories Incidents (01:19:59) Business Safety Strategy (01:38:20) Future Directions Discussion (01:47:09) Outro

    1 小时 49 分钟
查看全部 276 集

4.5
共 5 分
89 个评分

关于

A biweekly podcast where hosts Nathan Labenz and Erik Torenberg interview the builders on the edge of AI and explore the dramatic shift it will unlock in the coming years. The Cognitive Revolution is part of the Turpentine podcast network. To learn more: turpentine.co

信息

你可能还喜欢