66 episodes

Deeply researched interviews

https://link.chtbl.com/dwarkesh

www.dwarkeshpatel.com

Dwarkesh Podcast Dwarkesh Patel

    • Technology

Deeply researched interviews

https://link.chtbl.com/dwarkesh

www.dwarkeshpatel.com

    Sholto Douglas & Trenton Bricken - How to Build & Understand GPT-7's Mind

    Sholto Douglas & Trenton Bricken - How to Build & Understand GPT-7's Mind

    Had so much fun chatting with my good friends Trenton Bricken and Sholto Douglas on the podcast.
    No way to summarize it, except: 
    This is the best context dump out there on how LLMs are trained, what capabilities they're likely to soon have, and what exactly is going on inside them.
    You would be shocked how much of what I know about this field, I've learned just from talking with them.
    To the extent that you've enjoyed my other AI interviews, now you know why.
    So excited to put this out. Enjoy! I certainly did :)
    Watch on YouTube. Listen on Apple Podcasts, Spotify, or any other podcast platform. 
    There's a transcript with links to all the papers the boys were throwing down - may help you follow along.
    Follow Trenton and Sholto on Twitter.
    Timestamps
    (00:00:00) - Long contexts
    (00:16:12) - Intelligence is just associations
    (00:32:35) - Intelligence explosion & great researchers
    (01:06:52) - Superposition & secret communication
    (01:22:34) - Agents & true reasoning
    (01:34:40) - How Sholto & Trenton got into AI research
    (02:07:16) - Are feature spaces the wrong way to think about intelligence?
    (02:21:12) - Will interp actually work on superhuman models
    (02:45:05) - Sholto’s technical challenge for the audience
    (03:03:57) - Rapid fire


    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    • 3 hrs 12 min
    Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat

    Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat

    Here is my episode with Demis Hassabis, CEO of Google DeepMind
    We discuss:
    * Why scaling is an artform
    * Adding search, planning, & AlphaZero type training atop LLMs
    * Making sure rogue nations can't steal weights
    * The right way to align superhuman AIs and do an intelligence explosion
    Watch on YouTube. Listen on Apple Podcasts, Spotify, or any other podcast platform. Read the full transcript here.
    Timestamps
    (0:00:00) - Nature of intelligence
    (0:05:56) - RL atop LLMs
    (0:16:31) - Scaling and alignment
    (0:24:13) - Timelines and intelligence explosion
    (0:28:42) - Gemini training
    (0:35:30) - Governance of superhuman AIs
    (0:40:42) - Safety, open source, and security of weights
    (0:47:00) - Multimodal and further progress
    (0:54:18) - Inside Google DeepMind


    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    • 1 hr 1 min
    Patrick Collison (Stripe CEO) - Craft, Beauty, & The Future of Payments

    Patrick Collison (Stripe CEO) - Craft, Beauty, & The Future of Payments

    We discuss:
    * what it takes to process $1 trillion/year
    * how to build multi-decade APIs, companies, and relationships
    * what's next for Stripe (increasing the GDP of the internet is quite an open ended prompt, and the Collison brothers are just getting started).
    Plus the amazing stuff they're doing at Arc Institute, the financial infrastructure for AI agents, playing devil's advocate against progress studies, and much more.
    Watch on YouTube. Listen on Apple Podcasts, Spotify, or any other podcast platform. Read the full transcript here. Follow me on Twitter for updates on future episodes.
    Timestamps
    (00:00:00) - Advice for 20-30 year olds
    (00:12:12) - Progress studies
    (00:22:21) - Arc Institute
    (00:34:27) - AI & Fast Grants
    (00:43:46) - Stripe history
    (00:55:44) - Stripe Climate
    (01:01:39) - Beauty & APIs
    (01:11:51) - Financial innards
    (01:28:16) - Stripe culture & future
    (01:41:56) - Virtues of big businesses
    (01:51:41) - John


    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    • 1 hr 54 min
    Tyler Cowen - Hayek, Keynes, & Smith on AI, Animal Spirits, Anarchy, & Growth

    Tyler Cowen - Hayek, Keynes, & Smith on AI, Animal Spirits, Anarchy, & Growth

    It was a great pleasure speaking with Tyler Cowen for the 3rd time.
    We discussed GOAT: Who is the Greatest Economist of all Time and Why Does it Matter?, especially in the context of how the insights of Hayek, Keynes, Smith, and other great economists help us make sense of AI, growth, animal spirits, prediction markets, alignment, central planning, and much more.
    The topics covered in this episode are too many to summarize. Hope you enjoy!
    Watch on YouTube. Listen on Apple Podcasts, Spotify, or any other podcast platform. Read the full transcript here. Follow me on Twitter for updates on future episodes.
    Timestamps
    (0:00:00) - John Maynard Keynes
    (00:17:16) - Controversy
    (00:25:02) - Fredrick von Hayek
    (00:47:41) - John Stuart Mill
    (00:52:41) - Adam Smith
    (00:58:31) - Coase, Schelling, & George
    (01:08:07) - Anarchy
    (01:13:16) - Cheap WMDs
    (01:23:18) - Technocracy & political philosophy
    (01:34:16) - AI & Scaling


    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    • 1 hr 42 min
    Lessons from The Years of Lyndon Johnson by Robert Caro [Narration]

    Lessons from The Years of Lyndon Johnson by Robert Caro [Narration]

    This is a narration of my blog post, Lessons from The Years of Lyndon Johnson by Robert Caro.
    You read the full post here: https://www.dwarkeshpatel.com/p/lyndon-johnson
    Listen on Apple Podcasts, Spotify, or any other podcast platform. Follow me on Twitter for updates on future posts and episodes.


    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    • 36 min
    Will scaling work? [Narration]

    Will scaling work? [Narration]

    This is a narration of my blog post, Will scaling work?.
    You read the full post here: https://www.dwarkeshpatel.com/p/will-scaling-work
    Listen on Apple Podcasts, Spotify, or any other podcast platform. Follow me on Twitter for updates on future posts and episodes.


    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    • 25 min

Top Podcasts In Technology

Lex Fridman Podcast
Lex Fridman
Acquired
Ben Gilbert and David Rosenthal
Search Off the Record
Google
Apple Events (video)
Apple
Apple Events (audio)
Apple
Practical AI: Machine Learning, Data Science
Changelog Media

You Might Also Like

Conversations with Tyler
Mercatus Center at George Mason University
"Upstream" with Erik Torenberg
Erik Torenberg
"Moment of Zen"
Erik Torenberg, Dan Romero, Antonio Garcia Martinez
"Econ 102" with Noah Smith and Erik Torenberg
Noah Smith, Erik Torenberg
"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
Erik Torenberg, Nathan Labenz
Latent Space: The AI Engineer Podcast — Practitioners talking LLMs, CodeGen, Agents, Multimodality, AI UX, GPU Infra and al
Alessio + swyx