EigenState

Shinde Aditya
  • 0.0 (0)
  • Physics
  • Updated weekly

EigenState is a long-form science and technology podcast exploring the physical foundations of intelligence, computation, mathematics, and emerging technologies. Each series investigates a fundamental question shaping the future of civilization: Why does intelligence require energy? Why does AI live inside geometry? What are the limits of computation? And what happens when physics becomes the bottleneck? Through deep narratives, scientific history, and first-principles reasoning, EigenState connects information theory, artificial intelligence, physics, mathematics, robotics, and complex systems into a coherent picture of how reality computes itself. Hosted by Shinde Aditya.

Episodes

  1. The Thermodynamics of Intelligence: Why AI Can't Think for Free

    23 Jun

    The Thermodynamics of Intelligence: Why AI Can't Think for Free

    Why does the human brain operate on roughly twenty watts while modern artificial intelligence systems consume megawatts? The answer begins with an unexpected claim: information is physical. For decades, information was treated as an abstract mathematical object—a sequence of symbols detached from the material world. But twentieth-century physics revealed something deeper. Every bit of information must be embodied in a physical system: a neuron, a transistor, a magnetic domain, a molecule of DNA. Once information becomes physical, it must obey the laws of physics. In this episode, we trace the surprising connection between information, entropy, memory, and energy. We explore how Claude Shannon transformed information into a measurable quantity, how Maxwell's Demon challenged the Second Law of Thermodynamics, and how Rolf Landauer discovered the hidden thermodynamic cost of erasing information. Along the way, we connect these ideas directly to modern artificial intelligence. Training a neural network is not simply a computational process—it is a continuous cycle of correction, revision, and controlled forgetting. Every update rewrites internal states. Every rewrite has a physical cost. The result is a startling conclusion: "The universe does not charge for knowing. It charges for forgetting." Estimated Difficulty: Intermediate Prerequisites: None Helpful Background: Basic familiarity with AI, computers, or high-school physics will enhance the experience, but all major concepts are introduced from first principles. Topics CoveredInformation TheoryEntropyThermodynamicsClaude ShannonMaxwell's DemonLeó SzilárdRolf LandauerCharles BennettLandauer's PrincipleArtificial IntelligenceNeural NetworksBackpropagationGradient DescentGPU ArchitectureData Center Energy ConsumptionSilicon vs BiologyReversible ComputingNeuromorphic ComputingPhysics of Intelligence People MentionedClaude Shannon (1916-2001) - Founder of modern information theory.James Clerk Maxwell (1831–1879) - Creator of Maxwell's Demon.Leó Szilárd (1898–1964) - Connected information and thermodynamics in 1929.Rolf Landauer (1927–1999) - IBM physicist.Charles Bennett - Extended Landauer's work and helped resolve Maxwell's Demon. Recommended ReadingBeginner The Information - James Gleick A narrative history of information theory and communication. Link: https://eigenstate.captivate.fm/the-information-james-gleick How to Create a Mind - Ray Kurzweil Explores intelligence from biological and computational perspectives. Link: https://eigenstate.captivate.fm/how-to-create-a-mind-ray-kurzweil Intermediate Gödel, Escher, Bach - Douglas Hofstadter One of the deepest explorations of information, intelligence, and self-reference ever written. Link: https://eigenstate.captivate.fm/godel-escher-bach-douglas-hofstadter The Emperor's New Mind - Roger Penrose A physicist's critique of computational theories of mind. Link: https://eigenstate.captivate.fm/the-emperors-new-mind-roger-penrose Advanced 5. Information Theory, Inference and Learning Algorithms - David MacKay One of the definitive texts connecting information theory and machine learning. Link: https://eigenstate.captivate.fm/information-theory-david-mackay PRIMARY SOURCES Claude Shannon (1948) - A Mathematical Theory of CommunicationRolf Landauer (1961) - Irreversibility and Heat Generation in the Computing ProcessCharles Bennett (1982) - The Thermodynamics of ComputationLeó Szilárd (1929) - On the Decrease of Entropy in a Thermodynamic System by the Intervention of Intelligent Beings These papers form the historical foundation of modern information theory, thermodynamics of computation, and the physics of intelligence. Support EigenStateEigenState is independently researched, written, recorded, and produced. If you would like to support future episodes: Support the podcast: https://eigenstate.captivate.fm/contributeSponsor EigenState: https://eigenstate.captivate.fm/sponsorShare the episodeLeave a rating on Spotify or Apple PodcastsSend the episode to someone who enjoys physics, mathematics, or AI Next EpisodeThe Geometry of Intelligence: Why Thoughts Need Coordinates In the next episode, we move from the laws of thermodynamics to the laws of geometry and explore why linear algebra became the language of intelligence itself. Website: https://eigenstate.captivate.fm/website Newsletter: https://eigenstate.captivate.fm/newsletter Contact: aditya@eigenstate.dev

    27 min
  • 1 Episode

About

EigenState is a long-form science and technology podcast exploring the physical foundations of intelligence, computation, mathematics, and emerging technologies. Each series investigates a fundamental question shaping the future of civilization: Why does intelligence require energy? Why does AI live inside geometry? What are the limits of computation? And what happens when physics becomes the bottleneck? Through deep narratives, scientific history, and first-principles reasoning, EigenState connects information theory, artificial intelligence, physics, mathematics, robotics, and complex systems into a coherent picture of how reality computes itself. Hosted by Shinde Aditya.

Information

  • Creator
    Shinde Aditya
  • Years Active
    2k
  • Episodes
    1
  • Rating
    Clean
  • Copyright
    © 2026 EigenState Media
  • Show Website
    EigenState