EigenState

Shinde Aditya
  • 0,0 (0)
  • Vật lý
  • Hằng tuần

EigenState is a long-form science and technology podcast exploring the physical foundations of intelligence, computation, mathematics, and emerging technologies. Each series investigates a fundamental question shaping the future of civilization: Why does intelligence require energy? Why does AI live inside geometry? What are the limits of computation? And what happens when physics becomes the bottleneck? Through deep narratives, scientific history, and first-principles reasoning, EigenState connects information theory, artificial intelligence, physics, mathematics, robotics, and complex systems into a coherent picture of how reality computes itself. Hosted by Shinde Aditya.

Tập

  1. 23 thg 6

    The Thermodynamics of Intelligence: Why AI Can't Think for Free

    Why does the human brain operate on roughly twenty watts while modern artificial intelligence systems consume megawatts? The answer begins with an unexpected claim: information is physical. For decades, information was treated as an abstract mathematical object—a sequence of symbols detached from the material world. But twentieth-century physics revealed something deeper. Every bit of information must be embodied in a physical system: a neuron, a transistor, a magnetic domain, a molecule of DNA. Once information becomes physical, it must obey the laws of physics. In this episode, we trace the surprising connection between information, entropy, memory, and energy. We explore how Claude Shannon transformed information into a measurable quantity, how Maxwell's Demon challenged the Second Law of Thermodynamics, and how Rolf Landauer discovered the hidden thermodynamic cost of erasing information. Along the way, we connect these ideas directly to modern artificial intelligence. Training a neural network is not simply a computational process—it is a continuous cycle of correction, revision, and controlled forgetting. Every update rewrites internal states. Every rewrite has a physical cost. The result is a startling conclusion: "The universe does not charge for knowing. It charges for forgetting." Estimated Difficulty: Intermediate Prerequisites: None Helpful Background: Basic familiarity with AI, computers, or high-school physics will enhance the experience, but all major concepts are introduced from first principles. Topics Covered Information TheoryEntropyThermodynamicsClaude ShannonMaxwell's DemonLeó SzilárdRolf LandauerCharles BennettLandauer's PrincipleArtificial IntelligenceNeural NetworksBackpropagationGradient DescentGPU ArchitectureData Center Energy ConsumptionSilicon vs BiologyReversible ComputingNeuromorphic ComputingPhysics of Intelligence People Mentioned Claude Shannon (1916-2001) - Founder of modern information theory.James Clerk Maxwell (1831–1879) - Creator of Maxwell's Demon.Leó Szilárd (1898–1964) - Connected information and thermodynamics in 1929.Rolf Landauer (1927–1999) - IBM physicist.Charles Bennett - Extended Landauer's work and helped resolve Maxwell's Demon. Recommended Reading Beginner The Information - James Gleick A narrative history of information theory and communication. Link: https://linkfuse.net/Q6i How to Create a Mind - Ray Kurzweil Explores intelligence from biological and computational perspectives. Link: https://linkfuse.net/Q6h Intermediate Gödel, Escher, Bach - Douglas Hofstadter One of the deepest explorations of information, intelligence, and self-reference ever written. Link: https://linkfuse.net/Q6e The Emperor's New Mind - Roger Penrose A physicist's critique of computational theories of mind. Link: https://linkfuse.net/Q6f Advanced Information Theory, Inference and Learning Algorithms - David MacKay One of the definitive texts connecting information theory and machine learning. Link: https://linkfuse.net/Q6g PRIMARY SOURCES Claude Shannon (1948) - A Mathematical Theory of CommunicationRolf Landauer (1961) - Irreversibility and Heat Generation in the Computing ProcessCharles Bennett (1982) - The Thermodynamics of ComputationLeó Szilárd (1929) - On the Decrease of Entropy in a Thermodynamic System by the Intervention of Intelligent BeingsThese papers form the historical foundation of modern information theory, thermodynamics of computation, and the physics of intelligence. Support EigenState EigenState is independently researched, written, recorded, and produced. If you would like to support future episodes: Support the podcast: https://www.eigenstate.dev/fundSponsor EigenState: https://www.eigenstate.dev/sponsorShare the episodeLeave a rating on Spotify or Apple PodcastsSend the episode to someone who enjoys physics, mathematics, or AI Website: https://www.eigenstate.com Newsletter: https://www.eigenstate.dev/newsletter Contact: aditya@eigenstate.dev

    The Thermodynamics of Intelligence: Why AI Can't Think for Free
  • 1 tập

Giới Thiệu

EigenState is a long-form science and technology podcast exploring the physical foundations of intelligence, computation, mathematics, and emerging technologies. Each series investigates a fundamental question shaping the future of civilization: Why does intelligence require energy? Why does AI live inside geometry? What are the limits of computation? And what happens when physics becomes the bottleneck? Through deep narratives, scientific history, and first-principles reasoning, EigenState connects information theory, artificial intelligence, physics, mathematics, robotics, and complex systems into a coherent picture of how reality computes itself. Hosted by Shinde Aditya.

Thông Tin

  • Nhà sáng tạo
    Shinde Aditya
  • Năm hoạt động
    2026
  • Tập
    1
  • Xếp hạng
    Sạch
  • Bản quyền
    © Shinde Aditya
  • Trang web chương trình
    EigenState