Limitless: An AI Podcast

Limitless

Exploring the frontiers of Technology and AI

  1. The Age of Inference: Etched Startup Proves the Next AI Hotspot

    10h ago

    The Age of Inference: Etched Startup Proves the Next AI Hotspot

    Inference is becoming more important than pre-training in AI chips, including how pre-fill and decode work and why more compute is shifting toward serving models.  Today we walk through Etched’s ASIC system for transformer inference, its claims around efficiency and throughput, and the tradeoff between specialization and general-purpose GPUs like NVIDIA’s.  We also look at custom chip efforts from companies like OpenAI, Google, and Amazon, and argues that inference demand may keep growing as AI agents and long-running workloads expand. ------🌌 LIMITLESS HQ ⬇️ EMAIL US:           info@limitless.fmNEWSLETTER:    https://limitlessft.substack.com/FOLLOW ON X:   https://x.com/LimitlessFTSPOTIFY:              https://open.spotify.com/show/5oV29YUL8AzzwXkxEXlRMQAPPLE:                 https://podcasts.apple.com/us/podcast/limitless-podcast/id1813210890RSS FEED:           https://limitlessft.substack.com/ ------TIMESTAMPS 0:00 Inference’s New Frontier2:14 Training Versus Inference5:19 Etched’s Bold Bet7:58 Building the Whole Rack10:48 TSMC and the Hard Problems13:29 Why Inference Matters14:59 The Transformer Risk17:02 OpenAI’s Jalapeno Chip18:59 Why Accelerators Keep Winning22:28 The Market Is Underpricing It23:10 NVIDIA Is Still in the Game24:56 Vertical Integration Wins ------RESOURCES Josh: https://x.com/JoshKale Ejaaz: https://x.com/cryptopunk7213 ------Not financial or tax advice. See our investment disclosures here:https://www.bankless.com/disclosures⁠ Josh works with Anthropic as a contractor. All views expressed are his own and do not represent Anthropic, its leadership, or its affiliates. Nothing in this episode is investment advice.

    27 min
  2. The AI Energy Stack: The Actual Industry Winners

    6d ago

    The AI Energy Stack: The Actual Industry Winners

    This is the long-awaited Energy Stack episode. The AI trade is shifting from GPUs to the power, wiring, and data center infrastructure needed to support them.  Today, we cover Bloom Energy, optical networking companies like Lumentum and Corning, Marvell’s role in AI hardware, and neocloud providers such as Nebius, CoreWeave, and IREN. ------🌌 LIMITLESS HQ ⬇️ NEWSLETTER:    https://limitlessft.substack.com/FOLLOW ON X:   https://x.com/LimitlessFTSPOTIFY:             https://open.spotify.com/show/5oV29YUL8AzzwXkxEXlRMQAPPLE:                 https://podcasts.apple.com/us/podcast/limitless-podcast/id1813210890RSS FEED:           https://limitlessft.substack.com/ ------TIMESTAMPS 0:00 GPU Bottleneck Shifts0:37 Power Becomes the Constraint3:15 Five-Year Grid Delays5:47 Bloom’s Fast Energy Fix9:54 Data Transfer Hits Limits11:51 Light Replaces Copper17:25 Power Delivery Gets Harder18:22 Marvell Wins Power Design20:35 Renting Compute at Scale21:08 Nebius and NeoClouds25:17 Compute Becomes an Asset29:47 The Substrate Layer Ahead ------RESOURCES Josh: https://x.com/JoshKale Ejaaz: https://x.com/cryptopunk7213 ------Not financial or tax advice. See our investment disclosures here:https://www.bankless.com/disclosures⁠ Josh works with Anthropic as a contractor. All views expressed are his own and do not represent Anthropic, its leadership, or its affiliates. Nothing in this episode is investment advice.

    33 min
4.7
out of 5
92 Ratings

About

Exploring the frontiers of Technology and AI

You Might Also Like