Top Technology Charts on Apple Podcasts

Super Data Science: ML & AI Podcast with Jon Krohn

1

Super Data Science: ML & AI Podcast with Jon Krohn

Jon Krohn
La XtrategIA

2

La XtrategIA

la.xtrategia
This Week in Tech (Audio)

3

This Week in Tech (Audio)

TWiT
Last Week in AI

4

Last Week in AI

Skynet Today
Apple Events

5

Apple Events

Apple
Technology Untangled

6

Technology Untangled

Hewlett Packard Enterprise
Samtaler i digitaliseringens skær og skygge

7

Samtaler i digitaliseringens skær og skygge

Hans Ravnkjær Larsen, Dansk IT

5 days ago

1028: The Chip Built for Agentic AI Inference, with SambaNova's Anton McGonnell

In Episode #1028, Anton McGonnell (VP of Product at SambaNova) joins Jon Krohn to explain why the chips running most AI inference today were never designed for the job. Agentic AI has changed the computational profile of inference, with much larger inputs and far heavier caches feeding the token generation that follows, and that shift has exposed where GPU architecture struggles. SambaNova has raised over $2 billion to build an alternative, the reconfigurable dataflow unit, which lays a whole model out spatially across the chip rather than executing it kernel by kernel. In this episode, Anton discusses why the speed that matters is payback, and how speed and concurrency are what turn a fixed hardware cost into a six-month payback. He also walks through the trade-off every inference provider faces between speed per user and throughput per chip, what the RDU architecture changes about scaling and data center deployment, the economics of the new SN50, and why four out of five AI infrastructure leaders say they would pay a premium for faster tokens. Additional materials: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://www.superdatascience.com/1028⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information. In this episode you will learn: (00:02:41) Why agentic AI is reshaping inference workloads (00:08:39) How SambaNova's RDU differs from a GPU (00:17:54) The economics of the SN50

Top Technology Podcasts

Top Shows: Technology

Trending Episodes: Technology

1028: The Chip Built for Agentic AI Inference, with SambaNova's Anton McGonnell