Substrate

Cat Tang

Researched writing and conversations on frontier technology.

Episodes

  1. 2d ago

    Open Source AI with Baseten's Co-Head of Research Charlie O'Neill

    Last week on OpenRouter, open source token share crossed 75% of total volume. Baseten's Co-Head of Research, Charlie O'Neill, predicted the rise of open source intelligence. Now, we discuss its consequences on Substrate: neoclouds competing with closed-source on compute purchasing, companies using RL environments and enterprise data as the new moat, and open research on continual learning. TIMESTAMPS: 00:00:00 Data is the most valuable moat 00:01:07 The Michael Scott Paper Company of AI 00:03:58 Why open source should stay behind the frontier 00:06:29 Will the gap last? Cyber and bio risk 00:08:17 Cheap closed models and the Pareto frontier 00:10:48 The real cost of post-training 00:13:14 Startups vs. Fortune 500s training their own models 00:15:02 Harvey, OpenAI, and who owns the data 00:18:47 Guardrails, ethics, and choosing a model 00:19:55 Compute, economies of scale, and pricing 00:22:53 The compute flywheel and the inference providers' bet 00:26:16 Continual learning 00:32:11 Compressing the KV cache 00:33:18 Is a longer context window bitter-lesson-pilled? 00:38:26 Where to build in the AI stack: data and RL environments 00:42:31 Scaling the RL environment muscle 00:44:04 Teaching customers to build their own RL environments 00:48:59 Benchmarks are RL environments 00:50:27 Distillation handicapped the model 00:54:20 What's next Substrate publishes researched writing and conversations on frontier technology. Site: https://read.substratemag.com/subscribe Substrate on X: https://x.com/substratemag Cat Tang on X: https://x.com/cattttang

About

Researched writing and conversations on frontier technology.