The Interlude Show

Vatsal Bajaj + Jake Kang

Interlude is a show about living through the AI transition. As we meander through the in-between of the pre- and post-AI world, we talk through the use cases, implications, and real-world impact. Helping you keep up as it all unfolds.

Episodes

  1. 16h ago

    Jasper Gilley: The Brain Region That Predicts Your Own Thoughts

    Jasper Gilley is a member at South Park Commons researching new AI architectures inspired by how the brain works - specifically the cerebellum, and what it would take for a model to introspect on its own computation the way humans do for free. Before that he was at Yutori, building vision-based web agents that emulate human users. We get into why models need expensive post-hoc interpretability while humans can dissect their own thinking automatically, his forward self-modeling work (training a deliberately undersized model to predict a transformer's own activations, then reading the residual as a novelty signal), why weighting grokking data by Zipf's law turns training into an infinite oscillator that discovers the solution and forgets it forever, why vision beats the DOM for browser agents, why software is an "exoskeleton of intelligence" and demand for it is still elastic, and what humans were actually evolutionarily designed for. Chapters: 0:00 Cold open 1:02 Intro 1:43 Researching brain-inspired architectures at South Park Commons 4:05 The cerebellum as a forward model 6:39 The Forward Self-Modeling paper 14:03 Grokking, explained 18:37 Zipfian Grokking: finding the solution and forgetting it 22:26 Yutori: why vision beats the DOM 31:23 Why Jevons' Paradox won't save your software engineering job 41:51 The window where creativity is the whole job 45:39 What humans were evolutionarily designed for 51:09 The future of post-training

    Jasper Gilley: The Brain Region That Predicts Your Own Thoughts

About

Interlude is a show about living through the AI transition. As we meander through the in-between of the pre- and post-AI world, we talk through the use cases, implications, and real-world impact. Helping you keep up as it all unfolds.