The Information Bottleneck

Ravid Shwartz-Ziv & Allen Roush

Two AI Researchers - Ravid Shwartz Ziv, and Allen Roush, discuss the latest trends, news, and research within Generative AI, LLMs, GPUs, and Cloud Systems.

  1. EP24: Can AI Learn to Think About Money? - with Bayan Bruss (Capital One)

    1日前

    EP24: Can AI Learn to Think About Money? - with Bayan Bruss (Capital One)

    Bayan Bruss, VP of Applied AI at Capital One, joins us to talk about building AI systems that can make autonomous financial decisions, and why money might be the hardest problem in machine learning. Bayan leads Capital One's AI Foundations team, where they're working toward a destination most people don't associate with banking: getting AI systems to perceive financial ecosystems, form beliefs about the future, and take actions based on those beliefs. It's a framework that sounds simple until you realize you're asking a model to predict whether someone will pay back a loan over 30 years while the world changes around them. We get into why LLMs are a bad fit for ingesting 5,000 credit card transactions, why synthetic data works surprisingly well for time series, and the tension between end-to-end learning and regulatory requirements that demand you know exactly what your model learned. We also discuss reasoning in language vs. in latent space - if you wouldn't trust a self-driving car that translated images to words before deciding to turn, should you trust a financial system that does all its reasoning in token space? Takeaways: Money is a behavioral science problem - AI in finance requires understanding people, not just numbers.Foundation models pre-trained on web text don't outperform purpose-built models for financial tasks. You're better off building a standalone encoder for financial data.Synthetic data works surprisingly well for time series - possibly because real-world time series lives on a simpler manifold than we assume.Explainability in ML is fundamentally unsatisfying because people want causality from non-causal models.Financial AI needs world models that can imagine alternative futures, not just fit historical data. Timeline: (00:24) Introduction and Bayan's Background (00:42) Claude Code, Vibe Coding - Hype or AGI? (05:59) The Future of Software Engineering and Abstraction (11:20) Abstraction Layers and Karpathy's Take (13:54) Hamming, Kuhn, and Scientific Revolutions in AI (19:24) Stack Overflow's Decline and Proof of Humanity (23:07) Why We Still Trust Humans Over LLMs (30:45) Deep Dive: AI in Banking and Consumer Finance (34:17) Are Markets Efficient? Behavioral Economics vs. Classical Views (37:14) The Components of a Financial Decision: Perception, Belief, Action (42:15) Protected Variables, Proxy Features, and Fairness in Lending (45:05) Explainability: Roller Skating on Marbles (47:55) Sparse Autoencoders, Interpretability, and Turtles All the Way Down (51:57) Foundation Models for Finance — Web Text vs. Purpose-Built (53:09) Time Series, Synthetic Data, and TabPFN (59:44) Feeding Tabular Data to VLMs - Graphs Beat Raw Numbers (1:03:35) Reasoning in Language vs. Latent Space (1:08:24) Is Language the Optimal Representation? Chinese Compression and Information Density (1:13:37) Personalization and Predicting Human Behavior (1:21:36) World Models, Uncertainty, and Professional Worrying (1:24:07) Prediction Markets and Insider Betting (1:26:33) Can LLMs Predict Stocks? (1:29:11) Multi-Agent Systems for Financial Decisions Music: "Kid Kodi" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0."Palms Down" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0. Changes: trimmed About: The Information Bottleneck is hosted by Ravid Shwartz-Ziv and Allen Roush, featuring in-depth conversations with leading AI researchers about the ideas shaping the future of machine learning.

    1時間32分
  2. EP23: Building Open Source AI Frameworks: David Mezzetti on TxtAI and Local-First AI

    2月1日

    EP23: Building Open Source AI Frameworks: David Mezzetti on TxtAI and Local-First AI

    David Mezzetti, creator of TxtAI, joins us to talk about building open source AI frameworks as a solo developer - and why local-first AI still matters in the age of API-everything. David's path from running a 50-person IT company through acquisition to building one of the most well-regarded AI orchestration libraries tells you how sometimes constraints breed better design. TextAI started during COVID when he was doing coronavirus literature research and realized semantic search could transform how we find information. We get into the evolution of the AI framework landscape - from the early days of vector embeddings to RAG to LLM orchestration. David was initially stubborn about not supporting OpenAI's API, wanting to keep everything local. He admits that probably cost him some early traction compared to LangChain, but it also shaped TextAI's philosophy: you shouldn't need permission to build with AI. We also talk about small models and some genuinely practical insights: a 20-million parameter model running on CPU might be all you need. On the future of coding with AI, David's come around on "vibe coding" and notes that well-documented frameworks with lots of examples are perfectly positioned for this new world. Takeaways: Local-first AI gives you control, reproducibility, and often better performance for your domainSmall models (even 20M parameters) can solve real problems on CPUGood documentation and examples make your framework AI-coding friendlyOpen source should mean actually contributing - not just publishing codeSolo developers can compete by staying focused and being willing to evolve Timeline: (00:14) Introduction and David's Background (07:44) TextAI History and Evolution (12:04) Framework Landscape: LangChain, LlamaIndex, Haystack (15:16) Can AI Re-implement Frameworks? (24:14) API Specs: OpenAI vs Anthropic (26:46) Running an Open Source Consulting Business (32:51) Origin Story: COVID, Kaggle, and Medical Literature (43:08) Open Source Philosophy and Giving Back (47:16) Ethics of Local AI and Developer Freedom (01:06:44) Human in the Loop and AI-Generated Code (01:09:31) The Future of Work and Automation Music: "Kid Kodi" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0."Palms Down" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0. Changes: trimmed About: The Information Bottleneck is hosted by Ravid Shwartz-Ziv and Allen Roush, featuring in-depth conversations with leading AI researchers about the ideas shaping the future of machine learning.

    1時間15分
  3. EP22: Data Curation for LLMs with Cody Blakeney (Datology AI)

    1月20日

    EP22: Data Curation for LLMs with Cody Blakeney (Datology AI)

    Cody Blakeney from Datology AI joins us to talk about data curation - the unglamorous but critical work of figuring out what to actually train models on. Cody's path from writing CUDA kernels to spending his days staring at weird internet text tells you something important: data quality can account for half or more of a model's final performance. That's on par with major architectural breakthroughs. We get into the differences between pre-training, mid-training, and post-training data. Mid-training in particular has become a key technique for squeezing value out of rare, high-quality datasets. Cody's team stumbled onto it while solving a practical problem: how do you figure out if a 5-billion-token dataset is actually useful when you can't afford hundreds of experimental runs? We also talk about data filtering and some genuinely surprising findings: the documents that make the best training data are often short and dense with information. Those nicely written blog posts with personal anecdotes? Turns out models don't learn as well from them. On synthetic data, Cody thinks pre-training is still in its early days, where most techniques are variations on a few core ideas, but there's huge potential. He's excited about connecting RL failures back to mid-training: when models fail at tasks, use that signal to generate targeted training data. Takeaways: Data work is high-leverage but underappreciatedMid-training helps extract signal from small, valuable datasetsGood filters favor dense, factual text over polished prose.Synthetic data for pre-training works surprisingly well, but remains primitive.Optimal data mixtures depend on model scale, where smaller models need more aggressive distribution shifts.Timeline (00:12) Introduction to Data Correlation in LLMs (05:14) The Importance of Data Quality (10:15) Pre-training vs Post-training Data (15:22) Strategies for Effective Data Utilization (20:15) Benchmarking and Model Evaluation (28:28) Maximizing Perplexity and Coherence (30:27) Measuring Quality in Data (32:56) The Role of Filters in Data Selection (34:19) Understanding High-Quality Data (39:15) Mid-Training and Its Importance (46:51) Future of Data Sources (48:13) Synthetic Data's Role in Pre-Training (53:10) Creating Effective Synthetic Data (57:39) The Debate on Pure Synthetic Data (01:00:25) Navigating AI Training and Legal Challenges (01:02:34) The Controversy of AI in the Art Community (01:05:29) Exploring Synthetic Data and Its Efficiency (01:11:21) The Future of Domain-Specific vs. General Models (01:22:06) Bias in Pre-trained Models and Data Selection (01:28:27) The Potential of Synthetic Data Over Human Data Music: "Kid Kodi" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0."Palms Down" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0.Changes: trimmed AboutThe Information Bottleneck is hosted by Ravid Shwartz-Ziv and Allen Roush, featuring in-depth conversations with leading AI researchers about the ideas shaping the future of machine learning.

    1時間26分
  4. EP21: Privacy in the Age of Agents with Niloofar Mireshghallah

    1月7日

    EP21: Privacy in the Age of Agents with Niloofar Mireshghallah

    Guest: Niloofar Mireshghallah (Incoming Assistant Professor at CMU, Member of Technical Staff at Humans and AI) In this episode, we dive into AI privacy, frontier model capabilities, and why academia still matters. We kick off by discussing GPT-5.2 and whether models rely more on parametric knowledge or context. Niloofar shares how reasoning models actually defer to context, even accepting obviously false information to "roll with it." On privacy, Niloofar challenges conventional wisdom: memorization isn't the problem anymore. The real threats are aggregation attacks (finding someone's pet name in HTML metadata), inference attacks (models are expert geoguessers), and input-output leakage in agentic workflows. We also explore linguistic colonialism in AI, or how models fail for non-English languages, sometimes inventing cultural traditions. The episode wraps with a call for researchers to tackle problems industry ignores: AI for science, education tools that preserve the struggle of learning, and privacy-preserving collaboration between small local models and large commercial ones. Timeline[0:00] Intro [1:03] GPT-5.2 first impressions and skepticism about the data cutoff claims [4:17] Parametric vs. context memory—when do models trust training vs. the prompt? [9:28] The messy problem of memory, weights, and online learning [16:12] Tool use changes model behavior in unexpected ways [17:15] OpenAI's "Advances in Sciences" paper and human-AI collaboration [24:17] Why deep research is getting less useful [28:17] Pre-training vs. post-training—which matters more? [30:35] Non-English languages and AI failures [33:23] Hilarious Farsi bugs: "I'll get back to you in a few days" and invented traditions [37:56] Linguistic colonialism—ChatGPT changed how we write [41:20] Why memorization isn't the real privacy threat [47:14] The three actual privacy problems: inference, aggregation, input-output leakage [54:33] Deep research stalking experiment—finding a cat's name in HTML [1:01:13] Privacy solutions for agentic systems [1:03:23] What Niloofar's excited about: AI for scientists, small models, niche problems [1:08:31] AI for education without killing the learning process [1:09:15] Closing: underrated life advice on health and sustainable habits Music: "Kid Kodi" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0. "Palms Down" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0. Changes: trimmed AboutThe Information Bottleneck is hosted by Ravid Shwartz-Ziv and Allen Roush, featuring in-depth conversations with leading AI researchers about the ideas shaping the future of machine learning.

    1時間12分
  5. EP20: Yann LeCun

    2025/12/15

    EP20: Yann LeCun

    Yann LeCun – Why LLMs Will Never Get Us to AGI"The path to superintelligence - just train up the LLMs, train on more synthetic data, hire thousands of people to school your system in post-training, invent new tweaks on RL-I think is complete bullshit. It's just never going to work." After 12 years at Meta, Turing Award winner Yann LeCun is betting his legacy on a radically different vision of AI. In this conversation, he explains why Silicon Valley's obsession with scaling language models is a dead end, why the hardest problem in AI is reaching dog-level intelligence (not human-level), and why his new company AMI is building world models that predict in abstract representation space rather than generating pixels. Timestamps(00:00:14) – Intro and welcome (00:01:12) – AMI: Why start a company now? (00:04:46) – Will AMI do research in the open? (00:06:44) – World models vs LLMs (00:09:44) – History of self-supervised learning (00:16:55) – Siamese networks and contrastive learning (00:25:14) – JEPA and learning in representation space (00:30:14) – Abstraction hierarchies in physics and AI (00:34:01) – World models as abstract simulators (00:38:14) – Object permanence and learning basic physics (00:40:35) – Game AI: Why NetHack is still impossible (00:44:22) – Moravec's Paradox and chess (00:55:14) – AI safety by construction, not fine-tuning (01:02:52) – Constrained generation techniques (01:04:20) – Meta's reorganization and FAIR's future (01:07:31) – SSI, Physical Intelligence, and Wayve (01:10:14) – Silicon Valley's "LLM-pilled" monoculture (01:15:56) – China vs US: The open source paradox (01:18:14) – Why start a company at 65? (01:25:14) – The AGI hype cycle has happened 6 times before (01:33:18) – Family and personal background (01:36:13) – Career advice: Learn things with a long shelf life (01:40:14) – Neuroscience and machine learning connections (01:48:17) – Continual learning: Is catastrophic forgetting solved? Music: "Kid Kodi" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0. "Palms Down" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0. Changes: trimmed AboutThe Information Bottleneck is hosted by Ravid Shwartz-Ziv and Allen Roush, featuring in-depth conversations with leading AI researchers about the ideas shaping the future of machine learning.

    1時間50分
  6. EP19: AI in Finance and Symbolic AI with Atlas Wang

    2025/12/10

    EP19: AI in Finance and Symbolic AI with Atlas Wang

    Atlas Wang (UT Austin faculty, XTX Research Director) joins us to explore two fascinating frontiers: the foundations of symbolic AI and the practical challenges of building AI systems for quantitative finance. On the symbolic AI side, Atlas shares his recent work proving that neural networks can learn symbolic equations through gradient descent, a surprising result given that gradient descent is continuous while symbolic structures are discrete. We talked about why neural nets learn clean, compositional mathematical structures at all, what the mathematical tools involved are, and the broader implications for understanding reasoning in AI systems. The conversation then turns to neuro-symbolic approaches in practice: agents that discover rules through continued learning, propose them symbolically, verify them against domain-specific checkers, and refine their understanding. On the finance side, Atlas pulls back the curtain on what AI research looks like at a high-frequency trading firm. The core problem sounds simple (predict future prices from past data). Still, the challenge is extreme: markets are dominated by noise, predictions hover near zero correlation, and success means eking out tiny margins across astronomical numbers of trades. He explains why synthetic data techniques that work elsewhere don't translate easily, and why XTX is building time series foundation models rather than adapting language models. We also discuss the convergence of hiring between frontier AI labs and quantitative finance, and why this is an exceptional moment for ML researchers to consider the finance industry. Links: Why Neural Network Can Discover Symbolic Structures with Gradient-based Training: An Algebraic and Geometric Foundation for Neurosymbolic Reasoning - arxiv.org/abs/2506.21797Atlas website - https://www.vita-group.space/Guest: Atlas Wang (UT Austin / XTX) Hosts: Ravid Shwartz-Ziv & Allen Roush Music: “Kid Kodi” — Blue Dot Sessions. Source: Free Music Archive. Licensed CC BY-NC 4.0.

    1時間11分
  7. EP18: AI Robotics

    2025/12/01

    EP18: AI Robotics

    In this episode, we hosted Judah Goldfeder, a PhD candidate at Columbia University and student researcher at Google, to discuss robotics, reproducibility in ML, and smart buildings. Key topics covered: Robotics challenges: We discussed why robotics remains harder than many expected, compared to LLMs. The real world is unpredictable and unforgiving, and mistakes have physical consequences. Sim-to-real transfer remains a major bottleneck because simulators are tedious to configure accurately for each robot and environment. Unlike text, robotics lacks foundation models, partly due to limited clean, annotated datasets and the difficulty of collecting diverse real-world data. Reproducibility crisis: We discussed how self-reported benchmarks can lead to p-hacking and irreproducible results. Centralized evaluation systems (such as Kaggle or ImageNet challenges), where researchers submit algorithms for testing on hidden test sets, seem to drive faster progress. Smart buildings: Judah's work at Google focuses on using ML to optimize HVAC systems, potentially reducing energy costs and carbon emissions significantly. The challenge is that every building is different. It makes the simulation configuration extremely labor-intensive. Generative AI could help by automating the process of converting floor plans or images into accurate building simulations. Links: Judah website - https://judahgoldfeder.com/ Music: "Kid Kodi" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0. "Palms Down" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0. Changes: trimmed

    1時間45分
  8. EP17: RL with Will Brown

    2025/11/24

    EP17: RL with Will Brown

    In this episode, we talk with Will Brown, a research lead at Prime Intellect, about his journey into reinforcement learning (RL) and multi-agent systems, exploring their theoretical foundations and practical applications. We discuss the importance of RL in the current LLMs pipeline and the challenges it faces. We also discuss applying agentic workflows to real-world applications and the ongoing evolution of AI development. Chapters 00:00 Introduction to Reinforcement Learning and Will's Journey 03:10 Theoretical Foundations of Multi-Agent Systems 06:09 Transitioning from Theory to Practical Applications 09:01 The Role of Game Theory in AI 11:55 Exploring the Complexity of Games and AI 14:56 Optimization Techniques in Reinforcement Learning 17:58 The Evolution of RL in LLMs 21:04 Challenges and Opportunities in RL for LLMs 23:56 Key Components for Successful RL Implementation 27:00 Future Directions in Reinforcement Learning 36:29 Exploring Agentic Reinforcement Learning Paradigms 38:45 The Role of Intermediate Results in RL 41:16 Multi-Agent Systems: Challenges and Opportunities 45:08 Distributed Environments and Decentralized RL 49:31 Prompt Optimization Techniques in RL 52:25 Statistical Rigor in Evaluations 55:49 Future Directions in Reinforcement Learning 59:50 Task-Specific Models vs. General Models 01:02:04 Insights on Random Verifiers and Learning Dynamics 01:04:39 Real-World Applications of RL and Evaluation Challenges 01:05:58 Prime RL Framework: Goals and Trade-offs 01:10:38 Open Source vs. Closed Source Models 01:13:08 Continuous Learning and Knowledge Improvement Music: "Kid Kodi" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0. "Palms Down" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0. Changes: trimmed

    1時間6分
すべて見る（24）

番組について

Two AI Researchers - Ravid Shwartz Ziv, and Allen Roush, discuss the latest trends, news, and research within Generative AI, LLMs, GPUs, and Cloud Systems.

情報

  • クリエイター
    Ravid Shwartz-Ziv & Allen Roush
  • 配信期間
    25年 - 26年
  • エピソード
    24
  • 制限指定
    不適切な内容を含む
  • Copyright
    © 2025 Ravid Shwartz-Ziv & Allen Roush
  • 番組のWebサイト
    The Information Bottleneck

その他のおすすめ