No Priors: Artificial Intelligence | Machine Learning | Technology | Startups Conviction | Pod People

OpenAI’s leadership has taken us all on a rollercoaster so it’s great timing for another host-only episode. This week Sarah and Elad get into what has been going on at OpenAI and what the turbulent leadership changes tell us about the importance of good intent and good incentives when building these influential companies. They also talk about innovative products coming out of Pika Labs, why people are moving away from diffusion models to LLMs, and how, in AI investing, the ASP is the opportunity. 

Sign up for new podcasts every week. Email feedback to show@no-priors.com
Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil
Show Notes: 
(0:00) Recapping the OpenAI saga
(9:56) AI video products
(16:14) Moving from Diffusion Models to LLMs
(19:47) The beneficial margins of AI investing

The future of tech is 25-person companies powered by AI agents that help us accomplish our larger goals. Imbue is working on building AI agents that reason, code and generally make our lives easier. Sarah Guo and Elad Gil sit down with co-founders Kanjun Qiu (CEO) and Josh Albrecht (CTO) to discuss how they define reasoning, the spectrum of specialized and generalized agents, and the path to improved agent performance. Plus, what’s behind their $200M Series B fundraise. 

Kanjun Qiu is the CEO and co-founder of Imbue. Kanjun is also a partner at angel fund Outset Capital, where she invests in promising pre-seed companies. Previously, Kanjun was the co-founder and CEO of Sourceress, a machine learning recruiting startup backed by YC and DFJ. She was previously Chief of Staff to Drew Houston at Dropbox, where she helped scale the company from 300 employees to 1200.

Josh Albrecht is the CTO and co-founder of Imbue. He also invests in other founders via his fund, Outset Capital. He has published machine learning papers as an academic researcher; founded an AI recruiting company that went through YC and a 3D injection molding software company that was acquired; helped build Addepar as an early engineer; and served as a Thiel Fellow mentor. He started programming as a kid and began working professionally as a software engineer in high school. 

Show Links: 

Kanjun’s LinkedIn | Website | Google Scholar


Josh’s LinkedIn | Website | Google Scholar


Imbue raises $200M to build AI systems that can reason and code

Sign up for new podcasts every week. Email feedback to show@no-priors.com

Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @Kanjun | @JoshAlbrecht

Show Notes: 
(00:00) - Introduction to Imbue
(04:55) - The Spectrum of Agent Tasks
(08:43) - Specialization and Generalization With Agents
(13:03) - Code and Language in AI Agents

Open Source fuels the engine of innovation, according to Arthur Mensch, CEO and co-founder of Mistral AI. Mistral is a French AI company which recently made a splash with releasing Mistral 7B, the most powerful language model for its size to date, and outperforming much larger models. Sarah Guo and Elad Gil sit down with Arthur to discuss why open source could win the AI wars, their $100M+ seed financing, the true nature of scaling laws, why he started his company in France, and what Mistral is building next.

Arthur Mensch is Chief Executive Officer and co-founder of Mistral AI. A graduate of École Polytechnique, Télécom Paris and holder of the Master Mathématiques Vision Apprentissage at Paris Saclay, he completed his thesis in machine learning for functional brain imaging at Inria (Parietal team). He spent two years as a post-doctoral fellow in the Applied Mathematics department at ENS Ulm, where he carried out work in mathematics for optimization and machine learning. In 2020, he joined DeepMind as a researcher, working on large language models, before leaving in 2023 to co-found Mistral AI with Guillaume Lample and Timothee Lacroix.

Show Links: 

Arthur’s Linkedin

Mistral

Mistral 7b

Retro: Improving language models by retrieving from trillions of tokens

Chinchilla: Training Compute-Optimal Large Language Models

Sign up for new podcasts every week. Email feedback to show@no-priors.com
Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @ArthurMensch

Show Notes: 
(0:00) - Why he co-founded Mistral
(4:22) - Chinchilla and Proportionality 
(6:16) - Mistral 7b
(9:17) - Data and Annotations
(10:33) - Open Source Ecosystem 
(17:36) - Proposed Compute and Scale Limits
(19:58) - Threat of Bioweapons 
(23:08) - Guardrails and Safety 
(29:46) - Mistral Platform
(31:31) - French and European AI Startups

Each iteration of ChatGPT has demonstrated remarkable step function capabilities. But what’s next? Ilya Sutskever, Co-Founder & Chief Scientist at OpenAI, joins Sarah Guo and Elad Gil to discuss the origins of OpenAI as a capped profit company, early emergent behaviors of GPT models, the token scarcity issue, next frontiers of AI research, his argument for working on AI safety now, and the premise of Superalignment. Plus, how do we define digital life?
Ilya Sutskever is Co-founder and Chief Scientist of OpenAI. He leads research at OpenAI and is one of the architects behind the GPT models. He co-leads OpenAI's new "Superalignment" project, which tries to solve the alignment of superintelligences in 4 years. Prior to OpenAI, Ilya was co-inventor of AlexNet and Sequence to Sequence Learning. He earned his Ph.D in Computer Science from the University of Toronto.

Show Links:
Ilya Sutskever | LinkedIn
Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @ilyasut

Show Notes:
(00:00) - Early Days of AI Research
(06:51) - Origins of Open Ai & CapProfit Structure
(13:46) - Emergent Behaviors of GPT Models
(17:55) - Model Scale Over Time & Reliability
(22:23) - Roles & Boundaries of Open-Source in the AI Ecosystem (28:22) - Comparing AI Systems to Biological & Human Intelligence (30:52) - Definition of Digital Life
(32:59) - Super Alignment & Creating Pro Human AI
(39:01) - Accelerating & Decelerating Forces 

Cyber Security is going to change significantly in the era of AI, according to Ryan Noon, cofounder of Material Security, a security company that makes cloud-based Google and Microsoft email a safe place for sensitive data. Elad Gil and Ryan talk about how Material Security started to use LLMs, potential security threats from AI hacks, and the role of the government in securing the Internet. Ryan also shares his advice for founders.

Ryan co-founded Material Security in 2017 after seeing high profile email hacks in the 2016 Presidential election. Previously, he led various engineering teams at Dropbox after it acquired his first company, Parastructure. Prior to Parastructure, he led engineering at a data analysis company spun out of Stanford by DARPA. He holds both an MS in Computer Networks and Security and a BS in Computer Science from Stanford.

Show Links: 

Ryan Noon LinkedIn



Material Security Website 


The Market for Silver Bullets by Ian Grigg


Sign up for new podcasts every week. Email feedback to show@no-priors.com

Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @InternetMeme

Show Notes: 
(00:00) - How 2016 Election Hacking Inspired Ryan to Start Material Security
(05:00) - Generative AI Use Cases in Cyber Security & Fine Tuning
(11:36) - Predictions on Effective Threat Levels from AI Hacks
(14:45) - Democracy, the Department of Defence, DARPA and Cyber Security
(20:14) - Is there room for startups in the Cyber Security industry?
(26:40) - New Challenges On Horizon After 7 Years as Cofounder
(32:30) - Advice to Founders

As the Lead for Generative AI in the Office of the CTO for Google Cloud, Kawal Gandhi has a unique vantage point on enterprise AI rollout. Sarah Guo and Elad Gil sit down with Gandhi this week to discuss his insights on how enterprises can effectively invest in AI development, the importance of TPUs, and Google’s internal AI applications. Plus, when will email get more intelligent? 

Kawal Gandhi has worked at Google for nearly a decade in search and ad roles before focusing on the development and marketing of AI tools.

Show Links: 

Kawal Gandhi | LinkedIn


Google Cloud  


Sign up for new podcasts every week. Email feedback to show@no-priors.com
Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @geeztweets

Show Notes: 
(00:00) - Generative AI in Google Cloud
(09:05) - AI Adoption in the Enterprise
(13:31) - Multi-Modal AI Models
(16:19) - AI Adoption, return-on-investment, anti-patterns
(24:43) - Google's TPU and NVIDIA GPU shortage
(31:00) - Data Marketplace and Model Training