"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis Turpentine

Dive into the profound discussion on AI expectations and the future with Martin Casado, General Partner at Andreessen Horowitz, as we unpack the complexity of AI systems and their potential impact on the world. Explore the differing viewpoints on AI's epistemics, possible regulatory standards, and the art of predicting AI advancements. Gain insights into the actionable outcomes of this dialogue and the significance of understanding AI before shaping policies. Join us for this episode of the Cognitive Revolution to contemplate AI's trajectory and what it might mean for humanity.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:
Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.

Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt
Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show
(00:03:18) AI progress
(00:05:20) Threshold effects
(00:12:30) Heavy-tailed universe
(00:14:53) LLMs are not very good at unique tasks
(00:26:27) Sponsors: Oracle | Brave
(00:28:36) Understanding meaning
(00:31:44) How do LLMs work? (Part 1)
(00:36:25) Sponsors: Omneky | Squad
(00:38:12) How do LLMs work? (Part 2)
(00:44:01) Post-training
(00:51:09) Simulation
(01:04:06) Regulation
(01:08:53) What makes AI a paradigm shift
(01:11:51) Compute limits
(01:20:07) Sleeper agents
(01:23:16) Surface area of models
(01:25:49) AI regulation
(01:27:35) AI in medicine
(01:29:56) AGI, superintelligence
(01:37:04) Competition in the foundation model space
(01:40:57) The scaling laws
(01:44:31) The AGI convergence
(01:45:35) Bets on the future of AI
(01:48:20) Outro

Explore the fusion of AI and computational chemistry with University of Queensland's researcher, Tim Duignan. Learn about transforming our understanding of electrolytes, the art of simulating physical processes using neural networks, and the potential of AI in scientific breakthroughs. Discover Tim's journey creating AI models for complex system predictions and join the discussion on advancing AI's role in future scientific discoveries.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

RECOMMENDED PODCAST:
Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.
Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt
Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

SPONSORS:
Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:
(00:00:00) About the Show
(00:02:47) Introduction
(00:04:09) Why electrolyte solutions are important
(00:06:53) What properties are we trying to predict with electrolyte solutions?
(00:09:33) Battery fires
(00:13:38) Molecular dynamics
(00:16:40) Time step
(00:18:51) Scaling
(00:23:09) Sponsors: Oracle | Brave
(00:25:17) Decoherence
(00:27:23) Neural Network Potentials
(00:31:04) How big are the models?
(00:35:46) What architecture is used?
(00:38:12) Equivariance (Part 1)
(00:42:29) Sponsors: Omneky | Squad
(00:44:15) Equivariance (Part 2)
(00:44:16) AlphaFold3
(00:46:52) Zero-shot latent space communication
(00:48:21) What is coarse graining?
(00:54:31) How to know if there is no crystallization
(00:56:53) What is the role of water in the simulation?
(01:01:25) Crystallization
(01:05:26) Matching surfaces
(01:09:32) Self-ionization of water
(01:13:22) Active learning
(01:16:41) Temperature
(01:19:20) Ice and water
(01:21:12) Scaling up the model
(01:25:21) Big tech singularity
(01:27:54) China is not far behind
(01:29:15) Safety concerns
(01:31:16) KANs
(01:34:36) The future of scientific progress
(01:39:28) The art of discovery
(01:43:02) One model to rule them all
(01:47:46) AGI, its risks and benefits
(01:50:21) Power vs. Generality
(01:53:01) Generality for Utility
(01:53:40) Outro

Dive into the future of medicine with Google researchers Khaled Saab and Vivek Natarajan, discussing the breakthroughs in AI for healthcare. Discover how AI doctors may soon provide high-quality medical advice, enhancing global access to healthcare. Learn about the innovative use of large language models in medical applications and the potential for AI to outperform human doctors. Listen as we explore the significance of AI's role in healthcare and its implications for future medical practices, featuring insights from leaders in AI research.

SPONSORS:
Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

RECOMMENDED PODCAST:
Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.
Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt
Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:
(00:00:00) About the Show
(00:04:34) Introduction
(00:06:35) Flamingo
(00:11:50) Importance of data quality
(00:13:29) Amy: AI doctor
(00:18:44) Simulation Learning Environment
(00:23:26) Sponsors: Oracle | Brave
(00:25:34) Training the Agents
(00:27:29) Tens of thousands of data points
(00:30:35) How to incorporate new knowledge
(00:33:21) MedGemini
(00:34:51) Sponsors: Omneky | Squad
(00:36:38) Uncertainty guided search
(00:39:29) Generalist models
(00:41:16) MedGemini, Gemini, multimodal, medical images
(00:44:57) Future work, integration, consolidation
(00:46:00) Cost of AI
(00:52:38) When will AI Doctors be Deployed?
(00:58:22) The Speed of Trust
(00:59:58) Societal Acceptance of AI Doctors
(01:02:06) Uncertainty-Guided Search
(01:06:02) Med-Gemini: Chest X-Rays and CT Scans
(01:17:38) AI Scientist
(01:20:01) What are the principles at play?
(01:22:58) What should we do about AI?
(01:28:24) LLM for democratizing access to care
(01:34:22) Final Message
(01:35:38) Closing
(01:36:45) Outro

Dive into an accessible discussion on AI safety and philosophy, technical AI safety progress, and why catastrophic outcomes aren't inevitable. This conversation provides practical advice for AI newcomers and hope for a positive future.

Consistently Candid Podcast : https://open.spotify.com/show/1EX89qABpb4pGYP1JLZ3BB

SPONSORS:
Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

Recommended Podcast:
Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.
Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt
Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:
(00:00:00) About the Show
(00:03:50) Intro
(00:08:13) AI Scouting
(00:14:42) Why arent people adopting AI more quickly?
(00:18:25) Why dont people take advantage of AI?
(00:22:35) Sponsors: Oracle | Brave
(00:24:42) How to get a better understanding of AI
(00:31:16) How to handle the public discourse around AI
(00:34:02) Scaling and research
(00:43:18) Sponsors: Omneky | Squad
(00:45:03) The pause
(00:47:29) Algorithmic efficiency
(00:52:52) Red Teaming in Public
(00:55:41) Deepfakes
(01:01:02) AI safety
(01:04:00) AI moderation
(01:07:03) Why not a doomer
(01:09:10) AI understanding human values
(01:15:00) Interpretability research
(01:18:30) AI safety leadership
(01:21:55) AI safety respectability politics
(01:33:42) China
(01:37:22) Radical uncertainty
(01:39:53) P(doom)
(01:42:30) Where to find the guest
(01:44:48) Outro

In this episode of the Cognitive Revolution, join us as we dive into a compelling conversation with Josep M. Pujol, Chief of Search at Brave, about the complexities of developing a privacy-focused search engine. Explore how Brave maintains user data privacy while managing over 1 million searches per hour with an AI-powered system. Gain insights into the significance of human evaluation in AI and learn about the potential of the Brave Search API. Don't miss the shared Google collab notebook link in the show notes!

🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

Google collab notebook : https://colab.research.google.com/drive/1AxQD-bDePl1l90A_gwvfAGXBIl92ERKy#scrollTo=WrhGZsvbxZy8

SPONSORS:
Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Recommended Podcast:
Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.
Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt
Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:
(00:00:00) Introduction
(00:05:46) Brave
(00:07:52) How Brave collects data
(00:10:45) The problem is not the data
(00:14:02) How Brave builds its index
(00:16:36) PageRank
(00:21:07) Sponsors: Oracle | Brave
(00:23:14) Brave Search
(00:26:26) Hardware improvements
(00:28:33) Language models
(00:34:17) Noise reduction in vertical search
(00:36:50) Fine-tuning models
(00:43:09) Sponsors: Squad | Omneky
(00:44:55) Ensemble approach
(00:58:00) The future of the web
(01:03:30) The business side of this
(01:09:22) Brave Search users
(01:14:21) Brave Search API vs. Google
(01:20:00) Brave Search API Pricing
(01:23:26) Brave Search API Use Cases

Dive into the world of AI investments with Eric Vishria of Benchmark and Sergiy Nesterenko of Quilter. Explore the future of AI in hardware design, the strategies for venture capital investment in the AI era, and the impact on society. Discover why Benchmark has yet to invest in foundation model companies and the significance of solving enduring problems in this dynamic field. Join us for an eye-opening discussion on the intersection of AI technology and business innovation.

🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

SPONSORS:
Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Recommended Podcast - The Riff with Byrne Hobart
Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.
Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt
Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486

CHAPTERS:
(00:00:00) Introduction
(00:10:12) The Idea Maze
(00:12:28) Disruptive Approach
(00:15:47) Sparse reward problem
(00:18:26) Sponsors: Oracle | Brave
(00:20:34) Reliability of the reward signal
(00:28:12) Model size and compute
(00:30:14) Simulation methods
(00:35:48) Superhuman circuit board design
(00:38:53) Sponsors: Squad | Omneky
(00:40:38) What does the future of circuit board design look like?
(00:43:11) How do I make money in AI?
(00:46:18) What is cutting edge?
(00:48:34) Researchers vs. engineers
(00:50:51) Call for startups