1 hr 33 min
#163 - Llama 3, Grok-1.5 Vision, new Atlas robot, RHO-1, Medium ban Last Week in AI
-
- Technology
Our 163rd episode with a summary and discussion of last week's big AI news!
Note: apology for this one coming out a few days late, got delayed in editing it -Andrey
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/
Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai
Timestamps + links:
Intro / Banter
Tools & Apps
(00:02:16) Meta releases Llama 3, claims it’s among the best open models available
(00:14:01) Elon Musk’s xAI Unveils Grok-1.5 Vision, Beats OpenAI’s GPT-4V
(00:17:55) Reka releases Reka Core, its multimodal language model to rival GPT-4 and Claude 3 Opus
(00:21:50) Cohere Compass Private Beta: A New Multi-Aspect Embedding Model
(00:23:48) Amazon Music’s Maestro lets listeners make AI playlists
(00:24:36) Snap plans to add watermarks to images created with its AI-powered tools
Applications & Business
(00:25:52) Boston Dynamics unveils new Atlas robot for commercial use
(00:30:32) TSMC’s $65 billion bet still leaves US missing piece of chip puzzle
(00:36:30) U.S. blacklists Intel's and Nvidia's key partner in China — three other Chinese firms also included in the blacklist for helping the military
(00:38:37) Elon Musk says the next-generation Grok 3 model will require 100,000 Nvidia H100 GPUs to train
(00:40:22) Dr. Andrew Ng appointed to Amazon’s Board of Directors
(00:41:55) Collaborative Robotics Locks Up $100M, Latest Robot Startup To Raise Big
Projects & Open Source
(00:44:08) OpenEQA: Embodied Question Answering in the Era of Foundation Models
(00:50:03) Introducing Idefics2: A Powerful 8B Vision-Language Model for the community
Research & Advancements
(00:51:21) RHO-1: Not All Tokens Are What You Need
(00:57:21) Scaling Laws for Fine-Grained Mixture of Experts
(01:03:20) Chinchilla Scaling: A replication attempt
(01:07:18) China develops new light-based chiplet that could power artificial general intelligence — where AI is smarter than humans
(01:10:45) OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
Policy & Safety
(01:13:44) U.S. Commerce Secretary Gina Raimondo Announces Expansion of U.S. AI Safety Institute Leadership Team
(01:17:18) NSA Publishes Guidance for Strengthening AI System Security
(01:19:19) Foundational Challenges in Assuring Alignment and Safety of Large Language Models
(01:24:11) Former OpenAI Board Member Calls for Audits of Top AI Companies
(01:27:35) SoA survey reveals a third of translators and quarter of illustrators losing work to AI
Synthetic Media & Art
(01:30:25) Medium bans AI-generated content from its paid Partner Program
Our 163rd episode with a summary and discussion of last week's big AI news!
Note: apology for this one coming out a few days late, got delayed in editing it -Andrey
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/
Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai
Timestamps + links:
Intro / Banter
Tools & Apps
(00:02:16) Meta releases Llama 3, claims it’s among the best open models available
(00:14:01) Elon Musk’s xAI Unveils Grok-1.5 Vision, Beats OpenAI’s GPT-4V
(00:17:55) Reka releases Reka Core, its multimodal language model to rival GPT-4 and Claude 3 Opus
(00:21:50) Cohere Compass Private Beta: A New Multi-Aspect Embedding Model
(00:23:48) Amazon Music’s Maestro lets listeners make AI playlists
(00:24:36) Snap plans to add watermarks to images created with its AI-powered tools
Applications & Business
(00:25:52) Boston Dynamics unveils new Atlas robot for commercial use
(00:30:32) TSMC’s $65 billion bet still leaves US missing piece of chip puzzle
(00:36:30) U.S. blacklists Intel's and Nvidia's key partner in China — three other Chinese firms also included in the blacklist for helping the military
(00:38:37) Elon Musk says the next-generation Grok 3 model will require 100,000 Nvidia H100 GPUs to train
(00:40:22) Dr. Andrew Ng appointed to Amazon’s Board of Directors
(00:41:55) Collaborative Robotics Locks Up $100M, Latest Robot Startup To Raise Big
Projects & Open Source
(00:44:08) OpenEQA: Embodied Question Answering in the Era of Foundation Models
(00:50:03) Introducing Idefics2: A Powerful 8B Vision-Language Model for the community
Research & Advancements
(00:51:21) RHO-1: Not All Tokens Are What You Need
(00:57:21) Scaling Laws for Fine-Grained Mixture of Experts
(01:03:20) Chinchilla Scaling: A replication attempt
(01:07:18) China develops new light-based chiplet that could power artificial general intelligence — where AI is smarter than humans
(01:10:45) OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
Policy & Safety
(01:13:44) U.S. Commerce Secretary Gina Raimondo Announces Expansion of U.S. AI Safety Institute Leadership Team
(01:17:18) NSA Publishes Guidance for Strengthening AI System Security
(01:19:19) Foundational Challenges in Assuring Alignment and Safety of Large Language Models
(01:24:11) Former OpenAI Board Member Calls for Audits of Top AI Companies
(01:27:35) SoA survey reveals a third of translators and quarter of illustrators losing work to AI
Synthetic Media & Art
(01:30:25) Medium bans AI-generated content from its paid Partner Program
1 hr 33 min