1 hr 45 min
#162 - Udio Song AI, TPU v5, Mixtral 8x22, Mixture-of-Depths, Musicians sign open letter Last Week in AI
-
- Technology
Our 162nd episode with a summary and discussion of last week's big AI news!
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/
Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai
Timestamps + links:
Tools & Apps
(00:02:50) AI-Music Arms Race: Meet Udio, the Other ChatGPT for Music
(00:07:42) Anthropic launches external tool use for Claude AI, enabling stock ticker integrations and more
(00:11:51) Building LLMs for Code Repair
(00:14:16) Early Reviews of Humane AI Pin Aren’t Impressed
(00:16:23) Microsoft 365’s Copilot gets a GPT-4 Turbo upgrade and improved image generation
(00:18:41) AI editing tools are coming to all Google Photos users
Applications & Business
(00:19:21) Google announces the Cloud TPU v5p, its most powerful AI accelerator yet
(00:23:32) Meta unveils its newest custom AI chip as it races to catch up
(00:27:27) Intel Unveils New AI Accelerator in Bid to Challenge Nvidia
(00:30:46) Adobe Is Buying Videos for $3 Per Minute to Build AI Model
(00:32:55) OpenAI transcribed over a million hours of YouTube videos to train GPT-4
(00:36:23) Waymo will launch paid robotaxi service in Los Angeles on Wednesday
(00:37:23) OpenAI removes Sam Altman's ownership of its Startup Fund
Projects & Open Source
(00:39:51) Mistral AI Stuns With Surprise Launch of New Mixtral 8x22B Model
(00:43:54) Google updates its Gemma AI model family with variants for coding and research
(00:47:04) Aurora-M: The First Open Source Multilingual Language Model Red-teamed according to the U.S. Executive Order
Research & Advancements
(00:52:08) Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
(00:57:41) Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
(01:03:31) Octopus v2: On-device language model for super agent
(01:07:54) Bigger is not Always Better: Scaling Properties of Latent Diffusion Models
(01:09:54) Many-shot Jailbreaking
Policy & Safety
(01:15:08) Schiff unveils AI training transparency measure
(01:20:25) Linwei Ding was a Google software engineer. He was also a prolific thief of trade secrets, say prosecutors.
(01:26:11) Responsible Reporting for Frontier AI Development
(01:30:08) US govt wants to talk to tech companies about AI electricity demands — eyes nuclear fusion and fission
(01:32:39) Washington state judge blocks use of AI-enhanced video as evidence in possible first-of-its-kind ruling
(01:36:45) Trudeau announces $2.4 billion for AI-related investments
Synthetic Media & Art
(01:39:26) Billie Eilish, Pearl Jam, Nicki Minaj Among 200 Artists Calling for Responsible AI Music Practices
Fun!
(01:41:52) OpenAI's Sora just made its first music video and it's like a psychedelic trip
Our 162nd episode with a summary and discussion of last week's big AI news!
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/
Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai
Timestamps + links:
Tools & Apps
(00:02:50) AI-Music Arms Race: Meet Udio, the Other ChatGPT for Music
(00:07:42) Anthropic launches external tool use for Claude AI, enabling stock ticker integrations and more
(00:11:51) Building LLMs for Code Repair
(00:14:16) Early Reviews of Humane AI Pin Aren’t Impressed
(00:16:23) Microsoft 365’s Copilot gets a GPT-4 Turbo upgrade and improved image generation
(00:18:41) AI editing tools are coming to all Google Photos users
Applications & Business
(00:19:21) Google announces the Cloud TPU v5p, its most powerful AI accelerator yet
(00:23:32) Meta unveils its newest custom AI chip as it races to catch up
(00:27:27) Intel Unveils New AI Accelerator in Bid to Challenge Nvidia
(00:30:46) Adobe Is Buying Videos for $3 Per Minute to Build AI Model
(00:32:55) OpenAI transcribed over a million hours of YouTube videos to train GPT-4
(00:36:23) Waymo will launch paid robotaxi service in Los Angeles on Wednesday
(00:37:23) OpenAI removes Sam Altman's ownership of its Startup Fund
Projects & Open Source
(00:39:51) Mistral AI Stuns With Surprise Launch of New Mixtral 8x22B Model
(00:43:54) Google updates its Gemma AI model family with variants for coding and research
(00:47:04) Aurora-M: The First Open Source Multilingual Language Model Red-teamed according to the U.S. Executive Order
Research & Advancements
(00:52:08) Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
(00:57:41) Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
(01:03:31) Octopus v2: On-device language model for super agent
(01:07:54) Bigger is not Always Better: Scaling Properties of Latent Diffusion Models
(01:09:54) Many-shot Jailbreaking
Policy & Safety
(01:15:08) Schiff unveils AI training transparency measure
(01:20:25) Linwei Ding was a Google software engineer. He was also a prolific thief of trade secrets, say prosecutors.
(01:26:11) Responsible Reporting for Frontier AI Development
(01:30:08) US govt wants to talk to tech companies about AI electricity demands — eyes nuclear fusion and fission
(01:32:39) Washington state judge blocks use of AI-enhanced video as evidence in possible first-of-its-kind ruling
(01:36:45) Trudeau announces $2.4 billion for AI-related investments
Synthetic Media & Art
(01:39:26) Billie Eilish, Pearl Jam, Nicki Minaj Among 200 Artists Calling for Responsible AI Music Practices
Fun!
(01:41:52) OpenAI's Sora just made its first music video and it's like a psychedelic trip
1 hr 45 min