AISN #41: The Next Generation of Compute Scale

Plus, Ranking Models by Susceptibility to Jailbreaking, and Machine Ethics.

Listen to the AI Safety Newsletter for free on Spotify or Apple Podcasts.

The Next Generation of Compute Scale

AI development is on the cusp of a dramatic expansion in compute scale. Recent developments across multiple fronts—from chip manufacturing to power infrastructure—point to a future where AI models may dwarf today's largest systems. In this story, we examine key developments and their implications for the future of AI compute.

xAI and Tesla are building massive AI clusters. Elon Musk's xAI has brought its Memphis supercluster—“Colossus”—online. According to Musk, the cluster has 100k Nvidia H100s, making it the largest supercomputer in the world. Moreover, xAI plans to add 50k H200s in the next few months. For comparison, Meta's Llama 3 was trained on 16k H100s.

Meanwhile, Tesla's “Gigafactory Texas” is expanding to house an AI supercluster. Tesla's Gigafactory supercomputer [...]

---

Outline:

(00:18) The Next Generation of Compute Scale

(04:36) Ranking Models by Susceptibility to Jailbreaking

(06:07) Machine Ethics

The original text contained 1 image which was described by AI.

---

First published:
September 11th, 2024

Source:
https://newsletter.safe.ai/p/ai-safety-newsletter-41-the-next

---

Want more? Check out our ML Safety Newsletter for technical safety research.

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.