AI Frontiers

Center for AI Safety

AI Frontiers is a platform for expert dialogue and debate on the impacts of artificial intelligence. Sign up for our newsletter: https://ai-frontiers.org/subscribe

  1. 2 days ago

    “AI Content Must Now Carry a Label. Cameras Are Next.” by AI Frontiers

    Subtitle: New EU and California laws require AI companies, and eventually camera makers, to sign their media outputs. It's our best chance to tell what's real. Eddan Katz, Head of Policy & Gov Affairs at Encypher — August 13, 2026 Two days before Slovakia's 2023 parliamentary election, a fabricated audio clip spread widely on social media, appearing to catch a leading candidate and a prominent journalist discussing how to rig the vote. The following year, nonconsensual pornographic deepfakes of Taylor Swift amassed over 45 million views on X in less than 24 hours. In summer 2025, an elderly woman in Ontario lost her life savings to a cryptocurrency scam, which began with a Facebook advertisement featuring a deepfake of Prime Minister Mark Carney. In each of these cases, harm might have been reduced by content provenance metadata: information attached to content that declares how it was produced. (Generally, the term “provenance” refers to a record of where something came from and what happened to it along the way.) Content provenance tools can’t directly prove whether a bare image or video is real or synthetic; no technology reliably can. Instead, they serve as an evidentiary layer of AI governance [...] --- Outline: (02:49) What Content Provenance Is and How It Works (06:51) Limitations of Content Credentials (12:00) What the EU and California Acts Require (15:15) The EU and California Laws' Global Impact (17:43) How Provenance Mandates Support Courts in Tackling Deepfake Evidence (21:21) Discussion about this post (21:25) Ready for more? --- First published: August 13th, 2026 Source: https://newsletter.ai-frontiers.org/p/ai-content-must-now-carry-a-label --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

  2. 4 days ago

    “AGI Will Set Off an Industrial Explosion” by AI Frontiers

    Subtitle: If AI reaches the point where it can do the cognitive work humans do, robots will proliferate. Standard data on US industry implies a fully automated economy could double its output roughly every year. Damon Binder, Senior Researcher at Coefficient Giving — August 11, 2026 AI systems now write so fluently that cheating at universities has become ubiquitous and “AI slop” is displacing human writing across the internet. They have begun producing original proofs on long-standing open problems in mathematics. Researchers at the frontier AI companies have largely stopped writing their own code, and the models’ hacking abilities are strong enough that the US government temporarily export-controlled Anthropic's Claude Fable 5, days after its release. Ten years ago, every claim in this paragraph would have sounded like science fiction. It is easy to become numb to this progress. Today's AI agents remain endearingly clumsy; watching Claude run a small store is a bit like watching a child running a lemonade stand. But we should not let such awkwardness distract from the trend. These systems have evolved from research curiosities to extremely powerful economic engines in 10 years, with no end in sight. I want to take [...] --- Outline: (03:17) Why AGI Gives You Robots (06:50) Machine Labor Will Be Cheap (08:20) Input-Output Analysis (11:38) How Fast Could an Autonomous Economy Grow? (17:03) From Investment Boom to Unprecedented Growth (20:50) What Could Stop an AI Industrial Explosion? (24:01) Power Without People (26:15) Discussion about this post (26:19) Ready for more? --- First published: August 11th, 2026 Source: https://newsletter.ai-frontiers.org/p/agi-will-set-off-an-industrial-explosion --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

  3. 5 Aug

    “An International AI Slowdown Is Ready Whenever Politicians Are” by AI Frontiers

    Subtitle: Skeptics of an AI slowdown deal with China say we’d need futuristic tech to make it cheat-proof. Instead, the US and China could just give auditors comprehensive access to major AI companies. Felix Choussat, Visiting Policy Researcher at the Center for AI Safety and Adam Khoja, Researcher at the Center for AI Safety — August 5, 2026 On July 28, over a thousand employees of the world's top AI companies advocated that the US government “support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development.” Following months of cybersecurity scares and their own loss of control incidents, both OpenAI and Anthropic officially endorsed the same message, recognizing the danger of blindly accelerating AI development. Despite this new urgency, many people argue that coordinating an international slowdown is currently unworkable—including some of the same groups in favor of one. Even if the US slowed down its own AI development, it wouldn’t be able to make sure that China was doing the same, leaving the US no choice but to race. These anti-slowdown arguments usually emphasize the technical challenges with designing AI monitoring measures to ensure a slowdown [...] --- Outline: (05:01) Enforcing a Slowdown Through Whole-Lab Inspections (09:39) Joint Verification (13:47) Benefits of Slowdown (16:10) An AI Slowdown Does Not Require New Technology (18:29) Discussion about this post (18:33) Ready for more? --- First published: August 5th, 2026 Source: https://newsletter.ai-frontiers.org/p/an-international-ai-slowdown-is-ready --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

  4. 3 Aug

    “AI Jailbreak Disclosure Is Broken. Here’s How to Fix It” by AI Frontiers

    Subtitle: Researchers who find dangerous flaws in frontier models have nowhere safe to report them. AI needs the disclosure system that cybersecurity built decades ago. Rich Barton-Cooper, Research Manager at MATS and Adam Gleave, CEO of FAR.AI — August 3, 2026 Frontier AI developers deploy significant safeguards to prevent their AI models from being misused. However, these safeguards are not robust: AI researchers consistently find techniques for circumventing them, commonly known as “jailbreaks.” Once companies learn about a jailbreak, they can usually implement a fix; yet AI researchers currently lack a safe and reliable way to inform AI companies about the jailbreaks they’ve discovered. We propose concrete improvements to the current system based on cybersecurity norms of responsible disclosure. Addressing this problem is urgent. Frontier AI models are already being abused by malicious actors: terrorist group Boko Haram is reported to be training its members on jailbreaking techniques in order to troubleshoot weapons, design new explosive devices, and plan attacks. Some former Boko Haram members stated an unequivocal willingness to use chemical or biological weapons—a task jailbroken models may already be able to help with today. With model capabilities continuing to rapidly accelerate—including in offensive cyber, where jailbreaks [...] --- Outline: (04:11) There Is No Good Way to Report Jailbreaks (06:12) Current Reporting Mechanisms Are Limited (11:19) Fear of Liability May Incentivize Vendors to Ignore Reports (12:26) Established Channels Are Often Covered by Powerful NDAs (15:11) Labs Grade Jailbreaks Without Oversight (16:27) The System Today Looks Increasingly Fragile (17:46) Proposals for Better Disclosure Practices (24:26) Relevant Parties Should Act Now (27:16) Discussion about this post (27:21) Ready for more? --- First published: August 3rd, 2026 Source: https://newsletter.ai-frontiers.org/p/ai-jailbreak-disclosure-is-broken --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

  5. 29 Jul

    “Don’t Let AI Developers Hire Their Own Referees” by AI Frontiers

    Subtitle: Letting AI developers pick their own safety auditors creates a conflict of interest. Requiring liability insurance instead would put insurers’ own capital behind risk assessments. Gabriel Weil, Professor at the University of Houston Law Center — July 29, 2026 A growing chorus of scholars and policymakers favors letting private organizations—rather than a government regulator—govern frontier AI. In the leading family of proposals, the state sets the safety outcomes it wants and licenses independent verification organizations (IVOs) that compete to certify developers against those outcomes. Gillian Hadfield has developed the idea as “regulatory markets,” in which AI developers must pay for oversight from private regulators that governments license and hold accountable for safety standards. Dean Ball, who likens the arrangement to bank supervision, has argued for a version he calls “private governance,” which a nonprofit named Fathom has converted into model legislation. The rationale is that legislators and agencies are poorly positioned to write good safety rules for frontier AI: they understand these systems less well than the labs building them, and rules fixed in advance cannot keep pace as the technology changes. Private verifiers, meanwhile, are closer to the technology than any agency and are disciplined by [...] --- Outline: (03:12) Building the Right Incentive Structures (08:15) A Mandatory Insurance Model for AI Governance (12:23) Objections to a Mandatory Insurance Model (20:41) Mandatory Insurance Is a Better Form of Private Governance (22:38) Discussion about this post (22:42) Ready for more? --- First published: July 29th, 2026 Source: https://newsletter.ai-frontiers.org/p/dont-let-ai-developers-hire-their --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

  6. 20 Jul

    “Drone WMDs Don’t Need Any New Technology” by AI Frontiers

    Subtitle: Today's drones can already navigate indoors, track down humans, and deliver a lethal payload. Attackers willing to kill indiscriminately don’t need to wait for much else. Felix Choussat — July 20, 2026 Drones are cheap, disposable, and the future of war. Over the past four years, we have seen platforms, missiles, and heavy infantry become increasingly obsolete in the face of $500 drones carrying a pack of explosives—a cost advantage that has let Iranians and Ukrainians alike neuter the conventional capabilities of their great power rivals. Eighty percent of casualties in the bloodiest war since 1945 are from drone strikes, Russia has managed to lose one-third of its fleet to a country without a navy, and the US is spending millions of dollars to intercept five-figure Shaheds flying over the Strait of Hormuz. All this is the result of a technology that is still immature. The violence inflicted by today's drones is the handiwork of the scant few that manage to evade countermeasures (a mix of radio jamming, high-power microwave weapons, missiles, automatic cannons, interceptor drones, and nets) before making contact. These defenses exploit the inherent limitations of drones—human guidance, GPS feedback, flight exposure, radio links, range—to [...] --- Outline: (03:02) Breaking the Last Barriers to Autonomous Weapons (08:38) Future Methods of Weaponization (10:52) What an Urban Drone Attack Might Look Like (13:26) Defenses Against Drone WMDs May Be Inadequate (17:46) Strategic Applications for Rogue Actors (21:37) Taking Drone WMDs Seriously (23:43) Discussion about this post (23:47) Ready for more? --- First published: July 20th, 2026 Last updated: July 27th, 2026 Source: https://newsletter.ai-frontiers.org/p/drone-wmds-dont-need-any-new-technology --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

  7. 20 Jul

    “Drone WMDs Don’t Need Any New Technology” by Felix Choussat

    Drones are cheap, disposable, and the future of war. Over the past four years, we have seen platforms, missiles, and heavy infantry become increasingly obsolete in the face of $500 drones carrying a pack of explosives—a cost advantage that has let Iranians and Ukrainians alike neuter the conventional capabilities of their great power rivals. Eighty percent of casualties in the bloodiest war since 1945 are from drone strikes, Russia has managed to lose one-third of its fleet to a country without a navy, and the US is spending millions of dollars to intercept five-figure Shaheds flying over the Strait of Hormuz. All this is the result of a technology that is still immature. The violence inflicted by today's drones is the handiwork of the scant few that manage to evade countermeasures (a mix of radio jamming, high-power microwave weapons, missiles, automatic cannons, interceptor drones, and nets) before making contact. These defenses exploit the inherent limitations of drones—human guidance, GPS feedback, flight exposure, radio links, range—to take them down en masse. And yet, even though 75% of some types of drones manufactured today never reach their targets, they have nonetheless been strategically decisive in Ukraine and elsewhere. These limitations will [...] --- Outline: (02:33) Breaking the Last Barriers to Autonomous Weapons (08:21) Future Methods of Weaponization (10:39) What an Urban Drone Attack Might Look Like (13:20) Defenses Against Drone WMDs May Be Inadequate (17:46) Strategic Applications for Rogue Actors (21:46) Taking Drone WMDs Seriously --- First published: July 20th, 2026 Source: https://aifrontiersmedia.substack.com/p/drone-wmds-dont-need-any-new-technology --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

  8. 10 Jul

    “The Government Is Choosing AI Models. Who Chooses Their Values?” by AI Frontiers

    Subtitle: The public deserves a say over the values of government-procured AIs. Kevin Frazier and Andrew Reddie — July 10, 2026 In September 2025, the state of California made an AI assistant, Poppy, generally available to employees, to help them “explore AI's productivity benefits.” The following month, the North Dakota Legislative Council deployed AI to assist with summarizing bills. And, in March 2026, the Los Angeles Superior Court partnered with an AI company to provide support across several key functions, including “case information, summarization, research, analysis and drafting assistance,” as well as case management. In the near future, it is likely that more US states and the federal government will direct the technology toward even more sensitive and significant tasks. AI may be used to adjudicate disputes, accelerate law-enforcement activities, and aid military operations to an even greater extent than it does today. As AI use cases are more regularly documented, scrutinized, fine-tuned, and optimized, people may actually demand increased AI adoption among government actors, even in sensitive domains. That raises the question: which models should be used? This question has no simple answer. With other technologies, the choice of a specific model might largely come down to [...] --- Outline: (02:32) How Model Character Could Influence Policy (06:34) Introducing Public Reasoning Fidelity (13:23) Designing an Institution to Evaluate PRF (16:34) Precedents (20:34) The Public Should Choose Public AI Values (21:47) Discussion about this post (21:51) Ready for more? --- First published: July 10th, 2026 Source: https://newsletter.ai-frontiers.org/p/the-government-is-choosing-ai-models --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

About

AI Frontiers is a platform for expert dialogue and debate on the impacts of artificial intelligence. Sign up for our newsletter: https://ai-frontiers.org/subscribe

You Might Also Like