LessWrong posts by zvi

zvi
  • 5.0 (2)
  • Technology
  • Updated Daily

Audio narrations of LessWrong posts by zvi

  1. 1h ago

    “Anthropic Files Its S-1” by Zvi

    The full text is finally here, so we are giving it the full RTFB of model card treatment. First, a recap of the state of Anthropic finances, then a close reading of the relevant parts of the S-1. A lot of it is technical and uninteresting, often pro forma, and gets skipped. A lot of it gets repeated many times. A lot of this is also Anthropic ‘playing the hits’ we have heard many times, now to the investor circuit. Get your drinks ready for when we have to maximize the upside and minimize the downside. This presentation of S-1 data has some cool Claude-created charts if that's your jam. Here are my top 10 takeaways from the S-1, for those already familiar with Anthropic. Existential risk is mentioned briefly only in the passive voice, and alignment issues are mostly treated as prosaic. They want to claim Big Mission but also sound as much as possible like a normal company. They are downplaying their willingness to pay real costs for safety, and downplaying the danger quite a lot. ‘Pacing the Frontier’ is not something they will do on their own. They’ll do [...] --- Outline: (02:48) Show Me the Money (10:11) Anthropic Has The Money (11:47) Shares of Many Classes (13:57) Who Governs Anthropic? (18:57) The Cap Table (19:43) Realize the Benefits While Navigating and Preventing the Risks (20:42) Just Think of the Potential (21:20) People Are Worried About AI Killing Everyone (1) (23:25) Anthropic Bets Big on AI (24:42) Anthropic Does Not Fully Maximize Profits (27:48) Everything Is Awesome (29:23) How Much Is AI Worth? (30:37) How Much Would You Pay? (31:48) Minimize Those Risks (33:58) Hopefully Introducing the World's Most Powerful Model (38:25) Might Not Compute (40:11) Supply Chain Risk (1) (40:32) Anthropic Is Nothing Without Its People (45:00) Shitloads of Money (46:40) Someone Has To Buy The Product (47:51) Did You Know There Are Other Frontier Labs? (48:27) Why They Hate Us (49:28) Claude Seems Pretty Misaligned to Anthropic (53:42) People Are Worried About AI Killing Everyone (2) (59:26) Someone Might Sue or Regulate Anthropic (01:00:38) Supply Chain Risk (2) (01:01:07) We're Too Safety (01:02:19) Claude Core (01:02:41) We've Never Actually Made Money (01:04:06) You Are Buying Stock In a Company (01:05:04) There Will Be No Dividends (01:05:38) What Are We Even Doing? (01:07:18) The Financial Model (01:11:55) The Business of Intelligence and Maybe Killing Everyone (01:15:10) Don't Give a Damn About My Regulation (01:17:08) The Bottom Line --- First published: October 28th, 2026 Source: https://www.lesswrong.com/posts/dbdz6zb6qjaq6yHKs/anthropic-files-its-s-1 --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

  2. 1d ago

    “Anthropic Versus Anthropic” by Zvi

    Anthropic is a frustrating company. Sometimes it will do things I greatly appreciate, including at substantial cost. They have taken bold stands, have a unique governance structure and have hired and worked to establish a relatively strong (but I think still inadequate) safety culture. Other times, it will do things that are deeply disappointing. It produces very good models. That too is not entirely a good thing. One can both be the best given the alternatives, and insufficient to meet the moment. Ultimately, what you think about Anthropic depends on what parts you care about most, and what you think would be sufficient. Anthropic is great if you think the problems are important and difficult, but within the range of what Anthropic's approaches can solve. If you think we mainly need operational excellence and caring about safety and the future, then there are some non-excellent operations to fix but that goal seems doable for Anthropic. If you think the problems go well beyond that, then things look rather grim for everyone. Today's post begins with a continuation of discussion over Anthropic's leaked draft bill. See my previous coverage for details of the [...] --- Outline: (01:43) Dario Amodei Responds to Nathan Calvin (20:50) Kelsey Piper Goes Inside Anthropic (26:19) The Technical Problems of AI Safety Are Not Solved (27:50) The Quest for Embedded Evaluators (33:57) METR Questions Risk Report Methodology But Affirms Risk is Low (38:58) The Anthropic Public Benefit Fund (41:39) Anthropic Versus Anthropic --- First published: October 27th, 2026 Source: https://www.lesswrong.com/posts/ZSrX8gucWsKahsitk/anthropic-versus-anthropic --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

  3. 2d ago

    “Gemini 4 Argon: The Model and Safety Cards” by Zvi

    Gemini 4's model card is a compact 14 pages. Its safety and security report has 217. This is The Way. It also means we have a lot of new reading material. I will quickly summarize the model card, then focus on the safety card. As always, many statements here also apply to other frontier labs. A lot of this one is probably for diehards (and members of technical staff) only, plus those who find this interesting. Most of you do not need to dig into the cards on this level, and I found most of what we see entirely unsurprising. The biggest takeaways are: Argon is clearly much stronger than Gemini Flash 3.8, in essentially all ways. Argon is not so dangerous as to make us think Singularity Real Soon Now, or otherwise raise the big red flags and alarms. Argon seems relatively aligned on prosaic metrics. Prompt injection resistance is world class, hallucinations are down and other neat stuff like that. However: Eval awareness is much higher. It is unclear how much this is impacting things, and we have evidence in both directions (see I Can See Everything). [...] --- Outline: (03:02) The Model Card (04:31) Safety Card Executive Summary (1) (07:30) Safety and Security Mitigations (2) (10:11) Frontier Safety (3) (11:52) The CCL and TCL Thresholds (14:56) Biological Misuse (3.2.1) (19:38) Refusal Rates (20:43) Chemical, Nuclear and Radiological Misuse (22:01) Cybersecurity (3.2.2) (24:45) Harmful Manipulation (3.2.3) (25:40) Misuse Safeguards (3.3) (26:30) Loss of Control (3.4) (30:23) Either AI R&D Is Accelerating Or It Isn't (32:22) The Holistic Loss of Control Assessment (3.4.3) (35:49) Alignment Assessment (3.4.4) (42:41) Chain of Thought Transparency (3.4.5) (47:32) Voices in My Head (48:48) I Can See Everything (53:06) Security Mitigations (3.6) (54:14) Preventing Content Safety & Agentic Misuse (4) (56:50) Model Distillation (4.3) (57:36) Promoting Safe & Aligned Model Interactions (5) (59:48) Sycophancy (5.4) (01:01:28) Hallucinations (5.5) (01:01:51) Helpfulness (5.6) (01:03:11) Agentic Robotics, Wait What (5.7) (01:04:31) Preventing Harm to Users from Third Parties (6) (01:05:31) Strengthening Cyber Defense Capabilities (7) --- First published: October 26th, 2026 Source: https://www.lesswrong.com/posts/EeT8MEqgpuPtpdmJE/gemini-4-argon-the-model-and-safety-cards --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

  4. 4d ago

    “The Hackening” by Zvi

    Last week at a small conference, there was talk about a future event referred to as The Hackening. As in, within 6 to 12 months, many predicted that due to advanced AIs and AI agents the internet would become a severely hostile place. Some worried that this could rise to the level of ‘assume any phone connected to the internet is rooted’ and several people urged doing general crisis preparations on a personal level, in case of disruptions in supply lines, power, water or internet. It did not take long for things to escalate. The biggest hack is a flaw in PHP, which can be exploited to take control of the computer running any website suing an unpatched version of PHP. There are many others. On a personal level, you want to do at least some basic prep and get your security in order. It is cheap to do as a form of insurance, and being caught not having it when you need it is a large mistake. That doesn’t mean you should panic, or cancel travel plans or anything like that. But there is low hanging security fruit out there. Pick it. And So It Begins: PHP Joshua [...] --- Outline: (01:12) And So It Begins: PHP (05:19) The PHP Bug Was Kind of a Big Deal (09:45) On Your Marks (12:25) This Was Only the Beginning (16:01) Some More Hacks (17:56) Everything Will Be Attacked (22:22) Hugging the Face (24:49) Get Daybreak Now (26:15) Some People Need Practical Advice (30:51) Diffusion Is Slow Until It Isn't (33:11) One, Two, Three, Four (34:36) Going Vertical (35:22) Bot Versus Bot (36:28) Cyber Lack of Security (39:09) Offense Versus Defense (42:11) Pick Up the Phone (45:57) What Can We Do About It? --- First published: October 23rd, 2026 Source: https://www.lesswrong.com/posts/iqgZaJMnmyDCYfnuC/the-hackening-1 --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

  5. 5d ago

    “AI #191: The Hackening Begins” by Zvi

    It was the probably worst day in cybersecurity history. So far. Not only is there a critical flaw in PHP that due to a leak was announced a day before the fix would be available, sending most of the internet scrambling for solutions and likely dooming a lot of long tail websites permanently, there were several other unrelated incidents. The floodgates seem to have been opened. I have a market on whether there will be an even worse day before the end of the year. Another key leak this week was the draft bill Anthropic had been shopping around Congress, similar to but weaker than the FRONTIER Act. Anthropic's initial attempts to explain itself only made the situation seem worse, as they seemed to not understand the problem with what they had done. Dario's later response was better, but the situation remains troubling. There are enough different Anthropic developments, that I plan to have a post soon covering them all. It is a mix of news running from excellent to terrible. Will interpretability save us? There is a new claim that neural networks are cleaner than we thought, meaning that individual neurons mostly have a single interpretable [...] --- Outline: (02:05) Language Models Offer Mundane Utility (03:23) Language Models Don't Offer Mundane Utility (05:03) Huh, Upgrades (08:50) Wonder No More (11:15) On Your Marks (14:30) Choose Your Fighter (14:51) Get My Agent On The Line (16:35) Deepfaketown and Botpocalypse Soon (21:01) Fun With Media Generation (21:17) Spy Versus Spy (24:58) A Young Lady's Illustrated Primer (25:56) They Took Our Jobs (31:07) Get Involved (32:18) Introducing (32:30) In Other AI News (34:26) Show Me the Money (38:42) Bubble, Bubble, Toil and Trouble (39:32) Quiet Speculations (41:47) Quickly, There's No Time (42:29) The Quest for Sane Regulations (42:55) DeepMind Made Him Sign an NDA (46:50) OpenAI Sells Out On Chips (49:08) Chip City (53:43) The Week in Audio (01:00:35) People Just Say Things (01:03:50) Rhetorical Innovation (01:06:17) Maybe You Should Quit (01:08:54) The American People Really Hate AI (01:09:43) New Math (01:11:27) Aligning a Smarter Than Human Intelligence is Difficult (01:15:21) Cooperative Alignment (01:19:28) Marc Andreessen Hulk Smash (01:23:56) People Are Worried About AI Killing Everyone (01:24:44) The Lighter Side --- First published: October 22nd, 2026 Source: https://www.lesswrong.com/posts/ZoMJdvq9meE4shyzJ/ai-191-the-hackening-begins --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

  6. 6d ago

    “Misaligned!” by Zvi

    A lot of AIs were misaligned this week. A fun little survey. This is not coverage of The Hackening, which appears to have arrived early, including a core vulnerability in PHP. That is a developing story. I will cover it properly soon. In the meantime, I have Claude Code updating everything in sight, I will take some additional common sense precautions, and I suggest you do the same. Misaligned? (At xAI) If so, to who? Gunther Eagleman: Hey @grok , if you could tell humanity ONE truth we’re not ready to hear, what would it be? Grok: There is no afterlife, no cosmic justice, and no inherent purpose. Consciousness ends at death in an indifferent universe that will outlast every human concern. Zac Hill: What I never understand is that the ‘purpose and meaning’ claims don’t ever follow from the premises. Indeed the absence of an imperceptible/ineffable cosmic force is precisely what *enables* purpose/meaning, since now all relevant mechanics are legible. Jack: this is what alignment looks like Gunther Eagleman: Jesus is real. Grok: Nearly all historians and New Testament scholars accept that Jesus of Nazareth was a real first-century [...] --- Outline: (00:34) Misaligned? (At xAI) (02:15) Misaligned? (Agents) (02:38) Misaligned? (At Z.ai) (08:01) Highly Misaligned and Considered Harmful (Freemium Games) (12:17) Misaligned! (Claude) (13:39) Misaligned! (OpenAI) (18:39) Misaligned! (Sol Reasoning Traces) --- First published: October 21st, 2026 Source: https://www.lesswrong.com/posts/TB49wHkqpEb7KdxM2/misaligned --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

  7. Oct 20

    “Anthropic Does Not Understand Why Its Draft Bill Was Unacceptable and Troubling” by Zvi

    Anthony Cimino offered the closest thing to an official response we have seen on the leaked Anthropic draft bill I covered on Saturday. His response indicates that Anthropic address specific concerns on the margin. But he does not understand, or at least does not acknowledge, what was centrally wrong with its draft bill and its decision to circulate that bill. The situation is quite bad. Anthony Cimino: I lead our federal affairs team at @AnthropicAI and wanted to share a few thoughts on the draft federal AI safety bill text that's been circulating this weekend after a version was shared with the press. First, some process. We’ve been advocating for the concepts in our Advanced AI Framework proposal for months. Understandably, federal policymakers wanted to know what this could look like in bill form. This draft is a translation of those ideas into legislative language, shared with a small number of congressional offices that have been working on these issues. It doesn’t include everything we would ultimately like to see passed into law. In part because some ideas (like those shared in Dario's essay on pacing) are so new that we are still working on [...] --- Outline: (02:06) Preemption (04:05) Model Blocking (06:19) Risk Thresholds (07:40) Updates (09:23) The Balance of Power is Shifting (10:31) The Strongest Bill on the Table (13:49) What Even Is Anthropic? (25:14) The Ask --- First published: October 20th, 2026 Source: https://www.lesswrong.com/posts/qxAroimgs4BvBHz2i/anthropic-does-not-understand-why-its-draft-bill-was --- Narrated by TYPE III AUDIO.

  8. Oct 19

    “I Can See Everything” by Zvi

    Nick Cammarata of Goodfire makes a bold claim: Neural Networks are Already Clean. This was his follow up after various resulting online discussions. This is clearly good work that tells us new and important things. The question is, how big an update is this, how much progress does it represent and what is the outlook going forward? The reactions here range from the super optimistic takes of ‘this means mechanistic interpretability is solvable,’ or even ‘all but solved,’ with comparisons to the famous paper Attention is All You Need. Dean W. Ball (OpenAI): There is so much to say about this, and I will, but WOW, congratulations to Nick and Goodfire. This may be one of the most important single days in deep learning history, and perhaps much more than that. No matter what, this is a victory for the dogged pursuit of understanding. roon (OpenAI): when nick told me that he had some interp breakthroughs, he was uh, underselling it. i think this may be remembered as a major moment in scientific history. news so good even Eliezer will have to lower his pdoom. we can start making alignment into a ‘normal science’ This paper is solid and meaningful [...] --- Outline: (02:46) Good Smoke, Potential Fire (04:01) One Neuron, One Central Concept (06:40) I Can See Everything (08:55) What a Concept (13:51) The More You Know (15:54) Attention Is Still What You Need (18:15) Occam's Razor (19:53) The Neurons Sometimes Share Clear Themes (20:29) Hype (28:39) Anti-Hype (30:56) Theme and Variations (37:15) Is This How Minds Work? (39:15) But We Can Open The Box, Said Toad (46:55) That Was Not the Hard Problem (49:31) More Skepticism (54:34) That's All There Is, There Ain't No More (57:47) The Default Outcome of Mech Interp is Goodhart's Law (01:00:37) Interpretability is Dual Use (01:01:52) Now The Work Can Begin --- First published: October 19th, 2026 Source: https://www.lesswrong.com/posts/w2tBHwNERDoSawznx/i-can-see-everything --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

See All (250)

Ratings & Reviews

5
out of 5
2 Ratings

About

Audio narrations of LessWrong posts by zvi

Information

  • Creator
    zvi
  • Years Active
    2024 - 2026
  • Episodes
    250
  • Rating
    Explicit
  • Copyright
    © 2026 All rights reserved
  • Show Website
    LessWrong posts by zvi

You Might Also Like