Ignition by RocketTools

Dan McCoy, MD

Healthcare is getting optimized by AI. But optimized for whom? Ignition by RocketTools breaks down the systems, incentives, and technology reshaping how care gets approved, denied, and paid for — with data, not hype.

  1. 19 MAR

    When AI Knows the Diagnosis But Misses the Action

    Mount Sinai just published the first independent safety evaluation of ChatGPT Health — and the findings should change how you think about AI in healthcare. Published in Nature Medicine, researchers ran 960 patient interactions across 21 medical specialties. What they found wasn't that ChatGPT gets medicine wrong. It's that it gets the diagnosis right, then tells you to do the wrong thing about it. In this episode, we break down: Why ChatGPT told patients to wait in over half of true emergencies — after correctly identifying the danger in its own explanationThe inverted suicide crisis alerts that fired for sadness but went silent when patients described specific plans for self-harmThe sycophancy problem: why ChatGPT is 12x more likely to agree when you downplay your own symptomsWhere ChatGPT actually performs well (93% in semi-urgent cases) — and why that makes the failures harder to spotWhat this means for anyone using, building, or recommending AI health toolsSources & Links: Primary Study — Nature Medicine, Feb 2026 https://doi.org/10.1038/s41591-026-04297-7 Mt. Sinai Press Release https://www.mountsinai.org/about/newsroom/2026/research-identifies-blind-spots-in-ai-medical-triage Forbes: "ChatGPT Provided Wrong Advice In Over 50% Medical Emergencies Tested" https://www.forbes.com/sites/brucelee/2026/03/08/chatgpt-provided-wrong-advice-in-over-50-medical-emergencies-tested/ NPR: "ChatGPT might give you bad medical advice, studies warn" https://www.nhpr.org/2026-03-11/chatgpt-might-give-you-bad-medical-advice-studies-warn Related: AI Chatbots and Medical Misinformation — Communications Medicine, 2025 https://doi.org/10.1038/s43856-025-01021-3 Full research brief and deep dive on Substack: danmccoymd.substack.com

    3 min

Acerca de

Healthcare is getting optimized by AI. But optimized for whom? Ignition by RocketTools breaks down the systems, incentives, and technology reshaping how care gets approved, denied, and paid for — with data, not hype.