AI Explained

AI Explained
  • 1.0 (1)
  • News
  • Daily

Covering the biggest news of the century - the arrival of smarter-than-human AI. The author of Simple Bench, exposing the remaining human-LLM reasoning gap. Solo Developer of LM Council: https://lmcouncil.ai - Code - INSIDER15Join me at AI Insiders, with exclusive videos and a 1000+ network of AI enthusiasts and professionals: https://www.patreon.com/AIExplainedLinks:AI Insiders: Code - INSIDER15: https://www.patreon.com/AIExplainedMy AI Council App: https://lmcouncil.aiSimple Bench: https://simple-bench.com/Podcast (New!): https://aiexplainedopodcast.buzzsprout.com/Newsletter: https://signaltonoise.beehiiv.com/X: https://twitter.com/AIExplainedYT

  1. 8m ago

    SmartGPT: Major Benchmark Broken - 89.0% on MMLU + Exam's Many Errors

    Has GPT4, using a SmartGPT system, broken a major benchmark, the MMLU, in more ways than one? 89.0% is an unofficial record, but do we urgently need a new, authoritative benchmark, especially in the light of today's insider info of 5x compute for Gemini than for GPT 5?Learn all about the power of exemplars, self-consistency and how you can tangibly benefit in real world examples. You'll learn more about everything from cutting edge benchmarking to AGI forecasting. https://www.patreon.com/AIExplainedOriginal SmartGPT Video: https://www.youtube.com/watch?v=wVzuvf9D9BU&list=PPSVMMLU: https://arxiv.org/pdf/2009.03300.pdfGemini 5x GPT 4, Semianalysis: https://www.semianalysis.com/p/google-gemini-eats-the-world-geminiWizardCoder Overfitting? https://twitter.com/Shahules786/status/1695493641610133600Let’s Do a Thought Experiment: https://arxiv.org/pdf/2306.14308.pdfLegalBench: https://arxiv.org/pdf/2308.11462.pdfSciBench: https://arxiv.org/pdf/2307.10635.pdfAGIEval: https://arxiv.org/pdf/2304.06364.pdfMMLU Grading Issues: https://huggingface.co/blog/evaluating-mmlu-leaderboardOxford University Press Question Example: https://global.oup.com/uk/orc/chemistry/chechik/student/mcqs/ch04/Fall 2011 Epidemiology Example: https://www.docsity.com/en/final-exam-fall-2011-4/8308030/HellaSwag: https://arxiv.org/pdf/1905.07830.pdfGPT 4 Technical Report: https://arxiv.org/pdf/2303.08774.pdfMinerva, Solving Quantitative Reasoning: https://arxiv.org/pdf/2206.14858.pdfOriginal Scratchpads Paper: https://arxiv.org/pdf/2112.00114.pdfIs ChatGPT Behaviour Changing Over Time? https://arxiv.org/pdf/2307.09009.pdfPaul Christiano: https://www.lesswrong.com/posts/fRSj2W4Fjje8rQWm9/thoughts-on-sharing-information-about-language-modelMetaculus Forecasting: https://www.metaculus.com/ai/ https://www.lesswrong.com/posts/SdkexhiynayG2sQCC/ai-forecasting-two-years-inMIT Paper: https://twitter.com/jeremyphoward/status/1669588857149612033?lang=en-GBSnowballing Hallucinations: https://arxiv.org/pdf/2305.13534.pdfSelf Consistency: https://arxiv.org/pdf/2203.11171.pdfOpenLLM Leaderboard: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboardNHS Question from ‘Extended Matching Questions’ Graph of Thoughts: https://arxiv.org/pdf/2308.09687.pdfDario Amodei Interview – Dwarkesh Patel: https://www.youtube.com/watch?v=Nlkk3glap_UGitHub Answers: https://github.com/Joshua-Stapleton/smartgpt-answersJoshua Stapleton is a Machine Learning Engineer who has worked in the healthcare and defence sectors. He recently pivoted into AI capabilities and safety, with a concentration on LLMs. He now works as a research engineer, consults on the applications of AI across various industries, and is pursuing his Masters in Machine Learning and Data Science at Imperial College London. Feel free to reach out to Josh via his email, joshua.stapleton.ai@gmail.com, or check out his new Patreon: https://patreon.com/JoshuaStapleton.AI Explained Community: https://discord.gg/PEmxEhFVaiexplained@outlook.comhttps://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices

    SmartGPT: Major Benchmark Broken - 89.0% on MMLU + Exam's Many Errors

  2. 22m ago

    What the New ChatGPT 5.4 Means for the World

    Just 48 hours after releasing GPT 5.3 Instant, OpenAI have released GPT 5.4 Thinking, so either their is an imminent singularity or perhaps we are being distracted from other news. This video will give 9 crucial bits of context, not just on the GPT 5.4 drop but on the background to the meltdown between the Pentagon and Anthropic. What does this say about the state of AI progress, your job, and what is next.Check out my fast-growing (!) app, free to use, and code INSIDER15 for 15% off paid tiers: https://lmcouncil.aiAI Insiders ($9!): https://www.patreon.com/AIExplainedChapters:00:00 - Introduction01:06: GPT 5.4 Breakdown05:06 - Closing the Loop06:35 - Spiky Performance10:31 - Advice11:32 - Less Encouraging Developments - Fired Like Dogs17:45 - But Used in IranGPT 5.4: https://openai.com/index/introducing-gpt-5-4/Hallucinations: https://artificialanalysis.ai/evaluations/omniscienceInvestment Banking Bench: https://x.com/bradlightcap/status/2029684672343728452Move 37: https://x.com/nasqret/status/2029628846518010099System Card: https://deploymentsafety.openai.com/gpt-5-4-thinking/gpt-5-4-thinking.pdfPrediction Market Scandal: https://www.wired.com/story/openai-fires-employee-insider-trading-polymarket-kalshi/GPT 5.3 Instant: https://openai.com/index/gpt-5-3-instant/GDPVal: https://openai.com/index/gdpval/Claude in Iran: https://www.washingtonpost.com/technology/2026/03/04/anthropic-ai-iran-campaign‘Like Dogs’: https://x.com/AndrewCurran_/status/2029605783311470679Altman leak: https://www.cnbc.com/2026/03/03/sam-altman-tells-openai-staff-operational-decisions-up-to-government.htmlOriginal 2024 Switch: https://archive.fo/20240116172526/https://www.bloomberg.com/news/articles/2024-01-16/openai-working-with-us-military-on-cybersecurity-tools-for-veterans#selection-6173.83-6173.226Amodei Original Memo: https://www.theinformation.com/articles/read-anthropic-ceos-memo-attacking-openais-mendacious-pentagon-announcement?rc=sy0ihqAnthropic Apology: https://www.anthropic.com/news/where-stand-department-warOpenAI Employee Reaction: https://x.com/tszzl/status/2029334980481212820DoD Suppler Risk: https://www.cnbc.com/amp/2026/03/05/anthropic-pentagon-ai-claude-iran.htmlAtlantic Exclusive: https://archive.fo/20260301152646/https://www.theatlantic.com/technology/2026/03/inside-anthropics-killer-robot-dispute-with-the-pentagon/686200/#selection-941.61-941.212No Negotiation: https://x.com/USWREMichael/status/2029754965778907493$20B Doubling: https://archive.ph/20260304111124/https://www.bloomberg.com/news/articles/2026-03-03/anthropic-nears-20-billion-revenue-run-rate-amid-pentagon-feudMarch 2022 Interview: https://www.youtube.com/watch?v=uAA6PZkek4Ahttps://lmcouncil.ai/Non-hype Newsletter: https://signaltonoise.beehiiv.com/Podcast: https://aiexplainedopodcast.buzzsprout.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices

    What the New ChatGPT 5.4 Means for the World

  3. 36m ago

    OpenAI’s New ImageGen is Unexpectedly Epic … (ft. Reve, Imagen 3, Midjourney etc)

    I’ve spent quite a while testing the new 4o ImageGen from OpenAI, and comparing it to models released just yesterday, like Reve, Midjourney, Imagen 3, as well as models not yet out. https://app.grayswan.ai/ai-explainedAI Insiders ($9!): https://www.patreon.com/AIExplainedRarely in AI is one model so much better than the rest, as we can see on the chatbot-side of things. Yes, I have a video imminent on Gemini 2.5 and DeepSeek. But for ImageGen, I was very impressed, as you’ll see. Still not perfect, don’t show it a mirror for example, and definitely not photorealistic, but incredibly obedient. You’ll see what I mean. What Sam Altman calls ‘Images in ChatGPT’ will be available to everyone apparently, even free users. There are some filters, but I am sure everyone will soon have access to an unfiltered model of its strength, and its easy to imagine what will come of that. Chapters:00:00 - Intro01:07 - Prompt Adherence, vs Reve, Midjourney, Imagen 3 + one other03:39 - Idioms04:20 - Thumbnails?05:56 - Captions / Infographics07:20 - Filters and Public Figures + Gray Swan08:30 - Sora?08:49 - Ethnicities/hands09:09 - Where’s Waldo?10:33 - Selfies and PhotorealismImages with ChatGPT/4o ImageGen: https://chatgpt.com/Imagen 3: https://labs.google/fx/tools/image-fxReve: https://preview.reve.art/appAltman Announcement: https://x.com/sama/status/1904598788687487422Non-hype Newsletter: https://signaltonoise.beehiiv.com/Podcast: https://aiexplainedopodcast.buzzsprout.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices

    OpenAI’s New ImageGen is Unexpectedly Epic … (ft. Reve, Imagen 3, Midjourney etc)

  4. 37m ago

    o3-mini and the “AI War”

    o3-mini is here, and yes, I’ve read the paper in full - 2 hours after release, and even the post-launch Reddit AMA. Some epic details like a FrontierMath score that made me double-take, a likely new Cursor favorite, bio risk expertise and a cost-comparison with Deepseek R1., But does it perform on basic reasoning - let’s find out. Plus, arguably the bigger story - the increasingly frenetic rhetoric coming out of the West - and Dario Amodei and Alexandr Wang (CEOs of Anthropic and Scale AI respectively) in particular. The last thing we need is an “AI War”.https://wandb.me/simple-bench(Colab): https://colab.research.google.com/drive/1AVijcPnEkl8Gy_754XbRdG5m7Q5-9slg?usp=sharingAI Insiders ($9!): https://www.patreon.com/AIExplainedChapters: 00:00 - Introduction00:45 - o3 mini05:11 - First impressions vs Deepseek R107:22 - 10x Scale, o3-mini System Card, Amodei Essay, bitcoin wallets…12:40 - Simple Competition Finale13:03 - Clips and Final Thoughts on the “AI War”O3-mini: https://openai.com/index/openai-o3-mini/Paper: https://cdn.openai.com/o3-mini-system-card.pdfAmodei Essay: https://darioamodei.com/on-deepseek-and-export-controls?s=09FrontierMath wild stat:https://arxiv.org/pdf/2411.04872Sam Altman Channels Napoleon: https://x.com/sama/status/1883185690508488934Altman ‘pulls up releases’: https://x.com/sama/status/1884066337103962416“AI War” by Wang: https://scale.com/blog/win-the-ai-warAnthropic Original Views on Capabilities: https://www.anthropic.com/news/core-views-on-ai-safetyAI Insider Cost Comparison:https://x.com/arankomatsuzaki/status/1884676245922934788Deepseek R1 Paper: https://arxiv.org/pdf/2501.12948R1, o3-mini Price Comparison: https://techcrunch.com/2025/01/31/openai-launches-o3-mini-its-latest-reasoning-model/Semianalysis on $1.3M deepseek salaries, and them falling behind as ‘the time gap to match US capabilities increases’: https://semianalysis.com/2025/01/31/deepseek-debates/OpenAI Valuation: https://www.bloomberg.com/news/articles/2025-01-30/openai-in-talks-to-raise-funding-at-340-billion-value-wsj-says?srnd=phx-aiWang Clip: https://x.com/tsarnick/status/1867700453494206883Amodei Clip: https://x.com/ai_ctrl/status/1884951111771001188https://simple-bench.com/AI Insiders ($9!): https://www.patreon.com/AIExplainedNon-hype Newsletter: https://signaltonoise.beehiiv.com/Podcast: https://aiexplainedopodcast.buzzsprout.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices

    o3-mini and the “AI War”

  5. 1h ago

    Gemini Exponential, Demis Hassabis' ‘Proto-AGI’ coming, but …

    The condensed highlights of hours of AI lab leader interviews, last-48-hour model releases, Gemini 3 Flash insights (plus it’s hidden flaw), Hassabis’ ‘proto-AGI’ and much more…https://matsprogram.org/apply?utm_source=ai-explained&utm_medium=youtube&utm_campaign=s26 Also, do check out my new app: https://lmcouncil.aiChapters: 00:00 - Introduction00:50 - Results02:44 - But… the Flaw04:49 - So Benchmarks are fake? No07:37 - Spatial Reasoning + Hassabis10:06 - Proto-AGI12:07 - Minimal AGI15:07 - Compute Slowdown17:56 - New Data ParadigmGemini 3 Flash: https://deepmind.google/models/gemini/flash/Hassabis Interview: https://www.youtube.com/watch?v=PqVbypvxDtoLegg Interview: https://www.youtube.com/watch?v=l3u_FAv33G0Pre-training Lead Interview: https://www.youtube.com/watch?v=cNGDAqFXvewAltman Interview: https://www.youtube.com/watch?v=2P27Ef-LLuQBrockman Video: https://x.com/OpenAI/status/2001336514786017417Post-Training Reveal: https://x.com/OfficialLoganK/status/2001742530472534442Hallucinations Paper: https://cdn.openai.com/pdf/d04913be-3f6f-4d2b-b283-ff432ef4aaa5/why-language-models-hallucinate.pdfPatreon Hallucinations Vid: https://www.patreon.com/posts/blockers-to-and-139264812AA-Omniscience Benchmark: https://artificialanalysis.ai/evaluations/omnisciencehttps://arxiv.org/pdf/2511.13029lmcouncil.ai/benchmarks https://simple-bench.com/https://x.com/scaling01/status/19996205877448132055.2 Codex Drop: https://cdn.openai.com/pdf/ac7c37ae-7f4c-4442-b741-2eabdeaf77e0/oai_5_2_Codex.pdfOpenAI Compute Trend: https://www.theinformation.com/articles/openais-350-billion-computing-cost-problem?rc=sy0ihqCramer Tweet/Response: https://x.com/BorisMPower/status/2001440650210976018OpenAI Valuation: ​​https://www.theinformation.com/articles/openai-discussed-raising-tens-billions-valuation-around-750-billion?rc=sy0ihqIndian Data: https://www.reuters.com/world/india/with-freebies-openai-google-vie-indian-users-training-data-2025-12-17/TheInformation Data: https://x.com/theinformation/status/2001421225751351778Genie 3: https://deepmind.google/blog/genie-3-a-new-frontier-for-world-models/Sima 2: https://deepmind.google/blog/sima-2-an-agent-that-plays-reasons-and-learns-with-you-in-virtual-3d-worlds/Veo 3.1: https://deepmind.google/blog/sima-2-an-agent-that-plays-reasons-and-learns-with-you-in-virtual-3d-worlds/METR: https://metr.org/blohttps://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/2025-03-19-measuring-ai-ability-to-complete-long-tasks/AI Insiders ($9!): https://www.patreon.com/AIExplainedNon-hype Newsletter: https://signaltonoise.beehiiv.com/Podcast: https://aiexplainedopodcast.buzzsprout.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices

    Gemini Exponential, Demis Hassabis' ‘Proto-AGI’ coming, but …

  6. 1h ago

    The AI 'Genie' is Out + Humanoid Robotics Step Closer

    First text-to-speech, text-to-video and text-to-action, and now text-to-interaction? Let’s take a look at the new Genie paper from Google DeepMind, and set it in the context of new developments regarding Sora and Gemini. We’ll hear what Demis Hassabis has to say about Altman’s $7 trillion dollar chip ambitions and touch on some recent notorious missteps. We’ll also learn more about Gemma, fully automated fabs, Elevenlabs integrated into Sora, and AI cheating unleashed. AI Insiders: https://www.patreon.com/AIExplainedGenie Paper: https://arxiv.org/pdf/2402.15391.pdfElevenlabs Sora: https://twitter.com/DrJimFan/status/1759287778268025177Sora Takes Time: https://www.bloomberg.com/news/newsletters/2024-02-22/openai-s-sora-video-generator-is-impressive-but-not-ready-for-prime-timeSamsung Humanless Fab: https://www.tomshardware.com/tech-ind...Nvidia Gear: https://twitter.com/DrJimFan/status/1761052023821369639Sora Job ‘Loss’: https://www.hollywoodreporter.com/business/business-news/tyler-perry-ai-alarm-1235833276/Huang Hardware: https://www.wired.com/story/nvidia-hardware-is-eating-the-world-jensen-huang/#intcid=_wired-right-rail_9918434f-10c2-461a-9560-d6507f1f8f6a_popular4-1-reranked-by-vidiTed Xiao News: https://twitter.com/xiao_ted/status/1760591701410799682Optimus Gets More Fluid: https://twitter.com/Tesla_Optimus/status/1761450961409573077RT-2-X: https://deepmind.google/discover/blog...Hassabis Interview: https://www.wired.com/story/deepmind-ceo-demis-hassabis-interview-artificial-intelligence-scale/?redirectURL=https%3A%2F%2Fwww.wired.com%2Fstory%2Fdeepmind-ceo-demis-hassabis-interview-artificial-intelligence-scale%2FGemma Paper: https://storage.googleapis.com/deepmind-media/gemma/gemma-report.pdfFull 5-star Video: https://www.reddit.com/r/singularity/comments/1aw312y/this_seems_relevant_with_the_way_things_are_going/AI Shark: https://www.techradar.com/computing/peripherals-accessories/ai-shark-reveals-gaming-peripherals-that-use-ai-to-give-players-an-advantageAI Monitor: https://www.tomshardware.com/monitors/msis-ai-powered-gaming-monitor-helps-you-cheat-at-league-of-legends-looks-great-doing-itGoogle Redteaming: https://twitter.com/untitled01ipynb/s...Figure AI Valuation: https://www.bloomberg.com/news/articles/2024-02-23/bezos-nvidia-join-openai-microsoft-in-funding-humanoid-robot-startup-figure-ai?srnd=technology-aiAI Insiders: https://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices

    The AI 'Genie' is Out + Humanoid Robotics Step Closer

  7. 2h ago

    Claude 4: Full 120 Page Breakdown … Is it the Best New Model?

    Not only did I get early access and ran my own tests, as per the title I read both the 120 page Claude 4 Opus and Claude 4 Sonnet System Card, and 25 page report on ASL-3 being triggered, plus the 2 hour launch video, and surrounding coverage. Ft. coding tests, Simple, twitter controversies, deep alignment coverage, spiritual bliss and much more!https://80000hours.org/aiexplainedAI Insiders ($9!): https://www.patreon.com/AIExplainedChapters: 00:00 - Introduction01:12 - 3 Quick Controversies02:42 - Benchmark Results 04:20 - 120 page Card 20 Highlights10:07 - Coding Test11:27 - Model Welfare and Spiritual Bliss13:29 - ASL-3Claude Card: https://www-cdn.anthropic.com/4263b940cabb546aa0e3283f35b686f4f3b2ff47.pdf?s=09ASL 3:https://www-cdn.anthropic.com/807c59454757214bfd37592d6e048079cd7a7728.pdfTweets: https://x.com/fish_kyle3/status/1925597284546629753https://x.com/EMostaque/status/1925624164527874452?ref_src=twsrc%5Egoogle%7Ctwcamp%5Eserp%7Ctwgr%5EtweetCursor Says State of the Art for Coding: https://x.com/cursor_ai/status/1925594428095561941Benchmarks: https://www.anthropic.com/news/claude-4Non-hype Newsletter: https://signaltonoise.beehiiv.com/Podcast: https://aiexplainedopodcast.buzzsprout.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices

    Claude 4: Full 120 Page Breakdown … Is it the Best New Model?

  8. 2h ago

    Gemini 3.1 Pro and the Downfall of Benchmarks: Welcome to the Vibe Era of AI

    Do we have a new best AI model, or do we have the downfall of benchmarks in general, as a way of capturing machine intelligence? Full breakdown of Gemini 3.1 Pro, guest-starring the new Sonnet 4.6, plus analysis from 7 papers/posts that will give you much needed context. Oh, and a new record on Simple Bench!https://epoch.ai/ai-explained-datacentersCheck out my fast-growing (!) app, free to use, and code INSIDER15 for Pro: https://lmcouncil.aiAI Insiders ($9!): https://www.patreon.com/AIExplainedChapters:00:00 - Introduction00:30 - Post-training Dominance04:00 - ARC-AGI 2 Caveat05:54 - Simple Bench Record08:22 - Hallucination Caveat10:05 - Model Card11:12 - Exponential Coming12:20 - Amodei on Generalizing15:10 - One True Benchmark?17:02 - Other Metrics…Gemini 3.1 Model Card: https://storage.googleapis.com/deepmind-media/Model-Cards/Gemini-3-1-Pro-Model-Card.pdfRelease: https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-3-1-pro/Where are Agents deployed?: https://www.anthropic.com/research/measuring-agent-autonomyNewsletter Post: https://signaltonoise.beehiiv.com/p/4-ai-numbers-that-surprised-me-this-weekHallucination AA: https://artificialanalysis.ai/evaluations/omniscienceMelanie Mitchell: https://x.com/MelMitchell1/status/2022738363548340526ARC-AGI-2: https://x.com/arcprize/status/2024522812728496470/photo/1Chollet on Agentic Coding and ML: https://x.com/fchollet/status/2024519439140737442METR Caveat: https://metr.org/notes/2026-01-22-time-horizon-limitations/Talaas Fast: https://chatjimmy.ai/Amodei Interview Continual learning: https://www.dwarkesh.com/p/dario-amodei-2?open=false#%C2%A7002942-is-continual-learning-necessary-how-will-it-be-solvedMetaculus FutureEval: https://www.metaculus.com/futureeval/Next Vid to Watch: https://www.patreon.com/posts/what-you-need-to-150647292Non-hype Newsletter: https://signaltonoise.beehiiv.com/Podcast: https://aiexplainedopodcast.buzzsprout.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices

    Gemini 3.1 Pro and the Downfall of Benchmarks: Welcome to the Vibe Era of AI
See All (78)

About

Covering the biggest news of the century - the arrival of smarter-than-human AI. The author of Simple Bench, exposing the remaining human-LLM reasoning gap. Solo Developer of LM Council: https://lmcouncil.ai - Code - INSIDER15Join me at AI Insiders, with exclusive videos and a 1000+ network of AI enthusiasts and professionals: https://www.patreon.com/AIExplainedLinks:AI Insiders: Code - INSIDER15: https://www.patreon.com/AIExplainedMy AI Council App: https://lmcouncil.aiSimple Bench: https://simple-bench.com/Podcast (New!): https://aiexplainedopodcast.buzzsprout.com/Newsletter: https://signaltonoise.beehiiv.com/X: https://twitter.com/AIExplainedYT

Information

  • Creator
    AI Explained
  • Years Active
    2026
  • Episodes
    78
  • Rating
    Explicit

You Might Also Like