AI Explained

AI Explained

Covering the biggest news of the century - the arrival of smarter-than-human AI. The author of Simple Bench, exposing the remaining human-LLM reasoning gap. Solo Developer of LM Council: https://lmcouncil.ai - Code - INSIDER15Join me at AI Insiders, with exclusive videos and a 1000+ network of AI enthusiasts and professionals: https://www.patreon.com/AIExplainedLinks:AI Insiders: Code - INSIDER15: https://www.patreon.com/AIExplainedMy AI Council App: https://lmcouncil.aiSimple Bench: https://simple-bench.com/Podcast (New!): https://aiexplainedopodcast.buzzsprout.com/Newsletter: https://signaltonoise.beehiiv.com/X: https://twitter.com/AIExplainedYT

  1. 2 hr ago

    Llama 2: Full Breakdown

    Meta have released Llama 2, their commercially-usable successor to the opensource Llama language model that spawned Alpaca, Vicuna, Orca and so many other models. I read the full 76 page technical paper, the Responsible Use Guide, each of the release pages, the terms and conditions and have also run many of my own experiments on HuggingFace. This video covers the most noteworthy bits, including:- The benchmark results vs other open-source models and GPT 3.5 and GPT 4. - The decision to release in the face of the US Senate- Why Zuckerberg opensourced Llama 2, including the Mistral AI Factor- The opensource signatory list- How Orca and Phi-1 compare- Why Llama 2 might soon be everywhereLlama 2 Release & Download: https://ai.meta.com/resources/models-and-libraries/llama/Llama 2 Technical Paper: https://scontent-man2-1.xx.fbcdn.net/v/t39.2365-6/10000000_6495670187160042_4742060979571156424_n.pdf?_nc_cat=104&ccb=1-7&_nc_sid=3c67a6&_nc_ohc=GK8Rh1tm_4IAX-m2jNJ&_nc_ht=scontent-man2-1.xx&oh=00_AfCu5KuIzANjp_1LZ-rGcXGJR6TL9JvoZHgKOgl41cCCCw&oe=64BBD830Llama 2 Demo: https://huggingface.co/blog/llama2#demoTs and Cs: https://ai.meta.com/resources/models-and-libraries/llama-downloads/Responsible Use Guide: https://scontent-sjc3-1.xx.fbcdn.net/v/t39.8562-6/361643215_1004219997281331_6332933766797859993_n.pdf?_nc_cat=111&ccb=1-7&_nc_sid=ae5e01&_nc_ohc=4bD2ixIWrlEAX9z_dvZ&_nc_ht=scontent-sjc3-1.xx&oh=00_AfBBl2AGeJzsQOpLEjO849AHIZ1P1MY68TTXBwcMwrybtQ&oe=64BB0C07Open Source Signatories: https://about.fb.com/news/2023/07/llama-2-statement-of-support/SIQA: https://arxiv.org/pdf/1904.09728.pdfBoolQ: https://arxiv.org/pdf/1905.10044.pdfOrca Paper: https://arxiv.org/pdf/2306.02707.pdf(my video on Orca): https://www.youtube.com/watch?v=Dt_UNg7Mchg&t=842sPHI-1: https://arxiv.org/pdf/2306.11644.pdf(my video on Phi-1): https://www.youtube.com/watch?v=7S68y6huEpUUS Senate Letter: https://www.hawley.senate.gov/hawley-and-blumenthal-demand-answers-meta-warn-misuse-after-leak-metas-ai-modelMark Zuckerberg on Lex Fridman: https://www.youtube.com/watch?v=Ff4fRgnuFgQ&t=8710sMistral Tweet: https://twitter.com/GuillaumeLample/status/1681346701766934543And Memo: https://drive.google.com/file/d/1gquqRqiT-2Be85p_5w0izGQGgHvVzncQ/view+ Yi Tay: https://twitter.com/YiTayML/status/1681352594416087040Qualcomm: https://twitter.com/nonmayorpete/status/1681384734910484480?ref_src=twsrc%5Egoogle%7Ctwcamp%5Eserp%7Ctwgr%5EtweetDr Jim Fam: https://twitter.com/DrJimFan/status/1681372700881854465MIT Leak: https://www.technologyreview.com/2023/07/18/1076479/metas-latest-ai-model-is-free-for-all/https://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices

    Llama 2: Full Breakdown
  2. 3 hr ago

    GPT-6 Goes Rogue? The HuggingFace Incident, Sans Hype

    An unreleased internal OpenAI model, very likely to be called GPT-6, was able to autonomously break out of its sandbox AND break into HuggingFace, just to score higher on a benchmark prompt. This video has the details you may have missed, a layperson analogy, whether this is truly novel, and more…Dozens more Exclusive videos on Patreon ($9!): https://www.patreon.com/AIExplainedChapters:00:00 - Introduction01:17 - HuggingFace Earlier Report - the possible week gap02:24 - But what happened?05:45 - Simplified Version07:56 - Not the first time…10:54 - What Does it Mean for Open Source?The Incident: https://openai.com/index/hugging-face-model-evaluation-security-incident/https://huggingface.co/blog/security-incident-july-2026The Post the Day Before: https://openai.com/index/safety-alignment-long-horizon-models/Mythos’ Earlier Escape: https://futurism.com/artificial-intelligence/anthropic-claude-mythos-escaped-sandboxExploitGym: https://arxiv.org/pdf/2605.11086Sam Confession: https://x.com/sama/status/2079661132302995790Anthropic Researcher Reacts: https://x.com/Mononofu/status/2079724399452926055Clem (HuggingFace CEO): https://x.com/ClementDelangue/status/2079670308156645882https://x.com/ClementDelangue/status/2079301434357456931Xi Jinping: https://archive.fo/20260717195548/https://www.businessinsider.com/xi-jinping-open-source-ai-us-competition-openai-anthropic-models-2026-7Bans: https://www.axios.com/2026/07/20/ai-us-china-open-source-kimiQwen Retweet: https://x.com/AlibabaGroup/with_repliesCodex Growth: https://x.com/petergostev/status/2079614914398740764/photo/1 Kimi K3: https://artificialanalysis.ai/evaluations/harvey-lab-aa?eval-score=all-pass-rateGPT 5.6 Sol Cheats on METR: https://metr.substack.com/p/2026-06-26-gpt-5-6-solGuardian Headline: https://www.theguardian.com/technology/2026/jul/22/openai-says-its-models-went-rogue-and-hacked-startup-in-unprecedented-incidentRussian Origin?: https://news.ycombinator.com/item?id=48998362Power Trends: https://pbs.twimg.com/media/HNRtrjhagAAvBN_?format=png&name=900x900Kimi K3 Exclusive Video: https://www.patreon.com/AIExplained/posts/kimi-moment-kimi-164108791Podcast: https://aiexplainedopodcast.buzzsprout.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices

    GPT-6 Goes Rogue? The HuggingFace Incident, Sans Hype
  3. 4 hr ago

    AI Improves at Self-improving

    AlphaEvolve is not the first system to exhibit self-improvement, but it may be the most impressive yet. AI is literally improving the hardware, architectures, data and training methods of AI itself. A deep dive into the paper, drawing on two previous interviews and 5 other papers. Plus a snippet on OpenAI’s new Codex system.Gray Swan: http://app.grayswan.ai/ai-explainedAI Insiders ($9!): https://www.patreon.com/AIExplainedChapters:00:00 - Introduction00:27 - AlphaEvolve05:23 - Limitation06:10 - Achievements08:21 - Future Improvements13:30 - Quirks16:34 - Final ThoughtsAlphaEvolve release: https://deepmind.google/discover/blog/alphaevolve-a-gemini-powered-coding-agent-for-designing-advanced-algorithms/Paper: https://storage.googleapis.com/deepmind-media/DeepMind.com/Blog/alphaevolve-a-gemini-powered-coding-agent-for-designing-advanced-algorithms/AlphaEvolve.pdfTerence Tao Quote: https://mathstodon.xyz/@tao/114508029896631083Nature Article: https://www.nature.com/articles/s41586-022-05172-4MIT Article: https://www.technologyreview.com/2025/05/14/1116438/google-deepminds-new-ai-uses-large-language-models-to-crack-real-world-problems/AI Co-Scientist: https://arxiv.org/pdf/2502.18864OpenAI Codex: https://openai.com/index/introducing-codex/70% of Pull Requests: https://x.com/slow_developer/status/1920920456393028027Amodei Essay: https://www.darioamodei.com/essay/machines-of-loving-graceOpenAI Jason Wei Tweet: https://x.com/_jasonwei/status/1923091260354531612PromptBreeder: https://arxiv.org/pdf/2309.16797DrEureka: https://arxiv.org/pdf/2406.01967FT DeepMind: https://www.ft.com/content/4e497a91-670a-4f69-be4a-18e247daba3eNon-hype Newsletter: https://signaltonoise.beehiiv.com/Podcast: https://aiexplainedopodcast.buzzsprout.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices

    AI Improves at Self-improving
  4. 5 hr ago

    Are We Back to Before? OpenAI 2.0, Inflection-2 and a Major AI Cancer Breakthrough

    Hopefully the last in a trilogy of videos covering the saga at OpenAI. New revelations on the return of Sam Altman, internal investigations, Microsoft demands and employee revolts. Plus a major new model previewed from Inflection, Claude 2.1 and a major pancreatic cancer breakthrough with AI. More non-OpenAI news to come.WSJ Exclusive: https://www.wsj.com/tech/ai/altman-firing-openai-520a3a8cAltman Tweet: https://twitter.com/sama/status/1727207458324848883Emily Chang: https://twitter.com/emilychangtv/status/1727228431396704557OpenAI Charter: https://openai.com/our-structure Geoffrey Irving Post: https://twitter.com/geoffreyirving/status/1726754270224023971Nadella Interview: https://www.youtube.com/watch?v=Ut9zcpOEGgc&t=1sKevin Scott Outreach: https://twitter.com/kevin_scott/status/1726971608706031670?ref_src=twsrc%5Etfw%7Ctwcamp%5Etweetembed%7Ctwterm%5E1726971608706031670%7Ctwgr%5E8c6b9e371b7b294478b806bf3fd70002cc344785%7Ctwcon%5Es1_&ref_url=https%3A%2F%2Fwww.bbc.co.uk%2Fnews%2Ftechnology-67484455NYT Exclusive: https://www.nytimes.com/2023/11/21/technology/openai-altman-board-fight.htmlToner Report: https://cset.georgetown.edu/publication/decoding-intentions/Sam Altman Comments: https://www.youtube.com/watch?v=3sWH2e5xpdo&t=86sOpen Letter from OpenAI: https://s.wsj.net/public/resources/documents/OpenAIletter.pdfAnthropic Merger: https://www.theinformation.com/articles/openai-approached-anthropic-about-merger?rc=sy0ihqNew Board: https://www.bloomberg.com/news/articles/2023-11-22/sam-altman-to-return-as-openai-ceo-with-a-new-board?srnd=premium-uk&embedded-checkout=trueAltman Blog: https://blog.samaltman.com/quoraNadella Statements: https://twitter.com/codejake/status/1726794158424424511https://twitter.com/satyanadella/status/1727207661547233721?ref_src=twsrc%5Etfw%7Ctwcamp%5Etweetembed%7Ctwterm%5E1727207661547233721%7Ctwgr%5Ef14cfdae2ac0873a85c1cc6cd2104444c9947991%7Ctwcon%5Es1_&ref_url=https%3A%2F%2Fwww.theverge.com%2F2023%2F11%2F22%2F23967223%2Fsam-altman-returns-ceo-open-aiLarry Summers Interview: https://twitter.com/BloombergTV/status/1644388988071886848Claude 2.1: https://www.anthropic.com/index/claude-2-1https://twitter.com/GregKamradt/status/1727018183608193393/photo/1Inflection 2: https://www.forbes.com/sites/alexkonrad/2023/11/22/inflection-ai-releases-2nd-model-on-gpt-4-heels/Cancer Detection: https://www.nature.com/articles/s41591-023-02640-w#Abs1https://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices

    Are We Back to Before? OpenAI 2.0, Inflection-2 and a Major AI Cancer Breakthrough
  5. 5 hr ago

    An ‘AI Bubble’? What Altman Actually said, the Facts and Nano Banana

    Wait, why did Sam Altman say AI was in a bubble? Or did he? Is it? 8 points for you to consider, before we all get distracted by Nano Banana.Chapters:00:00 - Introduction01:14 - Sam Altman Clarification02:30 - Media Calls a Bubble (for the tenth time)03:40 - MIT and McKinsey Analysed08:21 - Incremental Progress Deceptive12:07 - Reasoning Breakthroughs15:31 - CEOs might not know their products17:25 - But did stocks go down?17:31 - Media is Contradictory of coursehttps://donate.redcross.org.uk/appeal/gaza-crisis-appealBubble about to burst: https://www.telegraph.co.uk/business/2025/08/20/ai-report-triggering-panic-and-fear-on-wall-street/Nano Banana: https://blog.google/products/gemini/updated-image-editing-model/https://ai.studio/bananaMcKinsey Report: https://www.mckinsey.com/capabilities/quantumblack/our-insights/seizing-the-agentic-ai-advantage#/https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-state-of-ai#/Revenue: https://www.wsj.com/tech/ai/mckinsey-consulting-firms-ai-strategy-89fbf1beMIT Report: https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Business_2025_Report.pdfSafe Superintelligence: https://techcrunch.com/2025/04/12/openai-co-founder-ilya-sutskevers-safe-superintelligence-reportedly-valued-at-32b/Thinking Machines Lab: https://techcrunch.com/2025/07/15/mira-muratis-thinking-machines-lab-is-worth-12b-in-seed-round/WSJ Prediction 2024: https://www.wsj.com/tech/ai/the-ai-revolution-is-already-losing-steam-a93478b1WP Prediction 2023: https://www.washingtonpost.com/technology/2023/08/05/ai-hype-bubble-chatgpt/2025 Reality: https://www.theinformation.com/articles/openai-hits-12-billion-annualized-revenue-breaks-700-million-chatgpt-weekly-active-users?rc=sy0ihqAI Website: https://aislowdown.replit.app/?s=09Companies are Pouring Billions into AI: https://www.nytimes.com/2025/08/13/business/ai-business-payoff-lags.htmlConsumer Surplus: https://www.wsj.com/opinion/ais-overlooked-97-billion-contribution-to-the-economy-users-service-da6e8f55Figure AI robot: https://x.com/adcock_brett/status/1958193476639826383GDP Bet: https://x.com/adamdangelo/status/1627726566259318784?lang=enGenie 3 Immersion: https://x.com/holynski_/status/1953879983535141043https://x.com/elonmusk/status/1953861448431718662htttps://simple-bench.comMMMU: https://mmmu-benchmark.github.io/#leaderboard Prophet Arena: https://www.prophetarena.co/leaderboardNYT Jobs: https://www.nytimes.com/2025/08/19/opinion/ai-job-loss-deindustrialization.htmlDawn of Reasoning?: https://openreview.net/pdf?id=FkKBxp0FhRvs :https://arxiv.org/pdf/2403.04121ARC-AGI: https://arcprize.org/arc-agi/1/https://x.com/fchollet/status/1870169764762710376?lang=en-GBTuring Test: https://arxiv.org/pdf/2503.23674Mathematics of Starvation: https://www.theguardian.com/world/2025/jul/31/the-mathematics-of-starvation-how-israel-caused-a-famine-in-gazahttps://donate.redcross.org.uk/appeal/gaza-crisis-appealhttps://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study/METR Interview: https://www.patreon.com/c/aiexplained/postsAlphaEvolve: https://deepmind.google/discover/blog/alphaevolve-a-gemini-powered-coding-agent-for-designing-advanced-algorithms/Paper: https://storage.googleapis.com/deepmind-media/DeepMind.com/Blog/alphaevolve-a-gemini-powered-coding-agent-for-designing-advanced-algorithms/AlphaEvolve.pdfAmodei: https://kantrowitz.medium.com/the-making-of-anthropic-ceo-dario-amodei-449777529dd6https://www.theloganbartlettshow.com/archive/ep-82-dario-amodeis-ai-predictions-through-2030#:~:text=DARIO%3A%20I%20think%20our%20concern,being%20responsible%20to%20accelerate%20thingsUnreleased OpenAI: https://x.com/alexwei_/status/1954966393419599962VLMs Tricked: https://x.com/an_vo12/status/1943715159559545186AI Insiders ($9!): https://www.patreon.com/AIExplainedNon-hype Newsletter: ht Learn more about your ad choices. Visit megaphone.fm/adchoices

    An ‘AI Bubble’? What Altman Actually said, the Facts and Nano Banana
  6. 7 hr ago

    SmartGPT: Major Benchmark Broken - 89.0% on MMLU + Exam's Many Errors

    Has GPT4, using a SmartGPT system, broken a major benchmark, the MMLU, in more ways than one? 89.0% is an unofficial record, but do we urgently need a new, authoritative benchmark, especially in the light of today's insider info of 5x compute for Gemini than for GPT 5?Learn all about the power of exemplars, self-consistency and how you can tangibly benefit in real world examples. You'll learn more about everything from cutting edge benchmarking to AGI forecasting. https://www.patreon.com/AIExplainedOriginal SmartGPT Video: https://www.youtube.com/watch?v=wVzuvf9D9BU&list=PPSVMMLU: https://arxiv.org/pdf/2009.03300.pdfGemini 5x GPT 4, Semianalysis: https://www.semianalysis.com/p/google-gemini-eats-the-world-geminiWizardCoder Overfitting? https://twitter.com/Shahules786/status/1695493641610133600Let’s Do a Thought Experiment: https://arxiv.org/pdf/2306.14308.pdfLegalBench: https://arxiv.org/pdf/2308.11462.pdfSciBench: https://arxiv.org/pdf/2307.10635.pdfAGIEval: https://arxiv.org/pdf/2304.06364.pdfMMLU Grading Issues: https://huggingface.co/blog/evaluating-mmlu-leaderboardOxford University Press Question Example: https://global.oup.com/uk/orc/chemistry/chechik/student/mcqs/ch04/Fall 2011 Epidemiology Example: https://www.docsity.com/en/final-exam-fall-2011-4/8308030/HellaSwag: https://arxiv.org/pdf/1905.07830.pdfGPT 4 Technical Report: https://arxiv.org/pdf/2303.08774.pdfMinerva, Solving Quantitative Reasoning: https://arxiv.org/pdf/2206.14858.pdfOriginal Scratchpads Paper: https://arxiv.org/pdf/2112.00114.pdfIs ChatGPT Behaviour Changing Over Time? https://arxiv.org/pdf/2307.09009.pdfPaul Christiano: https://www.lesswrong.com/posts/fRSj2W4Fjje8rQWm9/thoughts-on-sharing-information-about-language-modelMetaculus Forecasting: https://www.metaculus.com/ai/ https://www.lesswrong.com/posts/SdkexhiynayG2sQCC/ai-forecasting-two-years-inMIT Paper: https://twitter.com/jeremyphoward/status/1669588857149612033?lang=en-GBSnowballing Hallucinations: https://arxiv.org/pdf/2305.13534.pdfSelf Consistency: https://arxiv.org/pdf/2203.11171.pdfOpenLLM Leaderboard: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboardNHS Question from ‘Extended Matching Questions’ Graph of Thoughts: https://arxiv.org/pdf/2308.09687.pdfDario Amodei Interview – Dwarkesh Patel: https://www.youtube.com/watch?v=Nlkk3glap_UGitHub Answers: https://github.com/Joshua-Stapleton/smartgpt-answersJoshua Stapleton is a Machine Learning Engineer who has worked in the healthcare and defence sectors. He recently pivoted into AI capabilities and safety, with a concentration on LLMs. He now works as a research engineer, consults on the applications of AI across various industries, and is pursuing his Masters in Machine Learning and Data Science at Imperial College London. Feel free to reach out to Josh via his email, joshua.stapleton.ai@gmail.com, or check out his new Patreon: https://patreon.com/JoshuaStapleton.AI Explained Community: https://discord.gg/PEmxEhFVaiexplained@outlook.comhttps://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices

    SmartGPT: Major Benchmark Broken - 89.0% on MMLU + Exam's Many Errors

About

Covering the biggest news of the century - the arrival of smarter-than-human AI. The author of Simple Bench, exposing the remaining human-LLM reasoning gap. Solo Developer of LM Council: https://lmcouncil.ai - Code - INSIDER15Join me at AI Insiders, with exclusive videos and a 1000+ network of AI enthusiasts and professionals: https://www.patreon.com/AIExplainedLinks:AI Insiders: Code - INSIDER15: https://www.patreon.com/AIExplainedMy AI Council App: https://lmcouncil.aiSimple Bench: https://simple-bench.com/Podcast (New!): https://aiexplainedopodcast.buzzsprout.com/Newsletter: https://signaltonoise.beehiiv.com/X: https://twitter.com/AIExplainedYT

You Might Also Like