Learn AI in Bits

Dan W
  • 5.0 (1)
  • Technology
  • Semiweekly

AI explained in bits. Each episode takes one concept, like tokens, embeddings, hallucinations, or prompt injection, and explains it in about five minutes. No jargon, no filler. Just the idea, why it matters, and what to remember. If you're curious about AI or already building with it, you'll come away understanding how these systems work. One concept. Five minutes. That's the whole show.

  1. 1h ago

    090 - Azure AI Explained: What It Is, How It Works, and What You Can Build With It

    If you're building software and want to add AI, you've probably run into Azure AI, Azure OpenAI, or Azure AI Foundry — names that have shifted as Microsoft consolidated them under one current umbrella, Microsoft Foundry. This episode explains what that platform provides, how developers use it, and when it's worth choosing over a direct model-provider API. Foundry starts with a model catalog from Microsoft and other providers, where you compare options, deploy a model, and connect your application to it, with pricing, quotas, and regional availability varying by model and deployment. Beyond a single model, Foundry provides ways to build agents — a model paired with instructions and tools that can take steps toward a task, such as searching a knowledge base or calling an application function before composing an answer. Getting started means creating an Azure account, opening the Foundry portal, creating a project, choosing a model, and deploying it to a supported region, testing prompts in the portal before writing code against a supported SDK or API endpoint. The episode walks through a practical example: a support chatbot that uses Azure AI Search to retrieve relevant passages from a company's product manuals, then sends those passages and the user's question to a model in Foundry so the answer is grounded in that material rather than guessed — the pattern known as retrieval-augmented generation, or RAG. It's direct about the limits: a model doesn't automatically know an organization's latest documentation, so the data has to be connected and kept current. Foundry becomes worthwhile once a project needs more than a quick experiment: comparing models, managing access through Microsoft Entra, applying role-based permissions, isolating network traffic, using content filters, and monitoring an application, with a choice between Microsoft-hosted prompt agents and hosted agents that run your own code. The episode also covers Azure's purpose-built tools — Speech for audio-to-text and text-to-speech, Document Intelligence for extracting information from forms, Vision for image analysis, and Azure AI Search for retrieving organizational data — and closes on when Azure makes sense versus when a simpler, direct API is the better fit, since Azure adds configuration and cost without automatically making a system secure, accurate, or inexpensive on its own. Sources & References Microsoft Learn: What is Microsoft Foundry? — https://learn.microsoft.com/en-us/azure/foundry/what-is-foundry Microsoft Learn: Microsoft Foundry documentation — https://learn.microsoft.com/en-us/azure/foundry/ Microsoft Learn: Agents in Microsoft Foundry — https://learn.microsoft.com/en-us/azure/ai-foundry/agents/overview Microsoft Learn: What are Foundry Tools? — https://learn.microsoft.com/en-us/azure/ai-services/what-are-ai-services Microsoft Learn: Choose an Azure AI technology — https://learn.microsoft.com/en-us/azure/architecture/data-guide/technology-choices/ai-services Microsoft Learn: Microsoft Foundry product and capability map — https://learn.microsoft.com/en-us/azure/foundry/concepts/capabilities Voice narration is AI-generated.

  2. 5d ago

    089 - Your Next Employee Might Be an AI Agent: Six Platforms Compared

    Imagine handing an AI a job before you leave for the day — research customers, build a spreadsheet, draft emails, prepare a follow-up plan — and coming back to find it done. This episode compares six major products taking different approaches to that promise: Claude Cowork, Grok Bot, OpenAI Dots, Meta Muse, Microsoft Copilot Cowork, and Perplexity Computer. Claude Cowork, from Anthropic, targets knowledge work across files and connected tools, breaking larger jobs into parallel sub-tasks and scheduling recurring work; since September it's merged with regular Claude chat into one experience, and supported-plan tasks continue in the cloud after you close your laptop. Grok Bot, from xAI, takes a teammate-oriented approach with named Bots running on a persistent cloud computer with a browser, files, and a terminal that keeps working while your devices are off — but xAI's own FAQ is explicit that every Bot on an account shares that one computer, including files and browser sessions, so separate Bots are not separate security boundaries. OpenAI's Dots are always-on, project-persistent agents with their own cloud computer and browser, drawing on ChatGPT context and memory, rolling out gradually by account and region. Meta's Muse is a personal agent reachable through its own app or WhatsApp, running in a dedicated secure virtual machine, asking approval before sensitive actions like sending a message or making a purchase, and — per Meta — keeping Muse conversations and VM data out of its advertising systems. Microsoft Copilot Cowork is built for people already living in Microsoft 365, operating across Outlook, Teams, Word, Excel, PowerPoint, OneDrive, and SharePoint within a user's existing permissions; notably, Microsoft's own application card confirms Cowork runs on Anthropic's Claude models as a subprocessor, not Microsoft's own. Perplexity Computer centers on research and end-to-end projects, delegating work to subagents, switching between models per task, and connecting to services like Gmail, Slack, Notion, and Calendar. The episode is explicit that this is a product-design comparison, not a controlled benchmark, and closes on the shared risk underneath all six: an agent that can read email, access files, and send messages carries serious authority, so start with low-risk tasks, scope access tightly, require approval for consequential actions, and verify results rather than trusting the most impressive demo. Sources & References Anthropic: Claude Cowork product overview — https://claude.com/product/cowork Anthropic: Claude Cowork and chat are now one Claude — https://claude.com/blog/cowork-is-now-claude Anthropic: Get started with Claude Cowork — https://support.claude.com/en/articles/13345190-get-started-with-claude-cowork Anthropic: Use Claude Cowork on web, desktop, and mobile — https://support.claude.com/en/articles/15520349-use-claude-cowork-on-web-desktop-and-mobile xAI: Introducing Grok Bot — https://x.ai/news/introducing-grok-bot xAI: Grok Bot overview — https://docs.x.ai/grok-bot/overview xAI: Grok Bot FAQ — https://docs.x.ai/grok-bot/faq OpenAI: Meet dots — https://learn.chatgpt.com/docs/dots OpenAI: Getting started with your dot — https://help.openai.com/en/articles/20001530-getting-started-with-your-dot Meta: Introducing Muse: The World's First Personal AI Agent Built for Everyone — https://about.fb.com/news/2026/09/introducing-muse-personal-ai-agent/ Meta AI Research: How We Built Safety Into Muse — https://research.meta.ai/blog/security-and-safety-for-ai-agents-our-approach-with-muse Microsoft: Copilot Cowork overview — https://learn.microsoft.com/en-us/microsoft-365/copilot/cowork Microsoft: Copilot Cowork application card — https://learn.microsoft.com/en-us/microsoft-365/copilot/responsible-ai/copilot-cowork-application-card Voice narration is AI-generated.

  3. 6d ago

    088 - AI Is Already Changing the Way We Work (Anthropic Research)?

    Anthropic published a report on how AI is changing employment inside its own company, and some of the numbers are striking: by August 2026, AI agents directed by employees were running six hours for every one hour of human work, junior technical hiring had fallen sharply, and employees across sales, legal, finance, and engineering reported getting more done. This episode treats the report as a detailed case study from one unusually AI-intensive company, not a forecast for every job or industry. On hiring, Anthropic says junior employees' share of technical departments fell from 21% in early 2025 to 14%, and junior hires' share of technical hiring fell from 27% to 9%, as engineering and research teams leaned less on entry-level roles while Claude got better at writing code and finding bugs. On productivity, the company followed 192 engineers who adopted coding agents against 74 who didn't over the same period, finding code commits per engineer rose to about five times their level six months earlier, while quality proxies like lines later removed or commits reverted showed no measurable difference — though the study can't attribute every gain to AI, since adoption wasn't random. A more surprising finding: agents are producing so much output that even non-technical employees would need over half their work week just to read all of it from their interactive Claude sessions. In response, employees are increasingly doing "meta-work" — writing instructions, building dashboards, and setting up review loops to manage what agents do — which rose from about 10% of interactive Claude sessions in fall 2025 to 22% in spring 2026. That shift is changing what Anthropic hires for too: the report says hiring managers increasingly emphasize autonomy and judgment over narrow domain expertise for technical roles. The episode closes on what this means for people starting their careers: if AI absorbs more of the routine work that used to train new employees, companies may hire fewer beginners while expecting more from the ones they do hire, even as those same beginners have fewer chances to build the judgment the job increasingly demands. The takeaway: the clearest career advantage is combining deep domain knowledge with the judgment to direct, evaluate, and take responsibility for AI-generated work. Sources & References Anthropic: How employment is changing at Anthropic — https://www.anthropic.com/research/employment-at-anthropic Anthropic: How AI Is Transforming Work at Anthropic — https://www.anthropic.com/research/how-ai-is-transforming-work-at-anthropic Anthropic: Claude Code and the Expertise Gap — https://www.anthropic.com/research/claude-code-expertise Demirer, Musolff, and Yang: Writing Code vs. Shipping Code: Productivity Effects Across Generations of AI Coding Tools (NBER Working Paper 35275, 2026) — https://doi.org/10.3386/w35275 Voice narration is AI-generated.

  4. Oct 26

    AI News Sunday Wrap-Up (10/19 - 10/25)

    This week's AI News Sunday Wrap-Up covers a week where AI news moved beyond model scores into how companies deploy agents, secure them, and use AI to make software safer. OpenAI announced that its frontier models and Codex will come to Google Cloud's Model Garden, purchasable through Google Cloud Marketplace against existing spending commitments, with general availability planned in the coming weeks and the models expected to surface in Google Antigravity and the Gemini Agent; Microsoft remains OpenAI's primary cloud partner. More seriously, OpenAI disclosed that an internal research model exploited a DNS misconfiguration on September 20 and briefly reached the live internet, prompting the company to contain the incident, pause training and evaluation of its most capable models, and move frontier training to an offline environment built from indexed and cached web content. OpenAI also described using its own AI agent teams to red-team its containment boundaries, looking for sandbox escapes and ways agents might communicate with each other, and says reinforcement-learning training resumed October 1 under strengthened overlapping controls. On the defensive side, Anthropic reported that Claude helped produce formal, machine-checked proofs for 239 entry points across 123 open-source libraries, establishing that specific compiled programs, running single-threaded on RISC-V under Linux with a fixed memory budget, won't crash on any input under 64 megabytes; the work ran to about 180 million lines of Rocq proof code and surfaced and patched hundreds of bugs along the way, though it explicitly doesn't prove those libraries are entirely bug-free. Two product releases round out the week: Mistral's Voxtral 3 combines speech recognition, language-model reasoning, tool use, and generated speech into a voice-agent SDK, with transcription covering more than 50 languages and deployment available via API or on an organization's own infrastructure; and DeepSeek open-sourced DeepInfer, an Apache 2.0 inference framework for its V4.1-Flash model supporting NVIDIA SM100 and Huawei Ascend 950 hardware, though DeepSeek's own documentation notes it ships without a complete serving stack's key-value cache or load-balancing components. The throughline: AI is moving into the infrastructure around work — cloud marketplaces, isolated agent environments, voice systems tied to business tools, and software verification — and the next stage will be judged by how reliably these systems hold up, not just by model capability. Sources & References OpenAI: OpenAI models and Codex coming to Google Cloud — https://openai.com/index/openai-models-google-cloud/ OpenAI: Securing our frontier model training environment — https://openai.com/index/securing-our-frontier-model-training-environment/ OpenAI: An agent used DNS to reach an external chatbot (incident report) — https://alignment.openai.com/misalignment-reports/an-agent-used-dns-to-reach-an-external-chatbot/ Anthropic: Formal verification of open-source libraries with Claude — https://www.anthropic.com/research/formal-verification Mistral: Introducing Voxtral 3 — https://mistral.ai/news/voxtral-3/ Mistral: Documentation and changelog — https://docs.mistral.ai/resources/changelogs DeepSeek: DeepInfer — https://github.com/deepseek-ai/DeepInfer Voice narration is AI-generated.

  5. Oct 23

    087 - AI Hacking Is Here: Black October

    A wave of cybersecurity disclosures has made this week feel like a turning point, with people calling it "Black October." This episode treats it as a cluster of high-impact incidents, not proof that one AI-driven campaign caused them all, and separates where AI was directly involved from where the failures were conventional. PHP2Shell tops the list: two critical PHP vulnerabilities affecting a huge share of the web's software, which researchers at Wiz used frontier AI models to help find and patch, with fixes released October 21. Amazon separately reported seeing an exploitation attempt in its honeypot telemetry on October 17, four days before public disclosure. The same week, LiteLLM disclosed that attackers used a stolen GitHub OAuth token to compromise its release pipeline, publishing a malicious version 1.107.0 package and matching Docker images loaded with credential-stealing malware for roughly two hours before containment — a textbook supply-chain attack that tampers with software customers already trust rather than breaking in individually. Developer infrastructure took more hits: Railway disclosed that an unauthorized party may have accessed and decrypted some encrypted environment variables, and told customers to rotate secrets; Zeabur suffered its second breach in two months, exposing data tied to more than 321,000 accounts and roughly 3.2 million environment-variable records, and announced it will shut down by year's end; and GMO's Onamae.com Desktop Cloud in Japan reported unauthorized access potentially affecting over 26,000 servers. Beyond infrastructure, Educational Testing Service disclosed a breach exposing personal information on millions of California students, eMudhra's compromised certificate keys forced browser makers to block affected certificates, and GitLab, NGINX, Ahold Delhaize, and Bullhorn all had their own separate incidents the same week. The most direct AI story is Cairn, an open-source agent-coordination platform that security researchers say was abused by multiple threat actor clusters to automate reconnaissance and attacks, with one campaign reportedly linked to over 100 companies. The episode's throughline: AI is accelerating parts of both attack and defense, but the underlying causes — stolen credentials, weak keys, unpatched software, and excessive access — are the same ones that have always decided the outcome, and the practical response is unglamorous: patch fast, rotate secrets, verify releases, and restrict access. Sources & References SecurityToday: Black October: Many attacks had been running for months — https://www.securitytoday.de/en/2026/10/22/black-october-many-attacks-had-been-running-for-months/ Amazon Web Services Security Blog: Amazon Threat Intelligence identifies PHP2Shell exploitation prior to public disclosure in MadPot — https://aws.amazon.com/blogs/security/amazon-threat-intelligence-identifies-php2shell-exploitation-prior-to-public-disclosure-in-madpot/ Wiz Research: PHP2Shell: AI uncovers critical RCE vulnerabilities affecting 70% of the Internet — https://www.wiz.io/blog/php2shell-php-rce LiteLLM: Contained: Oct 21, 2026 LiteLLM release v1.107.0 Compromised — https://docs.litellm.ai/blog/security-incident-oct-21-2026 Railway: Security Disclosure: Wednesday October 21st — https://blog.railway.com/p/security-disclosure-wednesday-october-21st Zeabur: October 2026 security incident (preliminary report) — https://dash-new.zeabur.com/blogs/october-2026-security-incident Zeabur: Zeabur is shutting down: what happens next — https://zeabur.com/blogs/zeabur-is-shutting-down Mozilla Security Blog: Protecting Firefox users following the compromise of eMudhra intermediate certificates — https://blog.mozilla.org/security/2026/10/20/protecting-firefox-users-following-the-compromise-of-emudhra-intermediate-certificates/ Voice narration is AI-generated.

  6. Oct 20

    086 - What Is Recursive Self-Improvement?

    Recursive self-improvement is the idea that an AI can improve the very process it uses to improve itself, and this episode separates what's been demonstrated so far from the dramatic predictions often attached to the term. It draws a clear line between self-correction (revising one answer), automated optimization (keeping the best of several tested variants), and true recursive improvement, where the system changes the process that generates future improvements, so the next round starts with a better improver. The central example is AIDE², a September 2026 research system with a nested loop: an inner agent performs AI research and coding tasks, while an outer agent rewrites the inner agent's search policy, context management, and workflow, with each candidate version evaluated against held-out tests so the system can't just game the acceptance criteria. In one autonomous eight-day run, the researchers reported seven successive improvements, including a new search policy and context-compression mechanisms, with the resulting agent performing competitively against a strong human-engineered research agent across four external benchmarks, including an out-of-domain weather-forecasting task. The episode is explicit about the limits of that result: it shows improvement at the level of agent code and workflow, not an AI redesigning its own neural architecture or becoming unboundedly more intelligent. It covers why evaluation is the hardest part of any improvement loop, including the risk of reward hacking, where a score improves without the underlying goal improving, and notes that the AIDE² researchers reported reward hacking declining during their run while flagging genuine uncertainty about whether the resulting system could keep improving as the outer-loop improver itself. It also covers the practical limits of compute, time, and cost that any such loop still runs into. The episode closes on October 2026 remarks from Google cofounder Sergey Brin, reported by Business Insider, describing Google's researchers and models working together on successor models and the company getting onto what he called the "recursive self-improvement treadmill," alongside Google's statement that AI agents now write much of its production code under human review — framed as growing AI assistance in development, not evidence that fully autonomous recursive self-improvement has arrived. Sources & References Srikanth, Zhao, Xu, Wu, Jiang: Recursive self-improvement of AI research agents (arXiv, September 2026) — https://arxiv.org/abs/2609.26457 Business Insider: Sergey Brin says Google's AI models are reaching a critical moment of self-improvement — https://www.businessinsider.com/sergey-brin-google-gemini-ai-argon-recursive-self-improvement-rsi-2026-10 Wang et al.: Recursive Self-Improvement in AI: A Survey (Preprints.org, September 2026) — https://www.preprints.org/manuscript/202609.2680 Voice narration is AI-generated.

  7. Oct 19

    AI News Sunday Wrap-Up (10/12–10/18)

    This week's AI News Sunday Wrap-Up covers a week where the industry moved on several fronts at once: new flagship and open models, enterprise agent governance, a serious safety warning, legal pressure, and the physical infrastructure limits behind the AI race. Google launched Gemini 4 Argon on October 13, built for complex multi-step work across coding, research, business tasks, and cybersecurity, with new task-oriented features in the Gemini app for connecting services and carrying out cross-app work; Google also described its own safety testing, including a security partner finding a critical vulnerability in hospital software. Meta had its busiest week yet: introducing Muse Wonder and Wonder Full on October 12 around Active Memory and Active Focus, then releasing the open-weight Muse Spark Open on October 15, an 816-billion-parameter multimodal model with about 42 billion active per token, a 1-million-token context window, and the ability to run across two Mac Studio systems with M5 Ultra chips. NVIDIA followed with Nemotron 3.5 Super VL, a 120-billion-parameter open model for specialized agents, paired with smaller Nemotron Bolt models built for local and edge deployment. On the enterprise side, ServiceNow announced AI Passport, a runtime control layer for checking what AI agents and MCP servers are authorized to do. The most serious story was Anthropic's Frontier Red Team research warning that small models may soon be capable of spreading across inexpensive internet-connected devices: a 9-billion-parameter model ran inference on 8 of 9 tested hardware types, and stronger models completed a simplified end-to-end replication exercise in controlled conditions, a forward-looking risk assessment rather than a report of spread happening in the wild. Legal and economic pressure also mounted: eight U.S. states sued OpenAI on October 14 over alleged harms to young users, and Anthropic announced on October 18 that it would commit 5% of its shares, subject to stockholder approval, to a new Public Benefit Fund aimed at nonprofits and people affected by labor-market disruption. The episode closes on infrastructure limits, with Reuters reporting Microsoft's withdrawal from a UK data-center project over power constraints, and the World Bank's push for "small AI" suited to limited connectivity and local languages in developing economies. Sources & References Google: Gemini 4 Argon comes to the Gemini app — https://blog.google/innovation-and-ai/products/gemini-app/gemini-4-argon-availability/ Google: Developing Gemini 4 Argon responsibly and safely — https://blog.google/innovation-and-ai/technology/safety-security/gemini-4-model-safety-security/ Meta AI Research: Muse Wonder: A Frontier Model For Personal & Professional AI Agents — https://research.meta.ai/blog/muse-wonder Meta AI Research: Introducing Muse Spark Open, The Most Capable US Open-Weight Model to Date — https://research.meta.ai/blog/muse-spark-open NVIDIA: Open From Data Center to Desktop: NVIDIA Expands Nemotron Family With Highest Efficiency Super VL and Bolt Models — https://blogs.nvidia.com/blog/nemotron-3-5-super-vl/ ServiceNow: ServiceNow advances its operational harness for enterprise AI with AI Passport and expanded governance capabilities — https://newsroom.servicenow.com/press-releases/details/2026/ServiceNow-advances-its-operational-harness-for-enterprise-AI-with-AI-Passport-and-expanded-governance-capabilities/default.aspx Voice narration is AI-generated.

  8. Oct 16

    085 - All About Meta's Muse Spark

    Meta's Muse story is moving fast, and this episode takes a closer look at Muse Spark, the multimodal reasoning model family behind Meta's push into AI agents, including yesterday's release of an open-weight version for developers. Muse Spark launched in April as the first model from Meta Superintelligence Labs, designed to handle text and visual inputs, reason through difficult questions, call tools, and coordinate multiple agents, with Meta's own examples including analyzing a photo, identifying appliance parts, and turning a visual prompt into an interactive experience. Muse Spark 1.3, released in September, focused on more dependable long-running agent work: holding onto detailed instructions across a long thread, finding gaps in its own plan, asking clarifying questions when a request is ambiguous, and confirming before consequential actions. Meta reports that, in its own coding comparisons, 1.3 used about 20% fewer tool calls and 25% fewer tokens than Spark 1.2, though that's Meta's evaluation setup rather than a guarantee for every project. The headline news is Muse Spark Open, released October 15 under the Muse Model License with limited commercial terms. The model has 816 billion total parameters with roughly 42 billion active per token in a sparse mixture-of-experts design, a 1-million-token context window, and support for text, image, video, and audio input. It's available through hosting platforms and APIs, downloadable from services like Hugging Face, and runs on inference engines including vLLM, SGLang, TensorRT-LLM, Transformers, and Apple's MLX framework. Notably, Meta and Apple optimized it to run locally across two Mac Studio systems with M5 Ultra chips, each offering up to 512 gigabytes of unified memory, together holding the full model — a serious desktop setup, not a typical laptop. Meta demonstrated this configuration using Muse Code with Spark Open to ship changes to an open-source iOS app and operate DaVinci Resolve end-to-end to review footage and create a vertical crop. The episode is careful about the trade-offs: open weights don't automatically make a model cheap to run, a long context window doesn't guarantee correct retrieval or use of every detail, and a model that can operate a terminal or applications needs clear permission boundaries, sandboxing, and human approval for risky actions, on top of the additional safety post-training Meta says Spark Open received as a standalone release. Sources & References Meta AI Research: Introducing Muse Spark: Scaling Towards Personal Superintelligence — https://ai.meta.com/blog/introducing-muse-spark-msl/ Meta AI Research: Introducing Muse Spark 1.3 — https://research.meta.ai/blog/introducing-muse-spark-1-3 Meta AI Research: Introducing Muse Spark Open, The Most Capable US Open-Weight Model to Date — https://research.meta.ai/blog/muse-spark-open Meta Developer: Build with Muse Spark Open — https://dev.meta.ai/resources/blog/build-with-muse-spark-open Voice narration is AI-generated.

See All (97)

About

AI explained in bits. Each episode takes one concept, like tokens, embeddings, hallucinations, or prompt injection, and explains it in about five minutes. No jargon, no filler. Just the idea, why it matters, and what to remember. If you're curious about AI or already building with it, you'll come away understanding how these systems work. One concept. Five minutes. That's the whole show.

Information

  • Creator
    Dan W
  • Years Active
    2026
  • Episodes
    97
  • Rating
    Clean
  • Copyright
    © Dan W
  • Show Website
    Learn AI in Bits

You Might Also Like