Code With Wilson

Wilson Wu

I'm using AI to learn AI, and I'm publishing the journey as I go. Each episode is a NotebookLM-generated audio overview of a study brief I wrote — Chip Huyen chapters, LeetCode problem walkthroughs, AI Engineering interview topics. Built for myself, useful for anyone studying AI engineering for Google Cloud, Anthropic, OpenAI, or similar roles. Made transparently with NotebookLM (audio) and Claude (briefs). — Wilson Wu

  1. 20 ביולי

    The Launch Tax: How CUDA Graphs Keep Your GPU From Sitting Idle

    Running one token through a language model isn't one big GPU operation. It's hundreds to thousands of tiny ones, and each of those has to be launched by the CPU first. During decode, those little operations finish so fast the GPU starves waiting for the CPU to queue the next one. CUDA Graphs fix this by recording the whole repeating sequence once and replaying it with a single launch, so the GPU stays fed. Same math, same result, far less idle time.

  2. 20 ביולי

    The Model Is a Commodity: What an AI Engineer Actually Builds

    The single idea the entire craft rests on is this: the model is a commodity, and the system around it is the job. A raw frontier model is a brilliant intern with amnesia, no hands, and no way to check its own work. The AI engineer gives it hands through tools, a memory across runs, a way to verify itself through evals, and a loop that keeps working until the task is done. That wrapper — not the model weights — is the thing you get paid to build. Learn to build it and you're employable.

  3. 20 ביולי

    Attention Is Just Four Operations: How Every LLM Decides What to Read

    Scaled dot-product attention is not a mysterious black box. It's four elementary operations — matrix multiplication, transpose, scaling by a constant, and softmax — plus three learned projections that produce queries, keys, and values. You can write it in about a hundred lines of plain C with no autograd and no libraries. Once you see it as loops instead of magic, you reason about cost, memory, and failure modes from first principles rather than treating the model as a sealed device.

  4. 20 ביולי

    Serving Is a Separate Problem: How vLLM Runs LLMs Fast and Cheap

    An LLM engine like vLLM exists because serving a model well is its own systems problem, distinct from training it. Text generation is autoregressive and memory-bound, and the key-value cache is the real capacity limit on how many users fit on a GPU. vLLM answers three questions: which requests run next, how a batch executes, and where each request's cache lives. Its headline move is treating GPU memory like virtual memory, which slashes waste and unlocks bigger batches.

  5. 20 ביולי

    Learn to Drive Before You Study the Engine: The fast.ai Bet on Top-Down Deep Learning

    Most technical courses go bottom-up: math, then theory, then maybe you build something months later, by which point your motivation is gone. fast.ai flips it. You train a real, state-of-the-art model in lesson one, and only then peel back the layers to see how it learned. The engine that makes this possible for beginners is transfer learning, and that same "inherit capability instead of building it from scratch" move is the single most important pattern in modern AI engineering.

  6. 20 ביולי

    One Camera, One 3D World: How a Feed-Forward Model Rebuilds a Room at 20 Frames a Second

    A system called LingBot-Map turns a single moving camera into a live 3D map, a point cloud plus the camera's path through space, at roughly 20 frames per second and staying coherent across sequences of 10,000-plus frames. The magic is two ideas working together. First, it's feed-forward: one fast pass per frame instead of a slow optimization loop. Second, it borrows paged KV-cache attention from LLM serving so its memory doesn't explode over long streams. Seeing a language-model trick reappear in 3D vision is the whole point.

  7. 20 ביולי

    What a Production Agent Framework Actually Gives You: The Anatomy of Agno

    A raw model call is stateless and blind — it can't remember you, can't look anything up, and can't act. An agent is that model wrapped in the parts that fix each gap: tools, instructions, memory, knowledge, storage, and reasoning. A serious agent framework hands you those parts pre-assembled, plus a runtime to deploy them. The single most useful idea is that a framework is really a checklist of what every production agent needs — so reading one teaches you the whole shape of the problem.

  8. 20 ביולי

    When Two AI Models Shake Hands: The Whisk-to-Veo Pipeline

    Turning one photo into an on-model video clip is not one model doing something clever. It is two models chained together: Whisk makes a consistent still image, and Veo animates it into about eight seconds of motion. The entire skill is managing the handoff between them: matching the aspect ratio, carrying the seed and prompt across the boundary, and conditioning one model on the other's output. The moat is the pipeline, not the button.

הצגת הכול (45)

אודות

I'm using AI to learn AI, and I'm publishing the journey as I go. Each episode is a NotebookLM-generated audio overview of a study brief I wrote — Chip Huyen chapters, LeetCode problem walkthroughs, AI Engineering interview topics. Built for myself, useful for anyone studying AI engineering for Google Cloud, Anthropic, OpenAI, or similar roles. Made transparently with NotebookLM (audio) and Claude (briefs). — Wilson Wu

מידע

  • יוצרים
    Wilson Wu
  • שנות פעילות
    2026
  • פרקים
    45
  • סיווג
    תוכן הולם
  • זכויות יוצרים
    © 2026 Wilson Wu
  • אתר התכנית
    Code With Wilson