A General Model Beat Trained Robot Policies, And Spent Most of Each Task Thinking Source: https://arxiv.org/abs/2611.09892 Paper was published on November 06, 2026 This episode was AI-generated on November 10, 2026. The script was written by an AI language model and the host voices were synthesized by Eleven Labs. The producer is not affiliated with Anthropic or Eleven Labs. An off-the-shelf reasoning model, handed a camera feed and a Python session but no pick-and-place functions, succeeded in 104 of 108 real robot trials — while purpose-trained manipulation policies managed 49 and 30. Then the authors gave it better tools, and the strongest models got worse. We dig into why crude controls can beat good ones, and what the four-minute-per-task price tag means for whether any of this ships. Key Takeaways: - Why a harness with no 'pick' and no 'place' function — just raw poses, depth, and a live Python session — outperformed vision-language-action and world-action specialists on real hardware - The real speed number: 280 seconds per successful trial, only 69 of them with the arm actually moving - Why helper routines lifted the six weakest models and made all four strongest models worse, and why the authors blame a wrapper that hides failure - The like-for-like caveat on the headline result — 94 of 108 once you remove the agent's permission to clear controller errors after collisions - What happens when you strip away depth, perception tools, and camera calibration: one model self-calibrates and holds 76 percent, another collapses from 52 to 11 - Where the whole approach is out of scope: static tabletop scenes, no mid-motion revision, and a result tied to specific model versions 00:00 - A grasp that was physically impossible: The cold open: an 8.5 cm gripper, an 11.5 cm pomegranate, and an agent that rolls the fruit up a crate wall instead of pinching at it. 01:27 - Why nobody kept the model at the stove: The dominant specialist approach — imitation-trained vision-language-action and world-action models — versus the arm's-length ways general models had been used in robotics, and the spatial-reasoning weakness that kept them out of the loop. 02:38 - A harness with no pick function: What AMP1 actually gives the model — images, depth, a 3D inventory, joint readings, a persistent Python session, and motion preview — and what it pointedly refuses to do for it. 03:30 - 104 of 108, no demonstrations: The real-hardware result: twelve tasks, nine trials each, agent at 104 of 108 against 49 for FLUX 3 Action and 30 for pi zero point five. 04:19 - Three quarters of the job, frozen: The cost: 280 seconds per successful trial with only 69 seconds of motion, the baselines' 62 and 44 seconds, and Tyler's caveat that error recovery is worth 10 of the agent's wins. 05:55 - When the goal moves to the object: The emergent behaviors — pushing an ungraspable bowl onto a plate, using a wooden spoon to tip a bottle closer — plus the boring habits found across 1,200 simulated episodes. 06:54 - Better tools made the best models worse: The assistive harness with suggested grasps, a planner, and a retrying pick routine lifted the six weakest models and dropped the four strongest — and the authors' explanation involves a function that returns only 'false'. 09:07 - Is this just bigger model wins?: Model choice spans 13 to 86 percent on the same harness, but a concurrent system scored 25 percent with the same model where AMP1 got about 85 on the same subset. 10:07 - Take away the calibration and see: Stripping depth, perception tools, and camera calibration — Opus holds at about 76 percent and self-calibrates its own wrist camera, Haiku collapses to 11 — followed by the three things Tyler says we should not conclude. Recommended Reading: - Code as Policies: Language Model Programs for Embodied Control: The canonical version of the 'write a control program and walk away' approach the episode contrasts with AMP1's always-at-the-stove agent loop. (https://arxiv.org/abs/2209.07753) - Inner Monologue: Embodied Reasoning through Planning with Language Models: Directly tests the episode's central claim that raw, unwrapped feedback from the environment is what lets a capable model diagnose and repair its own failures. (https://arxiv.org/abs/2207.05608) - Voyager: An Open-Ended Embodied Agent with Large Language Models: The clearest precedent for the memory experiment that lifted success from one in four to four in five by accumulating a reusable code library instead of updating weights. (https://arxiv.org/abs/2305.16291) - π0: A Vision-Language-Action Flow Model for General Robot Control: The specialist-policy lineage behind the π0.5 baseline that managed only 30 of 108 real trials, useful for judging whether the comparison was fair. (https://arxiv.org/abs/2410.24164)