Embodied AI 101

Shaoqing Tan

Embodied AI 101 tracks the latest research at the intersection of AI and physical intelligence. Robotics, manipulation, world models, and the path from digital intelligence to embodied agents — each episode breaks down recent papers and advances in the field. We examine the methodology, real-world implications, and path to deployment. Covering robot learning, perception, control, and the fundamental challenge of grounding intelligence in the physical world. New episodes daily.

  1. 12h ago

    RynnUnify: Does Video Imagination Improve Robot Planning?

    Can imagined video help a robot plan and execute a multi-step task? This episode explains how RynnUnify connects scene understanding, video prediction, and robot control, and how to interpret the evidence behind that connection. We cover three questions: how memory supports successive visual-planning steps, how BCPO learns when to request generated visual context, and how a world-action model turns predictive representations into action chunks. The discussion spans visual planning, anticipatory reasoning, simulated household manipulation in RoboCasa365, and physical manipulation on Astribot S1. We also place the work alongside Cosmos 3 and RxBrain to distinguish inherited architecture from RynnUnify's approach to temporal coordination. The central limitation is causal attribution: the headline agentic comparison changes the trained policy and the use of generated video together. For world-model researchers and roboticists, that raises an important engineering question about which component deserves the credit—and the investment. Listen for a concrete way to think about prediction as an internal decision-making representation. When a robot imagines a future, which part of its next decision actually gets better?

  2. 12h ago

    LaLa-World: Can Language Scale Latent World Models for Robots?

    Can natural language let one robot world model learn from incompatible control logs and ordinary video? This episode explains how LaLa-World unifies transition conditioning while keeping future prediction in visual feature space. ([june-page.github.io](https://june-page.github.io/lala-world/)) We unpack three findings: joint training improves average simulated planning success over JEPA-WMs; image and video co-training improves robustness to reworded actions; and predictive pretraining transfers into an action-generating policy. ([github.com](https://github.com/junha1125/LaLa-World)) The discussion follows the data pipeline from simulation trajectories and DROID's Franka manipulation recordings to captioned video and image-edit pairs, then separates goal-image model predictive control from LaLa-Policy fine-tuning on LIBERO and RoboCasa. ([raw.githubusercontent.com](https://raw.githubusercontent.com/junha1125/LaLa-World/main/data_preparation/README.md)) We explain why representation-based generation makes RAEv2 an informative comparison, and how Cosmos Policy supplies the policy-learning precedent. ([arxiv.org](https://arxiv.org/html/2605.18324v1)) The central limitation is physical execution: the DROID evaluation is offline, while LaLa-Policy's demonstrated execution is in simulation. ([arxiv.org](https://arxiv.org/html/2610.27851v2)) For roboticists working on latent world models, language-conditioned control, and mixed-data pretraining, the episode identifies the architectural idea worth testing. Could a better interface for experience matter as much as a larger predictor?

  3. 1d ago

    SwarmACB: Why Behavior Selection Helps Swarm Sim-to-Real Transfer

    Why do reinforcement-learned swarms coordinate in simulation and struggle after deployment? This episode explains SwarmACB's proposal to learn behavior selection instead of direct wheel control. We examine three questions: how behavioral modules change the learning problem, why attention and counterfactual credit assignment fit collective control, and what the reported physical evaluation establishes. The study evaluates controllers across five collective missions using 20 e-puck robots and 250 hardware runs, with the authors reporting stronger transfer from structured policies than from continuous-action control. We connect that result to AutoMoDe's modular design philosophy and earlier work on structured representations for swarm reinforcement learning. The discussion distinguishes action abstraction, restricted observations, network capacity, and recurrent memory rather than treating them as one architectural change. Its central critical question is whether a fixed behavior library remains useful beyond missions closely aligned with its primitives. For researchers building decentralized controllers and practitioners combining learned decisions with engineered behaviors, the episode offers a concrete way to think about learning authority. Could a better action interface matter more than another round of policy scaling?

  4. 2d ago

    GVC: Why Action Modeling Helps Robot Reinforcement Learning

    Can the machinery that generates robot actions also teach a better critic? This episode of *Embodied AI 101* explains Generative Value Classifier, or GVC, and separates its value-learning contribution from its proposed connection to pretrained robot policies. We unpack three questions: how return-conditioned action modeling becomes an implicit Q-function, why the Tool Hang comparison is compelling, and what the action-loss ablations reveal about the source of improvement. ([github.com](https://github.com/alexanderswerdlow/gvc)) The discussion follows simulated manipulation with a seven-degree-of-freedom arm, human demonstrations mixed with online replay, and offline learning on OGBench. ([arxiv.org](https://arxiv.org/pdf/2610.22497)) We connect the method to generative image classifiers, Decision Transformer, Q-chunking, and Value Flows, emphasizing the difference between generating candidate actions and judging their long-term usefulness. The central limitation is the untested transfer to large pretrained robot policies: the experiments evaluate state-input networks in simulation rather than fine-tuning a robot foundation model. ([arxiv.org](https://arxiv.org/pdf/2610.22497)) For researchers working on sparse-reward manipulation, flow policies, or offline-to-online reinforcement learning, the episode offers a concrete way to think about critic supervision. If your policy already proposes plausible moves, could the biggest improvement come from teaching its critic what those moves mean?

  5. 3d ago

    World Labs Atlas: Is Single-Image 3D Generation Ready for Robotics?

    This episode of Embodied AI 101 examines World Labs Atlas through the practical questions behind single-image 3D generation: how a photograph becomes posed views and depth, what camera-controlled synthesis adds to a robotics workflow, and why a convincing flythrough should not be confused with a measured reconstruction or a validated physical simulator. We assess the announcement's evidence alongside current beta documentation, runnable tooling, reconstruction baselines, and practitioner commentary, separating useful access from model reproducibility, interface advantages from fair benchmark comparisons, and the company's broader sim-to-real results from claims established for Atlas itself, while outlining where a robotics team could sensibly begin an evaluation without replacing its existing validation pipeline. For researchers considering world models as a source of training environments, the episode offers a concrete checklist covering geometric consistency, hidden surfaces, dynamic objects, licensing constraints, hardware transfer, and total engineering cost—what would Atlas need to demonstrate before you trusted its generated world to teach a real robot?

  6. 3d ago

    SpatialDex: Does 3D Video Pretraining Help Bimanual Manipulation?

    Can ordinary RGB human videos teach a robot to coordinate two dexterous hands? This episode explains how SpatialDex reconstructs spatial context from video and uses it to train bimanual manipulation policies. We cover three findings: why a shared video-level scale matters for aligning hands with their surroundings; how geometry enters both the policy's observations and its prediction targets; and what the matched pretraining experiment reveals beyond the headline baseline comparison. SpatialDex reports a 38.3-percentage-point real-robot improvement over its strongest tested baseline and a 14.2-point simulated improvement from geometry-rich versus motion-only pretraining. ([arxiv.org](https://arxiv.org/abs/2610.29716)) The evaluation includes simulated Allegro–Franka and Wuji–Tianji systems, plus physical Wuji hands on Tianji arms performing tasks such as handovers, spraying, unzipping, and sweeping. Human pretraining videos are RGB-only; robot execution uses RGB-D observations. The central limitation is causal attribution: the matched geometry-pretraining controls are evaluated in simulation, while the physical results compare complete systems. ([arxiv.org](https://arxiv.org/html/2610.29716v1)) Listen for a technical account of what reconstruction contributes—and why the relationship between a hand trajectory and its surroundings may be the most valuable thing to recover from human video.

  7. 4d ago

    Show-Harness: Can Small VLMs Replace Frontier Models in Robot Control?

    Can a small vision-language model take over robot control from a frontier agent? This episode explains what Show-Harness actually compresses, how its semantic action interface works, and where its strongest results come from. We cover three central questions: why a compact movement vocabulary changes the learning problem, how GUMI turns browser-based demonstrations into policy-training examples, and what the real-robot evaluation establishes. The method combines supervised action imitation with LoRA adaptation of Qwen3.5-2B, using demonstrations from Franka and AgileX robots alongside a separate ManiSkill and RoboLab simulation corpus. ([huggingface.co](https://huggingface.co/showlab/Show-Harness-VLMs)) We examine the manipulation results, the action-representation ablation, and the relationship to Code as Policies and SmolVLA. The key limitation is that the standalone compact controller does not preserve the frontier system's reasoning-task performance. ([arxiv.org](https://arxiv.org/html/2609.10522v1)) For roboticists working on data-efficient imitation learning and local robot control, the episode offers an architectural takeaway: the interface between model and machine can be as important as the model itself. What becomes easier to learn when the robot's actions become easier to express?

  8. 5d ago

    MolmoBot: Can Simulation Alone Deliver Zero-Shot Manipulation?

    Can a robot learn useful manipulation without real-world robot demonstrations? This episode of Embodied AI 101 explains what MolmoBot's simulation-first training achieves, how its data engine works, and what its zero-shot claim covers. We examine three questions: how procedural scenes and expert planners generate training experience; what the real-world comparison with π₀.₅-DROID measures; and how far the evidence supports broader manipulation generalization. MolmoBot combines a Molmo2 vision-language backbone with a flow-matching action head, alongside alternative policy architectures trained through behavior cloning. Its released synthetic dataset covers tabletop and articulated-object tasks on Franka and Rainbow Robotics platforms. The episode separates the strong real-world pick-and-place result from the much thinner evidence for reliable mobile door opening. We also discuss the practical value of downloadable policies, training episodes, and configurable generation pipelines for researchers studying sim-to-real transfer. If you build manipulation systems, the central question is actionable: what changes when you can program the experiences your robot learns from?

See All (416)

About

Embodied AI 101 tracks the latest research at the intersection of AI and physical intelligence. Robotics, manipulation, world models, and the path from digital intelligence to embodied agents — each episode breaks down recent papers and advances in the field. We examine the methodology, real-world implications, and path to deployment. Covering robot learning, perception, control, and the fundamental challenge of grounding intelligence in the physical world. New episodes daily.

Information

  • Creator
    Shaoqing Tan
  • Years Active
    2025 - 2026
  • Episodes
    416
  • Rating
    Clean
  • Copyright
    © 2026 Shaoqing Tan

You Might Also Like