Decoupling Physical Control and Reasoning: DeepMind's Gemini Robotics 2 Architecture

2026年8月4日2 次浏览来源:Dev.to阅读原文

Why Decouple Reasoning from Motor Control General-purpose robots have to pull off two very different jobs at once.

They need to read a cluttered, full-room visual scene, hold a multi-minute plan in memory, and converse with a person — and, in the same instant, close a high-frequency control loop that keeps a balancing humanoid upright and moves a delicate hand without dropping whatever it holds.

Cramming both jobs into a single end-to-end network forces uncomfortable trade-offs: the large context window you want for reasoning fights the low latency you need for torque control.

On July 28, 2026, Google DeepMind pushed directly against that trade-off with Gemini Robotics 2, followed on July 30 by Gemini Robotics ER

2.

Rather than one monolithic network, the suite splits the problem across three specialized models — whole-body vision-language-action (VLA) control, high-level embodied reasoning, and on-device adaptation — each tuned to a different cadence and context size.

The same modular thinking is visible across recent robotics and VLA research collected on the arXiv robotics listings and on Hugging Face Papers, where decomposed perception-planning-control stacks have become a recurring pattern.

Understanding DeepMind's specific split clarifies why this architecture is gaining traction.

The Three-Model Split ER 2: High-Level Task Reasoning Gemini Robotics ER 2 is the cognitive planner of the stack.

It is a vision-language model built for embodied reasoning: it ingests the live camera feed and a natural-language instruction, then decomposes a task that may run several minutes into structured sub-goals.

Beyond planning, ER 2 manages dialogue with a human supervisor, interprets spatial context, and coordinates multiple robots operating in a shared workspace — deciding which sub-task gets handed to which platform.

Operating more slowly than the control layer (roughly a few times per second), ER 2 trades frequency for breadth of context.

That separation matters: a reasoning model can afford to run a large context window and a careful forward pass because it is not on the critical 100 Hz balance-control path.

Gemini Robotics 2: Whole-Body VLA Controller If ER 2 decides what to do, Gemini Robotics 2 decides how the hardware moves.

As a vision-language-action (VLA) model, it drives motor control for bi-arm manipulators and full humanoid bodies, from feet to fingertips.

The model unifies dynamic balance with fine manipulation.

It generates trajectories for whole-body actions like crouching, walking, and navigating cluttered spaces.

For physical interaction, it controls a range of end-effectors: five-fingered, 22-degree-of-freedom (DoF) hands for delicate tasks such as tying knots, alongside two-fingered grippers for precise packing and placement.

On-Device 2: Rapid Embodiment Adaptation Operating at the edge, Gemini Robotics On-Device 2 is an efficient VLA variant optimized for local execution directly on robot hardware.

Its job is low-latency closed-loop control plus adjustment to hardware variation — the part of the problem most sensitive to per-robot kinematic quirks.

DeepMind reports that On-Device 2 can adapt to a new robot embodiment with only a few hours of operational data and fewer than 200 demonstration examples.

That low-shot capability targets a real bottleneck in physical AI: retargeting fine control policies to new kinematics without collecting enormous demonstration datasets for every new morphology.

The Execution Loop A physical goal requires continuous handoff across all three layers.

Consider a user instructing a humanoid to clear a cluttered workspace and pack items: Goal Planning — ER 2 reads the camera stream, analyzes the scene, breaks the multi-minute task into discrete sub-goals, and assigns them.

Action Dispatch — ER 2 passes structured intent targets to Gemini Robotics

2.

Trajectory Generation — Gemini Robotics 2 converts sub-goals into coordinated joint control, balancing walking stability with manipulator po

分享