百科.dev
全部条目在线工具AI 编程趋势榜开源项目技术资讯提交条目
登录
< 返回工具列表
A

ABot-Claw

> 编程语言
开源

ABot-Claw 是基于 OpenClaw 构建的新一代体现式 AI 框架,通过 VLAC (Vision-Language-…

200 stars0 点赞1 次浏览
访问官网GitHub

工具介绍

ABot-Claw 是基于 OpenClaw 构建的新一代体现式 AI 框架,通过 VLAC (Vision-Language-…

ABot-Claw is a next-generation embodied AI framework built on OpenClaw that unifies VLN, VLA, and WAM models through the VLAC (Vision-Language-Action-Critic) loop, enabling real-time task monitoring and self-adaptation. By sharing a multimodal memory—centered on vision, semantics, and geometry—across devices and leveraging centralized control, it breaks down the silos of single-task robots, delivering a robust, collaborative, and elastically scalable multi-agent system.


✨ Core Features

1. VLAC: Task Progress Feedback Mechanism

Introduces the VLAC (Vision-Language-Action-Critic) closed-loop feedback mechanism for dynamic task control.

  • Real-time Assessment: Agents assess task completion and execution progress.
  • Adaptive Adjustment: VLAC provides feedback and triggers strategy updates when deviations occur, enhancing success rates and robustness in long-horizon tasks.

2. End-to-End Closed-Loop Interaction

Supports VLA (Vision-Language-Action) and WAM (World Action Model) for full-cycle autonomy.

  • Seamless Integration: Tightly aligns perception with action to accurately follow natural language instructions.
  • High Autonomy: Executes complex multi-step tasks end-to-end without human intervention.

3. Multi-Robot Collaboration & Elastic Architecture

Enables decentralized collaboration via a shared "Brain."

  • Unified Decision Making: All robots share one Agent Runtime for synchronized state and joint reasoning.
  • Hot-Swappable Support: Robots can join or replace others anytime without disrupting task flow.

4. Vision-Centric Memory Mechanism

Features a unified Memory System for persistent knowledge storage.

  • Integrated Structure: Combines geometric maps (for localization) and semantic maps / image-feature-GPS (for understanding).
  • Long-Context Understanding: Retains and retrieves key visual history to overcome occlusion and delayed feedback.

️ System Architecture

ABot-Claw employs a layered microservices architecture to ensure high cohesion and low coupling:

  1. Infrastructure Layer:
  • GPU Server: Hosts high-performance computing models including Yolo, Depth, VLA, Grasp Anything, VLN, and WAM.
  • Robots & Cameras: Physical terminals including Dog, G1, PiPer, and various camera devices.
  1. Runtime Core (Agent Runtime):
  • Gateway: Handles message routing for CLI/Web UI and Channels (Telegram, DingTalk, Feishu).
  • Agent Loop: The core intelligence cycle containing Context, Tools, and Skills.
  • Scheduler & Device: Manages task scheduling (Heartbeat/Cron) and local device interaction (File System, Shell, Browser).
  1. Memory & Knowledge:
  • Vision-centric Memory: A central repository at the top layer storing geometric maps, semantic maps, and image feature indices for global access.

Quick Start

Server Side

Please refer to the installation instructions in each service.

OpenClaw Side

  1. Configure the OpenClaw workspace before running multi-robot tasks:
bash
# Merge AbotClaw workspace files into an existing OpenClaw setup
./setup.sh

# Or rebuild the OpenClaw workspace, then apply AbotClaw files
./setup.sh --fresh
  1. Update robot fleet endpoints in ~/.openclaw/workspace/skills/ROBOT.md:
  • PIPER_BASE_URL=http://:
  • G1_BASE_URL=http://:
  • GO2_BASE_URL=http://:

Example:

PIPER_BASE_URL=http://192.168.1.10:8880
G1_BASE_URL=http://192.168.1.20:8880
GO2_BASE_URL=http://192.168.1.30:8880
  1. Update shared service host in ~/.openclaw/workspace/skills/SERVICE.md:
  • SERVICE_HOST=

Example:

SERVICE_HOST=192.168.1.100

Service URLs are derived as:

  • http://:8012 (SpatialMemory)
  • http://:8013 (YOLO)
  • http://:8014 (VLAC)
  • http://:8015 (GraspAnything)
  1. Verify robot-type routing rules in ~/.openclaw/workspace/skills/MISSION.md:
  • Piper: fixed-base manipulation tasks
  • Unitree G1: humanoid interaction / whole-body tasks
  • Unitree Go2: mobility, scouting, and inspection tasks
  1. Restart the OpenClaw gateway:
bash
openclaw gateway restart

Robot Side

  1. Install Python dependencies:
bash
cd robot_layer/arm_piper/agent_server
pip3 install -r requirements.txt
  1. Build ROS driver in robot_driver_ros (download the corresponding ROS driver for your robot):
bash
cd robot_driver_ros/src
git clone https://github.com/agilexrobotics/piper_ros.git
git clone https://github.com/realsenseai/realsense-ros.git -b ros1-legacy
# Install dependencies required by the corresponding driver.

cd ../..
catkin_make
  1. Update robot topics and source path in robot_layer/arm_piper/agent_server/robot_sdk/config.yaml:
yaml
ros:
  image_topic: "/your_camera/color/image_raw"
  depth_topic: "/your_camera/aligned_depth_to_color/image_raw"
  camera_info_topic: "/your_camera/color/camera_info"
  joint_state_topic: "/your_joint_states_topic"
  end_pose_topic: "/your_end_pose_topic"

piper:
  setup_bash: "/absolute_path_to/robot_layer/arm_piper/agent_server/robot_driver_ros/devel/setup.bash"

Please modify the ROS topics according to your robot setup, and make sure setup_bash points to your local devel/setup.bash.

  1. Launch components in order:
  • Arm driver
    bash
    cd robot_layer/arm_piper/agent_server/robot_driver_ros/src/piper_ros
    ./can_activate.sh
    
    cd ../..
    source devel/setup.bash
    
    roslaunch piper start_single_piper.launch can_port:=can0 auto_enable:=true
  • Camera driver
    bash
    cd robot_layer/arm_piper/agent_server/robot_driver_ros
    source devel/setup.bash
    roslaunch realsense2_camera rs_rgbd.launch
  • Arm MoveIt
    bash
    cd robot_layer/arm_piper/agent_server/robot_driver_ros
    source devel/setup.bash
    roslaunch piper_with_gripper_moveit demo.launch use_rviz:=false
  1. After all three components are running, start the robot agent server:
bash
cd robot_layer/arm_piper/agent_server
python3 server.py --port 8888

Acknowledgement

This project builds upon the following open-source projects. We thank these teams for their contributions:

  • Tidybot-Universe

We also gratefully acknowledge Deepblue College for their support in the humanoid robot deployment, providing access to the Unitree G1-Romp Edu robot and the LinkerBot-O6 hand system.


Issues· 2 开放

查看全部 Issues在 GitHub 打开

暂无开放 Issues,或尚未同步最近议题。

> 标签

Python

暂无评论,来聊聊你的看法吧

> 工具信息

发布日期2026年8月1日
最后更新2026年9月18日
分类编程语言
定价开源

> 相关工具

T
TypeScript
JavaScript 的超集,为前端与全栈提供静态类型
P
Python
通用编程语言,广泛用于 Web、数据与 AI
G
Go
Google 推出的简洁高效系统语言