Baike.dev
All toolsOnline toolsAI codingTrendingOpen sourceNewsSubmit
Log in
< Back to tools
K

kairos

> 编程语言
Open source

Official code for world model Kairos

2.4K stars0 likes1 views
WebsiteGitHub

About

Official code for world model Kairos

Kairos

Kairos Platform    |    ️ GitHub    |    Hugging Face   |    Model Scope  |    Paper   


Kairos is a 4B-parameter native cross-embodiment world model for unified understanding, generation, and action prediction. Through a progressive Cross-Embodiment Data Curriculum, it learns from general videos, human behavior, and real-robot interaction to build persistent world representations. Powered by a World-Action Model architecture and hybrid linear temporal memory, Kairos jointly predicts future visual states and executable robot actions, enabling long-horizon reasoning, high-quality generation, and real-time edge-side deployment for embodied AI.

0. Latest News

Jul 2, 2026: ️ We've open-sourced the Kairos3.1 series, including World-Action Model inference code and three model weights: Kairos3.1-4B-robot-480P, kairos-4B-robot-RoboTwin2.0, and kairos-4B-robot-LIBERO-plus. RoboTwin 2.0 and LIBERO-Plus support executable action prediction.

Jun 16, 2026: We've released the Kairos technical report on arXiv: Kairos Technical Report.

Feb 26, 2026: We've released Kairos video world model weights, including kairos-robot-4B-480P, kairos-robot-4B-480P-distilled, and kairos-4B-720P.

Dec 18, 2025: Kairos 3.0 was officially introduced, along with the Kairos World Model inference code and kairos-4B-480P-pretrained.

1. Motivation

Embodied AI is entering the era of Scaling Laws, yet scaling alone cannot overcome the core barriers to reliable real-world interaction. Heterogeneous embodiment data, weak long-horizon reasoning, separated video-and-action modeling, and edge-side compute constraints still limit the practicality of current world models. Kairos addresses these challenges by unifying cross-embodiment pretraining, persistent world-state modeling, future generation, and executable action prediction within an efficient deployment-aware framework.

2. Kairos Framework

Native Pretraining Paradigm with Cross-Embodiment Data Curriculum

Kairos introduces a native world-model pretraining paradigm that learns physical, behavioral, and embodied knowledge from scratch, rather than relying on decoupled post-training adaptation. Through a Cross-Embodiment Data Curriculum (CEDC), the model progressively absorbs knowledge from general videos, human behavior data, and real-robot interaction data. This curriculum enables Kairos to move beyond flat data scaling, building world representations that evolve from passive physical understanding to active task intent and embodied control.

Unified Understanding–Generation–Prediction Architecture

Kairos is designed as a native end-to-end architecture for understanding, generating, and predicting the world within a unified Mixture-of-Transformers framework. Instead of treating world modeling as simple video continuation, Kairos maintains persistent world states, where understanding provides causal interpretation, generation unfolds plausible futures, and prediction produces executable robot actions. This unified design allows the model to connect perception, reasoning, planning, and action in a single intelligence loop.

⚡ Hybrid Linear Temporal Memory for Efficient Deployment

Kairos introduces a hybrid linear temporal memory mechanism for long-horizon world modeling. By combining Sliding-Window Attention, Dilated Sliding-Window Attention, and Gated Linear Attention, the model captures local dynamics, mid-range interactions, and global causal memory under linear-complexity temporal modeling. Together with deployment-aware system co-design, including efficient kernels, quantization, and token streaming, Kairos supports low-memory, high-throughput inference and lays the foundation for real-time closed-loop deployment.

✨ 3. Demos

Physical–causal consistency

Kairos leverages causal CoT and physical laws to transform multimodal inputs into deep task logic. It enables autonomous planning and feasibility analysis, shifting the system from "executing commands" to "understanding intent" for real-world robotic actions.

Cross-embodiment generalization

Unified Cross-Embodiment Generation: A single "brain" that generalizes across single-arm, dual-arm, and dexterous-hand platforms. Kairos enables shared, transferable world knowledge with maximal adaptability. Broad Hardware Support: Native compatibility with Agibot G1, Unitree G1, and Songling PIPER, significantly slashing development costs through zero-shot multi-task generalization.

Accurate Action Prediction

Powered by its World-Action Model, Kairos predicts executable robot action trajectories directly from visual observations and task context. This enables accurate, temporally coherent, and physically grounded action generation for long-horizon embodied manipulation.

High-efficiency inference

Real-time Edge Performance: Industry-leading inference speed with ultra-low resource consumption. Optimized for low-latency, high-reliability deployment across single or multi-GPU embodied systems.

4. Model Zoo

Download Links Model Version Highlights
HuggingFace ModelScope kairos3.1-4B-robot-480P Embodied foundation model for generation
HuggingFace ModelScope kairos3.1-4B-robot-RoboTwin2.0 SOTA performance on 50+ bimanual RoboTwin2.0 tasks
HuggingFace ModelScope kairos3.1-4B-robot-LIBERO-plus SOTA performance on LIBERO-plus
HuggingFace ModelScope kairos-4B-720P Supports 720P HD output with enhanced fine-grained detail capture

5. Evaluation

5.1 Accuracy Benchmarks

⚡ 5.2 Deployment

5.2.1 Real-time Inference

GPU Resolution Memory(GB) 1 GPU (s) 4 GPUs (s)
NV-A800 480P 23.5 11.7 3.0
NV-RTX5090 480P 13.9 11.4 5.7

*(results based on kairos-4B-robot 480p distillation)

5.2.2 Benchmark for A800 GPU

Model Parameters Memory (GB) Complexity (PFLOPs) 1 GPU (s) 4 GPUs (s)
Kairos 4B 23.5 2.3 43.3 9.5
Cosmos 2.5 14B 70.2 156.5 (~70x) 2526.0 687.2
Wan 2.2 5B 23.4 16.6 (~7x) 201.0 85.0
Lingbot 28B 46.1 347.4 (~160x) 5525.0 1436.0

*(evaluation setting:TI2V mode with 720P/5s)

6. Quick Start

6.1 Environment Installation

…

6.2 Download Kairos Models

  • Download with huggingface
…
  • Download with modelscope
…

6.3 Run Inference

…

6.4 Run Inference in Simulation Environments

We provide benchmark-specific instructions and evaluation scripts for the following embodied AI benchmarks.

Benchmark Description Guide
RoboTwin 2.0 Dual-arm manipulation benchmark for evaluating long-horizon embodied control and action prediction. benchmarks/robotwin
LIBERO-Plus Long-horizon manipulation benchmark for evaluating generalization across tasks and scenes. benchmarks/libero_plus

6.5 Kairos Training

Kairos training uses Flow Matching with local JSONL video manifests and one target output shape per run. The default recipe samples videos to 832x480, 81 frames, and 16 FPS, resizing and temporally resampling source clips as needed. The default trainable_models selection is dit.video_dit, and EMA is not applied.

Install the optional dependencies and launch the one-GPU default:

bash
pip install -r requirements-train.txt
bash examples/train_kairos.sh

Use NUM_PROCESSES to enable the included DeepSpeed ZeRO-1 launcher:

NUM_PROCESSES=8 bash examples/train_kairos.sh

The configurable conditions are t2v, ti2v, i2v, and null2v. See docs/TRAINING.md for the manifest schema, model paths, training arguments, condition probabilities, and checkpoint resume behavior.

7. About Us

Developed and maintained by the Kairos Team. We specialize in Embodied Intelligence and World Model research, with a mission to build Artificial General Intelligence (AGI) that truly understands the physical world. Our goal is to accelerate the industrialization of embodied technologies and reshape the global landscape of AI competition.

8. License

Kairos is open-sourced under the Apache License 2.0. Feel free to use, modify, and build commercial products on top of it. Check the LICENSE file for the full text.

9. Citation

If you find our work helpful, please cite us.

…

10. Acknowledgements

We would like to thank the contributors to Qwen-Image, Wan2.1, DiffSynth-Studio, FastWAM and HuggingFace for their open-source research contributions.


⭐ Star us on GitHub if you find Kairos helpful!

Issues· 0 open

View all issuesOpen on GitHub

No open issues yet, or sync has not completed.

> Tags

Python

No comments yet. Be the first to share.

> Details

PublishedAug 1, 2026
UpdatedSep 17, 2026
Category编程语言
PricingOpen source

> Related tools

T
TypeScript
JavaScript 的超集,为前端与全栈提供静态类型
P
Python
通用编程语言,广泛用于 Web、数据与 AI
G
Go
Google 推出的简洁高效系统语言