Skip to content

Source paper

GigaBrain-0: A World Model-Powered Vision-Language-Action Model

GigaBrain Team, Angen Ye, Boyuan Wang and 24 more

GigaBrain Team, Angen Ye, Boyuan Wang, Chaojun Ni, Guan Huang, Guosheng Zhao, Haoyun Li, Jie Li, Jiagang Zhu, Lv Feng, Peng Li, Qiuping Deng, Runqi Ouyang, Wenkang Qin, Xinze Chen, Xiaofeng Wang, Yang Wang, Yifan Li, Yilong Li, Yiran Ding, Yuan Xu, Yun Ye, Yukun Zhou, Zhehao Dong, Zhenan Wang, Zhichao Liu, Zheng Zhu

arXiv 2510.19430 · 202549 upvotes on Hugging Face

Research ideas from this paper (3)

Generated by AI. The paper’s authors did not write these.

AI summary

This paper introduces GigaBrain-0, a Vision-Language-Action (VLA) foundation model that significantly reduces reliance on expensive real-world robot data by leveraging a "world model" (GigaWorld) to generate diverse synthetic training trajectories. The authors demonstrate that scaling data via video generation—covering variations in texture, viewpoint, and simulation-to-real transfer—combined with a model architecture incorporating RGB-D inputs and embodied Chain-of-Thought (CoT) supervision, leads to superior generalization in complex manipulation tasks.

How it works (AI summary)

The model utilizes a mixture-of-transformers architecture, combining a pretrained Vision-Language Model (PaliGemma2) for semantic encoding with a Diffusion Transformer (DiT) using flow matching for continuous action prediction. Training data is augmented by GigaWorld, a generative pipeline that performs Real2Real, Sim2Real, and View Transfer synthesis to create photorealistic, physically plausible variations of robot trajectories.