Octo

Octo

โ˜… 3.8 ๐Ÿ”– 1200 saves ๐Ÿ’ฐ Free GitHub

Octo is an open-source generalist robot policy: a transformer-based model trained on a diverse mix of 800,000 robot trajectories. The project has 1,808 stars on GitHub and was last updated in 2024. Developed by researchers at UC Berkeley and partner institutions, Octo is one of the reference open models for robot learning with foundation models.

Overview

Instead of training a separate controller for every robot and task, Octo learns a single diffusion policy from the Open X-Embodiment dataset, the largest robot data collection assembled at the time. Out of the box it accepts multiple RGB camera inputs, can drive various robot arms, and follows either language commands or goal images. Its modular attention structure means the same pretrained model can be fine-tuned to new sensory inputs, action spaces, and robot morphologies using only a small target-domain dataset and modest compute. The codebase includes training and fine-tuning pipelines, and the pretrained checkpoints can be loaded in a few lines of Python. The project page collects demonstration videos, the paper, and links to the training datasets, making it a practical starting point rather than just a model release.

Key Features

  • Pretrained generalist policy trained on 800k trajectories from many robot embodiments
  • Transformer backbone with diffusion action heads for smooth robot control
  • Instruction via natural language commands or goal images
  • Fine-tuning support for new robots, sensors, and action spaces with small datasets
  • Pretrained checkpoints hosted on Hugging Face for immediate inference
  • Example notebooks for zero-shot evaluation and fine-tuning, built on JAX

๐Ÿ’ณ Pricing

Octo is free and open source under the MIT license, including the code and the pretrained model weights. You only need your own GPU and robot hardware to run it.

Who Is It For

Octo is for robotics researchers and engineers who want a strong open baseline for generalist robot control, and for labs fine-tuning foundation policies onto their own robots instead of training from scratch.

๐Ÿš€ Visit Octo Official Site

๐Ÿšฉ Report an issue