Let Your Claude Code or Codex Control Any Robot, Real or Simulated
https://arxiv.org/abs/2610.02459 ↗// readme
OpenRUA
Let Your Claude Code or Codex Control Any Robot, Real or Simulated
Through the standard ROS 2 CLI and client library, without relying on any VLA model.
https://github.com/user-attachments/assets/3b134c51-a949-44dd-9474-5249c3879aa0
Codex (GPT-6 Astra) on LIBERO-10, “put the yellow and white mug on the left plate and put the white mug on the right plate”: the commands it typed on the left, the robot’s cameras on the right, task success. More in docs/demos.md.
A robot-use agent (RUA) uses a robot just as a computer-use agent uses a computer.
OpenRUA connects off-the-shelf coding agents to robots through their native ROS 2 interfaces. The agent works in a workspace containing robot documentation and starter tools, writes perception and control programs, and uses execution feedback to continue the task.
You can chat with the agent through OpenRUA’s terminal UI or browser, use its original terminal, or run recorded benchmark experiments. Shared chat lets you send follow-up instructions, inspect tool…