Oossa

RoboBuilder tests AI-designed robots on a physical course

The benchmark builds robots that pass simulation and tests them in the real world. Video feedback helped agents fix many failures, but harder tasks remained difficult.

NoteBy Published by Oossa: 1 min read

Researchers introduced RoboBuilder, a benchmark where coding agents design both a robot’s hardware and its control program using standard parts and a custom 3D-printed piece. Designs that pass simulation are built and tested on a physical obstacle course.

In the researchers’ tests, none of 15 initial designs that passed simulation completed the real course. Across four coding agents, 135 robots were built; simulated successes carried over to real trials 66% of the time across all difficulty levels.

When shown videos of real-world failures, agents redesigned robots and sometimes corrected their simulator, removing 72% of failures on the two easier levels. They still struggled with harder obstacles and with designing one robot that could cross every obstacle.

Why it matters

For robotics researchers using simulation to screen designs, RoboBuilder shows that a passing simulation is not enough: in these tests, about one in three simulated passes failed to hold up across the real-world trials.

Was this article useful?
Share

Read next

Oossa · Newsletter

The week in AI, explained

Every Monday: the stories worth knowing, in plain language. Free, no spam.