Robot Learning

DrEureka

DrEureka is a 2024 method that uses large language models to automate sim-to-real transfer design, extending the Eureka reward-generation framework. Given a task and simulator source code, the LLM proposes reward functions and, guided by a physics-feasibility prior, generates domain randomization ranges for training robust policies. Its headline demonstration was a quadruped balancing and walking on a yoga ball, transferred to hardware zero-shot without task-specific manual tuning.

Why it matters for physical AI

Reward shaping and randomization tuning are the most labor-intensive parts of sim-to-real reinforcement learning. LLM-automated pipeline design points toward compressing weeks of expert iteration into hours of compute.