Reconstruct, Practice, Go Real: Guided Self-Improvement for Embodied Agents
arXiv cs.AI · 2 Oct 2026, 03:59 AEST
Building reliable robot capabilities across diverse tasks requires substantial human effort to develop and maintain skills, design rewards, and integrate perception with control. We present Reconstruct, Practice, Go Real (RPG), a framework for autonomous improvement of robot execution systems without updating model weights.
Key facts
- Building reliable robot capabilities across diverse tasks requires substantial human effort to develop and maintain skills, design rewards, and integrate perception with control.
- We present Reconstruct, Practice, Go Real (RPG), a framework for autonomous improvement of robot execution systems without updating model weights.
- RPG identifies manipulation capabilities in an offline dataset and constructs related practice tasks in simulation.
- During practice, RPG uses execution feedback, privileged simulator state, and available dataset videos to diagnose failures.
- It develops new reusable symbolic skills, refines existing skills, and revises the system prompt based on these diagnoses.
Read aloud
Building reliable robot capabilities across diverse tasks requires substantial human effort to develop and maintain skills, design rewards, and integrate perception with control. We present Reconstruct, Practice, Go Real RPG, a framework for autonomous improvement of robot execution systems without updating model weights. Building reliable robot capabilities across diverse tasks requires substantial human effort to develop and maintain skills, design rewards, and integrate perception with control. We present Reconstruct, Practice, Go Real RPG, a framework for autonomous improvement of robot execution systems without updating model weights. RPG identifies manipulation capabilities in an offline dataset and constructs related practice tasks in simulation. During practice, RPG uses execution feedback, privileged simulator state, and available dataset videos to diagnose failures. It develops new reusable symbolic skills, refines existing skills, and revises the system prompt based on these diagnoses.
Sources in this cluster
- Reconstruct, Practice, Go Real: Guided Self-Improvement for Embodied Agents
arXiv cs.AI · 2 Oct 2026, 03:59 AEST