PyRUA-DataFarm: LLM Agent as a Cost-Efficient Teleoperator for Real-Ready Robot Data
arXiv cs.AI · 4 Nov 2026, 04:25 AEST
A new system called PyRUA-DataFarm uses a coding agent to automate the teleoperation process for robot demonstrations. This approach significantly reduces costs and time compared to traditional methods.
Key facts
- Teleoperation remains the default way to collect robot demonstrations, but every episode costs robot and operator time, and every new task starts from scratch.
- In our DataFarm, the agent receives a data request and one calibration episode of the robot in the target scene and rebuilds the task in simulation: it writes the scene, an expert controller, and a success judge.
- On five real-robot tasks, policies trained only on farm data match policies trained on as many teleoperated episodes (93 vs. 84 successes in 100 trials).
- Adapting a task is fully automatic and costs $21 of API usage on average, paid once per task, plus $5 for a render contract.
- One hour of three-view data for a task costs $107 on average, these costs included, slightly below a quote of $117 for teleoperation in China.
Read aloud
A new system called PyRUA-DataFarm uses a coding agent to automate the teleoperation process for robot demonstrations. This approach significantly reduces costs and time compared to traditional methods. Teleoperation remains the default way to collect robot demonstrations, but every episode costs robot and operator time, and every new task starts from scratch. In our DataFarm, the agent receives a data request and one calibration episode of the robot in the target scene and rebuilds the task in simulation: it writes the scene, an expert controller, and a success judge. On five real-robot tasks, policies trained only on farm data match policies trained on as many teleoperated episodes ninety three vs. eighty four successes in one hundred trials. Adapting a task is fully automatic and costs twenty one dollars of A P I usage on average, paid once per task, plus five dollars for a render contract. One hour of three-view data for a task costs one hundred seven dollars on average, these costs included, slightly below a quote of one hundred seventeen dollars for teleoperation in China.
Sources in this cluster
- PyRUA-DataFarm: LLM Agent as a Cost-Efficient Teleoperator for Real-Ready Robot Data
arXiv cs.AI · 4 Nov 2026, 04:25 AEST