AI TrackerFrontier desk · AEST
Back to news
normalaitech

EgoLAP: Learning from Egocentric Human Data through Language-Action Reasoning

arXiv cs.AI · 7 Oct 2026, 03:30 AEST

EgoLAP is a new framework designed to enhance robot learning by leveraging egocentric human data. It effectively transfers human experience to robot control, achieving significant performance improvements over existing methods.

Key facts

Read aloud

EgoLAP is a new framework designed to enhance robot learning by leveraging egocentric human data. It effectively transfers human experience to robot control, achieving significant performance improvements over existing methods. Egocentric human data offer a path to scaling robot learning beyond costly robot demonstrations, yet the embodiment gap makes raw human trajectories a poor supervisory target for control. Our key insight is that, although low-level actions are embodiment-specific, their underlying motion intent can capture task-relevant structure that transfers across humans and robots. EgoLAP expresses motion intent as structured, temporally abstracted language actions and pairs them with motion-level reasoning grounded in scene geometry, physics, and object affordances. Across extensive real-world and simulated experiments, EgoLAP transfers human experience to robot control more effectively than alternative action representations and reaches eighty point one percent mean real-world task progress, a two.3x performance gain over alternative action representations.

Sources in this cluster