A Matrix with Steps: An Episodic and Procedural Memory Method for Tool-Using Agents and Robots
arXiv cs.AI · 16 Nov 2026, 06:06 AEST
A new memory method for tool-using agents and robots addresses their tendency to repeat failures and misjudge successes. This method records every run as an episode and relies on external verification for learning outcomes.
Key facts
- Agents that call tools and robots that execute tasks are challenged by two shortcomings: they repeat what failed before, and they learn from runs that they only believe succeeded.
- Every run is recorded as an episode, and only an outcome confirmed by an external check, a test, a tool result or a person counts; the agent's own claim never does.
- In simulation, a robot that judged its own success and stopped when it believed it was done reported 96% of its tasks as done and solved 35%; with external verification it solved 79%.
- In a store of 100000 synthetic episodes (457MB on disk), the oldest episode was still found first, no episode from another person's memory was returned, and a success vouched for only by the model was never recalled.
Read aloud
A new memory method for tool-using agents and robots addresses their tendency to repeat failures and misjudge successes. This method records every run as an episode and relies on external verification for learning outcomes. Agents that call tools and robots that execute tasks are challenged by two shortcomings: they repeat what failed before, and they learn from runs that they only believe succeeded. Every run is recorded as an episode, and only an outcome confirmed by an external check, a test, a tool result or a person counts; the agent's own claim never does. In simulation, a robot that judged its own success and stopped when it believed it was done reported ninety six percent of its tasks as done and solved thirty five percent; with external verification it solved seventy nine percent. In a store of one hundred thousand synthetic episodes 457MB on disk, the oldest episode was still found first, no episode from another person's memory was returned, and a success vouched for only by the model was never recalled.
Sources in this cluster
- A Matrix with Steps: An Episodic and Procedural Memory Method for Tool-Using Agents and Robots
arXiv cs.AI · 16 Nov 2026, 06:06 AEST