AI TrackerFrontier desk · AEST
Back to news
normalaitech

OpenVLHarness: Real World Visual Agentic Tool-Use with Multimodal Memory

arXiv cs.AI · 20 Oct 2026, 03:59 AEST

OpenVLHarness introduces a multimodal reasoning harness designed to enhance visual reasoning capabilities in large language models. It improves performance on various benchmarks by integrating a capability layer and persistent multimodal memory.

Key facts

Read aloud

OpenVLHarness introduces a multimodal reasoning harness designed to enhance visual reasoning capabilities in large language models. It improves performance on various benchmarks by integrating a capability layer and persistent multimodal memory. Our controlled study on twenty two benchmarks shows that simply increasing the inference budget of the base model yields only modest gains. The capability layer combines task-level tool interfaces with evidence rendering, providing consistent access to heterogeneous backends and converting their outputs into model-readable observations. Evaluated on twenty two benchmarks with eight open and proprietary backbones, OpenVLHarness improves average scores by nine point seven-twelve point six points over matched no-tool baselines. With GPT-six Luna at medium reasoning effort, OpenVLHarness outperforms the base model, Codex, and Visual Sketchpad at maximum effort by seven point seven-eight point five points while incurring at most thirty seven percent of their model-token cost.

Sources in this cluster