AI TrackerFrontier desk · AEST
Back to news
normalaitech

How Ground Truth Shapes Retrieval Scores: Evidence-Aware Evaluation of a Retrieval-Augmented Generation System for Breast Lesions

arXiv cs.AI · 23 Oct 2026, 03:36 AEST

A new evidence-aware retrieval evaluation protocol has been developed for a clinical retrieval-augmented generation system focused on breast lesions. The study highlights the impact of ground truth on retrieval scores and the importance of annotation coverage.

Key facts

Read aloud

A new evidence-aware retrieval evaluation protocol has been developed for a clinical retrieval-augmented generation system focused on breast lesions. The study highlights the impact of ground truth on retrieval scores and the importance of annotation coverage. An eighteen-document corpus and an eighteen-query development benchmark, with one Yes/No or WH-question per document, were used. The selected hybrid retriever, using three hundred eighty four-token chunks and twenty percent overlap, retrieved accepted evidence in the top three results for seventeen of eighteen queries. Recall@three, R-Precision, MRR@three, and nDCG@three each reached zero point nine four. Ground-truth curation increased evidence spans from twenty five to thirty seven and accepted chunk targets from thirty six to fifty one without changing retrieval rankings. Cross-encoder reranking achieved the highest retrieval scores.

Sources in this cluster