Fetching from the wire…
Skills2026-07-30 · source-backed
RAGAS-style evaluation checks correctness against a frozen snapshot, which means routine document updates and corrections can silently break production without moving a dashboard. This ASE 2026 paper defines 11 mutation operators perturbing at both the pre-chunk index level and post-chunk retrieved-context level. Across five datasets and 28,000+ mutants, metamorphic oracles detected violations at F1 0.927-1.000 versus 0.570 for the best RAGAS metric.
Each link below shares sources, entities, or timing with this story.
Shared entity: RAG / Same source domain / Shared topic / Earlier coverage / Tension
Both cover RAG; reported by the same outlet (arxiv.org); overlapping topics (against, corpu, document).
Shared entities / Same source domain / Earlier coverage / Tension
Both cover RAG, RAGAs; reported by the same outlet (arxiv.org); earlier RAG coverage from 2026-07-21.
Shared entity: Test / Same source domain / Shared topic / Earlier coverage
Both cover Test; reported by the same outlet (arxiv.org); overlapping topics (against, break).
Shared entity: RAG / Same source domain / Earlier coverage / Tension
Both cover RAG; reported by the same outlet (arxiv.org); earlier RAG coverage from 2026-07-26.
Both cover RAG; reported by the same outlet (arxiv.org); earlier RAG coverage from 2026-06-19.
Shared entity: Test / Same source domain / Earlier coverage / Tension
Both cover Test; reported by the same outlet (arxiv.org); earlier Test coverage from 2026-06-14.
Shared entity: RAG / Same source domain / Earlier coverage / Tension
Both cover RAG; reported by the same outlet (arxiv.org); earlier RAG coverage from 2026-03-22.
Shared entity: Test / Same source domain / Earlier coverage / Downstream implication
Both cover Test; reported by the same outlet (arxiv.org); earlier Test coverage from 2026-02-27.