Make retrieve-then-rerank your default: pull top 50–100, cross-encode, pass top 3–10

FreeAcademy·high signal

The 2026 production standard is a two-stage pipeline: retrieve 50–100 candidates with a fast bi-encoder, then re-score each (query, chunk) pair jointly with a cross-encoder re-ranker (Cohere Rerank 3.5, Voyage rerank-2.5, BGE reranker-v2, Jina Reranker v2), passing only the top 3–10 to the LLM. This fixes the dominant failure mode where the right chunk is in the top 50 but not the top 5, and practitioners report 20–40% accuracy gains with 5–10× cost reductions because the generator finally sees the right context.