Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-07-19 · high
Pushing dimensions from 1536 to 3072 costs about six times the storage for only marginal recall gains, per CodeSOTA's benchmark analysis.
Why now: CodeSOTA's MTEB benchmark analysis appears in coverage dated July 19, timed for anyone about to scale up embedding dimensions before a re-index.
Retrieval quality flattens past 768 embedding dimensions, according to CodeSOTA's MTEB benchmark analysis. That's the tradeoff anyone re-indexing a vector database needs to see before scaling up embedding size. Storage grows with dimension count, and past 768 dimensions, most of that spend isn't buying better search results.
The jump from 256 to 768 dimensions buys recall gains worth the storage cost. Push further, from 1536 to 3072, and the gains turn marginal, while storage costs roughly 6x more.
The analysis also argues for hybrid retrieval over dense embeddings alone. BM25, added alongside dense retrieval, still wins on exact matches: IDs, product names, and rare entities.
CodeSOTA flags its own analysis as single-source and secondary, and says to verify against your own eval set before re-indexing anything. That's a fair caveat. Benchmark aggregates don't know your data distribution or your query patterns.
Teams still defaulting to 3072-dimension embeddings without a BM25 layer are spending storage on recall gains a hybrid index would get them for free. If you're planning a re-index, 768 dimensions plus BM25 is the more defensible default than reaching for the biggest embedding model available.
Each link below shares sources, entities, or timing with this story.
Shared entities / Earlier coverage
Both cover IDs, Verify; earlier IDs coverage from 2026-04-21.
Shared entity: Verify / Shared topic / Earlier coverage
Both cover Verify; overlapping topics (alongside, analysi); earlier Verify coverage from 2026-02-21.
Shared entity: IDs / Earlier coverage / Tension
Both cover IDs; earlier IDs coverage from 2026-06-22; pushes against this story (against).
Both cover IDs; earlier IDs coverage from 2026-06-14; pushes against this story (against).
Shared entity: Verify / Earlier coverage / Tension
Both cover Verify; earlier Verify coverage from 2026-06-12; pushes against this story (against).
Shared topic
Overlapping topics (bm25, dense, exact, gain, hybrid).
Shared entity: Verify / Earlier coverage / Tension
Both cover Verify; earlier Verify coverage from 2026-03-02; pushes against this story (vs).
Both cover Verify; earlier Verify coverage from 2026-02-26; pushes against this story (vs).