Skills
Gemini Embedding 2 Matryoshka Truncation: Cut from 3,072 to 768 Dimensions with Under 0.5% Quality Loss for Storage and Query Cost Reduction
Gemini Embedding 2 natively supports Matryoshka Representation Learning, enabling truncation of its 3,072-dimensional vectors to lower resolutions (e.g., 768 dimensions) with less than 0.5% quality degradation on retrieval benchmarks. This reduces vector storage to ~25% of full size and cuts similarity search compute proportionally. For production RAG systems where storage or query latency is a constraint, truncated Gemini embeddings offer a dominant tradeoff over using a smaller baseline model.
Source
↳ Follow the thread