Dispatch
Sentence Transformers v6.0 ships MultiVectorEncoder, and a 3090 finetuned a ColBERT model in 14.5 hours
Hugging Face's August 26 post introduces ColBERT-style late-interaction training in Sentence Transformers v6.0 with MultiVectorEncoder, MultiVectorEncoderTrainer, CachedMultiVectorMultipleNegativesRankingLoss and a MultiVectorInformationRetrievalEvaluator. Their finetuned mLateOn-medical hits 0.9139 NDCG@10 on MIRIAD's 200,000 passages against 0.8502 for GTE-ModernColBERT-v1 and 0.7817 for dense Qwen3-Embedding-4B, cutting rank-1 error by more than a third. The training cost is the real story for builders: one RTX 3090, 14.5 hours, 1M pairs, 17.5GB peak VRAM, and 100k pairs got near-identical results in about 75 minutes.
↳ Follow the thread