Training and Finetuning Reranker Models with Sentence Transformers

Hugging Face Blog · 1 year ago

Sentence Transformers library now supports finetuning reranker models (cross-encoders) that can outperform larger general-purpose models on domain-specific data. A finetuned ModernBERT-base model trained on the blogger's evaluation dataset outperformed 13 commonly used public reranker models, including models 4 times larger. The approach enables organizations to build reranker models optimized for their specific domains by combining datasets, loss functions, training arguments, evaluators, and a trainer class.