BEIR · MTEB Leaderboard
Zero-shot retrieval quality across a heterogeneous set of IR tasks and domains, providing a common framework for comparing NLP-based retrieval models.
Public notes from activescott tagged with both #leaderboard and #benchmarks
Zero-shot retrieval quality across a heterogeneous set of IR tasks and domains, providing a common framework for comparing NLP-based retrieval models.
We’re excited to introduce the beta version of the Retrieval Embedding Benchmark (RTEB), a new benchmark designed to reliably evaluate the retrieval accuracy of embedding models for real-world applications. Existing benchmarks struggle to measure true generalization, while RTEB addresses this with a hybrid strategy of open and private datasets.
Best AI for Coding in 2026
Compare the best AI for coding, ranked by live arena results and benchmark performance across code generation, debugging, and software engineering.