Evaluation

Benchmark access

MTEB(eng, v2) reproduction

Model similar-dev/similar.dev-en-v2b-medium is evaluated through the public Similar.dev API. See the model reference for dimensions, input modes, and request shape.

Request a usage-exempt API key for leaderboard reproduction (about 200 requests per minute). Click the button below; the key is shown once in the response.

Internal note: similar.dev-lang3-lite

Aggregate outcome metrics for similar.dev-lang3-lite. This describes measured behavior, not model construction.

On a held-out internal multilingual retrieval benchmark spanning six language directions, top-1 retrieval ranged from 99.48% to 99.73% across 10,000 examples. Top-10 recall was 100% across those directions. This is an internal result, not MTEB or independent third-party validation.

Model: similar.dev-lang3-lite. Published: 2026-08-26.

Back to home