Evaluation
Internal evaluation note
Aggregate outcome metrics for similar.dev-lang3-lite-512. This note describes measured behavior, not model construction.
Approved summary
On a held-out internal multilingual retrieval benchmark spanning six language directions, top-1 retrieval ranged from 99.48% to 99.73% across 10,000 examples. Top-10 recall was 100% across those directions. This is an internal result, not MTEB or independent third-party validation.
What this establishes
- Model-specific internal multilingual retrieval performance for the published lite multilingual model
- Held-out evaluation on 10,000 examples across six language directions
What this does not establish
- MTEB leaderboard ranking or third-party certification
- Performance for models other than
similar.dev-lang3-lite-512 - Evidence for languages or domains outside the tested set
Record
Model: similar.dev-lang3-lite-512. Published: 2026-08-26.