MTEB · benchmark platform
MTEB
Embeddings and retrieval benchmark ecosystem for text and image across many languages and tasks.
verification status
verified
Last checked May 1, 2026
Evidence ledger
Modalitiesembedding, imageCadencecontinuousAPInot publicEvaluations1VerificationverifiedVerified runtime1Manual verified0Relay / mirrored0Backfilled0
Relay sources mirror another provider's public page; manual rows are checked against the cited page; backfilled rows are historical inserts; seeded rows are demo fixtures. Relay rows are supporting evidence, not first-party measurements.
Operational state
snapshot
Latest pull
jsonMay 1, 2026
parser
Loaded 1 live MTEB retrieval records.
ok0.1.0
verify
mteb verification finished with status verified.
verifiedMay 1, 2026
Benchmarks from this source
Retrieval
English retrieval
NDCG@10
Latest change explanation
mteb changed versus mteb-20260501T202633Z with source_snapshot, parser_diff, benchmark_movement causes.
- Source snapshot changed: The saved raw source snapshot changed relative to the previous run.
- Parser output changed: The parser metadata or warnings shifted relative to the previous run.
- Benchmark coverage or values moved: 1 benchmark rows were added, 0 removed, and 0 existing rows changed value or evaluation date.