All pull requests

Pull requests

• make benchmark auto discoverable

  #5732·Samoed opened Oct 20, 2026Member·

  ·
  1

• Upldate lock with uv 0.13.3

  #5731·Samoed opened Oct 20, 2026Member·

  ·

• feat: add shields.io badge endpoint for model rank

  #5728·eyupcodes opened Oct 20, 2026Contributor·

  ·
  1

• fix flacky test

  #5727·Samoed opened Oct 20, 2026Member·

  ·
  3

• Switch MTEB(Africa) benchmarks from SIB200Classification.v2 to v3

  #5725·RizgarOzan opened Oct 20, 2026Contributor·

  ·
  2

• fix: cite the published versions of preprints that have been published

  #5724·ayush1298 opened Oct 20, 2026Collaborator·

  ·
  8

• fix: Clarify documentation on output_dtypes and update in ModelMeta

  #5723·ayush1298 opened Oct 20, 2026Collaborator·

  ·
  1

  8

• report cited arXiv preprints that have since been published

  #5722·ayush1298 opened Oct 20, 2026Collaborator·

  ·
  1

  10

• pad short audio

  #5721·AdnanElAssadi opened Oct 20, 2026Contributor·

  ·
  1

• fix: match only the requested script for language-script codes

  #5720·spicysharkco opened Oct 19, 2026·

  ·
  2

• Scripts to analyze mmtebv2

  #5717·Samoed opened Oct 19, 2026Member·

  ·

• model: add JMullings/spectral-embed-v2-140m

  #5716·jmullings opened Oct 19, 2026Contributor·

  ·
  15

• fix: ensure to partial task results are not included when computing the rank

  #5712·KennethEnevoldsen opened Oct 18, 2026Contributor·

  ·
  5

• dataset: GigaSpeech v2, MridinghamTonic short clip, UrbanSound8K superseded

  #5710·AdnanElAssadi opened Oct 18, 2026Contributor·

  ·
  7

• feat: Add feature to remove unclear labels in mteb.data_cleaning

  long PR desc
  #5696·ayush1298 opened Oct 18, 2026Collaborator·

  ·
  16

• refactor: split benchmarks.py into themed modules

  #5689·CatOn60Hz opened Oct 17, 2026·

  ·
  4

• feat: add CLI support for OpenAI-compatible embedding endpoints

  #5688·ayush1298 opened Oct 17, 2026Collaborator·

  ·
  1

  13

• benchmark: Add mmteb v3

  #5687·KennethEnevoldsen opened Oct 16, 2026Contributor·

  ·
  19

• fix: preserve benchmark ownership when restoring leaderboard caches

  #5678·lxer19 opened Oct 16, 2026Contributor·

  ·

• dataset: Add Analogy task and VisLingA dset

  #5659·YonatanGideoni opened Oct 14, 2026·8 tasks done·

  ·
  1

  6

• dataset: add NoRecSentenceClassification

  #5657·avalyset opened Oct 14, 2026·7 of 8 tasks·

  ·

• fix video frame timing

  #5652·AdnanElAssadi opened Oct 14, 2026Contributor·

  ·
  21

• Support document modality selection for retrieval and reranking

  #5642·oliverholworthy opened Oct 12, 2026Contributor·

  ·
  9

• Make zeroshot tasks retreival

  #5639·Samoed opened Oct 11, 2026Member·

  ·
  1

  13

• leaderboard: Add ELO index

  leaderboard
  #5618·Samoed opened Oct 9, 2026Member·

  ·
  1

  10