Skip to content

Pull requests: embeddings-benchmark/mteb

New pull request New
35 Open 2,723 Closed
35 Open 2,723 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

model: Add LanguageBind video and audio model wrapper new model Questions related to adding a new model to the benchmark video video extension
#4557 opened Apr 29, 2026 by Michelleyyy333 Loading…
10
fix: remove button from Gradio event handler inputs in benchmark selector
#4553 opened Apr 28, 2026 by KennethEnevoldsen Contributor Loading…
1
fix: Allow get_tasks to filter out a tasks
#4552 opened Apr 28, 2026 by KennethEnevoldsen Contributor Loading…
leaderboard: Reduce severity of not being able to produce the plot leaderboard issues related to the leaderboard
#4549 opened Apr 28, 2026 by KennethEnevoldsen Contributor Loading…
model: Add DenseOn/LateOn definitions new model Questions related to adding a new model to the benchmark
#4545 opened Apr 28, 2026 by NohTow Contributor Loading…
3
dataset: add news datasets new dataset Issues related to adding a new task or dataset
#4544 opened Apr 28, 2026 by guenthermi Member • Draft
12 tasks done
8
WIP: Added SomethingSomething zeroshot new dataset Issues related to adding a new task or dataset video video extension
#4542 opened Apr 28, 2026 by x-tabdeveloping Collaborator Loading…
5 of 7 tasks
3
Add AVMeme-Exam zero shot classification task new dataset Issues related to adding a new task or dataset video video extension
#4539 opened Apr 28, 2026 by deep9539 Contributor Loading…
6 of 7 tasks
2
Add Kinetics700 and Kinetics600 zeroshot classification task new dataset Issues related to adding a new task or dataset video video extension
#4537 opened Apr 28, 2026 by deep9539 Contributor Loading…
6 of 7 tasks
4
[MVEB] MELD Clustering Task new dataset Issues related to adding a new task or dataset video video extension
#4534 opened Apr 28, 2026 by AdnanElAssadi56 Contributor Loading…
8 tasks done
1
2
[MVEB] Add HMDB51ZeroShot for video zero-shot classification new dataset Issues related to adding a new task or dataset video video extension
#4532 opened Apr 28, 2026 by taidnguyen Contributor Loading…
7 tasks done
2
[MVEB] Add Daily-Omni video-centric QA task new dataset Issues related to adding a new task or dataset video video extension
#4530 opened Apr 27, 2026 by Rakshitha-Ireddi Contributor Loading…
5
[MVEB] Add WorldSense 1min video-centric QA task new dataset Issues related to adding a new task or dataset video video extension
#4529 opened Apr 27, 2026 by Rakshitha-Ireddi Contributor Loading…
8
added private lex retrieval task new dataset Issues related to adding a new task or dataset
#4521 opened Apr 27, 2026 by YevhenKost Contributor Loading…
3
ci: add .venv caching step to speed up dep install
#4516 opened Apr 26, 2026 by isaac-chung Collaborator • Draft
7
dataset: Add elastic kb retrieval new dataset Issues related to adding a new task or dataset
#4487 opened Apr 23, 2026 by emilia-elastic Loading…
6 tasks done
18
[MVEB] Add 3 native VideoPairClassification tasks new dataset Issues related to adding a new task or dataset video video extension
#4471 opened Apr 21, 2026 by stef41 Contributor Loading…
6 tasks done
7
Adding prompts to voyage-4-large 2048d model
#4464 opened Apr 20, 2026 by fzowl Contributor Loading…
5 of 7 tasks
13
Add model: TIPSv2 (google/tipsv2-b14/l14/so400m14/g14) image The image extension of MTEB new model Questions related to adding a new model to the benchmark
#4459 opened Apr 20, 2026 by Rakshitha-Ireddi Contributor Loading…
1
10
Add model: llm-semantic-router/aegis-embed new model Questions related to adding a new model to the benchmark
#4458 opened Apr 20, 2026 by Rakshitha-Ireddi Contributor Loading…
1
9
Track mteb_version per subset and allow cross-version merging
#4452 opened Apr 20, 2026 by Rakshitha-Ireddi Contributor Loading…
1
1
Make corpus_chunk_size tunable via the public evaluate() API
#4451 opened Apr 19, 2026 by Rakshitha-Ireddi Contributor Loading…
1
6
model: add multilingual BM25 model using HuggingFace subword tokenizer
#4405 opened Apr 16, 2026 by fzoll Contributor Loading…
1
9
feat: add num_queries and num_documents to retrieval statistics
#4403 opened Apr 16, 2026 by fzoll Contributor Loading…
3
move mteb_version to individual subsets in result files
#4401 opened Apr 16, 2026 by fzoll Contributor Loading…
1
11
ProTip! Exclude everything labeled bug with -label:bug.