Skip to content

Commit 8a0faab

Browse files
feat(vendor): add LLM2Vec embedding model
- Add LLM2Vec from OneIG vendor source - Includes Llama encoder and bidirectional models - Self-contained, no dependencies on Pruna internals - Licensed under Apache 2.0
1 parent b210fdb commit 8a0faab

4 files changed

Lines changed: 896 additions & 0 deletions

File tree

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
LLM2Vec (llm2vec package) vendored from OneIG-Benchmark.
2+
3+
Source: https://github.com/OneIG-Bench/OneIG-Benchmark
4+
Commit: 41b49831e79e6dde5323618c164da1c4cf0f699d
5+
Path: scripts/utils/llm2clip/llm2vec/
6+
7+
OneIG-Benchmark is licensed under the Apache License 2.0.
8+
See the project repository for full license text.
9+
10+
``oneig_llm2vec/modeling_llama_encoder.py`` is derived from
11+
McGill-NLP/LLM2Vec-Meta-Llama-3-8B-Instruct-mntp (Hugging Face Hub);
12+
Pruna relaxes the upstream flash-attention-only constraint for CPU use.

0 commit comments

Comments
 (0)