Instructions to use intfloat/multilingual-e5-large-instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use intfloat/multilingual-e5-large-instruct with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("intfloat/multilingual-e5-large-instruct") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Transformers
How to use intfloat/multilingual-e5-large-instruct with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="intfloat/multilingual-e5-large-instruct")# Load model directly from transformers import AutoTokenizer, AutoModelForMultimodalLM tokenizer = AutoTokenizer.from_pretrained("intfloat/multilingual-e5-large-instruct") model = AutoModelForMultimodalLM.from_pretrained("intfloat/multilingual-e5-large-instruct") - Inference
- Notebooks
- Google Colab
- Kaggle
Update instruction with infinity
Browse filesCommand tested:
```
docker run --gpus all -v $PWD/data:/app/.cache -e HF_TOKEN=$HF_TOKEN -p "7997":"7997" michaelf34/infinity:0.0.68 v2 --model-id intfloat/multilingual-e5-large-instruct --revision "main" --dtype float16 --batch-size 32 --device cuda --engine torch --port 7997
INFO: Started server process [1]
INFO: Waiting for application startup.
INFO 2024-11-13 00:46:42,260 infinity_emb INFO: infinity_server.py:89
Creating 1engines:
engines=['intfloat/multilingual-e5-large-instruct
']
INFO 2024-11-13 00:46:42,264 infinity_emb INFO: Anonymized telemetry.py:30
telemetry can be disabled via environment variable
`DO_NOT_TRACK=1`.
INFO 2024-11-13 00:46:42,272 infinity_emb INFO: select_model.py:64
model=`intfloat/multilingual-e5-large-instruct`
selected, using engine=`torch` and device=`cuda`
INFO 2024-11-13 00:46:42,367 SentenceTransformer.py:216
sentence_transformers.SentenceTransformer
INFO: Load pretrained SentenceTransformer:
intfloat/multilingual-e5-large-instruct
INFO 2024-11-13 00:46:46,145 infinity_emb INFO: Adding acceleration.py:56
optimizations via Huggingface optimum.
```
|
@@ -5466,6 +5466,16 @@ print(scores.tolist())
|
|
| 5466 |
# [[91.92853546142578, 67.5802993774414], [70.38143157958984, 92.13307189941406]]
|
| 5467 |
```
|
| 5468 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5469 |
## Supported Languages
|
| 5470 |
|
| 5471 |
This model is initialized from [xlm-roberta-large](https://huggingface.co/xlm-roberta-large)
|
|
|
|
| 5466 |
# [[91.92853546142578, 67.5802993774414], [70.38143157958984, 92.13307189941406]]
|
| 5467 |
```
|
| 5468 |
|
| 5469 |
+
### Infinity
|
| 5470 |
+
|
| 5471 |
+
Usage with [Infinity](https://github.com/michaelfeil/infinity):
|
| 5472 |
+
|
| 5473 |
+
```bash
|
| 5474 |
+
docker run --gpus all -v $PWD/data:/app/.cache -e HF_TOKEN=$HF_TOKEN -p "7997":"7997" \
|
| 5475 |
+
michaelf34/infinity:0.0.68 \
|
| 5476 |
+
v2 --model-id intfloat/multilingual-e5-large-instruct --revision "main" --dtype float16 --batch-size 32 -engine torch --port 7997
|
| 5477 |
+
```
|
| 5478 |
+
|
| 5479 |
## Supported Languages
|
| 5480 |
|
| 5481 |
This model is initialized from [xlm-roberta-large](https://huggingface.co/xlm-roberta-large)
|