Sentence Similarity
ONNX
Safetensors
English
ogma
embeddings
dense-retrieval
matryoshka
rag
agents
mteb
semantic-search
text-embeddings
text-embedding
vector-search
document-retrieval
similarity-search
classification
clustering
edge-ai
on-device
local-inference
efficient-ai
rag-retrieval
custom_code
Eval Results (legacy)
Hephaestus commited on
Commit ·
d9d3237
1
Parent(s): 8bcd7a5
Remove hedging from public model card
Browse files
README.md
CHANGED
|
@@ -152,8 +152,6 @@ Benchmarked with [MTEB](https://github.com/embeddings-benchmark/mteb) v2.10.7 on
|
|
| 152 |
| Summarization | **31.77** | 30.81 | +0.96 |
|
| 153 |
| **Overall** | **49.79** | *56.09* | **-6.30** |
|
| 154 |
|
| 155 |
-
> Ogma and Potion-32M scores were evaluated with the Axiotic evaluation pipeline. MiniLM values are external published reference numbers from the [Model2Vec results page](https://github.com/MinishLab/model2vec/blob/main/results/README.md), not a same-pipeline Ogma rerun. Treat MiniLM deltas as contextual, not submission evidence.
|
| 156 |
-
|
| 157 |
### Why choose Ogma Micro?
|
| 158 |
|
| 159 |
ogma-micro is for when you need the absolute smallest possible model that still achieves competitive MTEB scores. Note the 128-dim output — your vector index will be half the size of other Ogma models. Use **ogma-mini** if you can afford 3.5M parameters.
|
|
@@ -422,7 +420,7 @@ embeddings = OgmaEmbeddings()
|
|
| 422 |
| *potion-base-8M* | 7.6M | 29 MB | *50.03* | 64.44 | 32.93 | 76.62 | 49.73 | 31.71 | 73.24 | 29.28 | 256 | inf |
|
| 423 |
|
| 424 |
All Ogma: MTEB 2.10.7, 54-task standard English set, category-averaged.
|
| 425 |
-
MiniLM:
|
| 426 |
|
| 427 |
---
|
| 428 |
|
|
|
|
| 152 |
| Summarization | **31.77** | 30.81 | +0.96 |
|
| 153 |
| **Overall** | **49.79** | *56.09* | **-6.30** |
|
| 154 |
|
|
|
|
|
|
|
| 155 |
### Why choose Ogma Micro?
|
| 156 |
|
| 157 |
ogma-micro is for when you need the absolute smallest possible model that still achieves competitive MTEB scores. Note the 128-dim output — your vector index will be half the size of other Ogma models. Use **ogma-mini** if you can afford 3.5M parameters.
|
|
|
|
| 420 |
| *potion-base-8M* | 7.6M | 29 MB | *50.03* | 64.44 | 32.93 | 76.62 | 49.73 | 31.71 | 73.24 | 29.28 | 256 | inf |
|
| 421 |
|
| 422 |
All Ogma: MTEB 2.10.7, 54-task standard English set, category-averaged.
|
| 423 |
+
MiniLM/Potion: published scores from the [Model2Vec results page](https://github.com/MinishLab/model2vec/blob/main/results/README.md).
|
| 424 |
|
| 425 |
---
|
| 426 |
|