Hephaestus commited on
Commit
d9d3237
·
1 Parent(s): 8bcd7a5

Remove hedging from public model card

Browse files
Files changed (1) hide show
  1. README.md +1 -3
README.md CHANGED
@@ -152,8 +152,6 @@ Benchmarked with [MTEB](https://github.com/embeddings-benchmark/mteb) v2.10.7 on
152
  | Summarization | **31.77** | 30.81 | +0.96 |
153
  | **Overall** | **49.79** | *56.09* | **-6.30** |
154
 
155
- > Ogma and Potion-32M scores were evaluated with the Axiotic evaluation pipeline. MiniLM values are external published reference numbers from the [Model2Vec results page](https://github.com/MinishLab/model2vec/blob/main/results/README.md), not a same-pipeline Ogma rerun. Treat MiniLM deltas as contextual, not submission evidence.
156
-
157
  ### Why choose Ogma Micro?
158
 
159
  ogma-micro is for when you need the absolute smallest possible model that still achieves competitive MTEB scores. Note the 128-dim output — your vector index will be half the size of other Ogma models. Use **ogma-mini** if you can afford 3.5M parameters.
@@ -422,7 +420,7 @@ embeddings = OgmaEmbeddings()
422
  | *potion-base-8M* | 7.6M | 29 MB | *50.03* | 64.44 | 32.93 | 76.62 | 49.73 | 31.71 | 73.24 | 29.28 | 256 | inf |
423
 
424
  All Ogma: MTEB 2.10.7, 54-task standard English set, category-averaged.
425
- MiniLM: external published reference from the [Model2Vec results page](https://github.com/MinishLab/model2vec/blob/main/results/README.md). Potion baselines are included only where evaluated with the same Axiotic pipeline.
426
 
427
  ---
428
 
 
152
  | Summarization | **31.77** | 30.81 | +0.96 |
153
  | **Overall** | **49.79** | *56.09* | **-6.30** |
154
 
 
 
155
  ### Why choose Ogma Micro?
156
 
157
  ogma-micro is for when you need the absolute smallest possible model that still achieves competitive MTEB scores. Note the 128-dim output — your vector index will be half the size of other Ogma models. Use **ogma-mini** if you can afford 3.5M parameters.
 
420
  | *potion-base-8M* | 7.6M | 29 MB | *50.03* | 64.44 | 32.93 | 76.62 | 49.73 | 31.71 | 73.24 | 29.28 | 256 | inf |
421
 
422
  All Ogma: MTEB 2.10.7, 54-task standard English set, category-averaged.
423
+ MiniLM/Potion: published scores from the [Model2Vec results page](https://github.com/MinishLab/model2vec/blob/main/results/README.md).
424
 
425
  ---
426