blobbybob commited on
Commit
4c529ac
·
verified ·
1 Parent(s): d93b2e5

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -23,7 +23,7 @@ model-index:
23
  name: MTEB STS (English, 10 tasks)
24
  metrics:
25
  - type: spearman_cosine
26
- value: 70.10
27
  - task:
28
  type: Classification
29
  dataset:
@@ -31,7 +31,7 @@ model-index:
31
  name: MTEB Classification (English, 12 tasks)
32
  metrics:
33
  - type: accuracy
34
- value: 59.67
35
  - task:
36
  type: PairClassification
37
  dataset:
@@ -39,7 +39,7 @@ model-index:
39
  name: MTEB PairClassification (English, 3 tasks)
40
  metrics:
41
  - type: ap
42
- value: 74.58
43
  ---
44
 
45
  # potion-mxbai-micro
@@ -48,7 +48,7 @@ A **700KB** static embedding model. Yes, really. Seven hundred kilobytes for use
48
 
49
  ## Highlights
50
 
51
- - **68.12 avg** on full MTEB English (STS + Classification + PairClassification, 25 tasks)
52
  - **700KB** total model size — fits in an email attachment
53
  - **256 dimensions** — same output dimensionality as the full model
54
  - **80-88x faster** than all-MiniLM-L6-v2 on CPU
@@ -69,9 +69,9 @@ The result is a 2,000-row embedding table at 256D with int8 quantization. Tokens
69
  | Model | STS | Classification | PairClassification | **Avg** | **Size** |
70
  |-------|-----|----------------|-------------------|---------|----------|
71
  | [potion-mxbai-2m-512d](https://huggingface.co/blobbybob/potion-mxbai-2m-512d) | 74.15 | 65.44 | 76.80 | **72.13** | ~125MB |
72
- | [potion-mxbai-256d-v2](https://huggingface.co/blobbybob/potion-mxbai-256d-v2) | 73.33 | 63.36 | 76.25 | **70.98** | 7.5MB |
73
  | [potion-mxbai-128d-v2](https://huggingface.co/blobbybob/potion-mxbai-128d-v2) | 72.56 | 61.48 | 75.45 | **69.83** | 3.9MB |
74
- | **potion-mxbai-micro** (this) | 70.10 | 59.67 | 74.58 | **68.12** | **0.7MB** |
75
 
76
  Evaluated on 25 tasks (10 STS, 12 Classification, 3 PairClassification), English subsets only.
77
 
@@ -108,7 +108,7 @@ embeddings = model.encode(["Hello world", "Static embeddings are fast"])
108
  | [potion-mxbai-2m-512d](https://huggingface.co/blobbybob/potion-mxbai-2m-512d) | 72.13 | ~125MB | Maximum quality |
109
  | [potion-mxbai-256d-v2](https://huggingface.co/blobbybob/potion-mxbai-256d-v2) | 70.98 | 7.5MB | Best quality/size balance |
110
  | [potion-mxbai-128d-v2](https://huggingface.co/blobbybob/potion-mxbai-128d-v2) | 69.83 | 3.9MB | Compact deployments |
111
- | **potion-mxbai-micro** | **68.12** | **0.7MB** | Ultra-tiny / embedded |
112
 
113
  ## Citation
114
 
 
23
  name: MTEB STS (English, 10 tasks)
24
  metrics:
25
  - type: spearman_cosine
26
+ value: 71.04
27
  - task:
28
  type: Classification
29
  dataset:
 
31
  name: MTEB Classification (English, 12 tasks)
32
  metrics:
33
  - type: accuracy
34
+ value: 59.66
35
  - task:
36
  type: PairClassification
37
  dataset:
 
39
  name: MTEB PairClassification (English, 3 tasks)
40
  metrics:
41
  - type: ap
42
+ value: 76.02
43
  ---
44
 
45
  # potion-mxbai-micro
 
48
 
49
  ## Highlights
50
 
51
+ - **68.91 avg** on full MTEB English (STS + Classification + PairClassification, 25 tasks)
52
  - **700KB** total model size — fits in an email attachment
53
  - **256 dimensions** — same output dimensionality as the full model
54
  - **80-88x faster** than all-MiniLM-L6-v2 on CPU
 
69
  | Model | STS | Classification | PairClassification | **Avg** | **Size** |
70
  |-------|-----|----------------|-------------------|---------|----------|
71
  | [potion-mxbai-2m-512d](https://huggingface.co/blobbybob/potion-mxbai-2m-512d) | 74.15 | 65.44 | 76.80 | **72.13** | ~125MB |
72
+ | [potion-mxbai-256d-v2](https://huggingface.co/blobbybob/potion-mxbai-256d-v2) | 73.79 | 63.23 | 77.33 | **71.45** | 7.5MB |
73
  | [potion-mxbai-128d-v2](https://huggingface.co/blobbybob/potion-mxbai-128d-v2) | 72.56 | 61.48 | 75.45 | **69.83** | 3.9MB |
74
+ | **potion-mxbai-micro** (this) | 71.04 | 59.66 | 76.02 | **68.91** | **0.7MB** |
75
 
76
  Evaluated on 25 tasks (10 STS, 12 Classification, 3 PairClassification), English subsets only.
77
 
 
108
  | [potion-mxbai-2m-512d](https://huggingface.co/blobbybob/potion-mxbai-2m-512d) | 72.13 | ~125MB | Maximum quality |
109
  | [potion-mxbai-256d-v2](https://huggingface.co/blobbybob/potion-mxbai-256d-v2) | 70.98 | 7.5MB | Best quality/size balance |
110
  | [potion-mxbai-128d-v2](https://huggingface.co/blobbybob/potion-mxbai-128d-v2) | 69.83 | 3.9MB | Compact deployments |
111
+ | **potion-mxbai-micro** | **68.91** | **0.7MB** | Ultra-tiny / embedded |
112
 
113
  ## Citation
114