Hugging Face's logo

dleemiller
/
finecat-nli-s

Text Classification
sentence-transformers
Safetensors
English
modernbert
cross-encoder
reranker
Generated from Trainer
dataset_size:1024986
loss:CrossEntropyLoss
mnli
snli
anli
Eval Results (legacy)
text-embeddings-inference
Model card Files
xet
 Community
dleemiller commited on
Commit
b66fc9f
·
verified ·
1 Parent(s): 02a761a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -5
README.md CHANGED
@@ -63,12 +63,12 @@ F1-Micro scores (equivalent to accuracy) for each dataset.
63
 
64
  | Model | finecat | mnli | mnli_mismatched | snli | anli_r1 | anli_r2 | anli_r3 | wanli | lingnli |
65
  | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
66
- | `MoritzLaurer/DeBERTa-v3-large-mnli-fever-anli-ling-wanli` | **0.8233** | **0.9121** | 0.9079 | 0.8898 | **0.7960** | **0.6830** | **0.6400** | **0.7700** | **0.8821** |
67
- | `dleemiller/finecat-nli-l` | <u>0.8152</u> | <u>0.9088</u> | <u>0.9217</u> | <u>0.9259</u> | <u>0.7400</u> | <u>0.5230</u> | <u>0.5150</u> | <u>0.7424</u> | <u>0.8689</u> |
68
- | `tasksource/ModernBERT-large-nli` | 0.7959 | 0.8983 | **0.9229** | 0.9188 | 0.7260 | 0.5110 | 0.4925 | 0.6978 | 0.8504 |
69
  | `dleemiller/finecat-nli-s` | 0.7865 | 0.8727 | 0.8715 | 0.9087 | 0.6270 | 0.4720 | 0.4258 | 0.7272 | 0.7996 |
70
- | `dleemiller/ModernCE-large-nli` | 0.7811 | <u>0.9088</u> | 0.9205 | **0.9273** | 0.6630 | 0.4860 | 0.4408 | 0.6576 | 0.8566 |
71
- | `MoritzLaurer/DeBERTa-v3-base-mnli-fever-anli` | 0.7642 | 0.9033 | 0.9028 | 0.8866 | 0.7120 | 0.5470 | 0.4950 | 0.6418 | 0.8523 |
72
  | `cross-encoder/nli-deberta-v3-large` | 0.7618 | 0.9019 | 0.9049 | 0.9220 | 0.5300 | 0.4170 | 0.3758 | 0.6548 | 0.8466 |
73
  | `tasksource/ModernBERT-base-nli` | 0.7595 | 0.8685 | 0.8979 | 0.8915 | 0.6300 | 0.4820 | 0.4192 | 0.6632 | 0.8118 |
74
  | `dleemiller/ModernCE-base-nli` | 0.7533 | 0.8923 | 0.9035 | 0.9187 | 0.5240 | 0.3950 | 0.3333 | 0.6464 | 0.8282 |
@@ -81,6 +81,7 @@ F1-Micro scores (equivalent to accuracy) for each dataset.
81
 
82
 
83
 
 
84
  ## Usage
85
 
86
  Label Map:
 
63
 
64
  | Model | finecat | mnli | mnli_mismatched | snli | anli_r1 | anli_r2 | anli_r3 | wanli | lingnli |
65
  | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
66
+ | `MoritzLaurer/DeBERTa-v3-large-mnli-fever-anli-ling-wanli` | **0.8233** | <u>0.9121</u> | 0.9079 | 0.8898 | **0.7960** | **0.6830** | **0.6400** | </u>0.7700</u> | **0.8821** |
67
+ | `dleemiller/finecat-nli-l` | <u>0.8227</u> | **0.9152** | **0.9265** | 0.9162 | <u>0.7480</u> | <u>0.5700</u> | <u>0.5433</u> | **0.7706** | <u>0.8742</u> |
68
+ | `tasksource/ModernBERT-large-nli` | 0.7959 | 0.8983 | <u>0.9229</u> | <u>0.9188</u> | 0.7260 | 0.5110 | 0.4925 | 0.6978 | 0.8504 |
69
  | `dleemiller/finecat-nli-s` | 0.7865 | 0.8727 | 0.8715 | 0.9087 | 0.6270 | 0.4720 | 0.4258 | 0.7272 | 0.7996 |
70
+ | `dleemiller/ModernCE-large-nli` | 0.7811 | 0.9088 | 0.9205 | **0.9273** | 0.6630 | 0.4860 | 0.4408 | 0.6576 | 0.8566 |
71
+ | `MoritzLaurer/DeBERTa-v3-base-mnli-fever-anli` | 0.7642 | 0.9033 | 0.9028 | 0.8866 | 0.7120 | <u>0.5470</u> | 0.4950 | 0.6418 | 0.8523 |
72
  | `cross-encoder/nli-deberta-v3-large` | 0.7618 | 0.9019 | 0.9049 | 0.9220 | 0.5300 | 0.4170 | 0.3758 | 0.6548 | 0.8466 |
73
  | `tasksource/ModernBERT-base-nli` | 0.7595 | 0.8685 | 0.8979 | 0.8915 | 0.6300 | 0.4820 | 0.4192 | 0.6632 | 0.8118 |
74
  | `dleemiller/ModernCE-base-nli` | 0.7533 | 0.8923 | 0.9035 | 0.9187 | 0.5240 | 0.3950 | 0.3333 | 0.6464 | 0.8282 |
 
81
 
82
 
83
 
84
+
85
  ## Usage
86
 
87
  Label Map: