Hugging Face's logo

dleemiller
/
finecat-nli-s

Text Classification
sentence-transformers
Safetensors
English
modernbert
cross-encoder
reranker
Generated from Trainer
dataset_size:1024986
loss:CrossEntropyLoss
mnli
snli
anli
Eval Results (legacy)
text-embeddings-inference
Model card Files
xet
 Community
dleemiller commited on
Commit
5f19d4f
·
verified ·
1 Parent(s): 6ec6711

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -81,7 +81,7 @@ Performance was measured at bs=32 using a Nvidia Blackwell PRO 6000 Max-Q.
81
  | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
82
  | `dleemiller/finecat-nli-s` | **0.7834** | 0.8725 | 0.8725 | 0.8973 | **0.6400** | **0.4660** | **0.4617** | **0.7284** | <u>0.8072</u> | 2291.87 | 415.65 |
83
  | `tasksource/deberta-small-long-nli` | 0.7492 | 0.8194 | 0.8206 | 0.8613 | <u>0.5670</u> | <u>0.4220</u> | <u>0.4475</u> | <u>0.7034</u> | 0.7605 | 2250.66 | 1351.08 |
84
- | `cross-encoder/nli-deberta-v3-xsmall` | 0.7269 | **0.8781** | 0.8777 | **0.9164** | 0.3620 | 0.3030 | 0.3183 | 0.6096 | **0.8122** | 2510.05 | 753.91 |
85
  | `dleemiller/EttinX-nli-s` | 0.7251 | <u>0.8765</u> | **0.8798** | 0.9128 | 0.3360 | 0.2790 | 0.3083 | 0.6234 | 0.8012 | 2348.21 | 415.65 |
86
  | `cross-encoder/nli-MiniLM2-L6-H768` | 0.7119 | 0.8660 | 0.8683 | <u>0.9137</u> | 0.3090 | 0.2850 | 0.2867 | 0.5830 | 0.7905 | 2885.72 | 566.64 |
87
  | `cross-encoder/nli-distilroberta-base` | 0.6936 | 0.8365 | 0.8398 | 0.8996 | 0.2660 | 0.2810 | 0.2975 | 0.5516 | 0.7516 | 2838.17 | 566.64 |
 
81
  | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
82
  | `dleemiller/finecat-nli-s` | **0.7834** | 0.8725 | 0.8725 | 0.8973 | **0.6400** | **0.4660** | **0.4617** | **0.7284** | <u>0.8072</u> | 2291.87 | 415.65 |
83
  | `tasksource/deberta-small-long-nli` | 0.7492 | 0.8194 | 0.8206 | 0.8613 | <u>0.5670</u> | <u>0.4220</u> | <u>0.4475</u> | <u>0.7034</u> | 0.7605 | 2250.66 | 1351.08 |
84
+ | `cross-encoder/nli-deberta-v3-xsmall` | 0.7269 | **0.8781** | <u>0.8777</u> | **0.9164** | 0.3620 | 0.3030 | 0.3183 | 0.6096 | **0.8122** | 2510.05 | 753.91 |
85
  | `dleemiller/EttinX-nli-s` | 0.7251 | <u>0.8765</u> | **0.8798** | 0.9128 | 0.3360 | 0.2790 | 0.3083 | 0.6234 | 0.8012 | 2348.21 | 415.65 |
86
  | `cross-encoder/nli-MiniLM2-L6-H768` | 0.7119 | 0.8660 | 0.8683 | <u>0.9137</u> | 0.3090 | 0.2850 | 0.2867 | 0.5830 | 0.7905 | 2885.72 | 566.64 |
87
  | `cross-encoder/nli-distilroberta-base` | 0.6936 | 0.8365 | 0.8398 | 0.8996 | 0.2660 | 0.2810 | 0.2975 | 0.5516 | 0.7516 | 2838.17 | 566.64 |