Hugging Face's logo

Omartificial-Intelligence-Space
/
Marbert-all-nli-triplet-Matryoshka

Sentence Similarity
sentence-transformers
Safetensors
Arabic
bert
mteb
feature-extraction
Generated from Trainer
dataset_size:557850
loss:MatryoshkaLoss
loss:MultipleNegativesRankingLoss
Eval Results (legacy)
text-embeddings-inference
Model card Files
xet
 Community
Omartificial-Intelligence-Space commited on
Commit
9e8b5e3
·
verified ·
1 Parent(s): dd2b80a

update readme.md

Browse files
Files changed (1) hide show
  1. README.md +183 -23
README.md CHANGED
@@ -61,46 +61,206 @@ model-index:
61
  results:
62
  - dataset:
63
  config: ar
64
- name: MTEB MIRACLRetrievalHardNegatives (ar)
65
- revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
66
- split: dev
67
- type: mteb/miracl-hard-negatives
68
  metrics:
69
- - type: main_score
70
- value: 15.853
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
71
  task:
72
  type: Retrieval
73
  - dataset:
74
- config: ara-ara
75
- name: MTEB MLQARetrieval (ara-ara)
76
- revision: 397ed406c1a7902140303e7faf60fff35b58d285
77
- split: test
78
- type: facebook/mlqa
79
  metrics:
80
- - type: main_score
81
- value: 4.397
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
82
  task:
83
  type: Retrieval
84
  - dataset:
85
  config: ar
86
- name: MTEB MintakaRetrieval (ar)
87
- revision: efa78cc2f74bbcd21eff2261f9e13aebe40b814e
88
- split: test
89
- type: jinaai/mintakaqa
90
  metrics:
91
- - type: main_score
92
- value: 16.058
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
93
  task:
94
  type: Retrieval
95
  - dataset:
96
  config: default
97
- name: MTEB SadeemQuestionRetrieval (default)
98
  revision: 3cb0752b182e5d5d740df547748b06663c8e0bd9
99
  split: test
100
- type: sadeem-ai/sadeem-ar-eval-retrieval-questions
101
  metrics:
102
- - type: main_score
103
- value: 57.068
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
104
  task:
105
  type: Retrieval
106
  - dataset:
 
61
  results:
62
  - dataset:
63
  config: ar
64
+ name: MTEB MintakaRetrieval (ar)
65
+ revision: efa78cc2f74bbcd21eff2261f9e13aebe40b814e
66
+ split: test
67
+ type: mintaka/mmteb-mintaka
68
  metrics:
69
+ - type: main_score
70
+ value: 16.058
71
+ - type: map_at_1
72
+ value: 8.398
73
+ - type: map_at_3
74
+ value: 11.681
75
+ - type: map_at_5
76
+ value: 12.616
77
+ - type: map_at_10
78
+ value: 13.281
79
+ - type: ndcg_at_1
80
+ value: 8.398
81
+ - type: ndcg_at_3
82
+ value: 12.75
83
+ - type: ndcg_at_5
84
+ value: 14.453
85
+ - type: ndcg_at_10
86
+ value: 16.058
87
+ - type: recall_at_1
88
+ value: 8.398
89
+ - type: recall_at_3
90
+ value: 15.842
91
+ - type: recall_at_5
92
+ value: 20.018
93
+ - type: recall_at_10
94
+ value: 24.966
95
+ - type: precision_at_1
96
+ value: 8.398
97
+ - type: precision_at_3
98
+ value: 5.281
99
+ - type: precision_at_5
100
+ value: 4.004
101
+ - type: precision_at_10
102
+ value: 2.497
103
+ - type: mrr_at_1
104
+ value: 8.3976
105
+ - type: mrr_at_3
106
+ value: 11.681
107
+ - type: mrr_at_5
108
+ value: 12.6161
109
+ - type: mrr_at_10
110
+ value: 13.2812
111
  task:
112
  type: Retrieval
113
  - dataset:
114
+ config: ar
115
+ name: MTEB MIRACLRetrievalHardNegatives (ar)
116
+ revision: 95c8db7d4a6e9c1d8a60601afd63d553ae20a2eb
117
+ split: dev
118
+ type: miracl/mmteb-miracl-hardnegatives
119
  metrics:
120
+ - type: main_score
121
+ value: 15.853
122
+ - type: map_at_1
123
+ value: 5.867
124
+ - type: map_at_3
125
+ value: 9.003
126
+ - type: map_at_5
127
+ value: 10.068
128
+ - type: map_at_10
129
+ value: 11.294
130
+ - type: ndcg_at_1
131
+ value: 9.0
132
+ - type: ndcg_at_3
133
+ value: 11.363
134
+ - type: ndcg_at_5
135
+ value: 12.986
136
+ - type: ndcg_at_10
137
+ value: 15.853
138
+ - type: recall_at_1
139
+ value: 5.867
140
+ - type: recall_at_3
141
+ value: 12.639
142
+ - type: recall_at_5
143
+ value: 16.649
144
+ - type: recall_at_10
145
+ value: 24.422
146
+ - type: precision_at_1
147
+ value: 9.0
148
+ - type: precision_at_3
149
+ value: 7.1
150
+ - type: precision_at_5
151
+ value: 5.82
152
+ - type: precision_at_10
153
+ value: 4.38
154
+ - type: mrr_at_1
155
+ value: 9.0
156
+ - type: mrr_at_3
157
+ value: 13.4667
158
+ - type: mrr_at_5
159
+ value: 14.6367
160
+ - type: mrr_at_10
161
+ value: 16.0177
162
  task:
163
  type: Retrieval
164
  - dataset:
165
  config: ar
166
+ name: MTEB MLQARetrieval (ar)
167
+ revision: 397ed406c1a7902140303e7faf60fff35b58d285
168
+ split: validation
169
+ type: mlqa/mmteb-mlqa
170
  metrics:
171
+ - type: main_score
172
+ value: 58.919
173
+ - type: map_at_1
174
+ value: 44.874
175
+ - type: map_at_3
176
+ value: 51.902
177
+ - type: map_at_5
178
+ value: 53.198
179
+ - type: map_at_10
180
+ value: 54.181
181
+ - type: ndcg_at_1
182
+ value: 44.874
183
+ - type: ndcg_at_3
184
+ value: 54.218
185
+ - type: ndcg_at_5
186
+ value: 56.541
187
+ - type: ndcg_at_10
188
+ value: 58.919
189
+ - type: recall_at_1
190
+ value: 44.874
191
+ - type: recall_at_3
192
+ value: 60.928
193
+ - type: recall_at_5
194
+ value: 66.538
195
+ - type: recall_at_10
196
+ value: 73.888
197
+ - type: precision_at_1
198
+ value: 44.874
199
+ - type: precision_at_3
200
+ value: 20.309
201
+ - type: precision_at_5
202
+ value: 13.308
203
+ - type: precision_at_10
204
+ value: 7.389
205
+ - type: mrr_at_1
206
+ value: 44.8743
207
+ - type: mrr_at_3
208
+ value: 51.902
209
+ - type: mrr_at_5
210
+ value: 53.1979
211
+ - type: mrr_at_10
212
+ value: 54.1809
213
  task:
214
  type: Retrieval
215
  - dataset:
216
  config: default
217
+ name: MTEB SadeemQuestionRetrieval (ar)
218
  revision: 3cb0752b182e5d5d740df547748b06663c8e0bd9
219
  split: test
220
+ type: sadeem/mmteb-sadeem
221
  metrics:
222
+ - type: main_score
223
+ value: 57.068
224
+ - type: map_at_1
225
+ value: 24.414
226
+ - type: map_at_3
227
+ value: 45.333
228
+ - type: map_at_5
229
+ value: 46.695
230
+ - type: map_at_10
231
+ value: 47.429
232
+ - type: ndcg_at_1
233
+ value: 24.414
234
+ - type: ndcg_at_3
235
+ value: 52.828
236
+ - type: ndcg_at_5
237
+ value: 55.288
238
+ - type: ndcg_at_10
239
+ value: 57.068
240
+ - type: recall_at_1
241
+ value: 24.414
242
+ - type: recall_at_3
243
+ value: 74.725
244
+ - type: recall_at_5
245
+ value: 80.708
246
+ - type: recall_at_10
247
+ value: 86.213
248
+ - type: precision_at_1
249
+ value: 24.414
250
+ - type: precision_at_3
251
+ value: 24.908
252
+ - type: precision_at_5
253
+ value: 16.142
254
+ - type: precision_at_10
255
+ value: 8.621
256
+ - type: mrr_at_1
257
+ value: 25.2753
258
+ - type: mrr_at_3
259
+ value: 45.58
260
+ - type: mrr_at_5
261
+ value: 46.8581
262
+ - type: mrr_at_10
263
+ value: 47.6414
264
  task:
265
  type: Retrieval
266
  - dataset: