Hugging Face's logo

openbmb
/
MiniCPM-Embedding

Feature Extraction
Transformers
Safetensors
sentence-transformers
Chinese
English
mteb
custom_code
Eval Results (legacy)
Model card Files
xet
Community
9
Kaguya-19 commited on
Commit
821a02f
·
verified ·
1 Parent(s): 6b6c466

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +256 -0
README.md CHANGED
@@ -3,6 +3,262 @@ language:
3
  - zh
4
  - en
5
  base_model: openbmb/MiniCPM-2B-sft-bf16
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  ---
7
  ## MiniCPM-Embedding
8
 
 
3
  - zh
4
  - en
5
  base_model: openbmb/MiniCPM-2B-sft-bf16
6
+ model-index:
7
+ - name: MiniCPM-Embedding
8
+ results:
9
+ - task:
10
+ type: Retrieval
11
+ dataset:
12
+ type: mteb/arguana
13
+ name: MTEB ArguAna
14
+ config: default
15
+ split: test
16
+ revision: c22ab2a51041ffd869aaddef7af8d8215647e41a
17
+ metrics:
18
+ - type: ndcg_at_10
19
+ value: 64.65
20
+ - task:
21
+ type: Retrieval
22
+ dataset:
23
+ type: BeIR/cqadupstack
24
+ name: MTEB CQADupstackRetrieval
25
+ config: default
26
+ split: test
27
+ revision: 4ffe81d471b1924886b33c7567bfb200e9eec5c4
28
+ metrics:
29
+ - type: ndcg_at_10
30
+ value: 46.53
31
+ - task:
32
+ type: Retrieval
33
+ dataset:
34
+ type: mteb/climate-fever
35
+ name: MTEB ClimateFEVER
36
+ config: default
37
+ split: test
38
+ revision: 47f2ac6acb640fc46020b02a5b59fdda04d39380
39
+ metrics:
40
+ - type: ndcg_at_10
41
+ value: 35.55
42
+ - task:
43
+ type: Retrieval
44
+ dataset:
45
+ type: mteb/dbpedia
46
+ name: MTEB DBPedia
47
+ config: default
48
+ split: test
49
+ revision: c0f706b76e590d620bd6618b3ca8efdd34e2d659
50
+ metrics:
51
+ - type: ndcg_at_10
52
+ value: 47.82
53
+ - task:
54
+ type: Retrieval
55
+ dataset:
56
+ type: mteb/fever
57
+ name: MTEB FEVER
58
+ config: default
59
+ split: test
60
+ revision: bea83ef9e8fb933d90a2f1d5515737465d613e12
61
+ metrics:
62
+ - type: ndcg_at_10
63
+ value: 90.76
64
+ - task:
65
+ type: Retrieval
66
+ dataset:
67
+ type: mteb/fiqa
68
+ name: MTEB FiQA2018
69
+ config: default
70
+ split: test
71
+ revision: 27a168819829fe9bcd655c2df245fb19452e8e06
72
+ metrics:
73
+ - type: ndcg_at_10
74
+ value: 56.64
75
+ - task:
76
+ type: Retrieval
77
+ dataset:
78
+ type: mteb/hotpotqa
79
+ name: MTEB HotpotQA
80
+ config: default
81
+ split: test
82
+ revision: ab518f4d6fcca38d87c25209f94beba119d02014
83
+ metrics:
84
+ - type: ndcg_at_10
85
+ value: 78.11
86
+ - task:
87
+ type: Retrieval
88
+ dataset:
89
+ type: mteb/msmarco
90
+ name: MTEB MSMARCO
91
+ config: default
92
+ split: dev
93
+ revision: c5a29a104738b98a9e76336939199e264163d4a0
94
+ metrics:
95
+ - type: ndcg_at_10
96
+ value: 43.93
97
+ - task:
98
+ type: Retrieval
99
+ dataset:
100
+ type: mteb/nfcorpus
101
+ name: MTEB NFCorpus
102
+ config: default
103
+ split: test
104
+ revision: ec0fa4fe99da2ff19ca1214b7966684033a58814
105
+ metrics:
106
+ - type: ndcg_at_10
107
+ value: 39.77
108
+ - task:
109
+ type: Retrieval
110
+ dataset:
111
+ type: mteb/nq
112
+ name: MTEB NQ
113
+ config: default
114
+ split: test
115
+ revision: b774495ed302d8c44a3a7ea25c90dbce03968f31
116
+ metrics:
117
+ - type: ndcg_at_10
118
+ value: 69.29
119
+ - task:
120
+ type: Retrieval
121
+ dataset:
122
+ type: mteb/quora
123
+ name: MTEB QuoraRetrieval
124
+ config: default
125
+ split: test
126
+ revision: None
127
+ metrics:
128
+ - type: ndcg_at_10
129
+ value: 89.97
130
+ - task:
131
+ type: Retrieval
132
+ dataset:
133
+ type: mteb/scidocs
134
+ name: MTEB SCIDOCS
135
+ config: default
136
+ split: test
137
+ revision: None
138
+ metrics:
139
+ - type: ndcg_at_10
140
+ value: 22.38
141
+ - task:
142
+ type: Retrieval
143
+ dataset:
144
+ type: mteb/scifact
145
+ name: MTEB SciFact
146
+ config: default
147
+ split: test
148
+ revision: 0228b52cf27578f30900b9e5271d331663a030d7
149
+ metrics:
150
+ - type: ndcg_at_10
151
+ value: 86.60
152
+ - task:
153
+ type: Retrieval
154
+ dataset:
155
+ type: mteb/trec-covid
156
+ name: MTEB TRECCOVID
157
+ config: default
158
+ split: test
159
+ revision: None
160
+ metrics:
161
+ - type: ndcg_at_10
162
+ value: 81.32
163
+ - task:
164
+ type: Retrieval
165
+ dataset:
166
+ type: mteb/touche2020
167
+ name: MTEB Touche2020
168
+ config: default
169
+ split: test
170
+ revision: a34f9a33db75fa0cbb21bb5cfc3dae8dc8bec93f
171
+ metrics:
172
+ - type: ndcg_at_10
173
+ value: 25.08
174
+ - task:
175
+ type: Retrieval
176
+ dataset:
177
+ type: C-MTEB/CmedqaRetrieval
178
+ name: MTEB CmedqaRetrieval
179
+ config: default
180
+ split: dev
181
+ revision: cd540c506dae1cf9e9a59c3e06f42030d54e7301
182
+ metrics:
183
+ - type: ndcg_at_10
184
+ value: 46.05
185
+ - task:
186
+ type: Retrieval
187
+ dataset:
188
+ type: C-MTEB/CovidRetrieval
189
+ name: MTEB CovidRetrieval
190
+ config: default
191
+ split: dev
192
+ revision: 1271c7809071a13532e05f25fb53511ffce77117
193
+ metrics:
194
+ - type: ndcg_at_10
195
+ value: 92.01
196
+ - task:
197
+ type: Retrieval
198
+ dataset:
199
+ type: C-MTEB/DuRetrieval
200
+ name: MTEB DuRetrieval
201
+ config: default
202
+ split: dev
203
+ revision: a1a333e290fe30b10f3f56498e3a0d911a693ced
204
+ metrics:
205
+ - type: ndcg_at_10
206
+ value: 90.98
207
+ - task:
208
+ type: Retrieval
209
+ dataset:
210
+ type: C-MTEB/EcomRetrieval
211
+ name: MTEB EcomRetrieval
212
+ config: default
213
+ split: dev
214
+ revision: 687de13dc7294d6fd9be10c6945f9e8fec8166b9
215
+ metrics:
216
+ - type: ndcg_at_10
217
+ value: 70.21
218
+ - task:
219
+ type: Retrieval
220
+ dataset:
221
+ type: C-MTEB/MMarcoRetrieval
222
+ name: MTEB MMarcoRetrieval
223
+ config: default
224
+ split: dev
225
+ revision: 539bbde593d947e2a124ba72651aafc09eb33fc2
226
+ metrics:
227
+ - type: ndcg_at_10
228
+ value: 85.55
229
+ - task:
230
+ type: Retrieval
231
+ dataset:
232
+ type: C-MTEB/MedicalRetrieval
233
+ name: MTEB MedicalRetrieval
234
+ config: default
235
+ split: dev
236
+ revision: 2039188fb5800a9803ba5048df7b76e6fb151fc6
237
+ metrics:
238
+ - type: ndcg_at_10
239
+ value: 63.91
240
+ - task:
241
+ type: Retrieval
242
+ dataset:
243
+ type: C-MTEB/T2Retrieval
244
+ name: MTEB T2Retrieval
245
+ config: default
246
+ split: dev
247
+ revision: 8731a845f1bf500a4f111cf1070785c793d10e64
248
+ metrics:
249
+ - type: ndcg_at_10
250
+ value: 87.33
251
+ - task:
252
+ type: Retrieval
253
+ dataset:
254
+ type: C-MTEB/VideoRetrieval
255
+ name: MTEB VideoRetrieval
256
+ config: default
257
+ split: dev
258
+ revision: 58c2597a5943a2ba48f4668c3b90d796283c5639
259
+ metrics:
260
+ - type: ndcg_at_10
261
+ value: 78.05
262
  ---
263
  ## MiniCPM-Embedding
264