Hugging Face's logo

TencentBAC
/
Conan-embedding-v1

sentence-transformers
PyTorch
Safetensors
Chinese
bert
mteb
Eval Results
Model card Files
xet
Community
21
RiccardoDav commited on
Commit
63961be
·
verified ·
1 Parent(s): bb9749a

add AIBOM

Browse files

Dear TencentBAC,
We are a group of researchers investigating the usefulness of sharing AIBOMs (Artificial Intelligence Bill of Materials) to document AI models and to improve transparency in AI model supply chains. AIBOMs are machine-readable, structured inventories of components—such as datasets and models—used in the development of AI-powered systems.

We would like to emphasize that we have no financial or competing interests related to AIBOMs. Our sole interest is to advance the collective understanding of AIBOMs within both academia and industry. As part of this effort, we are contributing to randomly selected open and popular models on Hugging Face (like yours) and are happy to offer support to you and the maintainers of your model if needed.

Based on your model card (and some configuration information available in Hugging Face), we generated the AIBOM according to the CyclonDX (v1.6) standard (see https://cyclonedx.org/docs/1.6/json/). This AIBOM is generated as a JSON file by using the following open-source supporting tool: https://github.com/MSR4SBOM/ALOHA (technical details are available in the research paper: https://github.com/MSR4SBOM/ALOHA/blob/main/ALOHA.pdf). This tool is freely available online and can be downloaded and used at your own convenience. We are also happy to assist you directly if you need help generating or reviewing an AIBOM for your model.

The JSON file in this pull request is your AIBOM (see https://github.com/MSR4SBOM/ALOHA/blob/main/documentation.json for details on its structure). Clearly, the submitted AIBOM matches the current model information, yet it can be easily regenerated when the model evolves, using the aforementioned AIBOM generation tool.

We understand that initiatives like ours may raise questions, especially in open communities like Hugging Face. Therefore, we would like to further remark that our interest in AIBOMs is only to enhance the body of knowledge on AIBOMs and to make this easy and low-friction for maintainers of AI models and developers of AI-powered systems.

We open this pull request containing an AIBOM of your AI model, and hope it will be considered. We would also like to hear your opinion on the usefulness (or not) of AIBOM by answering a 3-minute anonymous survey: https://forms.gle/WGffSQD5dLoWttEe7.

Thanks in advance, and regards,
Riccardo D’Avino, Fatima Ahmed, Sabato Nocera, Simone Romano, Giuseppe Scanniello (University of Salerno, Italy),
Massimiliano Di Penta (University of Sannio, Italy),
The MSR4SBOM team

Files changed (1) hide show
  1. TencentBAC_Conan-embedding-v1.json +1898 -0
TencentBAC_Conan-embedding-v1.json ADDED
@@ -0,0 +1,1898 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bomFormat": "CycloneDX",
3
+ "specVersion": "1.6",
4
+ "serialNumber": "urn:uuid:1c80cd70-56b1-487e-a9c0-d521ff5d25c0",
5
+ "version": 1,
6
+ "metadata": {
7
+ "timestamp": "2025-10-23T16:23:21.783558+00:00",
8
+ "component": {
9
+ "type": "machine-learning-model",
10
+ "bom-ref": "TencentBAC/Conan-embedding-v1-fe97accb-5adf-58e0-8222-ee0b14ae6841",
11
+ "licenses": [
12
+ {
13
+ "license": {
14
+ "id": "CC-BY-NC-4.0",
15
+ "url": "https://spdx.org/licenses/CC-BY-NC-4.0.html"
16
+ }
17
+ }
18
+ ],
19
+ "externalReferences": [
20
+ {
21
+ "url": "https://huggingface.co/TencentBAC/Conan-embedding-v1",
22
+ "type": "documentation"
23
+ }
24
+ ],
25
+ "modelCard": {
26
+ "modelParameters": {
27
+ "datasets": [],
28
+ "architectureFamily": "bert",
29
+ "modelArchitecture": "BertModel"
30
+ },
31
+ "properties": [
32
+ {
33
+ "name": "library_name",
34
+ "value": "sentence-transformers"
35
+ }
36
+ ],
37
+ "quantitativeAnalysis": {
38
+ "performanceMetrics": [
39
+ {
40
+ "slice": "dataset: C-MTEB/AFQMC, split: validation, config: default",
41
+ "type": "cos_sim_pearson",
42
+ "value": 56.613572467148856
43
+ },
44
+ {
45
+ "slice": "dataset: C-MTEB/AFQMC, split: validation, config: default",
46
+ "type": "cos_sim_spearman",
47
+ "value": 60.66446211824284
48
+ },
49
+ {
50
+ "slice": "dataset: C-MTEB/AFQMC, split: validation, config: default",
51
+ "type": "euclidean_pearson",
52
+ "value": 58.42080485872613
53
+ },
54
+ {
55
+ "slice": "dataset: C-MTEB/AFQMC, split: validation, config: default",
56
+ "type": "euclidean_spearman",
57
+ "value": 59.82750030458164
58
+ },
59
+ {
60
+ "slice": "dataset: C-MTEB/AFQMC, split: validation, config: default",
61
+ "type": "manhattan_pearson",
62
+ "value": 58.39885271199772
63
+ },
64
+ {
65
+ "slice": "dataset: C-MTEB/AFQMC, split: validation, config: default",
66
+ "type": "manhattan_spearman",
67
+ "value": 59.817749720366734
68
+ },
69
+ {
70
+ "slice": "dataset: C-MTEB/ATEC, split: test, config: default",
71
+ "type": "cos_sim_pearson",
72
+ "value": 56.60530380552331
73
+ },
74
+ {
75
+ "slice": "dataset: C-MTEB/ATEC, split: test, config: default",
76
+ "type": "cos_sim_spearman",
77
+ "value": 58.63822441736707
78
+ },
79
+ {
80
+ "slice": "dataset: C-MTEB/ATEC, split: test, config: default",
81
+ "type": "euclidean_pearson",
82
+ "value": 62.18551665180664
83
+ },
84
+ {
85
+ "slice": "dataset: C-MTEB/ATEC, split: test, config: default",
86
+ "type": "euclidean_spearman",
87
+ "value": 58.23168804495912
88
+ },
89
+ {
90
+ "slice": "dataset: C-MTEB/ATEC, split: test, config: default",
91
+ "type": "manhattan_pearson",
92
+ "value": 62.17191480770053
93
+ },
94
+ {
95
+ "slice": "dataset: C-MTEB/ATEC, split: test, config: default",
96
+ "type": "manhattan_spearman",
97
+ "value": 58.22556219601401
98
+ },
99
+ {
100
+ "slice": "dataset: mteb/amazon_reviews_multi, split: test, config: zh",
101
+ "type": "accuracy",
102
+ "value": 50.308
103
+ },
104
+ {
105
+ "slice": "dataset: mteb/amazon_reviews_multi, split: test, config: zh",
106
+ "type": "f1",
107
+ "value": 46.927458607895126
108
+ },
109
+ {
110
+ "slice": "dataset: C-MTEB/BQ, split: test, config: default",
111
+ "type": "cos_sim_pearson",
112
+ "value": 72.6472074172711
113
+ },
114
+ {
115
+ "slice": "dataset: C-MTEB/BQ, split: test, config: default",
116
+ "type": "cos_sim_spearman",
117
+ "value": 74.50748447236577
118
+ },
119
+ {
120
+ "slice": "dataset: C-MTEB/BQ, split: test, config: default",
121
+ "type": "euclidean_pearson",
122
+ "value": 72.51833296451854
123
+ },
124
+ {
125
+ "slice": "dataset: C-MTEB/BQ, split: test, config: default",
126
+ "type": "euclidean_spearman",
127
+ "value": 73.9898922606105
128
+ },
129
+ {
130
+ "slice": "dataset: C-MTEB/BQ, split: test, config: default",
131
+ "type": "manhattan_pearson",
132
+ "value": 72.50184948939338
133
+ },
134
+ {
135
+ "slice": "dataset: C-MTEB/BQ, split: test, config: default",
136
+ "type": "manhattan_spearman",
137
+ "value": 73.97797921509638
138
+ },
139
+ {
140
+ "slice": "dataset: C-MTEB/CLSClusteringP2P, split: test, config: default",
141
+ "type": "v_measure",
142
+ "value": 60.63545326048343
143
+ },
144
+ {
145
+ "slice": "dataset: C-MTEB/CLSClusteringS2S, split: test, config: default",
146
+ "type": "v_measure",
147
+ "value": 52.64834762325994
148
+ },
149
+ {
150
+ "slice": "dataset: C-MTEB/CMedQAv1-reranking, split: test, config: default",
151
+ "type": "map",
152
+ "value": 91.38528814655234
153
+ },
154
+ {
155
+ "slice": "dataset: C-MTEB/CMedQAv1-reranking, split: test, config: default",
156
+ "type": "mrr",
157
+ "value": 93.35857142857144
158
+ },
159
+ {
160
+ "slice": "dataset: C-MTEB/CMedQAv2-reranking, split: test, config: default",
161
+ "type": "map",
162
+ "value": 89.72084678877096
163
+ },
164
+ {
165
+ "slice": "dataset: C-MTEB/CMedQAv2-reranking, split: test, config: default",
166
+ "type": "mrr",
167
+ "value": 91.74380952380953
168
+ },
169
+ {
170
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
171
+ "type": "map_at_1",
172
+ "value": 26.987
173
+ },
174
+ {
175
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
176
+ "type": "map_at_10",
177
+ "value": 40.675
178
+ },
179
+ {
180
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
181
+ "type": "map_at_100",
182
+ "value": 42.495
183
+ },
184
+ {
185
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
186
+ "type": "map_at_1000",
187
+ "value": 42.596000000000004
188
+ },
189
+ {
190
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
191
+ "type": "map_at_3",
192
+ "value": 36.195
193
+ },
194
+ {
195
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
196
+ "type": "map_at_5",
197
+ "value": 38.704
198
+ },
199
+ {
200
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
201
+ "type": "mrr_at_1",
202
+ "value": 41.21
203
+ },
204
+ {
205
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
206
+ "type": "mrr_at_10",
207
+ "value": 49.816
208
+ },
209
+ {
210
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
211
+ "type": "mrr_at_100",
212
+ "value": 50.743
213
+ },
214
+ {
215
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
216
+ "type": "mrr_at_1000",
217
+ "value": 50.77700000000001
218
+ },
219
+ {
220
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
221
+ "type": "mrr_at_3",
222
+ "value": 47.312
223
+ },
224
+ {
225
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
226
+ "type": "mrr_at_5",
227
+ "value": 48.699999999999996
228
+ },
229
+ {
230
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
231
+ "type": "ndcg_at_1",
232
+ "value": 41.21
233
+ },
234
+ {
235
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
236
+ "type": "ndcg_at_10",
237
+ "value": 47.606
238
+ },
239
+ {
240
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
241
+ "type": "ndcg_at_100",
242
+ "value": 54.457
243
+ },
244
+ {
245
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
246
+ "type": "ndcg_at_1000",
247
+ "value": 56.16100000000001
248
+ },
249
+ {
250
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
251
+ "type": "ndcg_at_3",
252
+ "value": 42.108000000000004
253
+ },
254
+ {
255
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
256
+ "type": "ndcg_at_5",
257
+ "value": 44.393
258
+ },
259
+ {
260
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
261
+ "type": "precision_at_1",
262
+ "value": 41.21
263
+ },
264
+ {
265
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
266
+ "type": "precision_at_10",
267
+ "value": 10.593
268
+ },
269
+ {
270
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
271
+ "type": "precision_at_100",
272
+ "value": 1.609
273
+ },
274
+ {
275
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
276
+ "type": "precision_at_1000",
277
+ "value": 0.183
278
+ },
279
+ {
280
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
281
+ "type": "precision_at_3",
282
+ "value": 23.881
283
+ },
284
+ {
285
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
286
+ "type": "precision_at_5",
287
+ "value": 17.339
288
+ },
289
+ {
290
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
291
+ "type": "recall_at_1",
292
+ "value": 26.987
293
+ },
294
+ {
295
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
296
+ "type": "recall_at_10",
297
+ "value": 58.875
298
+ },
299
+ {
300
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
301
+ "type": "recall_at_100",
302
+ "value": 87.023
303
+ },
304
+ {
305
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
306
+ "type": "recall_at_1000",
307
+ "value": 98.328
308
+ },
309
+ {
310
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
311
+ "type": "recall_at_3",
312
+ "value": 42.265
313
+ },
314
+ {
315
+ "slice": "dataset: C-MTEB/CmedqaRetrieval, split: dev, config: default",
316
+ "type": "recall_at_5",
317
+ "value": 49.334
318
+ },
319
+ {
320
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
321
+ "type": "cos_sim_accuracy",
322
+ "value": 85.91701743836441
323
+ },
324
+ {
325
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
326
+ "type": "cos_sim_ap",
327
+ "value": 92.53650618807644
328
+ },
329
+ {
330
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
331
+ "type": "cos_sim_f1",
332
+ "value": 86.80265975431082
333
+ },
334
+ {
335
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
336
+ "type": "cos_sim_precision",
337
+ "value": 83.79025239338556
338
+ },
339
+ {
340
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
341
+ "type": "cos_sim_recall",
342
+ "value": 90.039747486556
343
+ },
344
+ {
345
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
346
+ "type": "dot_accuracy",
347
+ "value": 77.17378232110643
348
+ },
349
+ {
350
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
351
+ "type": "dot_ap",
352
+ "value": 85.40244368166546
353
+ },
354
+ {
355
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
356
+ "type": "dot_f1",
357
+ "value": 79.03038001481951
358
+ },
359
+ {
360
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
361
+ "type": "dot_precision",
362
+ "value": 72.20502901353966
363
+ },
364
+ {
365
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
366
+ "type": "dot_recall",
367
+ "value": 87.2808043020809
368
+ },
369
+ {
370
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
371
+ "type": "euclidean_accuracy",
372
+ "value": 84.65423932651834
373
+ },
374
+ {
375
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
376
+ "type": "euclidean_ap",
377
+ "value": 91.47775530034588
378
+ },
379
+ {
380
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
381
+ "type": "euclidean_f1",
382
+ "value": 85.64471499723298
383
+ },
384
+ {
385
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
386
+ "type": "euclidean_precision",
387
+ "value": 81.31567885666246
388
+ },
389
+ {
390
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
391
+ "type": "euclidean_recall",
392
+ "value": 90.46060322656068
393
+ },
394
+ {
395
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
396
+ "type": "manhattan_accuracy",
397
+ "value": 84.58208057726999
398
+ },
399
+ {
400
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
401
+ "type": "manhattan_ap",
402
+ "value": 91.46228709402014
403
+ },
404
+ {
405
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
406
+ "type": "manhattan_f1",
407
+ "value": 85.6631626034444
408
+ },
409
+ {
410
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
411
+ "type": "manhattan_precision",
412
+ "value": 82.10075026795283
413
+ },
414
+ {
415
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
416
+ "type": "manhattan_recall",
417
+ "value": 89.5487491232172
418
+ },
419
+ {
420
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
421
+ "type": "max_accuracy",
422
+ "value": 85.91701743836441
423
+ },
424
+ {
425
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
426
+ "type": "max_ap",
427
+ "value": 92.53650618807644
428
+ },
429
+ {
430
+ "slice": "dataset: C-MTEB/CMNLI, split: validation, config: default",
431
+ "type": "max_f1",
432
+ "value": 86.80265975431082
433
+ },
434
+ {
435
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
436
+ "type": "map_at_1",
437
+ "value": 83.693
438
+ },
439
+ {
440
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
441
+ "type": "map_at_10",
442
+ "value": 90.098
443
+ },
444
+ {
445
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
446
+ "type": "map_at_100",
447
+ "value": 90.145
448
+ },
449
+ {
450
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
451
+ "type": "map_at_1000",
452
+ "value": 90.146
453
+ },
454
+ {
455
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
456
+ "type": "map_at_3",
457
+ "value": 89.445
458
+ },
459
+ {
460
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
461
+ "type": "map_at_5",
462
+ "value": 89.935
463
+ },
464
+ {
465
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
466
+ "type": "mrr_at_1",
467
+ "value": 83.878
468
+ },
469
+ {
470
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
471
+ "type": "mrr_at_10",
472
+ "value": 90.007
473
+ },
474
+ {
475
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
476
+ "type": "mrr_at_100",
477
+ "value": 90.045
478
+ },
479
+ {
480
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
481
+ "type": "mrr_at_1000",
482
+ "value": 90.046
483
+ },
484
+ {
485
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
486
+ "type": "mrr_at_3",
487
+ "value": 89.34
488
+ },
489
+ {
490
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
491
+ "type": "mrr_at_5",
492
+ "value": 89.835
493
+ },
494
+ {
495
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
496
+ "type": "ndcg_at_1",
497
+ "value": 84.089
498
+ },
499
+ {
500
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
501
+ "type": "ndcg_at_10",
502
+ "value": 92.351
503
+ },
504
+ {
505
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
506
+ "type": "ndcg_at_100",
507
+ "value": 92.54599999999999
508
+ },
509
+ {
510
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
511
+ "type": "ndcg_at_1000",
512
+ "value": 92.561
513
+ },
514
+ {
515
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
516
+ "type": "ndcg_at_3",
517
+ "value": 91.15299999999999
518
+ },
519
+ {
520
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
521
+ "type": "ndcg_at_5",
522
+ "value": 91.968
523
+ },
524
+ {
525
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
526
+ "type": "precision_at_1",
527
+ "value": 84.089
528
+ },
529
+ {
530
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
531
+ "type": "precision_at_10",
532
+ "value": 10.011000000000001
533
+ },
534
+ {
535
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
536
+ "type": "precision_at_100",
537
+ "value": 1.009
538
+ },
539
+ {
540
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
541
+ "type": "precision_at_1000",
542
+ "value": 0.101
543
+ },
544
+ {
545
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
546
+ "type": "precision_at_3",
547
+ "value": 32.28
548
+ },
549
+ {
550
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
551
+ "type": "precision_at_5",
552
+ "value": 19.789
553
+ },
554
+ {
555
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
556
+ "type": "recall_at_1",
557
+ "value": 83.693
558
+ },
559
+ {
560
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
561
+ "type": "recall_at_10",
562
+ "value": 99.05199999999999
563
+ },
564
+ {
565
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
566
+ "type": "recall_at_100",
567
+ "value": 99.895
568
+ },
569
+ {
570
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
571
+ "type": "recall_at_1000",
572
+ "value": 100
573
+ },
574
+ {
575
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
576
+ "type": "recall_at_3",
577
+ "value": 95.917
578
+ },
579
+ {
580
+ "slice": "dataset: C-MTEB/CovidRetrieval, split: dev, config: default",
581
+ "type": "recall_at_5",
582
+ "value": 97.893
583
+ },
584
+ {
585
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
586
+ "type": "map_at_1",
587
+ "value": 26.924
588
+ },
589
+ {
590
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
591
+ "type": "map_at_10",
592
+ "value": 81.392
593
+ },
594
+ {
595
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
596
+ "type": "map_at_100",
597
+ "value": 84.209
598
+ },
599
+ {
600
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
601
+ "type": "map_at_1000",
602
+ "value": 84.237
603
+ },
604
+ {
605
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
606
+ "type": "map_at_3",
607
+ "value": 56.998000000000005
608
+ },
609
+ {
610
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
611
+ "type": "map_at_5",
612
+ "value": 71.40100000000001
613
+ },
614
+ {
615
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
616
+ "type": "mrr_at_1",
617
+ "value": 91.75
618
+ },
619
+ {
620
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
621
+ "type": "mrr_at_10",
622
+ "value": 94.45
623
+ },
624
+ {
625
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
626
+ "type": "mrr_at_100",
627
+ "value": 94.503
628
+ },
629
+ {
630
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
631
+ "type": "mrr_at_1000",
632
+ "value": 94.505
633
+ },
634
+ {
635
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
636
+ "type": "mrr_at_3",
637
+ "value": 94.258
638
+ },
639
+ {
640
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
641
+ "type": "mrr_at_5",
642
+ "value": 94.381
643
+ },
644
+ {
645
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
646
+ "type": "ndcg_at_1",
647
+ "value": 91.75
648
+ },
649
+ {
650
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
651
+ "type": "ndcg_at_10",
652
+ "value": 88.53
653
+ },
654
+ {
655
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
656
+ "type": "ndcg_at_100",
657
+ "value": 91.13900000000001
658
+ },
659
+ {
660
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
661
+ "type": "ndcg_at_1000",
662
+ "value": 91.387
663
+ },
664
+ {
665
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
666
+ "type": "ndcg_at_3",
667
+ "value": 87.925
668
+ },
669
+ {
670
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
671
+ "type": "ndcg_at_5",
672
+ "value": 86.461
673
+ },
674
+ {
675
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
676
+ "type": "precision_at_1",
677
+ "value": 91.75
678
+ },
679
+ {
680
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
681
+ "type": "precision_at_10",
682
+ "value": 42.05
683
+ },
684
+ {
685
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
686
+ "type": "precision_at_100",
687
+ "value": 4.827
688
+ },
689
+ {
690
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
691
+ "type": "precision_at_1000",
692
+ "value": 0.48900000000000005
693
+ },
694
+ {
695
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
696
+ "type": "precision_at_3",
697
+ "value": 78.55
698
+ },
699
+ {
700
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
701
+ "type": "precision_at_5",
702
+ "value": 65.82000000000001
703
+ },
704
+ {
705
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
706
+ "type": "recall_at_1",
707
+ "value": 26.924
708
+ },
709
+ {
710
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
711
+ "type": "recall_at_10",
712
+ "value": 89.338
713
+ },
714
+ {
715
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
716
+ "type": "recall_at_100",
717
+ "value": 97.856
718
+ },
719
+ {
720
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
721
+ "type": "recall_at_1000",
722
+ "value": 99.11
723
+ },
724
+ {
725
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
726
+ "type": "recall_at_3",
727
+ "value": 59.202999999999996
728
+ },
729
+ {
730
+ "slice": "dataset: C-MTEB/DuRetrieval, split: dev, config: default",
731
+ "type": "recall_at_5",
732
+ "value": 75.642
733
+ },
734
+ {
735
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
736
+ "type": "map_at_1",
737
+ "value": 54.800000000000004
738
+ },
739
+ {
740
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
741
+ "type": "map_at_10",
742
+ "value": 65.613
743
+ },
744
+ {
745
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
746
+ "type": "map_at_100",
747
+ "value": 66.185
748
+ },
749
+ {
750
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
751
+ "type": "map_at_1000",
752
+ "value": 66.191
753
+ },
754
+ {
755
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
756
+ "type": "map_at_3",
757
+ "value": 62.8
758
+ },
759
+ {
760
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
761
+ "type": "map_at_5",
762
+ "value": 64.535
763
+ },
764
+ {
765
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
766
+ "type": "mrr_at_1",
767
+ "value": 54.800000000000004
768
+ },
769
+ {
770
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
771
+ "type": "mrr_at_10",
772
+ "value": 65.613
773
+ },
774
+ {
775
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
776
+ "type": "mrr_at_100",
777
+ "value": 66.185
778
+ },
779
+ {
780
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
781
+ "type": "mrr_at_1000",
782
+ "value": 66.191
783
+ },
784
+ {
785
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
786
+ "type": "mrr_at_3",
787
+ "value": 62.8
788
+ },
789
+ {
790
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
791
+ "type": "mrr_at_5",
792
+ "value": 64.535
793
+ },
794
+ {
795
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
796
+ "type": "ndcg_at_1",
797
+ "value": 54.800000000000004
798
+ },
799
+ {
800
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
801
+ "type": "ndcg_at_10",
802
+ "value": 70.991
803
+ },
804
+ {
805
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
806
+ "type": "ndcg_at_100",
807
+ "value": 73.434
808
+ },
809
+ {
810
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
811
+ "type": "ndcg_at_1000",
812
+ "value": 73.587
813
+ },
814
+ {
815
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
816
+ "type": "ndcg_at_3",
817
+ "value": 65.324
818
+ },
819
+ {
820
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
821
+ "type": "ndcg_at_5",
822
+ "value": 68.431
823
+ },
824
+ {
825
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
826
+ "type": "precision_at_1",
827
+ "value": 54.800000000000004
828
+ },
829
+ {
830
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
831
+ "type": "precision_at_10",
832
+ "value": 8.790000000000001
833
+ },
834
+ {
835
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
836
+ "type": "precision_at_100",
837
+ "value": 0.9860000000000001
838
+ },
839
+ {
840
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
841
+ "type": "precision_at_1000",
842
+ "value": 0.1
843
+ },
844
+ {
845
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
846
+ "type": "precision_at_3",
847
+ "value": 24.2
848
+ },
849
+ {
850
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
851
+ "type": "precision_at_5",
852
+ "value": 16.02
853
+ },
854
+ {
855
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
856
+ "type": "recall_at_1",
857
+ "value": 54.800000000000004
858
+ },
859
+ {
860
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
861
+ "type": "recall_at_10",
862
+ "value": 87.9
863
+ },
864
+ {
865
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
866
+ "type": "recall_at_100",
867
+ "value": 98.6
868
+ },
869
+ {
870
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
871
+ "type": "recall_at_1000",
872
+ "value": 99.8
873
+ },
874
+ {
875
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
876
+ "type": "recall_at_3",
877
+ "value": 72.6
878
+ },
879
+ {
880
+ "slice": "dataset: C-MTEB/EcomRetrieval, split: dev, config: default",
881
+ "type": "recall_at_5",
882
+ "value": 80.10000000000001
883
+ },
884
+ {
885
+ "slice": "dataset: C-MTEB/IFlyTek-classification, split: validation, config: default",
886
+ "type": "accuracy",
887
+ "value": 51.94305502116199
888
+ },
889
+ {
890
+ "slice": "dataset: C-MTEB/IFlyTek-classification, split: validation, config: default",
891
+ "type": "f1",
892
+ "value": 39.82197338426721
893
+ },
894
+ {
895
+ "slice": "dataset: C-MTEB/JDReview-classification, split: test, config: default",
896
+ "type": "accuracy",
897
+ "value": 90.31894934333957
898
+ },
899
+ {
900
+ "slice": "dataset: C-MTEB/JDReview-classification, split: test, config: default",
901
+ "type": "ap",
902
+ "value": 63.89821836499594
903
+ },
904
+ {
905
+ "slice": "dataset: C-MTEB/JDReview-classification, split: test, config: default",
906
+ "type": "f1",
907
+ "value": 85.93687177603624
908
+ },
909
+ {
910
+ "slice": "dataset: C-MTEB/LCQMC, split: test, config: default",
911
+ "type": "cos_sim_pearson",
912
+ "value": 73.18906216730208
913
+ },
914
+ {
915
+ "slice": "dataset: C-MTEB/LCQMC, split: test, config: default",
916
+ "type": "cos_sim_spearman",
917
+ "value": 79.44570226735877
918
+ },
919
+ {
920
+ "slice": "dataset: C-MTEB/LCQMC, split: test, config: default",
921
+ "type": "euclidean_pearson",
922
+ "value": 78.8105072242798
923
+ },
924
+ {
925
+ "slice": "dataset: C-MTEB/LCQMC, split: test, config: default",
926
+ "type": "euclidean_spearman",
927
+ "value": 79.15605680863212
928
+ },
929
+ {
930
+ "slice": "dataset: C-MTEB/LCQMC, split: test, config: default",
931
+ "type": "manhattan_pearson",
932
+ "value": 78.80576507484064
933
+ },
934
+ {
935
+ "slice": "dataset: C-MTEB/LCQMC, split: test, config: default",
936
+ "type": "manhattan_spearman",
937
+ "value": 79.14625534068364
938
+ },
939
+ {
940
+ "slice": "dataset: C-MTEB/Mmarco-reranking, split: dev, config: default",
941
+ "type": "map",
942
+ "value": 41.58107192600853
943
+ },
944
+ {
945
+ "slice": "dataset: C-MTEB/Mmarco-reranking, split: dev, config: default",
946
+ "type": "mrr",
947
+ "value": 41.37063492063492
948
+ },
949
+ {
950
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
951
+ "type": "map_at_1",
952
+ "value": 68.33
953
+ },
954
+ {
955
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
956
+ "type": "map_at_10",
957
+ "value": 78.261
958
+ },
959
+ {
960
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
961
+ "type": "map_at_100",
962
+ "value": 78.522
963
+ },
964
+ {
965
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
966
+ "type": "map_at_1000",
967
+ "value": 78.527
968
+ },
969
+ {
970
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
971
+ "type": "map_at_3",
972
+ "value": 76.236
973
+ },
974
+ {
975
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
976
+ "type": "map_at_5",
977
+ "value": 77.557
978
+ },
979
+ {
980
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
981
+ "type": "mrr_at_1",
982
+ "value": 70.602
983
+ },
984
+ {
985
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
986
+ "type": "mrr_at_10",
987
+ "value": 78.779
988
+ },
989
+ {
990
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
991
+ "type": "mrr_at_100",
992
+ "value": 79.00500000000001
993
+ },
994
+ {
995
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
996
+ "type": "mrr_at_1000",
997
+ "value": 79.01
998
+ },
999
+ {
1000
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1001
+ "type": "mrr_at_3",
1002
+ "value": 77.037
1003
+ },
1004
+ {
1005
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1006
+ "type": "mrr_at_5",
1007
+ "value": 78.157
1008
+ },
1009
+ {
1010
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1011
+ "type": "ndcg_at_1",
1012
+ "value": 70.602
1013
+ },
1014
+ {
1015
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1016
+ "type": "ndcg_at_10",
1017
+ "value": 82.254
1018
+ },
1019
+ {
1020
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1021
+ "type": "ndcg_at_100",
1022
+ "value": 83.319
1023
+ },
1024
+ {
1025
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1026
+ "type": "ndcg_at_1000",
1027
+ "value": 83.449
1028
+ },
1029
+ {
1030
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1031
+ "type": "ndcg_at_3",
1032
+ "value": 78.46
1033
+ },
1034
+ {
1035
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1036
+ "type": "ndcg_at_5",
1037
+ "value": 80.679
1038
+ },
1039
+ {
1040
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1041
+ "type": "precision_at_1",
1042
+ "value": 70.602
1043
+ },
1044
+ {
1045
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1046
+ "type": "precision_at_10",
1047
+ "value": 9.989
1048
+ },
1049
+ {
1050
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1051
+ "type": "precision_at_100",
1052
+ "value": 1.05
1053
+ },
1054
+ {
1055
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1056
+ "type": "precision_at_1000",
1057
+ "value": 0.106
1058
+ },
1059
+ {
1060
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1061
+ "type": "precision_at_3",
1062
+ "value": 29.598999999999997
1063
+ },
1064
+ {
1065
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1066
+ "type": "precision_at_5",
1067
+ "value": 18.948
1068
+ },
1069
+ {
1070
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1071
+ "type": "recall_at_1",
1072
+ "value": 68.33
1073
+ },
1074
+ {
1075
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1076
+ "type": "recall_at_10",
1077
+ "value": 94.00800000000001
1078
+ },
1079
+ {
1080
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1081
+ "type": "recall_at_100",
1082
+ "value": 98.589
1083
+ },
1084
+ {
1085
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1086
+ "type": "recall_at_1000",
1087
+ "value": 99.60799999999999
1088
+ },
1089
+ {
1090
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1091
+ "type": "recall_at_3",
1092
+ "value": 84.057
1093
+ },
1094
+ {
1095
+ "slice": "dataset: C-MTEB/MMarcoRetrieval, split: dev, config: default",
1096
+ "type": "recall_at_5",
1097
+ "value": 89.32900000000001
1098
+ },
1099
+ {
1100
+ "slice": "dataset: mteb/amazon_massive_intent, split: test, config: zh-CN",
1101
+ "type": "accuracy",
1102
+ "value": 78.13718897108272
1103
+ },
1104
+ {
1105
+ "slice": "dataset: mteb/amazon_massive_intent, split: test, config: zh-CN",
1106
+ "type": "f1",
1107
+ "value": 74.07613180855328
1108
+ },
1109
+ {
1110
+ "slice": "dataset: mteb/amazon_massive_scenario, split: test, config: zh-CN",
1111
+ "type": "accuracy",
1112
+ "value": 86.20040349697376
1113
+ },
1114
+ {
1115
+ "slice": "dataset: mteb/amazon_massive_scenario, split: test, config: zh-CN",
1116
+ "type": "f1",
1117
+ "value": 85.05282136519973
1118
+ },
1119
+ {
1120
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1121
+ "type": "map_at_1",
1122
+ "value": 56.8
1123
+ },
1124
+ {
1125
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1126
+ "type": "map_at_10",
1127
+ "value": 64.199
1128
+ },
1129
+ {
1130
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1131
+ "type": "map_at_100",
1132
+ "value": 64.89
1133
+ },
1134
+ {
1135
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1136
+ "type": "map_at_1000",
1137
+ "value": 64.917
1138
+ },
1139
+ {
1140
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1141
+ "type": "map_at_3",
1142
+ "value": 62.383
1143
+ },
1144
+ {
1145
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1146
+ "type": "map_at_5",
1147
+ "value": 63.378
1148
+ },
1149
+ {
1150
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1151
+ "type": "mrr_at_1",
1152
+ "value": 56.8
1153
+ },
1154
+ {
1155
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1156
+ "type": "mrr_at_10",
1157
+ "value": 64.199
1158
+ },
1159
+ {
1160
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1161
+ "type": "mrr_at_100",
1162
+ "value": 64.89
1163
+ },
1164
+ {
1165
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1166
+ "type": "mrr_at_1000",
1167
+ "value": 64.917
1168
+ },
1169
+ {
1170
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1171
+ "type": "mrr_at_3",
1172
+ "value": 62.383
1173
+ },
1174
+ {
1175
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1176
+ "type": "mrr_at_5",
1177
+ "value": 63.378
1178
+ },
1179
+ {
1180
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1181
+ "type": "ndcg_at_1",
1182
+ "value": 56.8
1183
+ },
1184
+ {
1185
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1186
+ "type": "ndcg_at_10",
1187
+ "value": 67.944
1188
+ },
1189
+ {
1190
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1191
+ "type": "ndcg_at_100",
1192
+ "value": 71.286
1193
+ },
1194
+ {
1195
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1196
+ "type": "ndcg_at_1000",
1197
+ "value": 71.879
1198
+ },
1199
+ {
1200
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1201
+ "type": "ndcg_at_3",
1202
+ "value": 64.163
1203
+ },
1204
+ {
1205
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1206
+ "type": "ndcg_at_5",
1207
+ "value": 65.96600000000001
1208
+ },
1209
+ {
1210
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1211
+ "type": "precision_at_1",
1212
+ "value": 56.8
1213
+ },
1214
+ {
1215
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1216
+ "type": "precision_at_10",
1217
+ "value": 7.9799999999999995
1218
+ },
1219
+ {
1220
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1221
+ "type": "precision_at_100",
1222
+ "value": 0.954
1223
+ },
1224
+ {
1225
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1226
+ "type": "precision_at_1000",
1227
+ "value": 0.1
1228
+ },
1229
+ {
1230
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1231
+ "type": "precision_at_3",
1232
+ "value": 23.1
1233
+ },
1234
+ {
1235
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1236
+ "type": "precision_at_5",
1237
+ "value": 14.74
1238
+ },
1239
+ {
1240
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1241
+ "type": "recall_at_1",
1242
+ "value": 56.8
1243
+ },
1244
+ {
1245
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1246
+ "type": "recall_at_10",
1247
+ "value": 79.80000000000001
1248
+ },
1249
+ {
1250
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1251
+ "type": "recall_at_100",
1252
+ "value": 95.39999999999999
1253
+ },
1254
+ {
1255
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1256
+ "type": "recall_at_1000",
1257
+ "value": 99.8
1258
+ },
1259
+ {
1260
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1261
+ "type": "recall_at_3",
1262
+ "value": 69.3
1263
+ },
1264
+ {
1265
+ "slice": "dataset: C-MTEB/MedicalRetrieval, split: dev, config: default",
1266
+ "type": "recall_at_5",
1267
+ "value": 73.7
1268
+ },
1269
+ {
1270
+ "slice": "dataset: C-MTEB/MultilingualSentiment-classification, split: validation, config: default",
1271
+ "type": "accuracy",
1272
+ "value": 78.57666666666667
1273
+ },
1274
+ {
1275
+ "slice": "dataset: C-MTEB/MultilingualSentiment-classification, split: validation, config: default",
1276
+ "type": "f1",
1277
+ "value": 78.23373528202681
1278
+ },
1279
+ {
1280
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1281
+ "type": "cos_sim_accuracy",
1282
+ "value": 85.43584190579317
1283
+ },
1284
+ {
1285
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1286
+ "type": "cos_sim_ap",
1287
+ "value": 90.76665640338129
1288
+ },
1289
+ {
1290
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1291
+ "type": "cos_sim_f1",
1292
+ "value": 86.5021770682148
1293
+ },
1294
+ {
1295
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1296
+ "type": "cos_sim_precision",
1297
+ "value": 79.82142857142858
1298
+ },
1299
+ {
1300
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1301
+ "type": "cos_sim_recall",
1302
+ "value": 94.40337909186906
1303
+ },
1304
+ {
1305
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1306
+ "type": "dot_accuracy",
1307
+ "value": 78.66811044937737
1308
+ },
1309
+ {
1310
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1311
+ "type": "dot_ap",
1312
+ "value": 85.84084363880804
1313
+ },
1314
+ {
1315
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1316
+ "type": "dot_f1",
1317
+ "value": 80.10075566750629
1318
+ },
1319
+ {
1320
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1321
+ "type": "dot_precision",
1322
+ "value": 76.58959537572254
1323
+ },
1324
+ {
1325
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1326
+ "type": "dot_recall",
1327
+ "value": 83.9493136219641
1328
+ },
1329
+ {
1330
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1331
+ "type": "euclidean_accuracy",
1332
+ "value": 84.46128857606931
1333
+ },
1334
+ {
1335
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1336
+ "type": "euclidean_ap",
1337
+ "value": 88.62351100230491
1338
+ },
1339
+ {
1340
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1341
+ "type": "euclidean_f1",
1342
+ "value": 85.7709469509172
1343
+ },
1344
+ {
1345
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1346
+ "type": "euclidean_precision",
1347
+ "value": 80.8411214953271
1348
+ },
1349
+ {
1350
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1351
+ "type": "euclidean_recall",
1352
+ "value": 91.34107708553326
1353
+ },
1354
+ {
1355
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1356
+ "type": "manhattan_accuracy",
1357
+ "value": 84.51543042772063
1358
+ },
1359
+ {
1360
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1361
+ "type": "manhattan_ap",
1362
+ "value": 88.53975607870393
1363
+ },
1364
+ {
1365
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1366
+ "type": "manhattan_f1",
1367
+ "value": 85.75697211155378
1368
+ },
1369
+ {
1370
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1371
+ "type": "manhattan_precision",
1372
+ "value": 81.14985862393968
1373
+ },
1374
+ {
1375
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1376
+ "type": "manhattan_recall",
1377
+ "value": 90.91869060190075
1378
+ },
1379
+ {
1380
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1381
+ "type": "max_accuracy",
1382
+ "value": 85.43584190579317
1383
+ },
1384
+ {
1385
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1386
+ "type": "max_ap",
1387
+ "value": 90.76665640338129
1388
+ },
1389
+ {
1390
+ "slice": "dataset: C-MTEB/OCNLI, split: validation, config: default",
1391
+ "type": "max_f1",
1392
+ "value": 86.5021770682148
1393
+ },
1394
+ {
1395
+ "slice": "dataset: C-MTEB/OnlineShopping-classification, split: test, config: default",
1396
+ "type": "accuracy",
1397
+ "value": 95.06999999999998
1398
+ },
1399
+ {
1400
+ "slice": "dataset: C-MTEB/OnlineShopping-classification, split: test, config: default",
1401
+ "type": "ap",
1402
+ "value": 93.45104559324996
1403
+ },
1404
+ {
1405
+ "slice": "dataset: C-MTEB/OnlineShopping-classification, split: test, config: default",
1406
+ "type": "f1",
1407
+ "value": 95.06036329426092
1408
+ },
1409
+ {
1410
+ "slice": "dataset: C-MTEB/PAWSX, split: test, config: default",
1411
+ "type": "cos_sim_pearson",
1412
+ "value": 40.01998290519605
1413
+ },
1414
+ {
1415
+ "slice": "dataset: C-MTEB/PAWSX, split: test, config: default",
1416
+ "type": "cos_sim_spearman",
1417
+ "value": 46.5989769986853
1418
+ },
1419
+ {
1420
+ "slice": "dataset: C-MTEB/PAWSX, split: test, config: default",
1421
+ "type": "euclidean_pearson",
1422
+ "value": 45.37905883182924
1423
+ },
1424
+ {
1425
+ "slice": "dataset: C-MTEB/PAWSX, split: test, config: default",
1426
+ "type": "euclidean_spearman",
1427
+ "value": 46.22213849806378
1428
+ },
1429
+ {
1430
+ "slice": "dataset: C-MTEB/PAWSX, split: test, config: default",
1431
+ "type": "manhattan_pearson",
1432
+ "value": 45.40925124776211
1433
+ },
1434
+ {
1435
+ "slice": "dataset: C-MTEB/PAWSX, split: test, config: default",
1436
+ "type": "manhattan_spearman",
1437
+ "value": 46.250705124226386
1438
+ },
1439
+ {
1440
+ "slice": "dataset: C-MTEB/QBQTC, split: test, config: default",
1441
+ "type": "cos_sim_pearson",
1442
+ "value": 42.719516197112526
1443
+ },
1444
+ {
1445
+ "slice": "dataset: C-MTEB/QBQTC, split: test, config: default",
1446
+ "type": "cos_sim_spearman",
1447
+ "value": 44.57507789581106
1448
+ },
1449
+ {
1450
+ "slice": "dataset: C-MTEB/QBQTC, split: test, config: default",
1451
+ "type": "euclidean_pearson",
1452
+ "value": 35.73062264160721
1453
+ },
1454
+ {
1455
+ "slice": "dataset: C-MTEB/QBQTC, split: test, config: default",
1456
+ "type": "euclidean_spearman",
1457
+ "value": 40.473523909913695
1458
+ },
1459
+ {
1460
+ "slice": "dataset: C-MTEB/QBQTC, split: test, config: default",
1461
+ "type": "manhattan_pearson",
1462
+ "value": 35.69868964086357
1463
+ },
1464
+ {
1465
+ "slice": "dataset: C-MTEB/QBQTC, split: test, config: default",
1466
+ "type": "manhattan_spearman",
1467
+ "value": 40.46349925372903
1468
+ },
1469
+ {
1470
+ "slice": "dataset: mteb/sts22-crosslingual-sts, split: test, config: zh",
1471
+ "type": "cos_sim_pearson",
1472
+ "value": 62.340118285801104
1473
+ },
1474
+ {
1475
+ "slice": "dataset: mteb/sts22-crosslingual-sts, split: test, config: zh",
1476
+ "type": "cos_sim_spearman",
1477
+ "value": 67.72781908620632
1478
+ },
1479
+ {
1480
+ "slice": "dataset: mteb/sts22-crosslingual-sts, split: test, config: zh",
1481
+ "type": "euclidean_pearson",
1482
+ "value": 63.161965746091596
1483
+ },
1484
+ {
1485
+ "slice": "dataset: mteb/sts22-crosslingual-sts, split: test, config: zh",
1486
+ "type": "euclidean_spearman",
1487
+ "value": 67.36825684340769
1488
+ },
1489
+ {
1490
+ "slice": "dataset: mteb/sts22-crosslingual-sts, split: test, config: zh",
1491
+ "type": "manhattan_pearson",
1492
+ "value": 63.089863788261425
1493
+ },
1494
+ {
1495
+ "slice": "dataset: mteb/sts22-crosslingual-sts, split: test, config: zh",
1496
+ "type": "manhattan_spearman",
1497
+ "value": 67.40868898995384
1498
+ },
1499
+ {
1500
+ "slice": "dataset: C-MTEB/STSB, split: test, config: default",
1501
+ "type": "cos_sim_pearson",
1502
+ "value": 79.1646360962365
1503
+ },
1504
+ {
1505
+ "slice": "dataset: C-MTEB/STSB, split: test, config: default",
1506
+ "type": "cos_sim_spearman",
1507
+ "value": 81.24426700767087
1508
+ },
1509
+ {
1510
+ "slice": "dataset: C-MTEB/STSB, split: test, config: default",
1511
+ "type": "euclidean_pearson",
1512
+ "value": 79.43826409936123
1513
+ },
1514
+ {
1515
+ "slice": "dataset: C-MTEB/STSB, split: test, config: default",
1516
+ "type": "euclidean_spearman",
1517
+ "value": 79.71787965300125
1518
+ },
1519
+ {
1520
+ "slice": "dataset: C-MTEB/STSB, split: test, config: default",
1521
+ "type": "manhattan_pearson",
1522
+ "value": 79.43377784961737
1523
+ },
1524
+ {
1525
+ "slice": "dataset: C-MTEB/STSB, split: test, config: default",
1526
+ "type": "manhattan_spearman",
1527
+ "value": 79.69348376886967
1528
+ },
1529
+ {
1530
+ "slice": "dataset: C-MTEB/T2Reranking, split: dev, config: default",
1531
+ "type": "map",
1532
+ "value": 68.35595092507496
1533
+ },
1534
+ {
1535
+ "slice": "dataset: C-MTEB/T2Reranking, split: dev, config: default",
1536
+ "type": "mrr",
1537
+ "value": 79.00244892585788
1538
+ },
1539
+ {
1540
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1541
+ "type": "map_at_1",
1542
+ "value": 26.588
1543
+ },
1544
+ {
1545
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1546
+ "type": "map_at_10",
1547
+ "value": 75.327
1548
+ },
1549
+ {
1550
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1551
+ "type": "map_at_100",
1552
+ "value": 79.095
1553
+ },
1554
+ {
1555
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1556
+ "type": "map_at_1000",
1557
+ "value": 79.163
1558
+ },
1559
+ {
1560
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1561
+ "type": "map_at_3",
1562
+ "value": 52.637
1563
+ },
1564
+ {
1565
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1566
+ "type": "map_at_5",
1567
+ "value": 64.802
1568
+ },
1569
+ {
1570
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1571
+ "type": "mrr_at_1",
1572
+ "value": 88.103
1573
+ },
1574
+ {
1575
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1576
+ "type": "mrr_at_10",
1577
+ "value": 91.29899999999999
1578
+ },
1579
+ {
1580
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1581
+ "type": "mrr_at_100",
1582
+ "value": 91.408
1583
+ },
1584
+ {
1585
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1586
+ "type": "mrr_at_1000",
1587
+ "value": 91.411
1588
+ },
1589
+ {
1590
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1591
+ "type": "mrr_at_3",
1592
+ "value": 90.801
1593
+ },
1594
+ {
1595
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1596
+ "type": "mrr_at_5",
1597
+ "value": 91.12700000000001
1598
+ },
1599
+ {
1600
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1601
+ "type": "ndcg_at_1",
1602
+ "value": 88.103
1603
+ },
1604
+ {
1605
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1606
+ "type": "ndcg_at_10",
1607
+ "value": 83.314
1608
+ },
1609
+ {
1610
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1611
+ "type": "ndcg_at_100",
1612
+ "value": 87.201
1613
+ },
1614
+ {
1615
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1616
+ "type": "ndcg_at_1000",
1617
+ "value": 87.83999999999999
1618
+ },
1619
+ {
1620
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1621
+ "type": "ndcg_at_3",
1622
+ "value": 84.408
1623
+ },
1624
+ {
1625
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1626
+ "type": "ndcg_at_5",
1627
+ "value": 83.078
1628
+ },
1629
+ {
1630
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1631
+ "type": "precision_at_1",
1632
+ "value": 88.103
1633
+ },
1634
+ {
1635
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1636
+ "type": "precision_at_10",
1637
+ "value": 41.638999999999996
1638
+ },
1639
+ {
1640
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1641
+ "type": "precision_at_100",
1642
+ "value": 5.006
1643
+ },
1644
+ {
1645
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1646
+ "type": "precision_at_1000",
1647
+ "value": 0.516
1648
+ },
1649
+ {
1650
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1651
+ "type": "precision_at_3",
1652
+ "value": 73.942
1653
+ },
1654
+ {
1655
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1656
+ "type": "precision_at_5",
1657
+ "value": 62.056
1658
+ },
1659
+ {
1660
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1661
+ "type": "recall_at_1",
1662
+ "value": 26.588
1663
+ },
1664
+ {
1665
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1666
+ "type": "recall_at_10",
1667
+ "value": 82.819
1668
+ },
1669
+ {
1670
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1671
+ "type": "recall_at_100",
1672
+ "value": 95.334
1673
+ },
1674
+ {
1675
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1676
+ "type": "recall_at_1000",
1677
+ "value": 98.51299999999999
1678
+ },
1679
+ {
1680
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1681
+ "type": "recall_at_3",
1682
+ "value": 54.74
1683
+ },
1684
+ {
1685
+ "slice": "dataset: C-MTEB/T2Retrieval, split: dev, config: default",
1686
+ "type": "recall_at_5",
1687
+ "value": 68.864
1688
+ },
1689
+ {
1690
+ "slice": "dataset: C-MTEB/TNews-classification, split: validation, config: default",
1691
+ "type": "accuracy",
1692
+ "value": 55.029
1693
+ },
1694
+ {
1695
+ "slice": "dataset: C-MTEB/TNews-classification, split: validation, config: default",
1696
+ "type": "f1",
1697
+ "value": 53.043617905026764
1698
+ },
1699
+ {
1700
+ "slice": "dataset: C-MTEB/ThuNewsClusteringP2P, split: test, config: default",
1701
+ "type": "v_measure",
1702
+ "value": 77.83675116835911
1703
+ },
1704
+ {
1705
+ "slice": "dataset: C-MTEB/ThuNewsClusteringS2S, split: test, config: default",
1706
+ "type": "v_measure",
1707
+ "value": 74.19701455865277
1708
+ },
1709
+ {
1710
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1711
+ "type": "map_at_1",
1712
+ "value": 64.7
1713
+ },
1714
+ {
1715
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1716
+ "type": "map_at_10",
1717
+ "value": 75.593
1718
+ },
1719
+ {
1720
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1721
+ "type": "map_at_100",
1722
+ "value": 75.863
1723
+ },
1724
+ {
1725
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1726
+ "type": "map_at_1000",
1727
+ "value": 75.863
1728
+ },
1729
+ {
1730
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1731
+ "type": "map_at_3",
1732
+ "value": 73.63300000000001
1733
+ },
1734
+ {
1735
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1736
+ "type": "map_at_5",
1737
+ "value": 74.923
1738
+ },
1739
+ {
1740
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1741
+ "type": "mrr_at_1",
1742
+ "value": 64.7
1743
+ },
1744
+ {
1745
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1746
+ "type": "mrr_at_10",
1747
+ "value": 75.593
1748
+ },
1749
+ {
1750
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1751
+ "type": "mrr_at_100",
1752
+ "value": 75.863
1753
+ },
1754
+ {
1755
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1756
+ "type": "mrr_at_1000",
1757
+ "value": 75.863
1758
+ },
1759
+ {
1760
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1761
+ "type": "mrr_at_3",
1762
+ "value": 73.63300000000001
1763
+ },
1764
+ {
1765
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1766
+ "type": "mrr_at_5",
1767
+ "value": 74.923
1768
+ },
1769
+ {
1770
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1771
+ "type": "ndcg_at_1",
1772
+ "value": 64.7
1773
+ },
1774
+ {
1775
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1776
+ "type": "ndcg_at_10",
1777
+ "value": 80.399
1778
+ },
1779
+ {
1780
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1781
+ "type": "ndcg_at_100",
1782
+ "value": 81.517
1783
+ },
1784
+ {
1785
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1786
+ "type": "ndcg_at_1000",
1787
+ "value": 81.517
1788
+ },
1789
+ {
1790
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1791
+ "type": "ndcg_at_3",
1792
+ "value": 76.504
1793
+ },
1794
+ {
1795
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1796
+ "type": "ndcg_at_5",
1797
+ "value": 78.79899999999999
1798
+ },
1799
+ {
1800
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1801
+ "type": "precision_at_1",
1802
+ "value": 64.7
1803
+ },
1804
+ {
1805
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1806
+ "type": "precision_at_10",
1807
+ "value": 9.520000000000001
1808
+ },
1809
+ {
1810
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1811
+ "type": "precision_at_100",
1812
+ "value": 1
1813
+ },
1814
+ {
1815
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1816
+ "type": "precision_at_1000",
1817
+ "value": 0.1
1818
+ },
1819
+ {
1820
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1821
+ "type": "precision_at_3",
1822
+ "value": 28.266999999999996
1823
+ },
1824
+ {
1825
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1826
+ "type": "precision_at_5",
1827
+ "value": 18.060000000000002
1828
+ },
1829
+ {
1830
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1831
+ "type": "recall_at_1",
1832
+ "value": 64.7
1833
+ },
1834
+ {
1835
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1836
+ "type": "recall_at_10",
1837
+ "value": 95.19999999999999
1838
+ },
1839
+ {
1840
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1841
+ "type": "recall_at_100",
1842
+ "value": 100
1843
+ },
1844
+ {
1845
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1846
+ "type": "recall_at_1000",
1847
+ "value": 100
1848
+ },
1849
+ {
1850
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1851
+ "type": "recall_at_3",
1852
+ "value": 84.8
1853
+ },
1854
+ {
1855
+ "slice": "dataset: C-MTEB/VideoRetrieval, split: dev, config: default",
1856
+ "type": "recall_at_5",
1857
+ "value": 90.3
1858
+ },
1859
+ {
1860
+ "slice": "dataset: C-MTEB/waimai-classification, split: test, config: default",
1861
+ "type": "accuracy",
1862
+ "value": 89.69999999999999
1863
+ },
1864
+ {
1865
+ "slice": "dataset: C-MTEB/waimai-classification, split: test, config: default",
1866
+ "type": "ap",
1867
+ "value": 75.91371640164184
1868
+ },
1869
+ {
1870
+ "slice": "dataset: C-MTEB/waimai-classification, split: test, config: default",
1871
+ "type": "f1",
1872
+ "value": 88.34067777698694
1873
+ }
1874
+ ]
1875
+ }
1876
+ },
1877
+ "name": "TencentBAC/Conan-embedding-v1",
1878
+ "authors": [
1879
+ {
1880
+ "name": "TencentBAC"
1881
+ }
1882
+ ],
1883
+ "tags": [
1884
+ "sentence-transformers",
1885
+ "pytorch",
1886
+ "safetensors",
1887
+ "bert",
1888
+ "mteb",
1889
+ "zh",
1890
+ "arxiv:2408.15710",
1891
+ "license:cc-by-nc-4.0",
1892
+ "model-index",
1893
+ "region:us"
1894
+ ]
1895
+ }
1896
+ },
1897
+ "components": []
1898
+ }