Update README.md
Browse files
README.md
CHANGED
|
@@ -86,7 +86,7 @@ We introduce Latxa 3.1 8B Instruct, an instructed version of [Latxa](https://acl
|
|
| 86 |
> Further training details will be released with the corresponding research paper in the near future.
|
| 87 |
|
| 88 |
|
| 89 |
-
Our preliminary experimentation shows that
|
| 90 |
The official paper is coming soon.
|
| 91 |
|
| 92 |
|
|
|
|
| 86 |
> Further training details will be released with the corresponding research paper in the near future.
|
| 87 |
|
| 88 |
|
| 89 |
+
Our preliminary experimentation shows that Latxa 3.1 8B Instruct outperforms Llama-3.1-Instruct by a large margin on Basque standard benchmarks, and particularly, on chat conversations. In addition, we organized a public arena-based evaluation, on which Latxat competed against other baselines and proprietary models such as GPT-4o and Claude Sonnet. The results showed that Latxa ranked 3rd, just behind Claude and GPT-4 and above all the other same-size competitors.
|
| 90 |
The official paper is coming soon.
|
| 91 |
|
| 92 |
|