Update README.md
Browse files
README.md
CHANGED
|
@@ -3,6 +3,8 @@ license: other
|
|
| 3 |
---
|
| 4 |
# Llama-3 chat vector
|
| 5 |
|
|
|
|
|
|
|
| 6 |
This is 'modelified' version of _chat vector_ from the paper [Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New Languages](https://arxiv.org/abs/2310.04799). So this is not a model, its just weight diff, just for ease to use myself(or you too)!
|
| 7 |
|
| 8 |
What I understand here:
|
|
@@ -21,7 +23,7 @@ So before (my) initial purpose in comparing which method is better, `llama3 →
|
|
| 21 |
| [kuotient/Llama-3-Ko-8B-dare-ties](https://huggingface.co/kuotient/Llama-3-Ko-8B-dare-ties) | Dare-ties | 0.4950 | 0.5399 |
|
| 22 |
| [kuotient/Llama-3-Ko-8B-TA](https://huggingface.co/kuotient/Llama-3-Ko-8B-TA) | Task Arithmetic(maybe...? not sure about this) | - |
|
| 23 |
| WIP | Model stock(I don't read this paper yet but still) | - |
|
| 24 |
-
|
|
| 25 |
|---|---|---|---|
|
| 26 |
| [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) | Base | - | - |
|
| 27 |
| [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) | - | 0.4239 | 0.4931 |
|
|
|
|
| 3 |
---
|
| 4 |
# Llama-3 chat vector
|
| 5 |
|
| 6 |
+
Update 0426: A small problem with the deployment of the model 'Llama-3-Seagull-Evo-8B', but we hope to have it back in good time!
|
| 7 |
+
|
| 8 |
This is 'modelified' version of _chat vector_ from the paper [Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New Languages](https://arxiv.org/abs/2310.04799). So this is not a model, its just weight diff, just for ease to use myself(or you too)!
|
| 9 |
|
| 10 |
What I understand here:
|
|
|
|
| 23 |
| [kuotient/Llama-3-Ko-8B-dare-ties](https://huggingface.co/kuotient/Llama-3-Ko-8B-dare-ties) | Dare-ties | 0.4950 | 0.5399 |
|
| 24 |
| [kuotient/Llama-3-Ko-8B-TA](https://huggingface.co/kuotient/Llama-3-Ko-8B-TA) | Task Arithmetic(maybe...? not sure about this) | - |
|
| 25 |
| WIP | Model stock(I don't read this paper yet but still) | - |
|
| 26 |
+
| kuotient/Llama-3-Seagull-Evo-8B | Evolutionary Model Merging | **0.6139** | **0.5344** |
|
| 27 |
|---|---|---|---|
|
| 28 |
| [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) | Base | - | - |
|
| 29 |
| [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) | - | 0.4239 | 0.4931 |
|