Disya commited on
Commit
41848b9
·
verified ·
1 Parent(s): 345cab9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +45 -43
README.md CHANGED
@@ -1,43 +1,45 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # Qwen2.5-1M-RP-Context-Merge
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the [DARE TIES](https://arxiv.org/abs/2311.03099) merge method using Qwen2.5-14B-Instruct-1M-abliterated as a base.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * Omega-Darker_The-Final-Directive-14B
22
- * Impish_QWEN_14B-1M
23
-
24
- ### Configuration
25
-
26
- The following YAML configuration was used to produce this model:
27
-
28
- ```yaml
29
- merge_method: dare_ties
30
- base_model: Qwen2.5-14B-Instruct-1M-abliterated
31
- models:
32
- - model: Qwen2.5-14B-Instruct-1M-abliterated
33
- parameters:
34
- weight: 0.3
35
- - model: Omega-Darker_The-Final-Directive-14B
36
- parameters:
37
- weight: 0.35
38
- - model: Impish_QWEN_14B-1M
39
- parameters:
40
- weight: 0.35
41
- parameters:
42
- density: 0.35
43
- ```
 
 
 
1
+ ---
2
+ base_model:
3
+ - huihui-ai/Qwen2.5-14B-Instruct-1M-abliterated
4
+ - ReadyArt/Omega-Darker_The-Final-Directive-14B
5
+ - SicariusSicariiStuff/Impish_QWEN_14B-1M
6
+ library_name: transformers
7
+ tags:
8
+ - mergekit
9
+ - merge
10
+ ---
11
+ # Qwen2.5-1M-RP-Context-Merge
12
+
13
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
+
15
+ ## Merge Details
16
+ ### Merge Method
17
+
18
+ This model was merged using the [DARE TIES](https://arxiv.org/abs/2311.03099) merge method using Qwen2.5-14B-Instruct-1M-abliterated as a base.
19
+
20
+ ### Models Merged
21
+
22
+ The following models were included in the merge:
23
+ * Omega-Darker_The-Final-Directive-14B
24
+ * Impish_QWEN_14B-1M
25
+
26
+ ### Configuration
27
+
28
+ The following YAML configuration was used to produce this model:
29
+
30
+ ```yaml
31
+ merge_method: dare_ties
32
+ base_model: Qwen2.5-14B-Instruct-1M-abliterated
33
+ models:
34
+ - model: Qwen2.5-14B-Instruct-1M-abliterated
35
+ parameters:
36
+ weight: 0.3
37
+ - model: Omega-Darker_The-Final-Directive-14B
38
+ parameters:
39
+ weight: 0.35
40
+ - model: Impish_QWEN_14B-1M
41
+ parameters:
42
+ weight: 0.35
43
+ parameters:
44
+ density: 0.35
45
+ ```