Delta-Vector commited on
Commit
e610267
·
verified ·
1 Parent(s): 20558c5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +361 -32
README.md CHANGED
@@ -6,36 +6,365 @@ library_name: transformers
6
  tags:
7
  - mergekit
8
  - merge
9
-
 
10
  ---
11
- # glm-merge-0-2
12
-
13
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
-
15
- ## Merge Details
16
- ### Merge Method
17
-
18
- This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method.
19
-
20
- ### Models Merged
21
-
22
- The following models were included in the merge:
23
- * [Delta-Vector/Rei-V1-32B-Base](https://huggingface.co/Delta-Vector/Rei-V1-32B-Base)
24
- * [allura-org/GLM4-32B-Neon-v2](https://huggingface.co/allura-org/GLM4-32B-Neon-v2)
25
-
26
- ### Configuration
27
-
28
- The following YAML configuration was used to produce this model:
29
-
30
- ```yaml
31
- models:
32
- - model: allura-org/GLM4-32B-Neon-v2
33
- - model: Delta-Vector/Rei-V1-32B-Base
34
- merge_method: slerp
35
- base_model: allura-org/GLM4-32B-Neon-v2
36
- parameters:
37
- t:
38
- - value: 0.2
39
- dtype: bfloat16
40
- tokenizer_source: base
41
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  tags:
7
  - mergekit
8
  - merge
9
+ - rolelplay
10
+ - creative_writing
11
  ---
12
+ <!DOCTYPE html>
13
+ <html lang="en">
14
+ <head>
15
+ <meta charset="UTF-8">
16
+ <meta name="viewport" content="width=device-width, initial-scale=1.0">
17
+ <title>Plesio-32B</title>
18
+ <link href="https://fonts.googleapis.com/css2?family=Quicksand:wght@400;500;600&display=swap" rel="stylesheet">
19
+ <style>
20
+ body {
21
+ font-family: 'Quicksand', sans-serif;
22
+ background: linear-gradient(135deg, #e6f3ff 0%, #cce7ff 50%, #b3daff 100%);
23
+ color: #1e3a5f;
24
+ margin: 0;
25
+ padding: 0;
26
+ font-size: 16px;
27
+ min-height: 100vh;
28
+ }
29
+ .container {
30
+ margin: 20px;
31
+ background: linear-gradient(145deg, rgba(255, 255, 255, 0.9), rgba(240, 248, 255, 0.95));
32
+ padding: 30px;
33
+ border-radius: 20px;
34
+ box-shadow: 0 8px 32px rgba(70, 130, 180, 0.3), 0 4px 16px rgba(0, 123, 191, 0.2);
35
+ border: 2px solid rgba(70, 130, 180, 0.4);
36
+ position: relative;
37
+ backdrop-filter: blur(10px);
38
+ }
39
+ .container::before {
40
+ content: '';
41
+ position: absolute;
42
+ top: 0;
43
+ left: 0;
44
+ right: 0;
45
+ bottom: 0;
46
+ background: linear-gradient(45deg, rgba(135, 206, 235, 0.1), rgba(0, 191, 255, 0.1), rgba(70, 130, 180, 0.1));
47
+ border-radius: 20px;
48
+ z-index: -1;
49
+ }
50
+ .header h1 {
51
+ font-size: 32px;
52
+ background: linear-gradient(45deg, #0066cc, #007bff, #4169e1);
53
+ -webkit-background-clip: text;
54
+ -webkit-text-fill-color: transparent;
55
+ background-clip: text;
56
+ margin: 0 0 20px 0;
57
+ text-align: center;
58
+ font-weight: 600;
59
+ text-shadow: 0 2px 4px rgba(70, 130, 180, 0.3);
60
+ }
61
+ .section {
62
+ margin-top: 30px;
63
+ }
64
+ .section h2 {
65
+ font-size: 24px;
66
+ background: linear-gradient(45deg, #0066cc, #007bff);
67
+ -webkit-background-clip: text;
68
+ -webkit-text-fill-color: transparent;
69
+ background-clip: text;
70
+ text-align: center;
71
+ font-weight: 600;
72
+ margin-bottom: 20px;
73
+ }
74
+ .info p {
75
+ color: #1e3a5f;
76
+ line-height: 1.8;
77
+ font-size: 16px;
78
+ }
79
+ .info img {
80
+ width: 85%;
81
+ border-radius: 15px;
82
+ margin: 0 auto 15px;
83
+ display: block;
84
+ box-shadow: 0 8px 25px rgba(70, 130, 180, 0.4);
85
+ border: 2px solid rgba(135, 206, 235, 0.5);
86
+ }
87
+ a {
88
+ color: #0066cc;
89
+ text-decoration: none;
90
+ transition: all 0.3s ease;
91
+ font-weight: 500;
92
+ }
93
+ a:hover {
94
+ color: #007bff;
95
+ text-shadow: 0 0 8px rgba(0, 191, 255, 0.6);
96
+ }
97
+ .button {
98
+ display: inline-block;
99
+ background: linear-gradient(45deg, #87ceeb, #00bfff);
100
+ color: #1e3a5f;
101
+ padding: 12px 24px;
102
+ border-radius: 25px;
103
+ cursor: pointer;
104
+ text-decoration: none;
105
+ transition: all 0.3s ease;
106
+ border: 1px solid rgba(70, 130, 180, 0.5);
107
+ font-weight: 500;
108
+ }
109
+ .button:hover {
110
+ background: linear-gradient(45deg, #5fb3d4, #0099e6);
111
+ box-shadow: 0 4px 15px rgba(70, 130, 180, 0.6);
112
+ transform: translateY(-2px);
113
+ }
114
+ pre {
115
+ background: linear-gradient(135deg, rgba(240, 248, 255, 0.8), rgba(230, 243, 255, 0.8));
116
+ padding: 20px;
117
+ border-radius: 12px;
118
+ overflow-x: auto;
119
+ border: 1px solid rgba(70, 130, 180, 0.3);
120
+ box-shadow: inset 0 2px 4px rgba(70, 130, 180, 0.2);
121
+ }
122
+ code {
123
+ font-family: 'Courier New', monospace;
124
+ color: #1e3a5f;
125
+ }
126
+ .info-card {
127
+ background: linear-gradient(145deg, rgba(240, 248, 255, 0.9), rgba(230, 243, 255, 0.9));
128
+ border: 2px solid rgba(70, 130, 180, 0.4);
129
+ border-radius: 15px;
130
+ overflow: hidden;
131
+ box-shadow: 0 4px 20px rgba(70, 130, 180, 0.3);
132
+ }
133
+ .info-header {
134
+ background: linear-gradient(135deg, rgba(135, 206, 235, 0.3), rgba(0, 191, 255, 0.2));
135
+ padding: 25px;
136
+ border-bottom: 1px solid rgba(70, 130, 180, 0.3);
137
+ }
138
+ .info-header h3 {
139
+ background: linear-gradient(45deg, #0066cc, #007bff);
140
+ -webkit-background-clip: text;
141
+ -webkit-text-fill-color: transparent;
142
+ background-clip: text;
143
+ margin: 0 0 15px 0;
144
+ font-size: 22px;
145
+ text-align: center;
146
+ font-weight: 600;
147
+ }
148
+ .model-tags {
149
+ display: flex;
150
+ gap: 10px;
151
+ flex-wrap: wrap;
152
+ justify-content: center;
153
+ }
154
+ .model-tag {
155
+ background: linear-gradient(45deg, rgba(70, 130, 180, 0.4), rgba(0, 191, 255, 0.3));
156
+ color: #1e3a5f;
157
+ padding: 8px 16px;
158
+ border-radius: 20px;
159
+ font-size: 13px;
160
+ border: 1px solid rgba(70, 130, 180, 0.5);
161
+ font-weight: 500;
162
+ box-shadow: 0 2px 8px rgba(70, 130, 180, 0.2);
163
+ }
164
+ .model-composition {
165
+ padding: 25px;
166
+ border-bottom: 1px solid rgba(70, 130, 180, 0.3);
167
+ }
168
+ .model-composition h4 {
169
+ background: linear-gradient(45deg, #0066cc, #007bff);
170
+ -webkit-background-clip: text;
171
+ -webkit-text-fill-color: transparent;
172
+ background-clip: text;
173
+ margin: 0 0 20px 0;
174
+ font-size: 18px;
175
+ text-align: center;
176
+ font-weight: 600;
177
+ }
178
+ .composition-list {
179
+ list-style: none;
180
+ padding: 0;
181
+ margin: 0;
182
+ display: grid;
183
+ gap: 15px;
184
+ }
185
+ .composition-list li {
186
+ color: #1e3a5f;
187
+ display: flex;
188
+ align-items: baseline;
189
+ gap: 12px;
190
+ padding: 10px;
191
+ background: rgba(240, 248, 255, 0.5);
192
+ border-radius: 8px;
193
+ border-left: 4px solid #87ceeb;
194
+ }
195
+ .model-component {
196
+ font-weight: 600;
197
+ min-width: 120px;
198
+ }
199
+ .model-description {
200
+ padding: 25px;
201
+ background: linear-gradient(135deg, rgba(255, 255, 255, 0.7), rgba(240, 248, 255, 0.8));
202
+ }
203
+ .metrics-section {
204
+ margin-bottom: 30px;
205
+ }
206
+ .metrics-section details {
207
+ background: linear-gradient(145deg, rgba(240, 248, 255, 0.9), rgba(230, 243, 255, 0.9));
208
+ border: 2px solid rgba(70, 130, 180, 0.4);
209
+ border-radius: 12px;
210
+ padding: 20px;
211
+ margin-bottom: 20px;
212
+ box-shadow: 0 4px 15px rgba(70, 130, 180, 0.2);
213
+ }
214
+ .metrics-section summary {
215
+ background: linear-gradient(45deg, #0066cc, #007bff);
216
+ -webkit-background-clip: text;
217
+ -webkit-text-fill-color: transparent;
218
+ background-clip: text;
219
+ font-size: 18px;
220
+ cursor: pointer;
221
+ outline: none;
222
+ padding: 8px 0;
223
+ text-align: center;
224
+ font-weight: 600;
225
+ transition: all 0.3s ease;
226
+ }
227
+ .metrics-section summary:hover {
228
+ text-shadow: 0 0 8px rgba(0, 191, 255, 0.6);
229
+ }
230
+ .creator-section {
231
+ margin: 20px 0;
232
+ text-align: center;
233
+ }
234
+ .creator-badge {
235
+ display: inline-flex;
236
+ align-items: center;
237
+ background: linear-gradient(145deg, rgba(240, 248, 255, 0.9), rgba(230, 243, 255, 0.9));
238
+ border: 2px solid rgba(70, 130, 180, 0.4);
239
+ border-radius: 25px;
240
+ padding: 15px 20px;
241
+ box-shadow: 0 4px 15px rgba(70, 130, 180, 0.3);
242
+ }
243
+ .creator-label {
244
+ color: #1e3a5f;
245
+ font-size: 14px;
246
+ margin-right: 10px;
247
+ font-weight: 500;
248
+ }
249
+ .creator-link {
250
+ display: flex;
251
+ align-items: center;
252
+ gap: 8px;
253
+ color: #0066cc;
254
+ text-decoration: none;
255
+ transition: all 0.3s ease;
256
+ }
257
+ .creator-name {
258
+ font-weight: 600;
259
+ }
260
+ .creator-arrow {
261
+ font-size: 16px;
262
+ transition: transform 0.3s ease;
263
+ }
264
+ .creator-link:hover .creator-arrow {
265
+ transform: translateX(4px);
266
+ color: #007bff;
267
+ }
268
+ .creator-link:hover {
269
+ color: #007bff;
270
+ text-shadow: 0 0 8px rgba(0, 191, 255, 0.6);
271
+ }
272
+ .link-arrow {
273
+ display: inline-block;
274
+ transition: transform 0.3s ease;
275
+ }
276
+ a:hover .link-arrow {
277
+ transform: translateX(3px);
278
+ }
279
+ .axolotl-container {
280
+ display: flex;
281
+ text-align: center;
282
+ justify-content: center;
283
+ margin: 30px 0;
284
+ }
285
+ .axolotl-container img {
286
+ max-width: 300px;
287
+ border-radius: 15px;
288
+ box-shadow: 0 6px 20px rgba(70, 130, 180, 0.4);
289
+ border: 2px solid rgba(135, 206, 235, 0.5);
290
+ transition: transform 0.3s ease;
291
+ display: block;
292
+ margin: 0 auto;
293
+ }
294
+ .axolotl-container img:hover {
295
+ transform: scale(1.05);
296
+ }
297
+ </style>
298
+ </head>
299
+ <body>
300
+ <div class="container">
301
+ <div class="header">
302
+ <h1>Plesio-32B</h1>
303
+ </div>
304
+ <div class="info">
305
+ <img src="https://files.catbox.moe/opd2nm.jpg" alt="Model banner">
306
+ <div style="text-align: center;">
307
+ <div class="creator-section">
308
+ <div class="creator-badge">
309
+ <span class="creator-label">Created by</span>
310
+ <a href="https://huggingface.co/Delta-Vector" target="_blank" class="creator-link">
311
+ <span class="creator-name">Delta-Vector</span>
312
+ <span class="creator-arrow">→</span>
313
+ </a>
314
+ </div>
315
+ </div>
316
+ <div class="model-info">
317
+ <h2>Model Information</h2>
318
+ <div class="info-card">
319
+ <div class="info-header">
320
+ <h3>Plesio-32B</h3>
321
+ <div class="model-tags">
322
+ <span class="model-tag">32B parameters</span>
323
+ <span class="model-tag">GLM-4 32B</span>
324
+ <span class="model-tag">Creative / Fresh Prose</span>
325
+ <span class="model-tag">Co-writing/Roleplay/Adventure Generalist</span>
326
+ </div>
327
+ </div>
328
+ <div class="model-description">
329
+ <p>Another Series of Merges! Since i could never beat Archaeo-32B-KTO! This time starting off with a GLM merge between Rei and Neon (thanks auri!!!)</p>
330
+ <p>Using the Oh-so-great 0.2 Slerp merge weight with Neon as the Base.</p>
331
+ <p>Support me on Ko-Fi: https://ko-fi.com/deltavector</p>
332
+ </div>
333
+ </div>
334
+ </div>
335
+ <div class="section">
336
+ <h2>Quantized Versions</h2>
337
+ <div class="info-card">
338
+ <div class="model-composition">
339
+ <h4>Available Downloads</h4>
340
+ <ul class="composition-list">
341
+ <li><span class="model-component"><a href="" target="_blank">GGUF Format</a></span>For use with LLama.cpp & Forks(Coming Soon!)</li>
342
+ <li><span class="model-component"><a href="" target="_blank">EXL2 Format</a></span>For use with TabbyAPI (Coming Soon!)</li>
343
+ <li><span class="model-component"><a href="" target="_blank">EXL3 Format</a></span>For use with TabbyAPI (Slower on Ampere))</li>
344
+ </ul>
345
+ </div>
346
+ </div>
347
+ </div>
348
+ <div class="section">
349
+ <h2>Prompting</h2>
350
+ <p>Model has been tuned with the GLM-4 formatting.</p>
351
+ </div>
352
+ <div class="section">
353
+ <h2>Samplers</h2>
354
+ <p>For testing of this model, I used Temp=1, 0.1 Min-P.</p>
355
+ <div class="metrics-section">
356
+ <details>
357
+ <summary>See Merging Config</summary>
358
+ <pre>https://files.catbox.moe/j9kyfy.yml<code>
359
+ </code></pre>
360
+ </details>
361
+ </div>
362
+ </div>
363
+ <div class="section">
364
+ <h2>Credits</h2>
365
+ <p>Thank you to <a href="https://huggingface.co/lucyknada">Lucy Knada</a>, <a href="https://huggingface.co/AuriAetherwiing">Auri</a>, <a href="https://huggingface.co/Ateron">Ateron</a>, <a href="https://huggingface.co/AliCat2">Alicat</a>, <a href="https://huggingface.co/intervitens">Intervitens</a>, <a href="https://huggingface.co/cgato">Cgato</a>, <a href="https://huggingface.co/kubernetes-bad">Kubernetes Bad</a> and the rest of <a href="https://huggingface.co/anthracite-org">Anthracite</a>.</p>
366
+ </div>
367
+ </div>
368
+ </div>
369
+ </body>
370
+ </html>