leonsarmiento commited on
Commit
f9cb9aa
·
verified ·
1 Parent(s): 0d0e936

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -43,6 +43,13 @@ using mlx-lm version **0.28.3**.
43
 
44
  MIXED QUANT: 6-BIT EMBEDDING AND PREDICTION LAYERS, 4-BIT EVERYTHING ELSE.
45
 
 
 
 
 
 
 
 
46
 
47
 
48
  ## Use with mlx
 
43
 
44
  MIXED QUANT: 6-BIT EMBEDDING AND PREDICTION LAYERS, 4-BIT EVERYTHING ELSE.
45
 
46
+ Temperature: 0.6 Top K: 20 Repeat penalty: OFF Min P sampling: OFF Top P sampling: 0.95
47
+
48
+ SYSTEM PROMPT:
49
+
50
+ "You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem."
51
+
52
+
53
 
54
 
55
  ## Use with mlx