Hugging Face's logo

HarshM12
/
model

Transformers
GGUF
English
llama
text-generation-inference
unsloth
conversational
Model card Files
xet
Community
HarshM12 commited on
Commit
2a21707
·
verified ·
1 Parent(s): aa88d19

(Trained with Unsloth)

Browse files
Files changed (1) hide show
  1. Modelfile +2 -2
Modelfile CHANGED
@@ -1,12 +1,12 @@
1
- FROM /content/HarshM12/model/unsloth.F16.gguf
2
 
3
  TEMPLATE """{{ if .System }}{{ .System }}{{ end }}{{ if .Prompt }}
4
  USER: {{ .Prompt }}{{ end }}
5
  ASSISTANT: {{ .Response }}<|end_of_text|>"""
6
 
7
- PARAMETER stop "<|start_header_id|>"
8
  PARAMETER stop "<|end_header_id|>"
9
  PARAMETER stop "<|eot_id|>"
 
10
  PARAMETER stop "<|end_of_text|>"
11
  PARAMETER stop "<|reserved_special_token_"
12
  PARAMETER temperature 1.5
 
1
+ FROM /content/HarshM12/model/unsloth.Q8_0.gguf
2
 
3
  TEMPLATE """{{ if .System }}{{ .System }}{{ end }}{{ if .Prompt }}
4
  USER: {{ .Prompt }}{{ end }}
5
  ASSISTANT: {{ .Response }}<|end_of_text|>"""
6
 
 
7
  PARAMETER stop "<|end_header_id|>"
8
  PARAMETER stop "<|eot_id|>"
9
+ PARAMETER stop "<|start_header_id|>"
10
  PARAMETER stop "<|end_of_text|>"
11
  PARAMETER stop "<|reserved_special_token_"
12
  PARAMETER temperature 1.5