Hugging Face's logo

Spaces:
rustformers
/
mpt-7b-instruct
Runtime error

App Files Community
LLukas22 commited on
Commit
9a9dd8a
·
1 Parent(s): 29f77ca

Switch to q5_1 version

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -2,7 +2,7 @@ import gradio as gr
2
  from llm_rs import AutoModel,SessionConfig,GenerationConfig,Precision
3
 
4
  repo_name = "rustformers/mpt-7b-ggml"
5
- file_name = "mpt-7b-instruct-q4_0-ggjt.bin"
6
 
7
  examples = [
8
  "Write a travel blog about a 3-day trip to Thailand.",
 
2
  from llm_rs import AutoModel,SessionConfig,GenerationConfig,Precision
3
 
4
  repo_name = "rustformers/mpt-7b-ggml"
5
+ file_name = "mpt-7b-instruct-q5_1-ggjt.bin"
6
 
7
  examples = [
8
  "Write a travel blog about a 3-day trip to Thailand.",