bibproj commited on
Commit
660ea36
·
verified ·
1 Parent(s): 7681d5e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -3
README.md CHANGED
@@ -1,5 +1,36 @@
1
  ---
2
  license: apache-2.0
3
- base_model:
4
- - stepfun-ai/Step-3.5-Flash
5
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ base_model: stepfun-ai/Step-3.5-Flash
4
+ library_name: mlx
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - mlx
8
+ ---
9
+
10
+ # mlx-community/Step-3.5-Flash-bf16
11
+
12
+ This model [mlx-community/Step-3.5-Flash-bf16](https://huggingface.co/mlx-community/Step-3.5-Flash-bf16) was
13
+ converted to MLX format from [stepfun-ai/Step-3.5-Flash](https://huggingface.co/stepfun-ai/Step-3.5-Flash)
14
+ using mlx-lm version **0.30.7**.
15
+
16
+ ## Use with mlx
17
+
18
+ ```bash
19
+ pip install mlx-lm
20
+ ```
21
+
22
+ ```python
23
+ from mlx_lm import load, generate
24
+
25
+ model, tokenizer = load("mlx-community/Step-3.5-Flash-bf16")
26
+
27
+ prompt = "hello"
28
+
29
+ if tokenizer.chat_template is not None:
30
+ messages = [{"role": "user", "content": prompt}]
31
+ prompt = tokenizer.apply_chat_template(
32
+ messages, add_generation_prompt=True, return_dict=False,
33
+ )
34
+
35
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
36
+ ```