SiddhJagani commited on
Commit
eb89ecf
·
verified ·
1 Parent(s): 6f7d3fc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -5
README.md CHANGED
@@ -5,14 +5,18 @@ library_name: transformers
5
  tags:
6
  - vllm
7
  - mlx
8
- - mlx-my-repo
 
 
 
 
9
  base_model: openai/gpt-oss-safeguard-20b
10
- base_model_relation: finetune
11
  ---
12
 
13
  # SiddhJagani/gpt-oss-safeguard-20b-mlx-8Bit
14
 
15
- The Model [SiddhJagani/gpt-oss-safeguard-20b-mlx-8Bit](https://huggingface.co/SiddhJagani/gpt-oss-safeguard-20b-mlx-8Bit) was converted to MLX format from [openai/gpt-oss-safeguard-20b](https://huggingface.co/openai/gpt-oss-safeguard-20b) using mlx-lm version **0.28.2**.
16
 
17
  ## Use with mlx
18
 
@@ -23,7 +27,7 @@ pip install mlx-lm
23
  ```python
24
  from mlx_lm import load, generate
25
 
26
- model, tokenizer = load("SiddhJagani/gpt-oss-safeguard-20b-mlx-8Bit")
27
 
28
  prompt="hello"
29
 
@@ -34,4 +38,4 @@ if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not
34
  )
35
 
36
  response = generate(model, tokenizer, prompt=prompt, verbose=True)
37
- ```
 
5
  tags:
6
  - vllm
7
  - mlx
8
+ - gpt
9
+ - gpt-oss
10
+ - gpt-oss-safeguard
11
+ - openai
12
+ - lmstudio
13
  base_model: openai/gpt-oss-safeguard-20b
14
+ base_model_relation: quantized
15
  ---
16
 
17
  # SiddhJagani/gpt-oss-safeguard-20b-mlx-8Bit
18
 
19
+ The Model [SiddhJagani/gpt-oss-safeguard-20b-mlx-8Bit](https://huggingface.co/SiddhJagani/gpt-oss-safeguard-20b-mlx-Q8) was converted to MLX format from [openai/gpt-oss-safeguard-20b](https://huggingface.co/openai/gpt-oss-safeguard-20b) using mlx-lm version **0.28.2**.
20
 
21
  ## Use with mlx
22
 
 
27
  ```python
28
  from mlx_lm import load, generate
29
 
30
+ model, tokenizer = load("SiddhJagani/gpt-oss-safeguard-20b-mlx-Q8")
31
 
32
  prompt="hello"
33
 
 
38
  )
39
 
40
  response = generate(model, tokenizer, prompt=prompt, verbose=True)
41
+ ```