calcuis commited on
Commit
9a515fe
·
verified ·
1 Parent(s): adcb9be

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -24
README.md CHANGED
@@ -29,35 +29,29 @@ ggc o2
29
  >
30
  >GGUF file(s) available. Select which one for **codec**:
31
  >
32
- >1. codec-bf16.gguf
33
- >2. codec-f16.gguf
34
- >3. codec-f32.gguf
35
- >4. codec-q2_k.gguf
36
- >5. codec-q3_k_m.gguf
37
- >6. codec-q4_k_m.gguf (recommended)
38
- >7. codec-q5_k_m.gguf
39
- >8. codec-q6_k.gguf
40
- >9. model-bf16.gguf
41
- >10. model-f16.gguf
42
- >11. model-f32.gguf
43
  >
44
- >Enter your choice (1 to 11): 6
45
  >
46
  >GGUF file(s) available. Select which one for **model**:
47
  >
48
- >1. codec-bf16.gguf
49
- >2. codec-f16.gguf
50
- >3. codec-f32.gguf
51
- >4. codec-q2_k.gguf
52
- >5. codec-q3_k_m.gguf
53
- >6. codec-q4_k_m.gguf
54
- >7. codec-q5_k_m.gguf
55
- >8. codec-q6_k.gguf
56
- >9. model-bf16.gguf (recommended)
57
- >10. model-f16.gguf (for non-cuda user)
58
- >11. model-f32.gguf
59
  >
60
- >Enter your choice (1 to 11): _
61
  >
62
 
63
  - note: for the latest update, only tokenizer will be pulled to `models/fish` automatically during the first launch, you need to prepare the **codec** and **model** files yourself, working like [vision](https://huggingface.co/calcuis/llava-gguf) connector right away; mix and match, more flexible
 
29
  >
30
  >GGUF file(s) available. Select which one for **codec**:
31
  >
32
+ >1. codec-q2_k.gguf
33
+ >2. codec-q3_k_m.gguf
34
+ >3. codec-q4_k_m.gguf (recommended)
35
+ >4. codec-q5_k_m.gguf
36
+ >5. codec-q6_k.gguf
37
+ >6. model-bf16.gguf
38
+ >7. model-f16.gguf
39
+ >8. model-f32.gguf
 
 
 
40
  >
41
+ >Enter your choice (1 to 8): 3
42
  >
43
  >GGUF file(s) available. Select which one for **model**:
44
  >
45
+ >1. codec-q2_k.gguf
46
+ >2. codec-q3_k_m.gguf
47
+ >3. codec-q4_k_m.gguf
48
+ >4. codec-q5_k_m.gguf
49
+ >5. codec-q6_k.gguf
50
+ >6. model-bf16.gguf (recommended)
51
+ >7. model-f16.gguf (for non-cuda user)
52
+ >8. model-f32.gguf
 
 
 
53
  >
54
+ >Enter your choice (1 to 8): _
55
  >
56
 
57
  - note: for the latest update, only tokenizer will be pulled to `models/fish` automatically during the first launch, you need to prepare the **codec** and **model** files yourself, working like [vision](https://huggingface.co/calcuis/llava-gguf) connector right away; mix and match, more flexible