| | --- |
| | license: apache-2.0 |
| | base_model: |
| | - Maincode/Maincoder-1B |
| | library_name: transformers |
| | --- |
| | # Maincoder-1B - GGUF |
| |
|
| | ## About |
| | This repository contains GGUF weights for [Maincode/Maincoder-1B](https://huggingface.co/Maincode/Maincoder-1B). |
| |
|
| | For a convenient overview and download list, visit our [model page](https://huggingface.co/sthaps/Maincoder-1B). |
| |
|
| | ## Usage |
| | If you are unsure how to use GGUF files, refer to the [llama.cpp documentation](https://github.com/ggerganov/llama.cpp) for more details. |
| |
|
| | ### Llama.cpp CLI |
| | ```bash |
| | ./llama-cli -m Maincoder-1B-q4_k_m.gguf -p "Hello!" |
| | ``` |
| |
|
| | ## Provided Quants |
| |
|
| | (sorted by size, not necessarily quality) |
| |
|
| | | Link | Type | Size/GB | Notes | |
| | | :--- | :--- | :---: | :--- | |
| | | [GGUF](https://huggingface.co/sthaps/Maincoder-1B/blob/main/Maincoder-1B-q2_k.gguf) | q2_k | 0.46 | very low quality, for testing | |
| | | [GGUF](https://huggingface.co/sthaps/Maincoder-1B/blob/main/Maincoder-1B-q3_k_m.gguf) | q3_k_m | 0.54 | | |
| | | [GGUF](https://huggingface.co/sthaps/Maincoder-1B/blob/main/Maincoder-1B-q4_0.gguf) | q4_0 | 0.60 | | |
| | | [GGUF](https://huggingface.co/sthaps/Maincoder-1B/blob/main/Maincoder-1B-q4_k_m.gguf) | q4_k_m | 0.63 | recommended, good balance | |
| | | [GGUF](https://huggingface.co/sthaps/Maincoder-1B/blob/main/Maincoder-1B-q5_k_m.gguf) | q5_k_m | 0.71 | | |
| | | [GGUF](https://huggingface.co/sthaps/Maincoder-1B/blob/main/Maincoder-1B-q8_0.gguf) | q8_0 | 1.02 | near-full precision | |
| | |
| | ## Thanks |
| | Special thanks to the `llama.cpp` team for their amazing work. |
