Update README.md
Browse files
README.md
CHANGED
|
@@ -112,13 +112,8 @@ The capital city of South Korea is Seoul.
|
|
| 112 |
```
|
| 113 |
|
| 114 |
## How to use in vllm
|
| 115 |
-
|
| 116 |
-
|
| 117 |
-
Our model supports 32K seq length
|
| 118 |
-
|
| 119 |
-
The [PR](https://github.com/vllm-project/vllm/pull/27396) adding support for the Motif model in the official vLLM package is currently under review.
|
| 120 |
-
|
| 121 |
-
In the meantime, to use our model with vLLM, please use the following container [image](https://github.com/motiftechnologies/vllm/pkgs/container/vllm).
|
| 122 |
Our model supports a sequence length of up to 32K tokens.
|
| 123 |
```bash
|
| 124 |
# run vllm api server
|
|
|
|
| 112 |
```
|
| 113 |
|
| 114 |
## How to use in vllm
|
| 115 |
+
The [PR](https://github.com/vllm-project/vllm/pull/27396) adding support for the Motif model in the official vLLM package is currently under review.
|
| 116 |
+
In the meantime, to use our model with vLLM, please use the following container [image](https://github.com/motiftechnologies/vllm/pkgs/container/vllm).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 117 |
Our model supports a sequence length of up to 32K tokens.
|
| 118 |
```bash
|
| 119 |
# run vllm api server
|