Update README.md
Browse files
README.md
CHANGED
|
@@ -49,6 +49,8 @@ A more detailed evaluation scheme we have prepared can be found on [GitHub](http
|
|
| 49 |
|
| 50 |
**transformers >= 4.54.0**
|
| 51 |
|
|
|
|
|
|
|
| 52 |
```python
|
| 53 |
from transformers import AutoModelForCausalLM, AutoTokenizer, GenerationConfig
|
| 54 |
|
|
|
|
| 49 |
|
| 50 |
**transformers >= 4.54.0**
|
| 51 |
|
| 52 |
+
**It is recommended to use vLLM==0.10.1 or SGLang>=0.4.9.post6 for better inference performance.**
|
| 53 |
+
|
| 54 |
```python
|
| 55 |
from transformers import AutoModelForCausalLM, AutoTokenizer, GenerationConfig
|
| 56 |
|