Update README with model card for todoist
Browse files
README.md
CHANGED
|
@@ -568,6 +568,10 @@ response = tokenizer.decode(output[0][input_tokens['input_ids'].shape[1]:], skip
|
|
| 568 |
print("Response:", response)
|
| 569 |
```
|
| 570 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 571 |
For best results, provide detailed system-prompt to steer the tool-use behaviour.
|
| 572 |
|
| 573 |
# License
|
|
|
|
| 568 |
print("Response:", response)
|
| 569 |
```
|
| 570 |
|
| 571 |
+
## Deployment with vLLM
|
| 572 |
+
|
| 573 |
+
`vllm serve ojus1/Qwen3-0.6B-Instruct --enable-lora --lora-modules prem-research/Funcdex-0.6B=prem-research/Funcdex-0.6B-todoist --enable-auto-tool-choice --tool-call-parser hermes`
|
| 574 |
+
|
| 575 |
For best results, provide detailed system-prompt to steer the tool-use behaviour.
|
| 576 |
|
| 577 |
# License
|