docs: reorganize README for clarity on local setup and modal deployment
Browse files
README.md
CHANGED
|
@@ -25,19 +25,25 @@ cp .env.sample .env
|
|
| 25 |
uv sync --frozen
|
| 26 |
```
|
| 27 |
|
| 28 |
-
###
|
| 29 |
-
|
| 30 |
-
If your local GPU is not powerful enough to run "gpt-oss-20b", you can deploy it to Modal 🚀
|
| 31 |
|
| 32 |
```sh
|
| 33 |
-
uv run
|
| 34 |
-
uv run modal deploy src/unpredictable_lord/llm_modal.py
|
| 35 |
```
|
| 36 |
|
| 37 |
-
|
| 38 |
|
| 39 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 40 |
|
| 41 |
```sh
|
| 42 |
-
uv run
|
|
|
|
| 43 |
```
|
|
|
|
|
|
|
|
|
| 25 |
uv sync --frozen
|
| 26 |
```
|
| 27 |
|
| 28 |
+
### Run locally
|
|
|
|
|
|
|
| 29 |
|
| 30 |
```sh
|
| 31 |
+
uv run gradio app.py
|
|
|
|
| 32 |
```
|
| 33 |
|
| 34 |
+
## About Chat Tab
|
| 35 |
|
| 36 |
+
The Chat Tab is hidden by default, because it is not fully implemented yet.
|
| 37 |
+
|
| 38 |
+
To enable it, change `with gr.TabItem("Chat", visible=False):` to `with gr.TabItem("Chat", visible=True):` in `app.py`.
|
| 39 |
+
|
| 40 |
+
### Modal
|
| 41 |
+
|
| 42 |
+
If your local GPU is not powerful enough to run "gpt-oss-20b", you can deploy it to Modal 🚀
|
| 43 |
|
| 44 |
```sh
|
| 45 |
+
uv run modal setup
|
| 46 |
+
uv run modal deploy src/unpredictable_lord/chat/llm_modal.py
|
| 47 |
```
|
| 48 |
+
|
| 49 |
+
Then set `USE_MODAL=true` in your `.env` file.
|