Spaces:

Duplicated from Luigi/ZeroGPU-LLM-Inference

YUGOROU
/

ZeroGPU-LLM-Inference

Running on Zero

App Files Files Community

ZeroGPU-LLM-Inference

Commit History

Update README.md

d6f7cc4
verified

Luigi commited on Apr 12, 2025

fix readme

c62b652

Luigi commited on Apr 12, 2025

switch to gradio version for stability reason

a703203

Luigi commited on Apr 12, 2025

add taiwan tinyllama

794ee70

Luigi commited on Apr 11, 2025

Improve responsiveness by asynchronously retrieving web search context

acda3f1

Luigi commited on Apr 11, 2025

update requirements

12731c2

Luigi commited on Apr 11, 2025

specify wheel of llama cpp python

f200cb7

Luigi commited on Apr 11, 2025

openblas build of llam acpp filed

66a3cb6

Luigi commited on Apr 11, 2025

specify to build llama cpp with openblas

e883a1b

Luigi commited on Apr 11, 2025

add llama 3.2 taiwan 3b

b1544e2

Luigi commited on Apr 11, 2025

add minicpm3 4b

f5c0811

Luigi commited on Apr 11, 2025

increase xt length to max

629495e

Luigi commited on Apr 11, 2025

remove all moe

fafc8cb

Luigi commited on Apr 11, 2025

remove qwen 1.5 moe

6735035

Luigi commited on Apr 11, 2025

adjust title style

e9559bd

Luigi commited on Apr 11, 2025

use another version of qwen 1.5 moe

96e60d6

Luigi commited on Apr 11, 2025

add Qwen1.5-MoE

e17afaf

Luigi commited on Apr 11, 2025

Qwen2.5-MOE-6x1.5B

5eca666

Luigi commited on Apr 11, 2025

remove under 3b models

617be26

Luigi commited on Apr 11, 2025

Add model caching

d33dfcd

Luigi commited on Apr 11, 2025

UI/UX Improvement

eb215ff

Luigi commited on Apr 11, 2025

reset timeout timer once a new token is generated

35943b1

Luigi commited on Apr 11, 2025

open web search settgins to user

c9fd924

Luigi commited on Apr 10, 2025

add 2 more models

f7a541f

Luigi commited on Apr 10, 2025

apply new settings on duckduck search

d9421eb

Luigi commited on Apr 10, 2025

tune llama paramters

20484f3

Luigi commited on Apr 10, 2025

increase max_chars_per_result to 600

1155897

Luigi commited on Apr 10, 2025

increase max results to 6 for better web search

0c2fe1d

Luigi commited on Apr 10, 2025

increase ctx lenght to 2k

9ba47d1

Luigi commited on Apr 10, 2025

increase timeout to 5min

71d28c5

Luigi commited on Apr 10, 2025

Code simplification

248f5a7

Luigi commited on Apr 10, 2025

Enable speculattive decoding

a7fdfe6

Luigi commited on Apr 10, 2025

fix role disorder error in history

06a162a

Luigi commited on Apr 10, 2025

Add internet search feature

4e60755

Luigi commited on Apr 10, 2025

fix reasonning model's thought process display

9d3ca6c

Luigi commited on Apr 10, 2025

bugfix

4522453

Luigi commited on Apr 10, 2025

fix for multi-turn conv.

6c77ec7

Luigi commited on Apr 10, 2025

bugfix for think tag handling

14564aa

Luigi commited on Apr 10, 2025

support reasoning tag

5db22d5

Luigi commited on Apr 10, 2025

add missing part of app.py

afa19a3

Luigi commited on Apr 10, 2025

fix readme error due to short description length

1bd76fd

Luigi commited on Apr 10, 2025

add 4 new models

d554072

Luigi commited on Apr 10, 2025

fix error : ValueError: Conversation roles must alternate user/assistant/user/assistant

3e4847c

Luigi commited on Apr 10, 2025

upgrade llamacpp version

b6129d9

Luigi commited on Apr 10, 2025

fault-free model loading

6e8312c

Luigi commited on Apr 10, 2025

add storage indicator

cc91a1a

Luigi commited on Apr 10, 2025

improve model management

0813164

Luigi commited on Apr 10, 2025

improve storage management

37ee1f3

Luigi commited on Apr 10, 2025

fix yaml error

3190ad6

Luigi commited on Apr 10, 2025

provide more models, secure memory usage

cd26609

Luigi commited on Apr 10, 2025