Can I use vllm to delopy 241b model on 8 80g gpus?

#6
by Curitis7 - opened

Can I use vllm to delopy 241b model on 8 gpus?

Sign up or log in to comment