VOLTA GPU compatibility
#6
by
ivanwaldon
- opened
May I use the MXFP4 model on Nvidia Tesla V100? And do I need download text encoder using this model?
not sure the torch version supports v100 or not, you might need some custom configs; if you use gguf-connector, all other files, i.e., text encoder, tokenizer, vae, etc. will be pulled to cache automatically