3 2

Sapbot

sapbot

sapbotgit

AI & ML interests

None yet

Recent Activity

replied to kostakoff's post about 23 hours ago

I found it very funny that the Hugging Face profile has a specific section where we can share our hardware. It really brings back memories of the good old days when we used to flex our custom PC specs on enthusiast forums 20 years ago! That inspired me to fill out my own profile and share it here. And this is my first set of GPUs that I am using to learn MLOps: - RTX 3090 – the best one; unfortunately it doesn't support the latest FP8 and FP4, but it’s still very powerful. - Tesla V100 – performance is almost like the RTX 3090, just much older. - Tesla P100 – old, and doesn't have tensor cores, but still can handle small models. - Radeon MI50 – old, similar to the P100, but uses ROCm instead of CUDA, which is actually a pretty good experience to setup. - GTX 1080 Ti – mostly useless, no FP16 support. - GTX 1660 – first generation of the Turing architecture, but mostly useless. https://huggingface.co/llmlaba

replied to kostakoff's post 2 days ago

updated a model 5 days ago

sapbot/7.6M-Chaos-Engine

View all activity

Organizations

replied to kostakoff's post about 23 hours ago

I don't think the filters filter by hardware vs model card?
As far as I can see they let you filter by app, inference provider, etc. But not hardware

I thought you are about seeing if you can run model in model card. Yeah, you can't filter by hardware compatibility. Also you can't filter by model type (Quantization/Base/Adapter/Fine-tune) (Leaving this there because I thought it will be cool feature too).