How Do i Use it on Android
#23
by
walkingstatue
- opened
So, i am creating a project and android app based in java and i want to use this model.. how can i use it?
Hi @walkingstatue ,
Welcome to Google's Gemma family of open source models, thanks for reaching out to us. Yes you could able to utilize the google/embeddinggemma-300m model in your mobile phone or any edge devices, this model is designed and developed with less parameters in LLMs space (300 - Millions) which makes it more compatible to use it in edge devices. To run this model in edge devices first need to convert the model to a LiteRT based model which give the compatibility to run it on the model devices.
Please find the following resource to get to know more above conversion of model to edge device compatibility - ref.
Thanks.