Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

running BGE-m3 model on Intel Gaudi #39

Open
sleepingcat4 opened this issue Jul 9, 2024 · 0 comments
Open

running BGE-m3 model on Intel Gaudi #39

sleepingcat4 opened this issue Jul 9, 2024 · 0 comments

Comments

@sleepingcat4
Copy link

I'm trying to run this embedding model on Intel Gaudi node. https://huggingface.co/BAAI/bge-m3

From my experience it sounds possible. I was thinking to use adapt_transformers class to adapt the HF classes for Gaudi using optimum habana. Unfortunately the habana_framework library is giving me errors and the tutorial is buggy.

https://github.com/HabanaAI/Gaudi-tutorials/blob/main/PyTorch/Hugging_Face_pipelines/image-classification.ipynb

Now, I am quite lost how can I run this model on Intel Gaudi. Can you provide some help? I looked into iPex library and it wasn't much helpful as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant