Submitting google models to leaderboard without setting up billing accounts on vertexai #1615
Unanswered
akshaykripalani
asked this question in
Q&A
Replies: 1 comment 1 reply
-
What API keys do you want to use? |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I want to submit the performance of google's text-embedding-005 model to the mteb leaderboard. I've read through the guide on how to add a model, contribution guidelines, but i cannot figure out how i can run this benchmark without setting up a billing account for vertexai.
Included is the code i wrote
Is there a way to do this using API keys? When I am developing with embedding models it lets me generate embeddings using that.
Beta Was this translation helpful? Give feedback.
All reactions