Skip to content

Commit

Permalink
Update InferenceEndpointsLLM to use chat_completion method (#815)
Browse files Browse the repository at this point in the history
* Update `InferenceEndpointsLLM` to use `chat_completion` method

* Fix unit test

* Fix unit test for python 3.8
  • Loading branch information
gabrielmbmb authored Jul 23, 2024
1 parent 54ecc38 commit 779ef41
Show file tree
Hide file tree
Showing 3 changed files with 409 additions and 223 deletions.
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ anthropic = ["anthropic >= 0.20.0"]
argilla = ["argilla >= 1.29.0"]
cohere = ["cohere >= 5.2.0"]
groq = ["groq >= 0.4.1"]
hf-inference-endpoints = ["huggingface_hub >= 0.19.0"]
hf-inference-endpoints = ["huggingface_hub >= 0.22.0"]
hf-transformers = ["transformers >= 4.34.1", "torch >= 2.0.0"]
instructor = ["instructor >= 1.2.3"]
litellm = ["litellm >= 1.30.0"]
Expand Down
Loading

0 comments on commit 779ef41

Please sign in to comment.