Remote TGI/TGI services with OAuth Client Credentials authentication #4

sgurunat · 2024-10-29T09:59:43Z

Description

To support remote TGI/TEI endpoints instead of running it locally along with if these endpoints are protected with OAuth Client Credentials flow.

New feature (non-breaking change which adds new functionality)
Added get_access_token method in utils.py to get the OAuth Client Credentials flow by taking parameters clientid, clientsecret and tokenurl from environment variables. Using utils.py so that the fucntion can be reused in multiple places.
```
Added authentication i.e Authorization header to pass the token in multiple components like embedding, llm-faqgen, llm-sumarization, llm-text-generation and reranking files. These components uses the common get_access_token method from utils.
```

…otected tgi and tei remote endpoints

…Uses get_access_token from utils

… tgi endpoints. Uses get_access_token from utils

…tgi endpoints. Uses get_access_token from utils

…r tgi endpoints. Uses get_access_token from utils

…s get_access_token from utils

for more information, see https://pre-commit.ci

sgurunat and others added 7 commits October 29, 2024 09:27

Add get_access_token method in utils.py to get the token for OAuth pr…

5982f53

…otected tgi and tei remote endpoints

Update embedding_tei.py to support authentication for tei endpoints. …

8eae983

…Uses get_access_token from utils

Update llm.py under llms faq-generation to support authentication for…

c42c523

… tgi endpoints. Uses get_access_token from utils

Update llm.py under llms summarization to support authentication for …

6b5089f

…tgi endpoints. Uses get_access_token from utils

Update llm.py under llms text-generation to support authentication fo…

9a8e582

…r tgi endpoints. Uses get_access_token from utils

Update reranking_tei to support authentication for tgi endpoints. Use…

5ef283f

…s get_access_token from utils

[pre-commit.ci] auto fixes from pre-commit.com hooks

18fa430

for more information, see https://pre-commit.ci