Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: enable Azure OpenAPI #41

Open
lipkau opened this issue Mar 26, 2024 · 1 comment
Open

Feature Request: enable Azure OpenAPI #41

lipkau opened this issue Mar 26, 2024 · 1 comment

Comments

@lipkau
Copy link

lipkau commented Mar 26, 2024

Hello.

I would love to use your tool; unfortunately I am restricted to use LLMs hosted by my company.
I have an Azure hosted OpenAPI and would love to be able to overwrite the API endpoint.

Here is an example of a request:

curl https://MY_RESOURCE_NAME.openai.azure.com/openai/deployments/MY_DEPLYOMENT_NAME/chat/completions?api-version=2023-05-15 \
  -H "Content-Type: application/json" \
  -H "api-key: MY_API_KEY" \
  -d '{"messages":[{"role": "system", "content": "You are a helpful assistant."},{"role": "user", "content": "Does Azure OpenAI support customer managed keys?"},{"role": "assistant", "content": "Yes, customer managed keys are supported by Azure OpenAI."},{"role": "user", "content": "Do other Azure AI services support this too?"}]}'

docs

here is an implementation from a raycast plugin which supports both openai.com and azure:
https://github.com/raycast/extensions/blob/beb950d86ecebbb2d8f6e6d27cbadd0959f9ca11/extensions/chatgpt/src/hooks/useChat.tsx

@lipkau lipkau closed this as not planned Won't fix, can't repro, duplicate, stale Mar 26, 2024
@lipkau lipkau reopened this Mar 26, 2024
@lipkau
Copy link
Author

lipkau commented Mar 26, 2024

I created a POC here:
#42

I didn't write documentation in the readme yet.
I would do so once I get feedback if this change is worth the while.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant