Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use the Github Copilot as LLM provider #5761

Open
SohamTilekar opened this issue Dec 23, 2024 · 4 comments
Open

Use the Github Copilot as LLM provider #5761

SohamTilekar opened this issue Dec 23, 2024 · 4 comments
Labels
enhancement New feature or request

Comments

@SohamTilekar
Copy link

If Some One Have access to the GitHub Copilot Then We Should Be able to use it as a LLM provider, as it is free for the students Then can have to use it like it provides the o1 mini, 4o, 4, etc.

@SohamTilekar SohamTilekar added the enhancement New feature or request label Dec 23, 2024
@mamoodi
Copy link
Collaborator

mamoodi commented Dec 23, 2024

Hi there. Copilot still uses an LLM underneath to work. You need API access to that LLM to run OpenHands so this won't work. Unless you have free access to an LLM API which would be surprising.

@SohamTilekar
Copy link
Author

Like this Using the Unofficial API, as how VS-code, Zed makes the Call the the GitHub Copilot End point for chat & other things we can Also do that.
https://github.com/B00TK1D/copilot-api/blob/main/api.py

@enyst
Copy link
Collaborator

enyst commented Dec 24, 2024

The example API call you linked looks like a call from an editor's auto-complete, with a single string as prompt and a one-line response? I'm sorry, I don't see how that will work with openhands, because we have a much more complex prompt, system and tools, so best case, you'd make many calls to get a single response. But also copilot sends its own prompt, likely making the LLM ignore ours.

openhands doesn't ask LLMs for a line of code, and we don't ask just python code; we ask them for complex responses calling tools to perform actions.
(e.g. some actions are running bash, not outputting python)

If you want to see for yourself, try it: you can run openhands, see the prompt in logs, merge all context into a single string, and send it via that project to see what it does.

@SohamTilekar
Copy link
Author

theis this also have the chat api

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants