Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmarking Ollama models #2208

Open
chemcoder-2020 opened this issue Oct 31, 2024 · 2 comments
Open

Benchmarking Ollama models #2208

chemcoder-2020 opened this issue Oct 31, 2024 · 2 comments
Labels
question Further information is requested

Comments

@chemcoder-2020
Copy link

Issue

When benchmarking ollama models in docker, I find I could not use the regular ollama api base url as in the documentation. What I needed was to use "http://host.docker.internal:11434" (MacOS). I thought it would be nice to update this in the benchmark documentation.

Version and model info

No response

@paul-gauthier
Copy link
Collaborator

Thanks for trying aider and filing this issue.

Unfortunately people may wish to poke different network holes to their docker images. It wouldn't be possible to document all the ways people might wish to do that.

@paul-gauthier paul-gauthier added the question Further information is requested label Oct 31, 2024
@chemcoder-2020
Copy link
Author

Well. Something to start with would be nice. I didn't expect to use a different URL for Ollama than what was in the documentation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants