You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When benchmarking ollama models in docker, I find I could not use the regular ollama api base url as in the documentation. What I needed was to use "http://host.docker.internal:11434" (MacOS). I thought it would be nice to update this in the benchmark documentation.
Version and model info
No response
The text was updated successfully, but these errors were encountered:
Unfortunately people may wish to poke different network holes to their docker images. It wouldn't be possible to document all the ways people might wish to do that.
Issue
When benchmarking ollama models in docker, I find I could not use the regular ollama api base url as in the documentation. What I needed was to use "http://host.docker.internal:11434" (MacOS). I thought it would be nice to update this in the benchmark documentation.
Version and model info
No response
The text was updated successfully, but these errors were encountered: