Skip to content

Commit

Permalink
docs: update ollama instructions
Browse files Browse the repository at this point in the history
  • Loading branch information
@mirkolenz
mirkolenz committed Apr 9, 2024
1 parent fcd6bbe commit 5eae393
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ Nix wrapper for running LLMs behind an OpenAI-compatible API proxy.
## Ollama Usage

```shell
# make sure to pull the models first
nix run github:recap-utr/nixllm#ollama -- pull MODEL_NAME
CUDA_VISIBLE_DEVICES=0 OLLAMA_HOST=0.0.0.0:6060 nix run github:recap-utr/nixllm#ollama -- serve
# then, in another terminal pull the models before performing API requests
OLLAMA_HOST=0.0.0.0:6060 nix run github:recap-utr/nixllm#ollama -- pull MODEL_NAME
```

0 comments on commit 5eae393

Please sign in to comment.