Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

llama stack run: error: File local-ollama does not exist. Did you run llama stack build? #72

Open
JoseGuilherme1904 opened this issue Sep 14, 2024 · 1 comment
Open

llama stack run: error: File local-ollama does not exist. Did you run llama stack build? #72

JoseGuilherme1904 opened this issue Sep 14, 2024 · 1 comment

Comments

@JoseGuilherme1904
Copy link

llama stack build
Enter value for name (required): ollama
Enter value for distribution (default: local) (required): local-ollama
Enter value for api_providers (optional):
Enter value for image_type (default: conda) (required):
Build ollama exists; will reconfigure
Conda environment 'llamastack-ollama' exists. Checking Python version...
Environment 'llamastack-ollama' already has Python 3.10. No action needed.
Requirement already satisfied: llama-toolchain in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (0.0.15)
Requirement already satisfied: blobfile in /home/guilherme/.local/lib/python3.10/site-packages (from llama-toolchain) (3.0.0)
Requirement already satisfied: fire in /home/guilherme/.local/lib/python3.10/site-packages (from llama-toolchain) (0.6.0)
Requirement already satisfied: httpx in /home/guilherme/.local/lib/python3.10/site-packages (from llama-toolchain) (0.27.2)
Requirement already satisfied: huggingface-hub in /home/guilherme/.local/lib/python3.10/site-packages (from llama-toolchain) (0.24.7)
Requirement already satisfied: llama-models>=0.0.15 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from llama-toolchain) (0.0.15)
Requirement already satisfied: pydantic in /home/guilherme/.local/lib/python3.10/site-packages (from llama-toolchain) (2.8.2)
Requirement already satisfied: requests in /home/guilherme/.local/lib/python3.10/site-packages (from llama-toolchain) (2.32.3)
Requirement already satisfied: termcolor in /home/guilherme/.local/lib/python3.10/site-packages (from llama-toolchain) (2.3.0)
Requirement already satisfied: PyYAML in /home/guilherme/.local/lib/python3.10/site-packages (from llama-models>=0.0.15->llama-toolchain) (6.0.1)
Requirement already satisfied: jinja2 in /home/guilherme/.local/lib/python3.10/site-packages (from llama-models>=0.0.15->llama-toolchain) (3.1.2)
Requirement already satisfied: tiktoken in /home/guilherme/.local/lib/python3.10/site-packages (from llama-models>=0.0.15->llama-toolchain) (0.6.0)
Requirement already satisfied: pycryptodomex>=3.8 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from blobfile->llama-toolchain) (3.20.0)
Requirement already satisfied: urllib3<3,>=1.25.3 in /home/guilherme/.local/lib/python3.10/site-packages (from blobfile->llama-toolchain) (2.2.1)
Requirement already satisfied: lxml>=4.9 in /home/guilherme/.local/lib/python3.10/site-packages (from blobfile->llama-toolchain) (5.3.0)
Requirement already satisfied: filelock>=3.0 in /home/guilherme/.local/lib/python3.10/site-packages (from blobfile->llama-toolchain) (3.13.1)
Requirement already satisfied: six in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from fire->llama-toolchain) (1.16.0)
Requirement already satisfied: anyio in /home/guilherme/.local/lib/python3.10/site-packages (from httpx->llama-toolchain) (3.7.1)
Requirement already satisfied: certifi in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from httpx->llama-toolchain) (2024.8.30)
Requirement already satisfied: httpcore==1.* in /home/guilherme/.local/lib/python3.10/site-packages (from httpx->llama-toolchain) (1.0.2)
Requirement already satisfied: idna in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from httpx->llama-toolchain) (3.8)
Requirement already satisfied: sniffio in /home/guilherme/.local/lib/python3.10/site-packages (from httpx->llama-toolchain) (1.3.0)
Requirement already satisfied: h11<0.15,>=0.13 in /home/guilherme/.local/lib/python3.10/site-packages (from httpcore==1.->httpx->llama-toolchain) (0.14.0)
Requirement already satisfied: fsspec>=2023.5.0 in /home/guilherme/.local/lib/python3.10/site-packages (from huggingface-hub->llama-toolchain) (2023.10.0)
Requirement already satisfied: packaging>=20.9 in /home/guilherme/.local/lib/python3.10/site-packages (from huggingface-hub->llama-toolchain) (23.2)
Requirement already satisfied: tqdm>=4.42.1 in /home/guilherme/.local/lib/python3.10/site-packages (from huggingface-hub->llama-toolchain) (4.66.2)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /home/guilherme/.local/lib/python3.10/site-packages (from huggingface-hub->llama-toolchain) (4.12.2)
Requirement already satisfied: annotated-types>=0.4.0 in /home/guilherme/.local/lib/python3.10/site-packages (from pydantic->llama-toolchain) (0.7.0)
Requirement already satisfied: pydantic-core==2.20.1 in /home/guilherme/.local/lib/python3.10/site-packages (from pydantic->llama-toolchain) (2.20.1)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/guilherme/.local/lib/python3.10/site-packages (from requests->llama-toolchain) (3.3.2)
Requirement already satisfied: exceptiongroup in /home/guilherme/.local/lib/python3.10/site-packages (from anyio->httpx->llama-toolchain) (1.2.2)
Requirement already satisfied: MarkupSafe>=2.0 in /home/guilherme/.local/lib/python3.10/site-packages (from jinja2->llama-models>=0.0.15->llama-toolchain) (2.1.3)
Requirement already satisfied: regex>=2022.1.18 in /home/guilherme/.local/lib/python3.10/site-packages (from tiktoken->llama-models>=0.0.15->llama-toolchain) (2023.10.3)
Installing pip dependencies: fastapi uvicorn ollama accelerate codeshield torch transformers codeshield matplotlib pillow pandas scikit-learn torch transformers blobfile chardet pypdf sentence-transformers faiss-cpu
Requirement already satisfied: fastapi in /home/guilherme/.local/lib/python3.10/site-packages (0.114.2)
Requirement already satisfied: uvicorn in /home/guilherme/.local/lib/python3.10/site-packages (0.30.6)
Requirement already satisfied: ollama in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (0.3.3)
Requirement already satisfied: accelerate in /home/guilherme/.local/lib/python3.10/site-packages (0.21.0)
Requirement already satisfied: codeshield in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (1.0.1)
Requirement already satisfied: torch in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (2.4.1)
Requirement already satisfied: transformers in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (4.44.2)
Requirement already satisfied: matplotlib in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (3.9.2)
Requirement already satisfied: pillow in /home/guilherme/.local/lib/python3.10/site-packages (10.2.0)
Requirement already satisfied: pandas in /home/guilherme/.local/lib/python3.10/site-packages (2.1.3)
Requirement already satisfied: scikit-learn in /home/guilherme/.local/lib/python3.10/site-packages (1.2.2)
Requirement already satisfied: blobfile in /home/guilherme/.local/lib/python3.10/site-packages (3.0.0)
Requirement already satisfied: chardet in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (5.2.0)
Requirement already satisfied: pypdf in /home/guilherme/.local/lib/python3.10/site-packages (4.1.0)
Requirement already satisfied: sentence-transformers in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (3.1.0)
Requirement already satisfied: faiss-cpu in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (1.8.0.post1)
Requirement already satisfied: starlette<0.39.0,>=0.37.2 in /home/guilherme/.local/lib/python3.10/site-packages (from fastapi) (0.38.5)
Requirement already satisfied: pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4 in /home/guilherme/.local/lib/python3.10/site-packages (from fastapi) (2.8.2)
Requirement already satisfied: typing-extensions>=4.8.0 in /home/guilherme/.local/lib/python3.10/site-packages (from fastapi) (4.12.2)
Requirement already satisfied: click>=7.0 in /home/guilherme/.local/lib/python3.10/site-packages (from uvicorn) (8.1.7)
Requirement already satisfied: h11>=0.8 in /home/guilherme/.local/lib/python3.10/site-packages (from uvicorn) (0.14.0)
Requirement already satisfied: httpx<0.28.0,>=0.27.0 in /home/guilherme/.local/lib/python3.10/site-packages (from ollama) (0.27.2)
Requirement already satisfied: numpy>=1.17 in /home/guilherme/.local/lib/python3.10/site-packages (from accelerate) (1.26.2)
Requirement already satisfied: packaging>=20.0 in /home/guilherme/.local/lib/python3.10/site-packages (from accelerate) (23.2)
Requirement already satisfied: psutil in /home/guilherme/.local/lib/python3.10/site-packages (from accelerate) (5.9.6)
Requirement already satisfied: pyyaml in /home/guilherme/.local/lib/python3.10/site-packages (from accelerate) (6.0.1)
Requirement already satisfied: semgrep>1.68 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from codeshield) (1.87.0)
Requirement already satisfied: filelock in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (3.13.1)
Requirement already satisfied: sympy in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (1.12)
Requirement already satisfied: networkx in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (3.2.1)
Requirement already satisfied: jinja2 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (3.1.2)
Requirement already satisfied: fsspec in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (2023.10.0)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.1.105 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (12.1.105)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.1.105 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (12.1.105)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.1.105 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (12.1.105)
Requirement already satisfied: nvidia-cudnn-cu12==9.1.0.70 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (9.1.0.70)
Requirement already satisfied: nvidia-cublas-cu12==12.1.3.1 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (12.1.3.1)
Requirement already satisfied: nvidia-cufft-cu12==11.0.2.54 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (11.0.2.54)
Requirement already satisfied: nvidia-curand-cu12==10.3.2.106 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (10.3.2.106)
Requirement already satisfied: nvidia-cusolver-cu12==11.4.5.107 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (11.4.5.107)
Requirement already satisfied: nvidia-cusparse-cu12==12.1.0.106 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (12.1.0.106)
Requirement already satisfied: nvidia-nccl-cu12==2.20.5 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (2.20.5)
Requirement already satisfied: nvidia-nvtx-cu12==12.1.105 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (12.1.105)
Requirement already satisfied: triton==3.0.0 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (3.0.0)
Requirement already satisfied: nvidia-nvjitlink-cu12 in /home/guilherme/.local/lib/python3.10/site-packages (from nvidia-cusolver-cu12==11.4.5.107->torch) (12.3.101)
Requirement already satisfied: huggingface-hub<1.0,>=0.23.2 in /home/guilherme/.local/lib/python3.10/site-packages (from transformers) (0.24.7)
Requirement already satisfied: regex!=2019.12.17 in /home/guilherme/.local/lib/python3.10/site-packages (from transformers) (2023.10.3)
Requirement already satisfied: requests in /home/guilherme/.local/lib/python3.10/site-packages (from transformers) (2.32.3)
Requirement already satisfied: safetensors>=0.4.1 in /home/guilherme/.local/lib/python3.10/site-packages (from transformers) (0.4.2)
Requirement already satisfied: tokenizers<0.20,>=0.19 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from transformers) (0.19.1)
Requirement already satisfied: tqdm>=4.27 in /home/guilherme/.local/lib/python3.10/site-packages (from transformers) (4.66.2)
Requirement already satisfied: contourpy>=1.0.1 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from matplotlib) (1.3.0)
Requirement already satisfied: cycler>=0.10 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from matplotlib) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from matplotlib) (4.53.1)
Requirement already satisfied: kiwisolver>=1.3.1 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from matplotlib) (1.4.7)
Requirement already satisfied: pyparsing>=2.3.1 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from matplotlib) (3.1.4)
Requirement already satisfied: python-dateutil>=2.7 in /home/guilherme/.local/lib/python3.10/site-packages (from matplotlib) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in /home/guilherme/.local/lib/python3.10/site-packages (from pandas) (2024.1)
Requirement already satisfied: tzdata>=2022.1 in /home/guilherme/.local/lib/python3.10/site-packages (from pandas) (2023.3)
Requirement already satisfied: scipy>=1.3.2 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from scikit-learn) (1.14.1)
Requirement already satisfied: joblib>=1.1.1 in /home/guilherme/.local/lib/python3.10/site-packages (from scikit-learn) (1.3.2)
Requirement already satisfied: threadpoolctl>=2.0.0 in /home/guilherme/.local/lib/python3.10/site-packages (from scikit-learn) (3.2.0)
Requirement already satisfied: pycryptodomex>=3.8 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from blobfile) (3.20.0)
Requirement already satisfied: urllib3<3,>=1.25.3 in /home/guilherme/.local/lib/python3.10/site-packages (from blobfile) (2.2.1)
Requirement already satisfied: lxml>=4.9 in /home/guilherme/.local/lib/python3.10/site-packages (from blobfile) (5.3.0)
Requirement already satisfied: anyio in /home/guilherme/.local/lib/python3.10/site-packages (from httpx<0.28.0,>=0.27.0->ollama) (3.7.1)
Requirement already satisfied: certifi in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from httpx<0.28.0,>=0.27.0->ollama) (2024.8.30)
Requirement already satisfied: httpcore==1. in /home/guilherme/.local/lib/python3.10/site-packages (from httpx<0.28.0,>=0.27.0->ollama) (1.0.2)
Requirement already satisfied: idna in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from httpx<0.28.0,>=0.27.0->ollama) (3.8)
Requirement already satisfied: sniffio in /home/guilherme/.local/lib/python3.10/site-packages (from httpx<0.28.0,>=0.27.0->ollama) (1.3.0)
Requirement already satisfied: annotated-types>=0.4.0 in /home/guilherme/.local/lib/python3.10/site-packages (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4->fastapi) (0.7.0)
Requirement already satisfied: pydantic-core==2.20.1 in /home/guilherme/.local/lib/python3.10/site-packages (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4->fastapi) (2.20.1)
Requirement already satisfied: six>=1.5 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from python-dateutil>=2.7->matplotlib) (1.16.0)
Requirement already satisfied: attrs>=21.3 in /home/guilherme/.local/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (23.1.0)
Requirement already satisfied: boltons~=21.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (21.0.0)
Requirement already satisfied: click-option-group~=0.5 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (0.5.6)
Requirement already satisfied: colorama~=0.4.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (0.4.6)
Requirement already satisfied: defusedxml~=0.7.1 in /home/guilherme/.local/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (0.7.1)
Requirement already satisfied: exceptiongroup~=1.2.0 in /home/guilherme/.local/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (1.2.2)
Requirement already satisfied: glom~=22.1 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (22.1.0)
Requirement already satisfied: jsonschema~=4.6 in /home/guilherme/.local/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (4.20.0)
Requirement already satisfied: opentelemetry-api~=1.25.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (1.25.0)
Requirement already satisfied: opentelemetry-sdk~=1.25.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (1.25.0)
Requirement already satisfied: opentelemetry-exporter-otlp-proto-http~=1.25.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (1.25.0)
Requirement already satisfied: opentelemetry-instrumentation-requests~=0.46b0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (0.46b0)
Requirement already satisfied: peewee~=3.14 in /home/guilherme/.local/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (3.17.6)
Requirement already satisfied: rich~=13.5.2 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (13.5.3)
Requirement already satisfied: ruamel.yaml<0.18,>=0.16.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (0.17.40)
Requirement already satisfied: tomli~=2.0.1 in /home/guilherme/.local/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (2.0.1)
Requirement already satisfied: wcmatch~=8.3 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (8.5.2)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/guilherme/.local/lib/python3.10/site-packages (from requests->transformers) (3.3.2)
Requirement already satisfied: MarkupSafe>=2.0 in /home/guilherme/.local/lib/python3.10/site-packages (from jinja2->torch) (2.1.3)
Requirement already satisfied: mpmath>=0.19 in /home/guilherme/.local/lib/python3.10/site-packages (from sympy->torch) (1.3.0)
Requirement already satisfied: face>=20.1.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from glom~=22.1->semgrep>1.68->codeshield) (22.0.0)
Requirement already satisfied: jsonschema-specifications>=2023.03.6 in /home/guilherme/.local/lib/python3.10/site-packages (from jsonschema~=4.6->semgrep>1.68->codeshield) (2023.11.1)
Requirement already satisfied: referencing>=0.28.4 in /home/guilherme/.local/lib/python3.10/site-packages (from jsonschema~=4.6->semgrep>1.68->codeshield) (0.31.0)
Requirement already satisfied: rpds-py>=0.7.1 in /home/guilherme/.local/lib/python3.10/site-packages (from jsonschema~=4.6->semgrep>1.68->codeshield) (0.13.0)
Requirement already satisfied: deprecated>=1.2.6 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-api~=1.25.0->semgrep>1.68->codeshield) (1.2.14)
Requirement already satisfied: importlib-metadata<=7.1,>=6.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-api~=1.25.0->semgrep>1.68->codeshield) (7.1.0)
Requirement already satisfied: googleapis-common-protos~=1.52 in /home/guilherme/.local/lib/python3.10/site-packages (from opentelemetry-exporter-otlp-proto-http~=1.25.0->semgrep>1.68->codeshield) (1.62.0)
Requirement already satisfied: opentelemetry-exporter-otlp-proto-common==1.25.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-exporter-otlp-proto-http~=1.25.0->semgrep>1.68->codeshield) (1.25.0)
Requirement already satisfied: opentelemetry-proto==1.25.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-exporter-otlp-proto-http~=1.25.0->semgrep>1.68->codeshield) (1.25.0)
Requirement already satisfied: protobuf<5.0,>=3.19 in /home/guilherme/.local/lib/python3.10/site-packages (from opentelemetry-proto==1.25.0->opentelemetry-exporter-otlp-proto-http~=1.25.0->semgrep>1.68->codeshield) (4.23.4)
Requirement already satisfied: opentelemetry-instrumentation==0.46b0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-instrumentation-requests~=0.46b0->semgrep>1.68->codeshield) (0.46b0)
Requirement already satisfied: opentelemetry-semantic-conventions==0.46b0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-instrumentation-requests~=0.46b0->semgrep>1.68->codeshield) (0.46b0)
Requirement already satisfied: opentelemetry-util-http==0.46b0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-instrumentation-requests~=0.46b0->semgrep>1.68->codeshield) (0.46b0)
Requirement already satisfied: setuptools>=16.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-instrumentation==0.46b0->opentelemetry-instrumentation-requests~=0.46b0->semgrep>1.68->codeshield) (72.1.0)
Requirement already satisfied: wrapt<2.0.0,>=1.0.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-instrumentation==0.46b0->opentelemetry-instrumentation-requests~=0.46b0->semgrep>1.68->codeshield) (1.16.0)
Requirement already satisfied: markdown-it-py>=2.2.0 in /home/guilherme/.local/lib/python3.10/site-packages (from rich~=13.5.2->semgrep>1.68->codeshield) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /home/guilherme/.local/lib/python3.10/site-packages (from rich~=13.5.2->semgrep>1.68->codeshield) (2.17.1)
Requirement already satisfied: ruamel.yaml.clib>=0.2.7 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from ruamel.yaml<0.18,>=0.16.0->semgrep>1.68->codeshield) (0.2.8)
Requirement already satisfied: bracex>=2.1.1 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from wcmatch~=8.3->semgrep>1.68->codeshield) (2.5)
Requirement already satisfied: zipp>=0.5 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from importlib-metadata<=7.1,>=6.0->opentelemetry-api~=1.25.0->semgrep>1.68->codeshield) (3.20.2)
Requirement already satisfied: mdurl~=0.1 in /home/guilherme/.local/lib/python3.10/site-packages (from markdown-it-py>=2.2.0->rich~=13.5.2->semgrep>1.68->codeshield) (0.1.2)
Successfully setup conda environment. Configuring build...
Configuration already exists for local-ollama. Will overwrite...
Configuring API: inference (remote::ollama)
Enter value for url (existing: http://localhost:11434) (required):

Configuring API: safety (meta-reference)
Do you want to configure llama_guard_shield? (y/n): y
Entering sub-configuration for llama_guard_shield:
Enter value for model (default: Llama-Guard-3-8B) (required):
Enter value for excluded_categories (default: []) (required):
Enter value for disable_input_check (default: False) (required):
Enter value for disable_output_check (default: False) (required):
Do you want to configure prompt_guard_shield? (y/n): y
Entering sub-configuration for prompt_guard_shield:
Enter value for model (default: Prompt-Guard-86M) (required):

Configuring API: agentic_system (meta-reference)
Enter value for brave_search_api_key (optional):
Enter value for bing_search_api_key (optional):
Enter value for wolfram_api_key (optional):

Configuring API: memory (meta-reference-faiss)

Configuring API: telemetry (console)

YAML configuration has been written to /home/guilherme/.llama/builds/local-ollama/conda/ollama.yaml
Target ollama built with configuration at /home/guilherme/.llama/builds/local-ollama/conda/ollama.yaml
Build spec configuration saved at /home/guilherme/.llama/distributions/local-ollama/conda/ollama-build.yaml
(app_env2) guilherme@desktop:/tmp/a/llama/llama3.1$ llama stack run local-ollama --port 5000 --disable-ipv6
Valor de args.config: local-ollama
usage: llama stack run [-h] [--port PORT] [--disable-ipv6] config
llama stack run: error: File local-ollama does not exist. Did you run llama stack build?

Please, llama distribution remove llama_toolchain?

llama distribution install --spec local-ollama --name ollama

Thanks
Guilherme
@yanxi0830
Copy link
Contributor

yanxi0830 commented Sep 16, 2024 •
edited
Loading

Thanks for raising the issue! Could you re-download the latest package via

pip uninstall llama-toolchain
pip install llama-toolchain

Then run:

llama stack build ./llama_toolchain/configs/distributions/conda/local-ollama-conda-example-build.yaml --name ollama
llama stack configure ./llama_toolchain/configs/distributions/conda/local-ollama-conda-example-build.yaml
llama stack run ~/.llama/builds/conda/ollama-run.yaml

We have recently updated our CLI, and the latest instructions have been updated & can be found in https://github.com/meta-llama/llama-stack-apps/blob/main/README.md

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@yanxi0830 @JoseGuilherme1904