Unable to run Retrieval-Augmented Generation (RAG) Applications with AutoGen without Docker

[rabarona]

Hi everyone,

I'm trying to run the Retrieval-Augmented Generation (RAG) Applications with AutoGen example in my local with code_execution_config={"use_docker": False}. I can't run with docker on my computer due to some restrictions.

I have Python 3.9.19, pyautogen 0.2.33 and, chromadb 0.5.5. I also had to downgrade onnxruntime to 1.16.3 for chroma to work in a Mackbook Pro 2020 with i7 processor.

The problem happens when I try to initiate the chat with:

ragproxyagent.initiate_chat(assistant, message=ragproxyagent.message_generator, problem="What is autogen?")

Both the Python interpreter and the Jupyter notebook kernel crash and all it's printed is this message:

>>> ragproxyagent.initiate_chat(assistant, message=ragproxyagent.message_generator, problem="What is autogen?")
Trying to create collection.
2024-08-07 16:00:31,050 - autogen.agentchat.contrib.retrieve_user_proxy_agent - INFO - Found 2 chunks.
2024-08-07 16:00:31,052 - autogen.agentchat.contrib.vectordb.chromadb - INFO - No content embedding is provided. Will use the VectorDB's embedding function to generate the content embedding.
[1]    61029 segmentation fault  python
/opt/my/envs/experiments/lib/python3.9/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
  warnings.warn('resource_tracker: There appear to be %d '

I already tried switching to Python 3.12 with onnxruntime 1.18.1 but still the same error.

I noticed this error is only happening with the RagProxyAgent. If I try the Quick Start example with UserProxyAgent "tell me a joke about..." that works fine.

Has anyone else seen this error?

[rabarona]

I just tried Python 3.9.13 and it's working now.

[elianna-wang]

I came across the same error as you do, tried to use the same Python version but no luck. Does anyone in the community have thoughts?

[rabarona]

Hey, sorry for the late response. This is the entire list of packages:

$ pip list
Package                                  Version
---------------------------------------- --------------
aiofiles                                 23.2.1
aiohappyeyeballs                         2.3.5
aiohttp                                  3.10.1
aiosignal                                1.3.1
annotated-types                          0.7.0
anthropic                                0.28.1
anyio                                    4.4.0
appdirs                                  1.4.4
appnope                                  0.1.4
argon2-cffi                              23.1.0
argon2-cffi-bindings                     21.2.0
arrow                                    1.3.0
asgiref                                  3.8.1
asttokens                                2.4.1
async-lru                                2.0.4
async-timeout                            4.0.3
attrs                                    24.2.0
babel                                    2.16.0
backoff                                  2.2.1
bcrypt                                   4.2.0
beautifulsoup4                           4.12.3
bleach                                   6.1.0
blinker                                  1.8.2
blis                                     0.7.11
bm25s                                    0.1.10
boto3                                    1.34.156
botocore                                 1.34.156
build                                    1.2.1
cachetools                               5.4.0
camelot-py                               0.11.0
catalogue                                2.0.10
certifi                                  2024.7.4
cffi                                     1.17.0
chardet                                  5.2.0
charset-normalizer                       3.3.2
chroma-hnswlib                           0.7.6
chromadb                                 0.5.5
circuitbreaker                           1.4.0
click                                    8.1.7
cloudpathlib                             0.18.1
cobble                                   0.1.4
cohere                                   5.6.2
coloredlogs                              15.0.1
comm                                     0.2.2
confection                               0.1.5
contourpy                                1.2.1
cryptography                             42.0.8
cycler                                   0.12.1
cymem                                    2.0.8
dataclasses-json                         0.6.7
datasets                                 2.20.0
debugpy                                  1.8.5
decorator                                5.1.1
deepeval                                 1.0.1
defusedxml                               0.7.1
Deprecated                               1.2.14
dill                                     0.3.8
dirtyjson                                1.0.8
diskcache                                5.6.3
distro                                   1.9.0
docker                                   7.1.0
docx2txt                                 0.8
et-xmlfile                               1.1.0
eval_type_backport                       0.2.0
exceptiongroup                           1.2.2
execnet                                  2.1.1
executing                                2.0.1
fastapi                                  0.112.0
fastavro                                 1.9.5
fastjsonschema                           2.20.0
ffmpy                                    0.4.0
filelock                                 3.15.4
FLAML                                    2.2.0
Flask                                    3.0.3
flatbuffers                              20191030132039
fonttools                                4.53.1
fqdn                                     1.5.1
frozendict                               2.4.4
frozenlist                               1.4.1
fsspec                                   2024.5.0
google-ai-generativelanguage             0.6.4
google-api-core                          2.19.1
google-api-python-client                 2.140.0
google-auth                              2.33.0
google-auth-httplib2                     0.2.0
google-generativeai                      0.5.4
googleapis-common-protos                 1.63.2
gradio                                   4.42.0
gradio_client                            1.3.0
greenlet                                 3.0.3
grpcio                                   1.63.0
grpcio-status                            1.62.3
h11                                      0.14.0
html5lib                                 1.1
httpcore                                 1.0.5
httplib2                                 0.22.0
httptools                                0.6.1
httpx                                    0.27.0
httpx-sse                                0.4.0
huggingface-hub                          0.24.5
humanfriendly                            10.0
idna                                     3.7
importlib-metadata                       7.0.0
importlib_resources                      6.4.0
iniconfig                                2.0.0
ipykernel                                6.29.5
ipython                                  8.18.1
ipywidgets                               8.1.3
isoduration                              20.11.0
itsdangerous                             2.2.0
jedi                                     0.19.1
Jinja2                                   3.1.4
jiter                                    0.5.0
jmespath                                 1.0.1
joblib                                   1.4.2
json5                                    0.9.25
jsonpatch                                1.33
jsonpointer                              3.0.0
jsonschema                               4.23.0
jsonschema-specifications                2023.12.1
jupyter                                  1.0.0
jupyter_client                           8.6.2
jupyter-console                          6.6.3
jupyter_core                             5.7.2
jupyter-events                           0.10.0
jupyter-lsp                              2.2.5
jupyter_server                           2.14.2
jupyter_server_terminals                 0.5.3
jupyterlab                               4.2.4
jupyterlab_pygments                      0.3.0
jupyterlab_server                        2.27.3
jupyterlab_widgets                       3.0.11
kiwisolver                               1.4.5
kubernetes                               30.1.0
langchain                                0.2.12
langchain-cohere                         0.2.2
langchain-community                      0.2.11
langchain-core                           0.2.29
langchain-experimental                   0.0.64
langchain-google-genai                   1.0.6
langchain-openai                         0.1.20
langchain-text-splitters                 0.2.2
langchain-together                       0.1.5
langcodes                                3.4.0
langsmith                                0.1.98
language_data                            1.2.0
llama-cloud                              0.0.13
llama-index                              0.10.64
llama-index-agent-openai                 0.2.9
llama-index-cli                          0.1.13
llama-index-core                         0.10.64
llama-index-embeddings-cohere            0.1.9
llama-index-embeddings-gemini            0.1.8
llama-index-embeddings-huggingface       0.2.3
llama-index-embeddings-openai            0.1.11
llama-index-indices-managed-llama-cloud  0.2.7
llama-index-legacy                       0.9.48
llama-index-llms-anthropic               0.1.17
llama-index-llms-cohere                  0.2.0
llama-index-llms-gemini                  0.2.0
llama-index-llms-groq                    0.1.4
llama-index-llms-openai                  0.1.29
llama-index-llms-openai-like             0.1.3
llama-index-llms-together                0.1.3
llama-index-multi-modal-llms-openai      0.1.9
llama-index-postprocessor-cohere-rerank  0.1.7
llama-index-program-openai               0.1.7
llama-index-question-gen-openai          0.1.3
llama-index-readers-file                 0.1.33
llama-index-readers-llama-parse          0.1.6
llama-index-retrievers-bm25              0.2.2
llama-parse                              0.4.9
lxml                                     5.3.0
mammoth                                  1.8.0
marisa-trie                              1.2.0
Markdown                                 3.6
markdown-it-py                           3.0.0
markdownify                              0.13.1
MarkupSafe                               2.1.5
marshmallow                              3.21.3
matplotlib                               3.9.2
matplotlib-inline                        0.1.7
mdurl                                    0.1.2
minijinja                                2.0.1
mistune                                  3.0.2
mmh3                                     4.1.0
monotonic                                1.6
mpmath                                   1.3.0
multidict                                6.0.5
multiprocess                             0.70.16
multitasking                             0.0.11
murmurhash                               1.0.10
mypy-extensions                          1.0.0
nbclient                                 0.10.0
nbconvert                                7.16.4
nbformat                                 5.10.4
nest-asyncio                             1.6.0
networkx                                 3.2.1
nltk                                     3.8.1
notebook                                 7.2.1
notebook_shim                            0.2.4
numpy                                    1.26.4
oauthlib                                 3.2.2
oci                                      2.131.1
onnxruntime                              1.16.3
openai                                   1.40.6
openpyxl                                 3.1.5
opentelemetry-api                        1.24.0
opentelemetry-exporter-otlp-proto-common 1.24.0
opentelemetry-exporter-otlp-proto-grpc   1.24.0
opentelemetry-instrumentation            0.45b0
opentelemetry-instrumentation-asgi       0.45b0
opentelemetry-instrumentation-fastapi    0.45b0
opentelemetry-proto                      1.24.0
opentelemetry-sdk                        1.24.0
opentelemetry-semantic-conventions       0.45b0
opentelemetry-util-http                  0.45b0
orjson                                   3.10.6
overrides                                7.7.0
packaging                                24.1
pandas                                   2.2.2
pandocfilters                            1.5.1
parameterized                            0.9.0
parso                                    0.8.4
pdfminer.six                             20240706
peewee                                   3.17.6
pexpect                                  4.9.0
pillow                                   10.4.0
pip                                      24.2
platformdirs                             4.2.2
pluggy                                   1.5.0
portalocker                              2.10.1
posthog                                  3.5.0
preshed                                  3.0.9
prometheus_client                        0.20.0
prompt_toolkit                           3.0.47
proto-plus                               1.24.0
protobuf                                 4.25.1
psutil                                   6.0.0
ptyprocess                               0.7.0
pure_eval                                0.2.3
pyarrow                                  17.0.0
pyarrow-hotfix                           0.6
pyasn1                                   0.6.0
pyasn1_modules                           0.4.0
pyautogen                                0.2.34
pycparser                                2.22
pydantic                                 2.8.2
pydantic_core                            2.20.1
pydub                                    0.25.1
Pygments                                 2.18.0
PyMuPDF                                  1.24.9
PyMuPDFb                                 1.24.9
pyOpenSSL                                24.2.1
pyparsing                                3.1.2
pypdf                                    4.3.1
PyPika                                   0.48.9
pyproject_hooks                          1.1.0
pysbd                                    0.3.4
PyStemmer                                2.2.0.1
pytest                                   8.3.2
pytest-repeat                            0.9.3
pytest-xdist                             3.6.1
python-dateutil                          2.9.0.post0
python-docx                              1.1.2
python-dotenv                            1.0.1
python-json-logger                       2.0.7
python-multipart                         0.0.9
pytz                                     2024.1
PyYAML                                   6.0.2
pyzmq                                    26.1.0
qtconsole                                5.5.2
QtPy                                     2.4.1
ragas                                    0.1.13
rank-bm25                                0.2.2
referencing                              0.35.1
regex                                    2024.7.24
requests                                 2.32.3
requests-oauthlib                        2.0.0
rfc3339-validator                        0.1.4
rfc3986-validator                        0.1.1
rich                                     13.9.2
rpds-py                                  0.20.0
rsa                                      4.9
ruff                                     0.6.2
s3transfer                               0.10.2
safetensors                              0.4.4
scikit-learn                             1.5.1
scipy                                    1.13.1
semantic-version                         2.10.0
Send2Trash                               1.8.3
sentence-transformers                    3.0.1
sentry-sdk                               2.12.0
setuptools                               72.1.0
shellingham                              1.5.4
six                                      1.16.0
smart-open                               7.0.4
sniffio                                  1.3.1
soupsieve                                2.5
spacy                                    3.7.5
spacy-legacy                             3.0.12
spacy-loggers                            1.0.5
SQLAlchemy                               2.0.32
srsly                                    2.4.8
stack-data                               0.6.3
starlette                                0.37.2
striprtf                                 0.0.26
sympy                                    1.13.1
tabulate                                 0.9.0
tenacity                                 8.4.2
termcolor                                2.4.0
terminado                                0.18.1
thinc                                    8.2.5
threadpoolctl                            3.5.0
tiktoken                                 0.7.0
tinycss2                                 1.3.0
together                                 1.3.1
tokenizers                               0.19.1
tomli                                    2.0.1
tomlkit                                  0.12.0
torch                                    2.2.2
tornado                                  6.4.1
tqdm                                     4.66.5
traitlets                                5.14.3
transformers                             4.44.0
typer                                    0.12.3
types-python-dateutil                    2.9.0.20240316
types-requests                           2.31.0.6
types-urllib3                            1.26.25.14
typing_extensions                        4.12.2
typing-inspect                           0.9.0
tzdata                                   2024.1
uri-template                             1.3.0
uritemplate                              4.1.1
urllib3                                  2.2.2
uvicorn                                  0.30.5
uvloop                                   0.19.0
wasabi                                   1.1.3
watchfiles                               0.23.0
wcwidth                                  0.2.13
weasel                                   0.4.1
webcolors                                24.6.0
webencodings                             0.5.1
websocket-client                         1.8.0
websockets                               12.0
Werkzeug                                 3.0.3
wheel                                    0.44.0
widgetsnbextension                       4.0.11
wrapt                                    1.16.0
xxhash                                   3.4.1
yarl                                     1.9.4
yfinance                                 0.2.43
zipp                                     3.19.2

I hope this helps.

[elianna-wang]

Thank you so much, I will test that from my end.
But I was able to run the code by using instance instead of locally.

[rritam94]

hey im having this issue still, were you guys able to figure it out? I need to use python 3.10+