Installing Haystack+Extras via a requirements.txt

[rdubester]

I'm trying to include the full version of Haystack as a dependency for a python project.
My current best guess is to use this line:
farm-haystack[all] @ git+https://github.com/deepset-ai/haystack.git
however this emits a bunch of warnings of the form
...
WARNING: farm-haystack 0.2.0.post1 does not provide the extra 'docstores'
WARNING: farm-haystack 0.2.0.post1 does not provide the extra 'ocr'
WARNING: farm-haystack 0.2.0.post1 does not provide the extra 'onnx'
WARNING: farm-haystack 0.2.0.post1 does not provide the extra 'preprocessing'
WARNING: farm-haystack 0.2.0.post1 does not provide the extra 'ray'
WARNING: farm-haystack 0.1.0.post2 does not provide the extra 'beir'
WARNING: farm-haystack 0.1.0.post2 does not provide the extra 'crawler'
WARNING: farm-haystack 0.1.0.post2 does not provide the extra 'dev'
...
before eventually failing.

ERROR: Requested dill from https://files.pythonhosted.org/packages/3e/ad/31932a4e2804897e6fd2f946d53df51dd9b4aa55e152b5404395d00354d1/dill-0.3.1.tar.gz#sha256=d3ddddf2806a7bc9858b20c02dc174396795545e9d62f243b34481fd26eb3e2c (from farm-haystack[all]@ git+https://github.com/deepset-ai/haystack.git->-r /dss_data/tmp/pip-requirements-install/req3361828774079305889.txt (line 1)) has different version in metadata: '0.3.1.dev0'

I'm sure that I just don't have the syntax quite right in the import statement, but the internet has been amazingly unhelpful. What is the correct way to go about this?

[robpasternak]

Hi @rdubester, are you working in Colab by any chance? I was able to replicate your problem there, but when I ran it locally everything went smoothly. If you are working in Colab, then farm-haystack[all] unfortunately won't work, and you should use farm-haystack[colab].

[masci]

Hey @rdubester, I'm pasting here my response from SO.

The format for listing Haystack in your requirements.txt should be the following (I pin the version here but it's not mandatory):

farm-haystack[all]==1.5.0

If you want to pin a specific git commit instead, the line in your requirements.txt should just be:

git+https://github.com/deepset-ai/haystack.git#egg=farm-haystack[all]