Job Failed, docker-compose.prod.yml don't have HUGGINGFACE_APIKEY Input Possibility or Connection Issue

[rob7xiv]

Hello,

After I add a Job wav/m4a it's failed.

I put my Huggingface Key in the Docker File, have Granted Access pyannote/speaker-diarization-3.1 and pyannote/segmentation-3.0, but it don't help.

Docker Desktop
M1 Pro Mac OS X 14.4.1,
PC: Windows 11 I7-8700k
Config docker-compose.prod.yml
MINIO_ENDPOINT=<my Mac/PC IP-Address>
Without GPU.

2024-04-03 10:01:14 /opt/conda/lib/python3.10/site-packages/pyannote/audio/core/io.py:43: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call.
2024-04-03 10:01:14 torchaudio.set_audio_backend("soundfile")
2024-04-03 10:01:15 2024-04-03 08:01:15 INFO Pika version 1.3.2 connecting to ('172.18.0.5', 5672)
2024-04-03 10:01:15 2024-04-03 08:01:15 ERROR Socket failed to connect: <socket.socket fd=10, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('172.18.0.8', 39940)>; error=111 (Connection refused)
2024-04-03 10:01:15 2024-04-03 08:01:15 ERROR TCP Connection attempt failed: ConnectionRefusedError(111, 'Connection refused'); dest=(<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('172.18.0.5', 5672))
2024-04-03 10:01:15 2024-04-03 08:01:15 ERROR AMQPConnector - reporting failure: AMQPConnectorSocketConnectError: ConnectionRefusedError(111, 'Connection refused')
2024-04-03 10:01:15 2024-04-03 08:01:15 ERROR AMQP connection workflow failed: AMQPConnectionWorkflowFailed: 1 exceptions in all; last exception - AMQPConnectorSocketConnectError: ConnectionRefusedError(111, 'Connection refused'); first exception - None.
2024-04-03 10:01:15 2024-04-03 08:01:15 ERROR AMQPConnectionWorkflow - reporting failure: AMQPConnectionWorkflowFailed: 1 exceptions in all; last exception - AMQPConnectorSocketConnectError: ConnectionRefusedError(111, 'Connection refused'); first exception - None
2024-04-03 10:01:15 2024-04-03 08:01:15 ERROR Connection workflow failed: AMQPConnectionWorkflowFailed: 1 exceptions in all; last exception - AMQPConnectorSocketConnectError: ConnectionRefusedError(111, 'Connection refused'); first exception - None
2024-04-03 10:01:15 2024-04-03 08:01:15 ERROR Error in _create_connection().
2024-04-03 10:01:15 Traceback (most recent call last):
2024-04-03 10:01:15 File "/opt/conda/lib/python3.10/site-packages/pika/adapters/blocking_connection.py", line 451, in _create_connection
2024-04-03 10:01:15 raise self._reap_last_connection_workflow_error(error)
2024-04-03 10:01:15 pika.exceptions.AMQPConnectionError
2024-04-03 10:01:15 2024-04-03 08:01:15 ERROR Job Failed
2024-04-03 10:01:20 /opt/conda/lib/python3.10/site-packages/pyannote/audio/core/io.py:43: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call.
2024-04-03 10:01:20 torchaudio.set_audio_backend("soundfile")
2024-04-03 10:01:21 2024-04-03 08:01:21 INFO Pika version 1.3.2 connecting to ('172.18.0.5', 5672)
2024-04-03 10:01:21 2024-04-03 08:01:21 INFO Socket connected: <socket.socket fd=10, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('172.18.0.2', 53542), raddr=('172.18.0.5', 5672)>
2024-04-03 10:01:21 2024-04-03 08:01:21 INFO Streaming transport linked up: (<pika.adapters.utils.io_services_utils._AsyncPlaintextTransport object at 0x7fff2a89b8b0>, _StreamingProtocolShim: <SelectConnection PROTOCOL transport=<pika.adapters.utils.io_services_utils._AsyncPlaintextTransport object at 0x7fff2a89b8b0> params=>).
2024-04-03 10:01:21 2024-04-03 08:01:21 INFO AMQPConnector - reporting success: <SelectConnection OPEN transport=<pika.adapters.utils.io_services_utils._AsyncPlaintextTransport object at 0x7fff2a89b8b0> params=>
2024-04-03 10:01:21 2024-04-03 08:01:21 INFO AMQPConnectionWorkflow - reporting success: <SelectConnection OPEN transport=<pika.adapters.utils.io_services_utils._AsyncPlaintextTransport object at 0x7fff2a89b8b0> params=>
2024-04-03 10:01:21 2024-04-03 08:01:21 INFO Connection workflow succeeded: <SelectConnection OPEN transport=<pika.adapters.utils.io_services_utils._AsyncPlaintextTransport object at 0x7fff2a89b8b0> params=>
2024-04-03 10:01:21 2024-04-03 08:01:21 INFO Created channel=1
2024-04-03 10:01:21 2024-04-03 08:01:21 INFO Starting consuming.
2024-04-03 10:04:35 2024-04-03 08:04:35 INFO test1 4e318473-4f7e-4c4d-a970-c5b88126284b.m4a Diarization started
2024-04-03 10:04:35
2024-04-03 10:04:35 Could not download 'pyannote/speaker-diarization-3.1' pipeline.
2024-04-03 10:04:35 It might be because the pipeline is private or gated so make
2024-04-03 10:04:35 sure to authenticate. Visit https://hf.co/settings/tokens to
2024-04-03 10:04:35 create your access token and retry with:
2024-04-03 10:04:35
2024-04-03 10:04:35 >>> Pipeline.from_pretrained('pyannote/speaker-diarization-3.1',
2024-04-03 10:04:35 ... use_auth_token=YOUR_AUTH_TOKEN)
2024-04-03 10:04:35
2024-04-03 10:04:35 If this still does not work, it might be because the pipeline is gated:
2024-04-03 10:04:35 visit https://hf.co/pyannote/speaker-diarization-3.1 to accept the user conditions.
2024-04-03 10:04:35 2024-04-03 08:04:35 INFO test1 failed.

Greetings

rob7xiv

[PaulKalho]

Hi @rob7xiv,

Thank's for the question.
We actually faced this issue on our own and thus have it on our agenda, we will patch that soon. #82

[PaulKalho]

Hi @rob7xiv,

We rebuilt our images, you can repull them now

[rob7xiv]

Thanks, its working :)

Greetings