meetingFailed When a Participant Turns Their Camera On

[shriyajuneja]

What happened and what did you expect to happen?

This issue is intermittently reproducible across multiple versions of the Amazon Chime SDK. We have been using the following versions in production since 2023, and they have previously operated smoothly:
amazon-chime-sdk-component-library-react: 3.7.0
amazon-chime-sdk-js: 3.18.0

Recently, users have reported that their calls randomly transition to a "connecting" state, particularly when one of the participants turns on their camera. Upon reviewing the logs, we observed that the agent received the event meetingFailed, with the message: "Failed during a meeting - The signaling connection failed." This "connecting" state is shown in our application whenever we receive the meetingFailed event.

Have you reviewed our existing documentation?

• GitHub issues
• FAQs page
• README page
• Feature-specific guides

Reproduction steps

We have identified two scenarios that reproduce the issue:

Scenario 1:

The agent's camera is off, and the customer has their camera turned on.
After the customer turns on their camera, the agent also turns on their camera.
The call then enters a "loading" state for the agent.

Scenario 2:

Both participants have their cameras off.
When the user turns on their camera, the agent’s call transitions into a "connecting" state.

Amazon Chime SDK for JavaScript version

3.18.0, 3.21.0

What browsers are you seeing the problem on?

Chrome

Browser version

127.0.0.0

Meeting and Attendee ID Information.

meeting id - 4708a8b7-17b3-4f3f-b01f-67bf1fc52713

attendeeID - e4ae086a-2d35-3947-9757-846b642ad332, 6b036989-906d-37f5-b153-4e5516a8418

Browser console logs

https://prod-cdata-app-export.sprinklr.com/video_events_log-787/video_events_log_a06cbaec-8b38-48ea-be79-870547804882.txt

[hensmi-amazon]

Sorry for taking so long to look at this. I was not able to reproduce, even when switching to the 3.18.0 version.

What i am seeing is that the local client adds a receive transceiver, but at some point it gets switched from recvonly to sendrecv (most likely from the browser):

adding transceiver mid: null subscription: 81 direction: recvonly","logTime":1723476038245,"createdTime":1723476045839,"offsetTime":7125,"activityTime":1723476038714,"logCounter":4}
{"id":"66ba284d0fe38200d75c5aed","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.245Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession/AttachMediaInputTask took 4 ms","logTime":1723476038245,"createdTime":1723476045839,"offsetTime":7125,"activityTime":1723476038714,"logCounter":4}
{"id":"66ba284d0fe38200d75c5aee","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.245Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - serial group task AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession completed subtask AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession/AttachMediaInputTask","logTime":1723476038245,"createdTime":1723476045839,"offsetTime":7125,"activityTime":1723476038714,"logCounter":4}
{"id":"66ba284d0fe38200d75c5aef","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.245Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - serial group task AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession running subtask AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession/CreateSDPTask","logTime":1723476038245,"createdTime":1723476045839,"offsetTime":7125,"activityTime":1723476038714,"logCounter":4}
{"id":"66ba284d0fe38200d75c5af0","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.245Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - running task AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession/CreateSDPTask","logTime":1723476038245,"createdTime":1723476045839,"offsetTime":7125,"activityTime":1723476038714,"logCounter":4}
{"id":"66ba284d0fe38200d75c5af1","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.245Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - uses video: true (enabled: true, sending: false, receiving: true)","logTime":1723476038245,"createdTime":1723476045839,"offsetTime":7125,"activityTime":1723476038714,"logCounter":4}
{"id":"66ba284d0fe38200d75c5af2","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.245Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - peer connection offerOptions: {\"offerToReceiveAudio\":true,\"offerToReceiveVideo\":true}","logTime":1723476038245,"createdTime":1723476045839,"offsetTime":7125,"activityTime":1723476038714,"logCounter":4}
{"id":"66ba284d0fe38200d75c5af3","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.248Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - peer connection negotiation is needed","logTime":1723476038248,"createdTime":1723476045839,"offsetTime":7122,"activityTime":1723476038717,"logCounter":4}
{"id":"66ba284d0fe38200d75c5af4","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.248Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - peer connection created offer","logTime":1723476038248,"createdTime":1723476045839,"offsetTime":7122,"activityTime":1723476038717,"logCounter":4}
{"id":"66ba284d0fe38200d75c5af5","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.248Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession/CreateSDPTask took 3 ms","logTime":1723476038248,"createdTime":1723476045839,"offsetTime":7122,"activityTime":1723476038717,"logCounter":4}
{"id":"66ba284d0fe38200d75c5af6","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.248Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - serial group task AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession completed subtask AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession/CreateSDPTask","logTime":1723476038248,"createdTime":1723476045839,"offsetTime":7122,"activityTime":1723476038717,"logCounter":4}
{"id":"66ba284d0fe38200d75c5af7","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.249Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - serial group task AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession running subtask AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession/SetLocalDescriptionTask","logTime":1723476038249,"createdTime":1723476045839,"offsetTime":7121,"activityTime":1723476038718,"logCounter":4}
{"id":"66ba284d0fe38200d75c5af8","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.249Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - running task AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession/SetLocalDescriptionTask","logTime":1723476038249,"createdTime":1723476045839,"offsetTime":7121,"activityTime":1723476038718,"logCounter":4}
{"id":"66ba284d0fe38200d75c5af9","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.254Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - set local description","logTime":1723476038255,"createdTime":1723476045839,"offsetTime":7115,"activityTime":1723476038724,"logCounter":4}
{"id":"66ba284d0fe38200d75c5afa","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.255Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession/SetLocalDescriptionTask took 6 ms","logTime":1723476038255,"createdTime":1723476045839,"offsetTime":7115,"activityTime":1723476038724,"logCounter":4}
{"id":"66ba284d0fe38200d75c5afb","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.255Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - serial group task AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession completed subtask AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession/SetLocalDescriptionTask","logTime":1723476038255,"createdTime":1723476045839,"offsetTime":7115,"activityTime":1723476038724,"logCounter":4}
{"id":"66ba284d0fe38200d75c5afc","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.255Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - serial group task AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession running subtask AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession/FinishGatheringICECandidatesTask","logTime":1723476038255,"createdTime":1723476045839,"offsetTime":7115,"activityTime":1723476038724,"logCounter":4}
{"id":"66ba284d0fe38200d75c5afd","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.255Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - running task AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession/FinishGatheringICECandidatesTask","logTime":1723476038255,"createdTime":1723476045839,"offsetTime":7115,"activityTime":1723476038724,"logCounter":4}
{"id":"66ba284d0fe38200d75c5afe","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.255Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - ice gathering state is complete and candidates are in SDP; bypass gathering","logTime":1723476038255,"createdTime":1723476045839,"offsetTime":7115,"activityTime":1723476038724,"logCounter":4}
{"id":"66ba284d0fe38200d75c5aff","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.255Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession/FinishGatheringICECandidatesTask took 0 ms","logTime":1723476038255,"createdTime":1723476045839,"offsetTime":7115,"activityTime":1723476038724,"logCounter":4}
{"id":"66ba284d0fe38200d75c5b00","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.255Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - serial group task AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession completed subtask AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession/FinishGatheringICECandidatesTask","logTime":1723476038255,"createdTime":1723476045839,"offsetTime":7115,"activityTime":1723476038724,"logCounter":4}
{"id":"66ba284d0fe38200d75c5b01","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.255Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - serial group task AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession running subtask AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession/SubscribeAndReceiveSubscribeAckTask","logTime":1723476038255,"createdTime":1723476045839,"offsetTime":7115,"activityTime":1723476038724,"logCounter":4}
{"id":"66ba284d0fe38200d75c5b02","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.255Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - running task AudioVideoUpdate/4708a8b7-17b3-4f3f-b01f-67bf1fc52713/e4ae086a-2d35-3947-9757-846b642ad332/Timeout5000ms/UpdateSession/SubscribeAndReceiveSubscribeAckTask","logTime":1723476038255,"createdTime":1723476045839,"offsetTime":7115,"activityTime":1723476038724,"logCounter":4}
{"id":"66ba284d0fe38200d75c5b03","videoConversationId":"a06cbaec-8b38-48ea-be79-870547804882","loggerSnType":"SPRINKLR","loggerSnUserId":"299414","logMessage":"AGENT: 2024-08-12T15:20:38.257Z [INFO] amazon-chime-sdk-js: Video Call (undefined) - Fixed up [0,81] to [0,0] (may be same))}","logTime":1723476038257,"createdTime":1723476045839,"offsetTime":7113,"activityTime":1723476038726,"logCounter":4}

From there the client and backend state machines get confused (e.g. Fixed up [0,81] to [0,0] which should be Fixed up [0,81] to [0,81] and things go south from there.

Unfortunately I could not reproduce with the above steps in the JS SDK demo app. It doesn't look like something the backend would impact, but may have been a browser change

• Does this still occur?
• Does it still occur with the latest SDK version?
• Can it be reproduced in the JS SDK demo app?
• Does