Kafka client is timing out in RemixGcnProduction-CircularsTableStreamLambda

[lpsinger]

Current behavior

The Kafka client is timing out in the circulars table stream Lambda. Here is an example log output.

timestamp	message
1731064812426	INIT_START Runtime Version: nodejs:20.v43 Runtime Version ARN: arn:aws:lambda:us-east-1::runtime:4a87b8fceb008240eb9bfe7dc3126c2dec6fe75f06c6a4d8977d0267eb5da2bd
1731064812979	START RequestId: 28023b61-98bd-4f9f-8616-515b0da1f31d Version: $LATEST
1731064819056	2024-11-08T11:20:19.056Z 28023b61-98bd-4f9f-8616-515b0da1f31d ERROR {"level":"ERROR","timestamp":"2024-11-08T11:20:19.056Z","logger":"kafkajs","message":"[Connection] Connection timeout","broker":"kafka3.gcn.nasa.gov:9092","clientId":"kafkajs"}
1731064820195	2024-11-08T11:20:20.195Z 28023b61-98bd-4f9f-8616-515b0da1f31d ERROR {"level":"ERROR","timestamp":"2024-11-08T11:20:20.195Z","logger":"kafkajs","message":"[Connection] Connection timeout","broker":"kafka1.gcn.nasa.gov:9092","clientId":"kafkajs"}
1731064820954	2024-11-08T11:20:20.954Z 28023b61-98bd-4f9f-8616-515b0da1f31d ERROR {"level":"ERROR","timestamp":"2024-11-08T11:20:20.954Z","logger":"kafkajs","message":"[Producer] Failed to send messages: Connection timeout","retryCount":0,"retryTime":251}
1731064822294	END RequestId: 28023b61-98bd-4f9f-8616-515b0da1f31d
1731064822294	REPORT RequestId: 28023b61-98bd-4f9f-8616-515b0da1f31d Duration: 9314.39 ms Billed Duration: 9315 ms Memory Size: 256 MB Max Memory Used: 129 MB Init Duration: 550.96 ms

Expected behavior

Kafka client should time out rarely or not at all.

Steps to reproduce

Refer to CloudWatch logs.

Environment

N/A - AWS.