Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider retrying requests when gRPC error detail is "broken pipe" #168

Open
pgautier404 opened this issue Jun 26, 2023 · 0 comments
Open

Comments

@pgautier404
Copy link
Collaborator

In certain Lambda-based environments we have observed and reliably reproduced a number gRPC errors with STATUS_UNAVAILABLE status code and broken pipe error detail as Lambdas try to reuse cache clients stored in global variables. The error is intermittent, but when it occurs it is always on the first transaction a client attempts after Lambda invocation. The error only occurs when global clients are reused as opposed to being constructed at the time of invocation. If we can verify that this error is guaranteed to be indicative of a complete failure of communication between client and server, we might be fine to always trigger a retry in this situation as idempotency would not be an issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant