Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Prototype for concurrent operations limiting #385

Closed
wants to merge 1 commit into from
Closed

feat: Prototype for concurrent operations limiting #385

wants to merge 1 commit into from

Commits on Aug 12, 2024

  1. feat: Prototype for concurrent operations limiting 

    Modify cache Get and Get to add optional concurrent operations limiting.
It works by creating an executor with a max number of threads equal to
the limit. Get and Set calls are given to the executor and wait on the
executor's internal queue until there is a thread free to take them,
implicitly limiting the number of concurrent requests.

Add a general ScsFutureStub method that takes a gRPC call, a gRPC to
Momento response converter, and an error handler. Something like this
should let us cut a lot of boilerplate out of the data client. It won't
work for the batch call, since that uses a different type of stub.
    @nand4011
    nand4011 committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    86422a4 View commit details
    Browse the repository at this point in the history