New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow obtaining and restoring the streaming hashes' internal state. #112

Open

rgallardo-netflix wants to merge 1 commit into lz4:master from rgallardo-netflix:feature/resumable-streaming-hashes

Commits on Oct 10, 2017

Allow obtaining and restoring the streaming hashes' internal state.

This enables a "very large stream" hashing use case: Instead of trying
to read a large object in a single pass, one can fetch chunks of it at
a time and save the state after each chunk as a checkpoint. In the case
of a failure, the saved checkpoint can be used to retry from that point
of the stream onwards.

rgallardo-netflix committed Oct 10, 2017