Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement a b/c layer that allows upgrading storages from previous file format #116

Open
albe opened this issue Jun 27, 2020 · 0 comments
Open
Labels
enhancement P: Index Affects the indexing layer P: Storage Affects the storage layer

Comments

@albe
Copy link
Owner

albe commented Jun 27, 2020

Sometimes breaking the file format (for the storage/partitions and indexes) is inevitable as seen with #80. In those cases right now the old data is no longer readable. The solution then would be to install two versions of this library, make the old one read the data (events), pipe it to an instance of the new version and write them there. This comes at least at the loss of original metainformation (timestamps) and is cumbersome.

A solution would be to implement a readonly support for the last file format version. Then transforming the old storage to the new format could be done automatically with as many adjustments as possible to keep the actual data intact.

@albe albe added enhancement P: Storage Affects the storage layer P: Index Affects the indexing layer labels Jun 27, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement P: Index Affects the indexing layer P: Storage Affects the storage layer
Projects
None yet
Development

No branches or pull requests

1 participant