Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use summarizers to make compaction decisions #1054

Open
keith-turner opened this issue Oct 17, 2018 · 1 comment
Open

Use summarizers to make compaction decisions #1054

keith-turner opened this issue Oct 17, 2018 · 1 comment

Comments

@keith-turner
Copy link
Contributor

In Accumulo 2.0 summarizes were introduced. Fluo could use these to count column types and notifications. These counts could be use to make compaction decisions.
keith-turner added a commit to keith-turner/accumulo that referenced this issue Oct 17, 2018
@keith-turner
Fix summarizer bug with empty loc group
b96cf61 
For a table with multiple locality groups and a locality group with no data,
feching summaries would fail.  Found this while working on apache/fluo#1054
@keith-turner keith-turner mentioned this issue Oct 17, 2018
Merged
keith-turner added a commit to apache/accumulo that referenced this issue Oct 17, 2018
@keith-turner
Fix summarizer bug with empty loc group (#707)
ed29ca3 
For a table with multiple locality groups and a locality group with no data,
feching summaries would fail.  Found this while working on apache/fluo#1054
@keith-turner keith-turner mentioned this issue Nov 8, 2018
Merged
keith-turner added a commit to keith-turner/fluo that referenced this issue Feb 15, 2019
@keith-turner
Generate summaries of Fluo data apache#1054
d1b5550 
This is a partial step for apache#1054.  I would like to make the summary data
available before making any decisions about how to use it for compaction
decsions.
keith-turner added a commit to keith-turner/fluo that referenced this issue Feb 15, 2019
@keith-turner
Generate summaries of Fluo data apache#1054
c53d3b3 
This is a partial step for apache#1054.  I would like to make the summary data
available before making any decisions about how to use it for compaction
decsions.
@keith-turner keith-turner mentioned this issue Feb 15, 2019
Merged
keith-turner added a commit that referenced this issue Feb 21, 2019
@keith-turner
Generate summaries of Fluo data #1054 (#1071)
8e06204 
This is a partial step for #1054.  I would like to make the summary data
available before making any decisions about how to use it for compaction
decsions.
@ctubbsii ctubbsii added this to the 2.0.0 milestone Jul 16, 2020
@keith-turner
Copy link
Contributor Author

It would be better to do this after Accumulo 2.1.0 releases w/ new compaction updates. Doing it now would require writing code against the Accumulo CompactionStrategy which is deprecated as of Accumulo 2.1.0 because its highly unstable.

@keith-turner keith-turner removed this from the 2.0.0 milestone Jan 12, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@keith-turner @ctubbsii and others