Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Even not working optimally? #95

Open
simplesteph opened this issue Jul 26, 2018 · 1 comment
Open

Even not working optimally? #95

simplesteph opened this issue Jul 26, 2018 · 1 comment

Comments

@simplesteph
Copy link

The even mode in balance is the following:

even - This is a specialized type for clusters which have topics that have a number of partitions that are a multiple of the number of brokers. The module assures that every broker has exactly the same number of partitions for each topic.

Yet the code tries to SSH to my brokers?

[ec2-user@ip-172-31-12-216 ~]$ kafka-assigner  -z $ZK_HOST -e balance --types even
[INFO] Connecting to zookeeper 172.31.9.21:2181
[INFO] Getting partition list from Zookeeper
[INFO] Closing connection to zookeeper
[INFO] Getting partition sizes via SSH for 172.31.32.31
[INFO] Getting partition sizes via SSH for 172.31.9.32
[INFO] Getting partition sizes via SSH for 172.31.16.33
[INFO] Getting partition sizes via SSH for 172.31.16.34
[INFO] Starting even partition balance

I would have guessed the even module could just connect to Zookeeper to distribute partitions evenly?

@kpocius
Copy link

kpocius commented Nov 5, 2019

As explained on #63:

It evenly balances the partitions across the brokers, and any "extra partitions" are evenly distributed within the cluster.

I believe that's what SSH'ing is for -- to figure out where to place the remainder of partitions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants