Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kafka Consumer lag always 1 when the input topic is transactional #684

Open
okouyad opened this issue Oct 22, 2022 · 0 comments
Open

Kafka Consumer lag always 1 when the input topic is transactional #684

okouyad opened this issue Oct 22, 2022 · 0 comments

Comments

@okouyad
Copy link

okouyad commented Oct 22, 2022

The issue is a known problem reported here spring-projects/spring-kafka#1587 and also here spring-projects/spring-kafka#1587.

Essentially when working with transaction, the lag of the consumer group get messed up i.e. when a read_committed consumer consumes everything, the lag stay stuck at 1.

I wonder if Kafka4s does anything or has anything to handle that use case?

I'm asking, because while not completely sure, i have seen a code in the lib that i could not beging to understand until i red the above

Also in the process i would like to ask what is the difference if a method of the same name, seemingly having the same purpose in a package object slightly above

https://github.com/Banno/kafka4s/blob/48f23050fecf539506bec236aeb0c66d75fe782f/core/src/main/scala/com/banno/kafka/package.scala

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant