Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing topic and offset infos when login error in ConsumerOffsetCommitter #629

Open
bmaggi opened this issue Aug 29, 2023 · 0 comments
Open
Labels
good first issue Good for newcomers

Comments

@bmaggi
Copy link

bmaggi commented Aug 29, 2023

First thanks for this library,

I'm trying to use it at its best to get the maximum throughput in my application.

I got some issue when scaling up and down my app, due to "infinite rebalance".

I feel that something may be going wrong between these two configurations : PERIODIC_CONSUMER_ASYNCHRONOUS and "partition.assignment.strategy" = org.apache.kafka.clients.consumer.CooperativeStickyAssignor

I would be very helpful to add topic/partition/offset that are tried to be commited in this log (Ideally the ones that failed)

https://github.com/confluentinc/parallel-consumer/blob/master/parallel-consumer-core/src/main/java/io/confluent/parallelconsumer/internal/ConsumerOffsetCommitter.java#L100

I don't see these informations in the current message

{extendedStackTrace=org.apache.kafka.common.errors.RebalanceInProgressException: Offset commit cannot be completed since the consumer is undergoing a rebalance for auto partition assignment. You can try completing the rebalance by calling poll() and then retry the operation.
, localizedMessage=Offset commit cannot be completed since the consumer is undergoing a rebalance for auto partition assignment. You can try completing the rebalance by calling poll() and then retry the operation., name=org.apache.kafka.common.errors.RebalanceInProgressException, commonElementCount=0, message=Offset commit cannot be completed since the consumer is undergoing a rebalance for auto partition assignment. You can try completing the rebalance by calling poll() and then retry the operation.}

Regards,
Benoit

@rkolesnev rkolesnev added the good first issue Good for newcomers label May 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

2 participants