AnsweredAssumed Answered

What's the right way to keep consumers alive and prevent them getting kicked out of the consumer group?

Question asked by nitdgp on May 26, 2018
Latest reply on Jun 5, 2018 by nitdgp

From Supportability of Apache Kafka Java Configuration , I can see "session.timeout.ms" isn't supported in MapR-ES 5.2. How do we make sure that consumer doesn't get kicked out of the group?

 

If my consumer subscribes a list of topics and polls a few messages, takes a long time to process them before it commits the offsets and polls again, is it possible that the consumer gets kicked out because there was no heartbeat sent from this consumer for a while? I read that there's an alternative to use pause/resume to deal with longer processing time, but what if my consumer actually goes down after the 'pause' is done (but before resume)? What's the recommended way to deal with this use-case?

Outcomes