AnsweredAssumed Answered

Kafka - Passive consumer same group / partition?

Question asked by john.humphreys on Sep 5, 2017
Latest reply on Sep 5, 2017 by john.humphreys

I need to make a system we're working with highly available.


We have multiple OpenTSDB instances and a writer app (from MapR-Streams to OpenTSDB) that can balance over them and remove dead ones/retry requests.


Ideally, I need more than one copy of this writer app to be running, but I just want the second one to wait for the first one to fail and then pick up from the same point.  I don't want them both running at once and doubling my writes/traffic.

Is it possible (MapR-Sterams/Java API) to have a second consumer target the same consumer-group/topic and just pick up if the other one stops consuming?  How would I achieve this?