AnsweredAssumed Answered

Zookeeper session timeout (Spark Streaming)?

Question asked by john.humphreys on Nov 6, 2017
Latest reply on Nov 21, 2017 by john.humphreys

I get this message after many days in Spark Streaming, and then my application starts to hang (or significantly slow down).

 

This is a MapR streams spark streaming application.  Is there a way to stop Zookeeper from expiring its session all together?

 

[2017-11-05 19:52:06,844] WARN ZK Reset due to SessionExpiration for ZK: psclxp00001.nomura.com:5181,psclxp00002.nomura.com:5181,psclxp00003.nomura.com:5181 (com.mapr.util.zookeeper.ZKDataRetrieval)

Outcomes