AnsweredAssumed Answered

WARN zookeeper.ZKUtil: hconnection Unable to set watcher on znode /hbase/master org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master

Question asked by rameshg on Mar 23, 2015
Hi Team,

We are using MapR 3.0.2 version while doing bulk load of data using MapReduce I'm facing the following issue.

    Code = ConnectionLoss for /hbase/master
    15/03/23 02:01:27 INFO util.RetryCounter: Sleeping 2000ms before retry #1...
    15/03/23 02:01:30 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
    15/03/23 02:01:30 INFO util.RetryCounter: Sleeping 4000ms before retry #2...
    15/03/23 02:01:34 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
    15/03/23 02:01:34 INFO util.RetryCounter: Sleeping 8000ms before retry #3...
    15/03/23 02:01:43 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
    15/03/23 02:01:43 ERROR zookeeper.RecoverableZooKeeper: ZooKeeper exists failed after 3 retries
    15/03/23 02:01:43 WARN zookeeper.ZKUtil: hconnection Unable to set watcher on znode /hbase/master
    org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
            at org.apache.zookeeper.KeeperException.create(KeeperException.java:90)
            at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
            at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
            at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:172)
            at org.apache.hadoop.hbase.zookeeper.ZKUtil.watchAndCheckExists(ZKUtil.java:420)
            at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.start(ZooKeeperNodeTracker.java:76)
            at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.ensureZookeeperTrackers(HConnectionManager.java:622)
            at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:882)
            at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:857)
            at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:257)
            at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:187)
            at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:142)
            at com.uhg.HBaseMapRMain.main(HBaseMapRMain.java:59)
            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
            at java.lang.reflect.Method.invoke(Method.java:606)
            at org.apache.hadoop.util.RunJar.main(RunJar.java:197)
    15/03/23 02:01:43 ERROR zookeeper.ZooKeeperWatcher: hconnection Received unexpected KeeperException, re-throwing exception
    org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
            at org.apache.zookeeper.KeeperException.create(KeeperException.java:90)
            at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
            at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
            at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:172)
            at org.apache.hadoop.hbase.zookeeper.ZKUtil.watchAndCheckExists(ZKUtil.java:420)
            at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.start(ZooKeeperNodeTracker.java:76)
            at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.ensureZookeeperTrackers(HConnectionManager.java:622)
            at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:882)
            at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:857)
            at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:257)
            at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:187)
            at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:142)
            at com.uhg.HBaseMapRMain.main(HBaseMapRMain.java:59)
            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
            at java.lang.reflect.Method.invoke(Method.java:606)
            at org.apache.hadoop.util.RunJar.main(RunJar.java:197)

The same question was asked previously here
[http://answers.mapr.com/questions/5864/hbase-jobs-failing-to-connect-to-zookeper-keeperexception-connectionloss-for-hbase-master.html][1]

FYI- We are using cluster not a sandbox. All the services are running and up.
Any Help please.


  [1]: http://answers.mapr.com/questions/5864/hbase-jobs-failing-to-connect-to-zookeper-keeperexception-connectionloss-for-hbase-master.html

Outcomes