AnsweredAssumed Answered

hive and hbase integration problem class not found exception for TableSplit

Question asked by wkv on Apr 8, 2014
Latest reply on Apr 11, 2014 by nyang
So I was able to do the "pokes" hive-hbase integration in the documentation.  Now I'm trying a multi-column hbase table however map reduce is failing:

<code>
Diagnostic Messages for this Task:
Error: java.lang.ClassNotFoundException: org.apache.hadoop.hbase.mapreduce.TableSplit
        at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:355)

hive.added.jars.path file:///opt/mapr/hive/hive-0.12/lib/hbase-0.94.13-mapr-1401.jar,file:///opt/mapr/hive/hive-0.12/lib/hive-hbase-handler-0.12-mapr-1401.jar

tmpjars file:///opt/mapr/hive/hive-0.12/lib/hive-hbase-handler-0.12-mapr-1401.jar,file:/opt/mapr/hbase/hbase-0.94.13/hbase-0.94.13-mapr-1401.jar,file:///opt/mapr/zookeeper/zookeeper-3.4.5/zookeeper-3.4.5-mapr-1401.jar,file:/opt/mapr/hive/hive-0.12/lib/hive-hbase-handler-0.12-mapr-1401.jar,file:///opt/mapr/hive/hive-0.12/lib/hbase-0.94.13-mapr-1401.jar,file:///opt/mapr/hbase/hbase-0.94.13/hbase-0.94.13-mapr-1401.jar

mapred.job.classpath.files /var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201404080354_0012/libjars/hive-hbase-handler-0.12-mapr-1401.jar:/var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201404080354_0012/libjars/hbase-0.94.13-mapr-1401.jar:/var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201404080354_0012/libjars/zookeeper-3.4.5-mapr-1401.jar:/var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201404080354_0012/libjars/hive-hbase-handler-0.12-mapr-1401.jar:/var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201404080354_0012/libjars/hbase-0.94.13-mapr-1401.jar:/var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201404080354_0012/libjars/hbase-0.94.13-mapr-1401.jar


hive-site.xml has:
<property>
  <name>hive.aux.jars.path</name>
   <value>file:///opt/mapr/hive/hive-0.12/lib/hive-hbase-handler-0.12-mapr-1401.jar,file:///opt/mapr/hbase/hbase-0.94.13/hbase-0.94.13-mapr-1401.jar,file:///opt/mapr/zookeeper/zookeeper-3.4.5/zookeeper-3.4.5-mapr-1401.jar</value>
  <description>A comma separated list (with no spaces) of the jar files required for Hive-HBase integration</description>
</property>

$ unzip -l /opt/mapr/hbase/hbase-0.94.13/hbase-0.94.13-mapr-1401.jar | grep TableSplit
     5481  01-14-2014 12:14   org/apache/hadoop/hbase/mapreduce/TableSplit.class
     1907  01-14-2014 12:14   org/apache/hadoop/hbase/mapreduce/TableSplit$Version.class
     2851  01-14-2014 12:14   org/apache/hadoop/hbase/mapred/TableSplit.class

</code>

 * have the eco system files from February 2014

Every thing I can find says that the hbase-0.94.13 jar is missing but I do not see why, any suggestions?

Outcomes