AnsweredAssumed Answered

HBase and completebulkload

Question asked by andy_sautins on Sep 14, 2011
Latest reply on Sep 15, 2011 by andy_sautins

  I have run into an issue using HBase completebulkload.  The first issue is that it does not seem to properly find zookeeper.  I believe this is somewhat related to HBASE-3714 which does not look like it is incorporated in the included version of HBase ( hbase-0.90.2 ).

  I can somewhat work around the issue ( as we worked around it in CDH3U0 ) by setting the zookeeper paramters on the command line.  The bulk load works and loads a few of the files, but fails with the following (santized) exception:

java.io.IOException: java.io.IOException: Failed rename of maprfs://x.x.x.x:7222/src to maprfs://y.y.y.y:7222/hbase/dest
   at org.apache.hadoop.hbase.regionserver.StoreFile.rename(StoreFile.java:512)
   at org.apache.hadoop.hbase.regionserver.Store.bulkLoadHFile(Store.java:366)
   at org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFile(HRegion.java:2201)
   at org.apache.hadoop.hbase.regionserver.HRegionServer.bulkLoadHFile(HRegionServer.java:2031)
   at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)

I guess my question is has anyone had success with completebulkload?

Outcomes