AnsweredAssumed Answered

Talend and MapR Tables/HBase

Question asked by matthew_moisen on Aug 19, 2014
Latest reply on Nov 10, 2014 by jobinthompu
I am attempting to use Talend for MapR Tables/HBase but am having difficulty.

If you note the first two lines, you will see that my talend job can not find the MapRTableMappingRules class, which MapR then assumes to mean that I am using generic HBase instead of MapR Tables, and my job hangs and eventually fails because it can't find any region servers (as expected because I have MapR Tables).

I have tried using tLibraryLoad component to load the mapr-hbase-1.0.3-mapr-3.0.1.jar class into my class path, but still have the same error message. My class path indeed specifies the mapr-hbase*.jar file.

Has anyone successfully used Talend with MapR Tables?

    14/08/06 15:51:26 INFO mapr.TableMappingRulesFactory: Could not find MapRTableMappingRules class, assuming HBase only cluster.
    14/08/06 15:51:26 INFO mapr.TableMappingRulesFactory: If you are trying to access M7 tables, add mapr-hbase jar to your classpath.
    14/08/06 15:51:26 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    14/08/06 15:51:26 INFO security.JniBasedUnixGroupsMappingWithFallback: Falling back to shell based
    14/08/06 15:51:26 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
    14/08/06 15:51:26 INFO zookeeper.ZooKeeper: Client environment:host.name=hddev-c01-edge-01
    14/08/06 15:51:26 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_24
    14/08/06 15:51:26 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
    14/08/06 15:51:26 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre
    
    14/08/06 15:51:26 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
    14/08/06 15:51:26 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
    14/08/06 15:51:26 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
    14/08/06 15:51:26 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
    14/08/06 15:51:26 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-358.6.1.el6.x86_64
    14/08/06 15:51:26 INFO zookeeper.ZooKeeper: Client environment:user.name=hdpsbp
    14/08/06 15:51:26 INFO zookeeper.ZooKeeper: Client environment:user.home=/users/hdpsbp
    14/08/06 15:51:26 INFO zookeeper.ZooKeeper: Client environment:user.dir=/users/hdpsbp/TestFiles/TestHBaseOperations/TestHBaseOperations
    14/08/06 15:51:26 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=hdnprd-c01-r01-01:5181,hdnprd-c01-r01-03:5181,hdnprd-c01-r01-02:5181 sessionTimeout=180000 watcher=hconnection
    14/08/06 15:51:26 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 16360@hddev-c01-edge-01
    14/08/06 15:51:26 INFO zookeeper.ClientCnxn: Opening socket connection to server hdnprd-c01-r01-03.cisco.com/64.102.197.12:5181. Will not attempt to authenticate using SASL (unknown error)
    14/08/06 15:51:26 INFO zookeeper.ClientCnxn: Socket connection established to hdnprd-c01-r01-03.cisco.com/64.102.197.12:5181, initiating session
    14/08/06 15:51:26 INFO zookeeper.ClientCnxn: Session establishment complete on server hdnprd-c01-r01-03.cisco.com/64.102.197.12:5181, sessionid = 0x24693d9191a7302, negotiated timeout = 40000
    Exception in component tHBaseInput_1
    org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find region for /app/SubscriptionBillingPlatform/Matthew,,99999999999999 after 10 tries.
            at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:991)
            at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:896)
            at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:998)
            at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:900)
            at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:857)
            at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:257)
            at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:187)
            at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:142)
            at poc2.testhbaseoperations_0_1.TestHBaseOperations.tHBaseInput_1Process(TestHBaseOperations.java:752)
            at poc2.testhbaseoperations_0_1.TestHBaseOperations.tHBaseConnection_1Process(TestHBaseOperations.java:375)
            at poc2.testhbaseoperations_0_1.TestHBaseOperations.runJobInTOS(TestHBaseOperations.java:1104)
            at poc2.testhbaseoperations_0_1.TestHBaseOperations.main(TestHBaseOperations.java:993)

Outcomes