AnsweredAssumed Answered

How to execute mapreduce job from mac os using mapr client

Question asked by kewlb on May 4, 2015
Latest reply on Oct 19, 2015 by nitin007kuru
This is a very basic question but am still struggling at this.

 - I downloaded the MapR sandbox for hadoop and installed it in the VirtualBox
 - Installed the MapR client for mac os x and also ran the configure.sh

I wrote a very a basic mapreduce job (word count). I now don't know how to deploy this job in the sandbox node.

Tried the following command from my mac os,

**Command**

/opt/mapr/hadoop/hadoop-2.4.1/bin/hadoop jar target/buyer-inventory-profile-1.0-SNAPSHOT.jar MapRTest /tmp/wordcount.txt /tmp/wordcountresult.txt

**Error**

15/05/04 11:45:49 INFO mapreduce.Cluster: Failed to use org.apache.hadoop.mapred.YarnClientProtocolProvider due to error: Does not contain a valid host:port authority: __RM_IP__:8032 (configuration property 'yarn.resourcemanager.address')
Exception in thread "main" java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.

**Command**

/opt/mapr/hadoop/hadoop-0.20.2/bin/hadoop jar target/buyer-inventory-profile-1.0-SNAPSHOT.jar com.rubicon.nogo.inventoryprofile.MapRTest /tmp/wordcount.txt /tmp/wordcountresult.txt

**Error**

2015-05-04 11:48:22,6945 ERROR Client fs/client/fileclient/cc/client.cc:394 Thread: 4497756160 Failed to initialize client for cluster demo.mapr.com, error Operation timed out(60)
15/05/04 11:48:22 ERROR ipc.FailoverRPC: FailoverProxy: Failing this Call: getStagingAreaDir. Error while fetching JobTracker location java.io.IOException: Failed to get cluster information for maprfs:///

Your help is appreciated.


Outcomes