AnsweredAssumed Answered

MapReduce jobs not assigned to tasktracker

Question asked by alexwoolford on Feb 11, 2015
Latest reply on Feb 11, 2015 by nabeel
I setup a three-node community cluster running both versions of Hadoop (MR1 and Yarn). I tried to run the TeraSort benchmark and got stumped when the job was submitted, but was not assigned:

![alt text][1]

Here's what I did:

    maprcli volume create -name data1 –replication 1 –mount 1 –path /data1

    mapr@hadoop01:~$ hadoop jar /opt/mapr/hadoop/hadoop-0.20.2/hadoop-0.20.2-dev-examples.jar teragen 5000000 /data1/out1
    15/02/11 20:24:05 INFO terasort.TeraSort: Generating 5000000 using 2
    15/02/11 20:24:05 INFO mapreduce.JobSubmitter: number of splits:2
    15/02/11 20:24:05 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1423696752634_0002
    15/02/11 20:24:05 INFO security.ExternalTokenManagerFactory: Initialized external token manager class - com.mapr.hadoop.yarn.security.MapRTicketManager
    15/02/11 20:24:06 INFO impl.YarnClientImpl: Submitted application application_1423696752634_0002
    15/02/11 20:24:06 INFO mapreduce.Job: The url to track the job: http://hadoop02:8088/proxy/application_1423696752634_0002/
    15/02/11 20:24:06 INFO mapreduce.Job: Running job: job_1423696752634_0002

I'm slightly confused. I expected the job to run through MR1 and see references to Yarn in the logging.

Does anyone have any idea what I might've done wrong and how to fix it?


  [1]: http://imgur.com/rFJUVpx

Outcomes