AnsweredAssumed Answered

mapreduce error on single node

Question asked by anu on May 24, 2012
Latest reply on Jul 1, 2013 by nabeel
I have installed mapr single node in ubuntu.I am getting the following when running the wordcount job
<code>
12/05/24 16:15:19 INFO fs.JobTrackerWatcher: Current running JobTracker is: localhost/127.0.0.1:9001
12/05/24 16:15:19 INFO input.FileInputFormat: Total input paths to process : 1
12/05/24 16:15:20 INFO mapred.JobClient: Running job: job_201205241551_0007
12/05/24 16:15:21 INFO mapred.JobClient:  map 0% reduce 0%
12/05/24 16:15:26 INFO mapred.JobClient: Task Id : attempt_201205241551_0007_m_000002_0, Status : FAILED on node localhost
java.lang.Throwable: Child Error
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:259)
Caused by: java.io.IOException: Task process exit with nonzero status of 137.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:246)

12/05/24 16:15:26 WARN mapred.JobClient: Error reading task outputhttp://localhost:50060/tasklog?plaintext=true&attemptid=attempt_201205241551_0007_m_000002_0&filter=stdout
12/05/24 16:15:26 WARN mapred.JobClient: Error reading task outputhttp://localhost:50060/tasklog?plaintext=true&attemptid=attempt_201205241551_0007_m_000002_0&filter=stderr

and my tasktracker log says

2012-05-24 16:15:43,872 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 3
2012-05-24 16:15:44,184 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201205241551_0007_m_000001_3 task's state:UNASSIGNED
2012-05-24 16:15:44,185 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201205241551_0007_m_000001_3 which needs 1 slots
2012-05-24 16:15:44,185 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free slots : 3 and trying to launch attempt_201205241551_0007_m_000001_3 which needs 1 slots
2012-05-24 16:15:44,189 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201205241551_0007_m_-1285214497
2012-05-24 16:15:44,189 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201205241551_0007_m_-1285214497 spawned.
2012-05-24 16:15:44,189 INFO org.apache.hadoop.mapred.TaskLog: MapR: Setup Cmds: export JVM_PID=`echo $$`
export HADOOP_CLIENT_OPTS="-Dhadoop.tasklog.taskid=attempt_201205241551_0007_m_000001_3 -Dhadoop.tasklog.iscleanup=false -Dhadoop.tasklog.totalLogFileSize=0"
export HADOOP_WORK_DIR="/tmp/mapr-hadoop/mapred/local/taskTracker/root/jobcache/job_201205241551_0007/attempt_201205241551_0007_m_000001_3/work"
export HADOOP_TOKEN_FILE_LOCATION="/tmp/mapr-hadoop/mapred/local/taskTracker/root/jobcache/job_201205241551_0007/jobToken"
export HADOOP_ROOT_LOGGER="INFO,TLA"
export LD_LIBRARY_PATH="/tmp/mapr-hadoop/mapred/local/taskTracker/root/jobcache/job_201205241551_0007/attempt_201205241551_0007_m_000001_3/work:/usr/lib/jvm/java-6-sun-1.6.0.26/jre/lib/amd64/server:/usr/lib/jvm/java-6-sun-1.6.0.26/jre/lib/amd64:/usr/lib/jvm/java-6-sun-1.6.0.26/jre/../lib/amd64"
'
ulimit' '-v' '32'
echo 10 > /proc/self/oom_score_adj;renice -n 10 -p $$ 1>/dev/null;
2012-05-24 16:15:44,189 INFO org.apache.hadoop.mapred.TaskController: Writing commands to /tmp/mapr-hadoop/mapred/local/ttprivate/taskTracker/root/jobcache/job_201205241551_0007/attempt_201205241551_0007_m_000001_3/taskjvm.sh
2012-05-24 16:15:44,205 WARN org.apache.hadoop.mapred.LinuxTaskController: Exit code from task is : 137
2012-05-24 16:15:44,205 INFO org.apache.hadoop.mapred.JvmManager: JVM Not killed jvm_201205241551_0007_m_-1285214497 but just removed
2012-05-24 16:15:44,205 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201205241551_0007_m_-1285214497 exited with exit code 137. Number of tasks it ran: 0
2012-05-24 16:15:44,206 WARN org.apache.hadoop.mapred.TaskRunner: attempt_201205241551_0007_m_000001_3 : Child Error
java.io.IOException: Task process exit with nonzero status of 137.
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:246)
2012-05-24 16:15:44,459 WARN org.apache.hadoop.mapred.TaskLog: Failed to retrieve stdout log for task: attempt_201205241551_0007_m_000002

Outcomes