AnsweredAssumed Answered

mapreduce job failed. exited with exitCode 1

Question asked by wasi on Dec 8, 2014
Latest reply on Apr 21, 2016 by bgajjela
I wrote a map job that reads a file from hdfs and writes the output into hbase. It uses the TableOutputFormat.class . I get the following error when running the job:

*14/12/08 07:22:20 INFO mapreduce.Job: Job job_1418038084089_0018 failed with state FAILED due to: Application application_1418038084089_0018 failed 2 times due to AM Container for appattempt_1418038084089_0018_000002 exited with  exitCode: 1 due to: Exception from container-launch:
org.apache.hadoop.util.Shell$ExitCodeException:
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:505)
        at org.apache.hadoop.util.Shell.run(Shell.java:418)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
        at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.launchContainer(LinuxContainerExecutor.java:295)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:314)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:83)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
main : command provided 1
main : user is root
main : requested yarn user is root
Container exited with a non-zero exit code 1
.Failing this attempt.. Failing the application.
14/12/08 07:22:20 INFO mapreduce.Job: Counters: 0*

The logfile has the following error just befor the exception is thrown:

*2014-12-08 07:22:16,229 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1418038084089_0018_000002 (auth:SIMPLE)
2014-12-08 07:22:16,235 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1418038084089_0018_02_000001 by user root
2014-12-08 07:22:16,235 ERROR com.mapr.hadoop.mapred.LocalVolumeAuxService: Can not find metadata for a job. Returning service metadata
2014-12-08 07:22:16,236 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=root IP=141.77.10.25 OPERATION=Start Container Request       TARGET=ContainerManageImpl      RESULT=SUCCESS  APPID=application_1418038084089_0018   CONTAINERID=container_1418038084089_0018_02_000001
2014-12-08 07:22:16,236 ERROR com.mapr.hadoop.mapred.LocalVolumeAuxService: Can not find metadata for a job. Returning service metadata
2014-12-08 07:22:16,236 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1418038084089_0018_02_000001 to application application_1418038084089_0018
2014-12-08 07:22:16,236 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1418038084089_0018_02_000001 transitioned from NEW to LOCALIZING
2014-12-08 07:22:16,236 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1418038084089_0018
2014-12-08 07:22:16,236 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1418038084089_0018_02_000001 transitioned from LOCALIZING to LOCALIZED
2014-12-08 07:22:16,260 ERROR com.mapr.hadoop.mapred.LocalVolumeAuxService: Can not find metadata for a job. Returning service metadata*

Does anybody know how to fix this issue?

greetings




Outcomes