AnsweredAssumed Answered

MapReduce jobs not running in Hive

Question asked by piyushgodbole on May 7, 2018
Latest reply on May 15, 2018 by maprcommunity

Hi all,

 

Hive is using mapreduce to execute a query. I am having a complex query with three filters. But every time the query fails with the following error:

 

Ended Job = job_1525669965073_0031 with errors
Error during job, obtaining debugging information...
Examining task ID: task_1525669965073_0031_m_000000 (and more) from job job_1525669965073_0031
Examining task ID: task_1525669965073_0031_m_000010 (and more) from job job_1525669965073_0031
Examining task ID: task_1525669965073_0031_m_000021 (and more) from job job_1525669965073_0031
Examining task ID: task_1525669965073_0031_m_000011 (and more) from job job_1525669965073_0031

Task with the most failures(4):
-----
Task ID:
task_1525669965073_0031_m_000003

-----
Diagnostic Messages for this Task:
Exception from container-launch.
Container id: container_e09_1525669965073_0031_02_000043
Exit code: 7
Stack trace: ExitCodeException exitCode=7:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
at org.apache.hadoop.util.Shell.run(Shell.java:456)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.launchContainer(LinuxContainerExecutor.java:304)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:354)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:87)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

Shell output: main : command provided 1
main : user is mapr
main : requested yarn user is mapr


Container exited with a non-zero exit code 7


FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched:
Stage-Stage-1: Map: 28 Cumulative CPU: 87.75 sec MAPRFS Read: 0 MAPRFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 1 minutes 27 seconds 750 msec

 

How to handle this? I have attached the application logs.

 

Thanks,

Piyush Godbole

Outcomes