AnsweredAssumed Answered

After query hive mapreduce job failed in mapr version 3.1.1 & hive-0.12

Question asked by pratap20 on May 31, 2015
Latest reply on Jun 1, 2015 by Hao Zhu
I have setup 7 node mapr M7 cluster with version 3.1.1
I have setup hive across all cluster nodes. hive meta , hiveserver2,is installed & configured on node2  mysql server is installed on the same node.
 All is working fine except when I query from my mapreduce job failed. Please find below error & help me resolve this issue.

    
    [root@blbdcprod02 ~]# hive
    15/05/31 13:03:19 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
    
    Logging initialized using configuration in jar:file:/opt/mapr/hive/hive-0.12/lib/hive-common-0.12-mapr-1501.jar!/hive-log4j.properties
    hive> select * from emp WHERE name='mayur';
    Total MapReduce jobs = 1
    Launching Job 1 out of 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201505040043_0015, Tracking URL = http://blbdcprod05:50030/jobdetails.jsp?jobid=job_201505040043_0015
    Kill Command = /opt/mapr/hadoop/hadoop-0.20.2/bin/../bin/hadoop job  -kill job_201505040043_0015
    Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0
    2015-05-31 13:03:29,846 Stage-1 map = 0%,  reduce = 0%
    2015-05-31 13:03:31,860 Stage-1 map = 100%,  reduce = 100%
    Ended Job = job_201505040043_0015 with errors
    Error during job, obtaining debugging information...
    Job Tracking URL: http://blbdcprod05:50030/jobdetails.jsp?jobid=job_201505040043_0015
    Examining task ID: task_201505040043_0015_m_000000 (and more) from job job_201505040043_0015
    Exception in thread "Thread-5" java.lang.RuntimeException: Error while reading from task log url
            at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getStackTraces(TaskLogProcessor.java:278)
            at org.apache.hadoop.hive.ql.exec.mr.JobDebugger.showJobFailDebugInfo(JobDebugger.java:276)
            at org.apache.hadoop.hive.ql.exec.mr.JobDebugger.run(JobDebugger.java:118)
            at java.lang.Thread.run(Thread.java:744)
    Caused by: java.io.FileNotFoundException: http://blbdcprod01:50060/tasklog?attemptid=attempt_201505040043_0015_m_000000_2
            at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1624)
            at java.net.URL.openStream(URL.java:1037)
            at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getInputStream(TaskLogProcessor.java:121)
            at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getStackTraces(TaskLogProcessor.java:220)
            ... 3 more
    FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
    MapReduce Jobs Launched:
    Job 0: Map: 1   MAPRFS Read: 0 MAPRFS Write: 0 FAIL
    Total MapReduce CPU Time Spent: 0 msec
    hive>
    

Please help me resolve this issue. Thanks in advance. Appreciate quick response. Pratap

Outcomes