AnsweredAssumed Answered

Strange hive error

Question asked by siddharth1988 on Jul 9, 2013
Latest reply on Jul 10, 2013 by shaka
Team,

Eventhough we have all URI_LOCATIONS proper we are hitting following error

Exception in thread "Thread-10" java.lang.IllegalArgumentException: Does not contain a valid host:port authority: maprfs:///
        at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:166)
        at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:132)
        at org.apache.hadoop.hive.ql.exec.JobTrackerURLResolver.getURL(JobTrackerURLResolver.java:42)
        at org.apache.hadoop.hive.ql.exec.JobDebugger.showJobFailDebugInfo(JobDebugger.java:209)
        at org.apache.hadoop.hive.ql.exec.JobDebugger.run(JobDebugger.java:92)
        at java.lang.Thread.run(Thread.java:662)
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
MapReduce Jobs Launched:

current setup of URI: maprfs:/vol1/dirtest/aet/project2/warehouse/project2.db


Also on Jobtracker console we see following errors for the job which fails in reduce phase

java.lang.Throwable: Child Error at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:275) Caused by: java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:262) ,java.lang.Throwable: Child Error at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:275) Caused by: java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:262)



Why is this happening.

It works well if we have smaller files. Current file we are trying to load is 4GB only.

Outcomes