AnsweredAssumed Answered

When I query at hive, the mapreduce job failed !?

Question asked by hyejin on Mar 27, 2014
Latest reply on Mar 28, 2014 by mufeed
When I use mapr-hive, I have a problem like below!!


----------


hive> select * from apachelog where host;

Total MapReduce jobs = 1

Launching Job 1 out of 1

Number of reduce tasks is set to 0 since there's no reduce operator

Starting Job = job_201403271322_0002, Tracking URL = http://localhost:50030/jobdetails.jsp?jobid=
Kill Command = /opt/mapr/hadoop/hadoop-0.20.2/bin/../bin/hadoop job  -kill job_201403271322_0002

Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0

2014-03-28 09:32:15,547 Stage-1 map = 0%,  reduce = 0%

2014-03-28 09:32:36,673 Stage-1 map = 100%,  reduce = 100%

Ended Job = job_201403271322_0002 with errors

Error during job, obtaining debugging information...

Job Tracking URL: http://localhost:50030/jobdetails.jsp?jobid=job_201403271322_0002

Examining task ID: task_201403271322_0002_m_000000 (and more) from job job_201403271322_0002

Task with the most failures(4):
-----
Task ID:
  task_201403271322_0002_m_000000

-----
Diagnostic Messages for this Task:

java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:414)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:349)
at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
at org.apache.hadoop.mapred.Child.main(Child.java:264)
    

Caused by: java.lang.reflect.InvocationTargetException

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 9 more
    
Caused by: java.lang.RuntimeException: Error in configuring object

at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 14 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 17 more
    
Caused by: java.lang.RuntimeException: Map operator initialization failed

at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.configure(ExecMapper.java:134)
... 22 more
    
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: orb.serde2.RegexSerDe

at org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:328)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:355)
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.configure(ExecMapper.java:103)
... 22 more
    
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe

at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:270)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1039)
at org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:291)
... 24 more


FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask

MapReduce Jobs Launched:

Job 0: Map: 1   MAPRFS Read: 0 MAPRFS Write: 0 FAIL

Total MapReduce CPU Time Spent: 0 msec

----------
Then I check the task tracker log

syslog logs

2014-03-28 11:43:28,740 INFO org.apache.hadoop.mapred.Child: JVM: jvm_201403281142_0001_m_1128750915 pid: 7385

2014-03-28 11:43:29,087 INFO org.apache.hadoop.mapred.TaskRunner: Creating symlink: /tmp/mapr-hadoop/mapred/local/taskTracker/root/distcache/-5596313453593109507_-478235440_110185998/maprfs/tmp/mydir/hive_2014-03-28_11-42-35_599_5620785440426199824-1/-mr-10003/fd3d91e7-a680-4987-bd05-ba5803a5ee83/map.xml <- /tmp/mapr-hadoop/mapred/local/taskTracker/root/jobcache/job_201403281142_0001/attempt_201403281142_0001_m_000000_0/work/map.xml

2014-03-28 11:43:29,091 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating symlink: /tmp/mapr-hadoop/mapred/local/taskTracker/root/jobcache/job_201403281142_0001/jars/job.jar <- /tmp/mapr-hadoop/mapred/local/taskTracker/root/jobcache/job_201403281142_0001/attempt_201403281142_0001_m_000000_0/work/job.jar

2014-03-28 11:43:29,092 INFO org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating symlink: /tmp/mapr-hadoop/mapred/local/taskTracker/root/jobcache/job_201403281142_0001/jars/.job.jar.crc <- /tmp/mapr-hadoop/mapred/local/taskTracker/root/jobcache/job_201403281142_0001/attempt_201403281142_0001_m_000000_0/work/.job.jar.crc

2014-03-28 11:43:29,105 INFO org.apache.hadoop.mapred.Child: Starting task attempt_201403281142_0001_m_000000_0

2014-03-28 11:43:29,106 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=MAP, sessionId=

2014-03-28 11:43:29,186 INFO org.apache.hadoop.mapreduce.util.ProcessTree: setsid exited with exit code 0

**2014-03-28 11:43:29,189 WARN org.apache.hadoop.mapreduce.util.ProcfsBasedProcessTree: /proc/<pid>/status does not have information about swap space used(VmSwap). Can not track swap usage of a task.**

2014-03-28 11:43:29,189 INFO org.apache.hadoop.mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.mapreduce.util.LinuxResourceCalculatorPlugin@41951585

2014-03-28 11:43:29,337 INFO org.apache.hadoop.hive.ql.exec.Utilities: <PERFLOG method=deserializePlan>

2014-03-28 11:43:29,473 INFO org.apache.hadoop.hive.ql.exec.Utilities: </PERFLOG method=deserializePlan start=1395974609337 end=1395974609473 duration=136>

**2014-03-28 11:43:29,501 WARN org.apache.hadoop.io.compress.snappy.LoadSnappy: Snappy native library is available**

2014-03-28 11:43:29,501 INFO org.apache.hadoop.io.compress.snappy.LoadSnappy: Snappy native library loaded

2014-03-28 11:43:29,508 INFO org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file maprfs:/user/hive/warehouse/test.db/apachelog/ssl_access_log-20140209

2014-03-28 11:43:29,513 INFO org.apache.hadoop.hive.ql.exec.mr.ExecMapper: maximum memory = 749731840

2014-03-28 11:43:29,514 INFO org.apache.hadoop.hive.ql.exec.mr.ExecMapper: conf classpath = [file:/opt/mapr/hadoop/hadoop-0.20.2/conf/, file:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/lib/tools.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/, file:/opt/mapr/hadoop/hadoop-0.20.2/hadoop*core*.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/amazon-s3.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/asm-3.2.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/aspectjrt-1.6.5.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/aspectjtools-1.6.5.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/aws-java-sdk-1.3.26.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/baseutils-0.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-cli-1.2.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-codec-1.5.jar, file:/opt/mapr/lib/commons-collections-3.2.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-configuration-1.8.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-daemon-1.0.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-el-1.0.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-httpclient-3.0.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-httpclient-3.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-lang-2.6.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-logging-1.0.4.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-logging-1.1.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-logging-api-1.0.4.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-math-2.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-net-1.4.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-net-3.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/core-3.1.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/emr-metrics-1.0.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/eval-0.5.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/gson-1.4.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/guava-13.0.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/hadoop-0.20.2-dev-capacity-scheduler.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/hadoop-0.20.2-dev-core.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/hadoop-0.20.2-dev-fairscheduler.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/hsqldb-1.8.0.10.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/httpclient-4.1.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/httpcore-4.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jackson-core-asl-1.5.2.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jackson-mapper-asl-1.5.2.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jasper-compiler-5.5.12.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jasper-runtime-5.5.12.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jersey-core-1.8.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jersey-json-1.8.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jersey-server-1.8.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jets3t-0.6.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jetty-6.1.26.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jetty-servlet-tester-6.1.26.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jetty-util-6.1.26.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/junit-4.5.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/kfs-0.2.2.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/libprotodefs.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/log4j-1.2.15.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/logging-0.1.jar, file:/opt/mapr/lib/maprfs-1.0.3-mapr-3.0.2.jar, file:/opt/mapr/lib/maprfs-core-1.0.3-mapr-3.0.2.jar, file:/opt/mapr/lib/maprfs-core-1.0.3-mapr-3.0.2-tests.jar, file:/opt/mapr/lib/maprfs-diagnostic-tools-1.0.3-mapr-3.0.2.jar, file:/opt/mapr/lib/maprfs-jni-1.0.3-mapr-3.0.2.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/mapr-hbase-1.0.3-mapr-3.0.2.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/mapr-hbase-1.0.3-mapr-3.0.2-tests.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/maprsecurity-0.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/mockito-all-1.8.2.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/mockito-all-1.8.5.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/mysql-connector-java-5.0.8-bin.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/oro-2.0.8.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/protobuf-java-2.4.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/servlet-api-2.5-20081211.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/servlet-api-2.5-6.1.14.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/slf4j-api-1.4.3.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/slf4j-log4j12-1.4.3.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/xmlenc-0.52.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/zookeeper-3.3.6.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jsp-2.1/jsp-2.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jsp-2.1/jsp-api-2.1.jar, file:/tmp/mapr-hadoop/mapred/local/taskTracker/root/jobcache/job_201403281142_0001/jars/classes, file:/tmp/mapr-hadoop/mapred/local/taskTracker/root/jobcache/job_201403281142_0001/jars/job.jar, file:/tmp/mapr-hadoop/mapred/local/taskTracker/root/distcache/1093974824435210859_-1291935556_110201792/maprfs/var/mapr/cluster/mapred/jobTracker/staging/root/.staging/job_201403281142_0001/libjars/hive-hbase-handler-0.12-mapr-1401-140130.jar, file:/tmp/mapr-hadoop/mapred/local/taskTracker/root/distcache/-8450094087318562552_-417495434_110201850/maprfs/var/mapr/cluster/mapred/jobTracker/staging/root/.staging/job_201403281142_0001/libjars/hbase-0.94.13-mapr-1401.jar, file:/tmp/mapr-hadoop/mapred/local/taskTracker/root/distcache/-3864877838927061197_-2129477948_110201905/maprfs/var/mapr/cluster/mapred/jobTracker/staging/root/.staging/job_201403281142_0001/libjars/zookeeper-3.3.6.jar, file:/tmp/mapr-hadoop/mapred/local/taskTracker/root/distcache/8166404069761618389_1819764007_110201937/maprfs/var/mapr/cluster/mapred/jobTracker/staging/root/.staging/job_201403281142_0001/libjars/hive-serde-0.12-mapr-1401-140130.jar, file:/tmp/mapr-hadoop/mapred/local/taskTracker/root/jobcache/job_201403281142_0001/attempt_201403281142_0001_m_000000_0/work/]

2014-03-28 11:43:29,514 INFO org.apache.hadoop.hive.ql.exec.mr.ExecMapper: thread classpath = [file:/opt/mapr/hadoop/hadoop-0.20.2/conf/, file:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/lib/tools.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/, file:/opt/mapr/hadoop/hadoop-0.20.2/hadoop*core*.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/amazon-s3.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/asm-3.2.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/aspectjrt-1.6.5.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/aspectjtools-1.6.5.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/aws-java-sdk-1.3.26.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/baseutils-0.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-cli-1.2.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-codec-1.5.jar, file:/opt/mapr/lib/commons-collections-3.2.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-configuration-1.8.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-daemon-1.0.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-el-1.0.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-httpclient-3.0.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-httpclient-3.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-lang-2.6.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-logging-1.0.4.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-logging-1.1.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-logging-api-1.0.4.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-math-2.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-net-1.4.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/commons-net-3.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/core-3.1.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/emr-metrics-1.0.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/eval-0.5.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/gson-1.4.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/guava-13.0.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/hadoop-0.20.2-dev-capacity-scheduler.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/hadoop-0.20.2-dev-core.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/hadoop-0.20.2-dev-fairscheduler.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/hsqldb-1.8.0.10.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/httpclient-4.1.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/httpcore-4.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jackson-core-asl-1.5.2.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jackson-mapper-asl-1.5.2.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jasper-compiler-5.5.12.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jasper-runtime-5.5.12.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jersey-core-1.8.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jersey-json-1.8.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jersey-server-1.8.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jets3t-0.6.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jetty-6.1.26.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jetty-servlet-tester-6.1.26.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jetty-util-6.1.26.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/junit-4.5.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/kfs-0.2.2.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/libprotodefs.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/log4j-1.2.15.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/logging-0.1.jar, file:/opt/mapr/lib/maprfs-1.0.3-mapr-3.0.2.jar, file:/opt/mapr/lib/maprfs-core-1.0.3-mapr-3.0.2.jar, file:/opt/mapr/lib/maprfs-core-1.0.3-mapr-3.0.2-tests.jar, file:/opt/mapr/lib/maprfs-diagnostic-tools-1.0.3-mapr-3.0.2.jar, file:/opt/mapr/lib/maprfs-jni-1.0.3-mapr-3.0.2.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/mapr-hbase-1.0.3-mapr-3.0.2.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/mapr-hbase-1.0.3-mapr-3.0.2-tests.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/maprsecurity-0.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/mockito-all-1.8.2.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/mockito-all-1.8.5.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/mysql-connector-java-5.0.8-bin.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/oro-2.0.8.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/protobuf-java-2.4.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/servlet-api-2.5-20081211.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/servlet-api-2.5-6.1.14.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/slf4j-api-1.4.3.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/slf4j-log4j12-1.4.3.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/xmlenc-0.52.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/zookeeper-3.3.6.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jsp-2.1/jsp-2.1.jar, file:/opt/mapr/hadoop/hadoop-0.20.2/lib/jsp-2.1/jsp-api-2.1.jar, file:/tmp/mapr-hadoop/mapred/local/taskTracker/root/jobcache/job_201403281142_0001/jars/classes, file:/tmp/mapr-hadoop/mapred/local/taskTracker/root/jobcache/job_201403281142_0001/jars/job.jar, file:/tmp/mapr-hadoop/mapred/local/taskTracker/root/distcache/1093974824435210859_-1291935556_110201792/maprfs/var/mapr/cluster/mapred/jobTracker/staging/root/.staging/job_201403281142_0001/libjars/hive-hbase-handler-0.12-mapr-1401-140130.jar, file:/tmp/mapr-hadoop/mapred/local/taskTracker/root/distcache/-8450094087318562552_-417495434_110201850/maprfs/var/mapr/cluster/mapred/jobTracker/staging/root/.staging/job_201403281142_0001/libjars/hbase-0.94.13-mapr-1401.jar, file:/tmp/mapr-hadoop/mapred/local/taskTracker/root/distcache/-3864877838927061197_-2129477948_110201905/maprfs/var/mapr/cluster/mapred/jobTracker/staging/root/.staging/job_201403281142_0001/libjars/zookeeper-3.3.6.jar, file:/tmp/mapr-hadoop/mapred/local/taskTracker/root/distcache/8166404069761618389_1819764007_110201937/maprfs/var/mapr/cluster/mapred/jobTracker/staging/root/.staging/job_201403281142_0001/libjars/hive-serde-0.12-mapr-1401-140130.jar, file:/tmp/mapr-hadoop/mapred/local/taskTracker/root/jobcache/job_201403281142_0001/attempt_201403281142_0001_m_000000_0/work/]

----------

I have 2 warning but below one is ok as I thought!

How can I fix "2014-03-28 11:43:29,189 WARN org.apache.hadoop.mapreduce.util.ProcfsBasedProcessTree: /proc/<pid>/status does not have information about swap space used(VmSwap). Can not track swap usage of a task." this one ??

Do you have any idea??














Outcomes