Author: Narsi Subramanian
Original Publication Date: May 3, 2015
Affects all versions of mapr software.
This issue is seen typically in developer machines, where one tries to submit a job that accesses MaprDB tables using the org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil API but does not have the correct classes in it's classpath.
The exception stack normally looks like :
Exception in thread "main" java.lang.NoClassDefFoundError:
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapreduce.lib.output.DirectFileOutputCommitter
The DirectFileOutputCommitter class is part of the amazon-s3.jar shipped with the mapr distribution. This is missing from the classpath of the job submitted above and hence the issue.
Include the jar /opt/mapr/hadoop/hadoop-0.20.2/lib/amazon-s3.jar in your job classpath and that will resolve the issue.