AnsweredAssumed Answered

Including AWS jar file in classpath

Question asked by SankarRaman on May 15, 2017
Latest reply on Jul 24, 2017 by maprcommunity


Current classpath (# hadoop classpath)is not  having the path for AWS jar file (opt/mapr/hadoop/hadoop-2.7.0/share/hadoop/tools/lib/hadoop-aws-2.7.0-mapr-1506.jar)

How can I update include above to the existing classpath in MAPR cluster.

Please advise.


Here is what I tried and not working.

1. I tried to copy the jar file (above mentioned)  to /opt/mapr/hadoop/hadoop-2.7.0/share/hadoop/tools/lib/

2. Then I login to Hive (# hive). it gives following error 

Exception in thread "main" java.util.ServiceConfigurationError: org.apache.hadoop.fs.FileSystem: Provider org.apache.hadoop.fs.s3a.S3AFileSystem could not be instantiated

3. Then I remove the jar file from /opt/mapr/hadoop/hadoop-2.7.0/share/hadoop/tools/lib/