AnsweredAssumed Answered

Distcp is throwing error while copying from kerberized HDP to our MapR

Question asked by udhaychoudhary on Oct 27, 2017
Latest reply on Oct 31, 2017 by jbubier


hadoop distcp -D -pb ipc.client.fallback-to-simple-auth-allowed=true hdfs://prodcluster/user/uday/distcptest maprfs://cldb1:7222//user/uday/distcptest/

 

17/10/27 19:21:07 ERROR tools.DistCp: Invalid arguments:

java.lang.RuntimeException: java.lang.ClassNotFoundException: Class com.mapr.fs.MapRFileSystem not found

at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2208)

at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2707)

at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2720)

at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:95)

at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2756)

at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2738)

at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:376)

at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295)

at org.apache.hadoop.tools.DistCp.setTargetPathExists(DistCp.java:225)

at org.apache.hadoop.tools.DistCp.run(DistCp.java:117)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)

at org.apache.hadoop.tools.DistCp.main(DistCp.java:461)

Caused by: java.lang.ClassNotFoundException: Class com.mapr.fs.MapRFileSystem not found

at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2114)

at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2206)

... 11 more

Invalid arguments: java.lang.ClassNotFoundException: Class com.mapr.fs.MapRFileSystem not found

usage: distcp OPTIONS [source_path...] <target_path>

              OPTIONS

Outcomes