AnsweredAssumed Answered

LoadIncrementalHFiles fails with No FileSystem for scheme: maprfs

Question asked by cynosureabu on Jun 17, 2014
Latest reply on Jul 21, 2014 by yufeldman
Folks,
I am trying to bulk load the hdfs file into hbase with

<code>
LoadIncrementalHFiles loader = new LoadIncrementalHFiles(conf);

loader.doBulkLoad(new Path(args[1]), hTable);
</code>
However, i receive exception of

<pre>java.io.IOException: java.io.IOException: No FileSystem for scheme: **maprfs**

Exception in thread "main" java.io.IOException: BulkLoad encountered an unrecoverable problem

at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:331)

at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:261)

at com.walmartlabs.targeting.mapred.Driver.main(Driver.java:81)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at org.apache.hadoop.util.RunJar.main(RunJar.java:197)

Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=10, exceptions:

Tue Jun 17 21:48:58 PDT 2014, org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$3@482d59a3, java.io.IOException: java.io.IOException: No FileSystem for scheme: maprfs

</pre>

What is the reason for this exception? I did some googling, and tried to add some config to Hbase configuration:
<code>
hbaseConf.set("fs.hdfs.impl",org.apache.hadoop.hdfs.DistributedFileSystem.class.getName());

hbaseConf.set("fs.file.impl",org.apache.hadoop.fs.LocalFileSystem.class.getName());
</code>

But it didnt work.

My pom looks like this:
<code>
<dependency>
   <groupId>org.apache.hadoop</groupId>
   <artifactId>hadoop-client</artifactId>
   <version>1.0.3</version>
  </dependency>
  <dependency>
   <groupId>org.apache.hadoop</groupId>
   <artifactId>hadoop-core</artifactId>
   <version>1.0.3-mapr-3.0.2</version>
  </dependency>
    <dependency>
   <groupId>com.mapr.fs</groupId>
   <artifactId>mapr-hbase</artifactId>
   <version>1.0.3-mapr-3.0.2</version>
  </dependency>
<dependency>
   <groupId>org.apache.hbase</groupId>
   <artifactId>hbase</artifactId>
   <version>0.94.9-mapr-1308</version>
  </dependency>
</code>
Thanks,
Chen

Outcomes