Wibe2017

HDFS Erasure Coding... in MapR-FS

Discussion created by Wibe2017 on Jan 3, 2018
Latest reply on Jun 18, 2018 by Ted Dunning

Hi, 

 

First of all, Happy New Year 

 

As you might already know, Hadoop 3.0 has been release few weeks ago, 

 

The most important feature in this release (in my opinion) was the HDFS Erasure Coding, wich will replace the replication x3 (200% storage overhead). It is a technique that is based on parity blocks, that will decrease the storage overhead to only 50%. 

 

This simply means, that the physical storage used by your data will be cut by half, without loosing any data security!!!

 

I was wondering if MapR-FS (MapR-XD) will support such a feature any soon? 

 

Thanks & Regards, 

 

--

Wissem BELGUIDOUM

Outcomes