Rachel Silver

Hadoop Ecosystem Updates for MapR Platform - May 12, 2016

Blog Post created by Rachel Silver Employee on May 5, 2016

Release Date: May 5, 2016

Updated: May 12, 2016

 

We are glad to announce another monthly ecosystem update release.

 

ECO-1604 release includes GA version of Apache Spark 1.6.1 for MapR (emerging from a 2-month Developer Preview) and updates to existing ecosystem packages.

 

Our latest release contains some interesting new features in Spark and updates for Hue, Mahout, and Hive

 

*Update 5/12/16: Today, we have re-released Hive 1.0.0 with fixes as part of ECO-1604 release.

 

Be the first to get notified about new releases

How to get notified of release, product and patch announcements

 

ECO-1604 Release Features

 

Spark 1.6.1

 

GitHub - mapr/spark at 1.6.1-mapr-1604

See the Spark 1.6 Developer Preview announcement for all of the added features: Essential Tips for Making the Most of the Spark 1.6 Developer Preview | MapR

 

Added features:

  • Automatic memory management: execution memory and storage memory are adapted dynamically based on workload characteristics.

  • Dataset API: Datasets can be constructed from JVM objects and then manipulated using functional transformations (map, flatMap, filter, etc) in Scala and Java.

  • Machine Learning Pipeline Persistence: adds new features to machine learning that takes persistence beyond models to persisting the entire pipeline, including transformers and estimators.

  • New Machine Learning algorithms: online hypothesis testing (A/B testing in Spark Streaming), bisecting K-Means clustering, and normal equation for least squares that provides R-like model summary statistics.

 

Mahout 0.11.2

Tag: 0.11.0-mapr-1604

GitHub - mapr/mahout at 0.11.0-mapr-1604

 

Hue Re-releases

Hue 3.8.1

Tag: 3.8.1-mapr-1604

GitHub - mapr/hue at 3.8.1-mapr-1604    

 

Hue 3.6

Tag: 3.6.0-mapr-1604

GitHub - mapr/hue at 3.6.0-mapr-1604

 

Hive 1.0.0

Tag: 1.0.0-mapr-1604

GitHub - mapr/hive at 1.0.0-mapr-1604

 

Download

 

Ecosystem Package locations:

http://package.mapr.com/releases/ecosystem-4.x/

http://package.mapr.com/releases/ecosystem-5.x/

 

Installer location:

http://package.mapr.com/releases/installer/

 

Documentation

 

Helpful Resources

 

Converge Community Resources

spark, mahout, hue

 

Have a Question?

Ask in Answers or comment below.

Outcomes