AnsweredAssumed Answered

Spark and Mapr-DB Connectors

Question asked by nirav on Apr 10, 2017
Latest reply on Apr 11, 2017 by Rachel Silver
Branched from an earlier discussion

I see two connectors in MEP 3.0 and both of them might work for our use case. Have few questions that may help further clarify which options is best for us.

 

1) Native Spark Connector for MapR-DB JSON

Are following scala DSL predicates gets pushdown to datasource?

Scala DSL for Specifying Predicates 

 

2) Spark HBase and MapR-DB Binary Connector

Would this work over mapr-db binary tables ? does it do predicate pushdown and projection? If so what is the difference between this one and previous connector? Performance? This one also supports spark dataframe which is more programmer friendly and performant with spark 2. 

SparkSQL and DataFrames 

Outcomes