AnsweredAssumed Answered

Running Spark applications on Yarn

Question asked by mahdi62b on Feb 27, 2017
Latest reply on Mar 1, 2017 by maprcommunity

Hi,

 

I have set up a MapR (5.2) cluster on couple of Ec2 instances. I can run spark application on local model using spark submit but can run using yarn-cluster.

 

it prompts 17/02/27 14:25:35 WARN Client: Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME.

 

and then my application exist with failed status..how to configure spark to run on yarn-custer in Mapr cluster?

Outcomes