AnsweredAssumed Answered

Running Spark applications on Yarn

Question asked by mahdi62b on Feb 27, 2017
Latest reply on Mar 1, 2017 by maprcommunity



I have set up a MapR (5.2) cluster on couple of Ec2 instances. I can run spark application on local model using spark submit but can run using yarn-cluster.


it prompts 17/02/27 14:25:35 WARN Client: Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME.


and then my application exist with failed to configure spark to run on yarn-custer in Mapr cluster?