AnsweredAssumed Answered

spark-shell Error in mapr 6.0 sandbox

Question asked by Anbazhagan on Jul 29, 2018
Latest reply on Aug 2, 2018 by cmcdonald

Hello All,


I want to trigger the spark-2.2.1 shell using --master yarn and deploy-mode cluster.But i getting the below error while submitting the below command using putty(login as "ssh mapr@localhost -p 2222" in my windows 8 machine.


./bin/spark-shell --master yarn --deploy-mode client



Zookeeper address not found from MapRFilesystem. Will try the configuration from yarn-site.xml
ERROR MapRZKRMFinderUtils: Zookeeper address can not be retrieved. Trying backup zk address

ERROR MapRZKRMFinderUtils: Zookeeper address not configured in Yarn configuration. Please check yarn-site.xml.ERROR MapRZKRMFinderUtils: Unable to determine ResourceManager service address from Zookeeper. ERROR MapRZKBasedRMFailoverProxyProvider: Unable to create proxy to the ResourceManager null ERROR SparkContext: Error initializing SparkContext.


Could you please help me how to fix this error.I want to submit the spark through  master yarn?.please provide the  necessary steps to change the hadoop config file.