AnsweredAssumed Answered

Spark 1.4.1 for yarn on MapR5 failing with error

Question asked by plcurran on Sep 23, 2015
Latest reply on Sep 28, 2015 by plcurran
Hi ,

After following these insructions:
http://doc.mapr.com/display/MapR/Install+Spark+on+YARN

last line is to test but this does not work and gives the following output
 MASTER=yarn-cluster /opt/mapr/spark/spark-1.4.1/bin/run-example org.apache.spark.examples.SparkPi 10
15/09/23 14:47:23 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Exception in thread "main" org.apache.spark.SparkException: Application application_1443009867572_0013 finished with failed status
        at org.apache.spark.deploy.yarn.Client.run(Client.scala:855)
        at org.apache.spark.deploy.yarn.Client$.main(Client.scala:881)
        at org.apache.spark.deploy.yarn.Client.main(Client.scala)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:665)
        at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:170)
        at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:193)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:112)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
[root@XXXXXXX mapr]#

Any help thanks,

Paul

Outcomes