AnsweredAssumed Answered

Spark Programs on MapR sandbox running damn slow

Question asked by vsbgugan on Sep 21, 2015
Latest reply on Sep 21, 2015 by leonclayton
The following simple count program takes around 70 secs in sandbox...

    public class SparkTestClient {
        public static void main(String[] args) {
            SparkConf conf = new SparkConf().setAppName("Simple Count");
            conf.setMaster("yarn-client");
            conf.set("spark.driver.host", "127.0.0.1");
            JavaSparkContext sc = new JavaSparkContext(conf);
            List<Integer> data = Arrays.asList(1, 2, 3, 4, 5);
            JavaRDD<Integer> distData = sc.parallelize(data);
            long count = distData.count();
            System.out.println("The count is : " + count);
        }
    }

Outcomes