saira

DEV 361 Apache Spark Lesson 5 - Skipped Stages in the Spark Web UI

Discussion created by saira Employee on Mar 13, 2018

In the screenshot of the Spark Web UI shown below, the second Collect and Count jobs had skipped one stage.

Why was one stage “skipped” and why is the duration lesser than job 2?

 

ClassDiscussion-5.2.2

Outcomes