AnsweredAssumed Answered

Spark Job failing with: "java.io.IOException: Could not create FileClient"

Question asked by dolanli on Mar 18, 2016
Latest reply on Apr 20, 2016 by maprcommunity


I'm submitting a Spark Job written in Scala to spark standalone cluster mode using spark-submit.

The job submits fine but immediately fails. The failure is "java.io.IOException: Could not create FileClient". There is no more details on the Spark UI or log files. The job runs fine in local mode but fails with the above failure in standalone cluster mode.

Any ideas what is could be causing this or any hints to troubleshoot further?

Outcomes