I'm submitting a Spark Job written in Scala to spark standalone cluster mode using spark-submit.
The job submits fine but immediately fails. The failure is "java.io.IOException: Could not create FileClient". There is no more details on the Spark UI or log files. The job runs fine in local mode but fails with the above failure in standalone cluster mode.
Any ideas what is could be causing this or any hints to troubleshoot further?