AnsweredAssumed Answered

pyspark failing with community mapr + spark2.1 in yarn cluster mode

Question asked by srinivasp on Jan 24, 2018
Latest reply on Jan 24, 2018 by maprcommunity

pyspark application is failing by below issue in running yarn cluster mode.

 

 ERROR MapRFileSystem: Failed to delete path maprfs:/user/padals06/.sparkStaging/application_1515423826731_0029, error: No such file or directory (2)

 

We are using community mapr cluster  with spark2.1.

Outcomes