AnsweredAssumed Answered

MapR Ticket expiry in spark streaming?

Question asked by john.humphreys on Dec 1, 2017
Latest reply on Jan 16, 2018 by john.humphreys

I have a Spark Streaming job which was up for around a week.  The job was launched with spark-submit on YARN with a long-lived MapR ticket good until 2021 exported in MAPR_TICKETFILE_LOCATION.


The job failed after a week and that may or may not have been ticket related; but in any case, when it was re-attempted by YARN, it got the following ticket error immediately.


Why would the re-attempt not have the long-lived ticket?  Can we fix this?


Exception in thread "main" failure to login: Unable to obtain MapR credentials      at      at      at      at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:65)      at org.apache.spark.deploy.yarn.ApplicationMaster$.main(ApplicationMaster.scala:764)      at org.apache.spark.deploy.yarn.ApplicationMaster.main(ApplicationMaster.scala) Caused by: Unable to obtain MapR credentials      at      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)      at sun.reflect.NativeMethodAccessorImpl.invoke(      at sun.reflect.DelegatingMethodAccessorImpl.invoke(      at java.lang.reflect.Method.invoke(      at      at$000(      at$      at$      at Method)      at      at      at      ... 5 more Caused by: com.mapr.login.MapRLoginException: Found ticket for cluster 'AMPHADP21' but it has expired.      at com.mapr.login.client.MapRLoginHttpsClient.doesSecurityHaveGoodKey(      at com.mapr.login.client.MapRLoginHttpsClient.authenticateIfNeeded(      at com.mapr.login.client.MapRLoginHttpsClient.authenticateIfNeeded(      at      ... 17 more