AnsweredAssumed Answered

How to do long running YARN application with native security turned on

Question asked by oae on Oct 24, 2017
Latest reply on Nov 6, 2017 by keysbotzum



I have a long running YARN application (potential running 'forever'...).

The YARN app accesses HDFS on a regular basis.

With Apache Hadoop (& co), we just pass renewed/re-created delegation tokens down to the app every once and a while.

Now on MapR, with native security turned on, there are no delegation tokens (FileSystem#getDelegationToken() returns null) since there is a different ticketing system (Tickets ).


How can i ensure that my app stays alive and can access HDFS beyond the initial ticket lifetime ?

Is there a Java API for that, similar to the delegation token API in regular Hadoop ?

Or is MapR taking care of this under the hood ?


Any help appreciated!