AnsweredAssumed Answered

How to do long running YARN application with native security turned on

Question asked by oae on Oct 24, 2017
Latest reply on Nov 6, 2017 by keysbotzum

Question...

 

I have a long running YARN application (potential running 'forever'...).

The YARN app accesses HDFS on a regular basis.

With Apache Hadoop (& co), we just pass renewed/re-created delegation tokens down to the app every once and a while.

Now on MapR, with native security turned on, there are no delegation tokens (FileSystem#getDelegationToken() returns null) since there is a different ticketing system (Tickets ).

 

How can i ensure that my app stays alive and can access HDFS beyond the initial ticket lifetime ?

Is there a Java API for that, similar to the delegation token API in regular Hadoop ?

Or is MapR taking care of this under the hood ?

 

Any help appreciated!

Johannes

Outcomes