AnsweredAssumed Answered

Spark/YARN kill app-attempt but not app?

Question asked by john.humphreys on Sep 20, 2017
Latest reply on Nov 14, 2017 by john.humphreys

I have a long-running streaming app and sometimes it gets OOM errors after around a week.

 

For some reason or other it hangs for hours and then starts a new app attempt (which is great if the hang didn't happen).

 

Can I kill the app-attempt when my monitoring notices it is hanging?  I know I can kill a YARN job; but I don't want to kill the whole job; I just want it to start a new attempt at the same job.

Outcomes