AnsweredAssumed Answered

cleanup taking a long time

Question asked by jerdavis2 on Dec 17, 2014
Latest reply on Feb 9, 2015 by jerdavis2
Recently our jobs have started taking a very long time to cleanup/finish.
We've seen this with low (Map*Reduces) counts, as well as Map only tasks.
We've seen it on Cascading, as well as plain Java Map/Reduce (LZO Indexer).

A task might have on (9*64 ) Map*Reduce, it might only generate 9GB of data.. All Map/Redcues finish in 10 minutes, and then hang out for an hour.

Any thoughts on how to debug this?

Outcomes