AnsweredAssumed Answered

MAPREDUCE JOB - Reduce phase blocked at 99%

Question asked by rvelfre on Dec 3, 2015
Hello,

I'm runinng a mapreduce task via Hive and I've got the following issue ;

Map task is 100% finished but reduce phase is blocked at 99% still many hours..

I have enough ressources on my cluster, I think its more about configuration.

When I look into the MapR Console I can see 2 reduce jobs that are still running and almost complete (75% and 99%).
No Error in the logs, only a warning :

2015-12-03 12:32:11,503 WARN util.ProcfsBasedProcessTree [communication thread]: The process 46777 may have finished in the interim.
2015-12-03 12:32:11,503 WARN util.ProcfsBasedProcessTree [communication thread]: The process 46778 may have finished in the interim.
2015-12-03 12:32:14,532 WARN util.ProcfsBasedProcessTree [communication thread]: The process 47910 may have finished in the interim.
2015-12-03 12:32:14,532 WARN util.ProcfsBasedProcessTree [communication thread]: The process 47911 may have finished in the interim.
2015-12-03 12:32:14,532 WARN util.ProcfsBasedProcessTree [communication thread]: The process 47912 may have finished in the interim.
2015-12-03 12:32:35,746 WARN util.ProcfsBasedProcessTree [communication thread]: The process 50520 may have finished in the interim.
2015-12-03 12:32:35,746 WARN util.ProcfsBasedProcessTree [communication thread]: The process 50521 may have finished in the interim.
...
...
...

I'm using MapR 3.3 with Hadoop 0.20.2 and Hive 0.13.

Could you help me ?

Thanks !

Outcomes