AnsweredAssumed Answered

Dependence of number of reducers on quantity of nodes of a cluster

Question asked by vladdv on Feb 6, 2013
Latest reply on Feb 6, 2013 by morillo
My hadoop program uses one mapper which breaks input data into a certain number of the portions which number is set in the `/usr/countcomputers.txt` file (it is read by the mapper function). Further on one portion arrives on each reducer. Thus the number which is set in the `/usr/countcomputers.txt` file, defines number of reducers. In this regard I had a question: reducers are executed only on computers on which the demon of TaskTracker is launched, or on all nodes, including on what demons of NameNode, by JobTracker and Secondary NameNode are launched? To me it is very important to know the response to this question as the number which is set in the `/usr/countcomputers.txt` file depends on it, read in the program.

Outcomes