AnsweredAssumed Answered

JobTracker Exceeds Max Counters

Question asked by myacoub on May 14, 2016
Latest reply on Aug 13, 2016 by mufeed

I am trying to access the JobTracker GUI via port 50030 of my HMASTER Node in MapR Cluster but the below is displayed

 

HTTP ERROR 500

Problem accessing /jobtracker.jsp. Reason:

    Too many counters: 121 max=120

Caused by:

org.apache.hadoop.mapreduce.counters.LimitExceededException: Too many counters: 121 max=120

 

After Checking the logs hadoop-mapr-jobtracker-masternode.log, I captured the below

 

2016-05-14 12:38:35,703 WARN mapreduce.Counters [1889115090@qtp-748968642-46]: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2016-05-14 12:38:35,732 ERROR mortbay.log [1889115090@qtp-748968642-46]: /jobtracker.jsp
org.apache.hadoop.mapreduce.counters.LimitExceededException: Too many counters: 121 max=120
at org.apache.hadoop.mapreduce.counters.Limits.checkCounters(Limits.java:61)
at org.apache.hadoop.mapreduce.counters.Limits.incrCounters(Limits.java:68)
at org.apache.hadoop.mapreduce.counters.AbstractCounterGroup.addCounter(AbstractCounterGroup.java:77)
at org.apache.hadoop.mapreduce.counters.AbstractCounterGroup.addCounterImpl(AbstractCounterGroup.java:94)
at org.apache.hadoop.mapreduce.counters.AbstractCounterGroup.findCounterImpl(AbstractCounterGroup.java:122)
at org.apache.hadoop.mapreduce.counters.AbstractCounterGroup.findCounter(AbstractCounterGroup.java:112)
at org.apache.hadoop.mapreduce.counters.AbstractCounterGroup.findCounter(AbstractCounterGroup.java:129)
at org.apache.hadoop.mapred.Counters$Group.findCounter(Counters.java:323)

 

I need to know how to deeply investigate in the Root Cause and if it is related to the below reported BUG or not

 

[MAPREDUCE-6129] Job failed due to counter out of limited in MRAppMaster - ASF JIRA

Outcomes