AnsweredAssumed Answered

NullPointer exception at the end of the reducer (@

Question asked by omirandette on Aug 16, 2013
Latest reply on Oct 7, 2013 by jerdavis
Currently using M5 2.1.3.  At the end of the reducer I receive this exception
at org.apache.hadoop.mapred.IFileInputStream.doRead(
at org.apache.hadoop.mapred.IFileInputStream.close(
at org.apache.hadoop.mapred.IFile$Reader.close(
at org.apache.hadoop.mapred.Merger$Segment.close(
at org.apache.hadoop.mapred.Merger$MergeQueue.adjustPriorityQueue(
at org.apache.hadoop.mapred.Merger$
at org.apache.hadoop.mapred.ReduceTask$
at org.apache.hadoop.mapreduce.ReduceContext.nextKeyValue(
at org.apache.hadoop.mapreduce.ReduceContext$
at DailyAggregationRawComparator$Reduce.reduce(
at DailyAggregationRawComparator$Reduce.reduce(
The same exception doesnt happen if my input file is smaller (28GB vs 56GB).

            for (IntWritable val : values) { //line 246