AnsweredAssumed Answered

issues after upgrade to 2.1.3

Question asked by peter on Jun 12, 2013
Recently we upgrade M5 from 2.0 to 2.1.3.

We got a lot of tasks failed for the following error, is it a known issue?

stderr logs

2013-06-13 09:15:29,3461 ERROR Client fs/client/fileclient/cc/client.cc:1972 Thread: 1084934464 AllocateFid failed, File output.00007, error Invalid argument(22), primaryFid 3687947.1693354.726292660

java.io.IOException: 3687947.1693354.726292660  (Invalid argument)
at com.mapr.fs.Inode.throwIfFailed(Inode.java:233)
at com.mapr.fs.Inode.flushPages(Inode.java:347)
at com.mapr.fs.Inode.releaseDirty(Inode.java:425)
at com.mapr.fs.MapRFsOutStream.dropCurrentPage(MapRFsOutStream.java:70)
at com.mapr.fs.MapRFsOutStream.write(MapRFsOutStream.java:81)
at com.mapr.fs.MapRFsDataOutputStream.write(MapRFsDataOutputStream.java:46)
at org.apache.hadoop.mapred.IFileOutputStream.write(IFileOutputStream.java:84)
at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:49)
at java.io.DataOutputStream.write(DataOutputStream.java:90)
at org.apache.hadoop.mapred.IFile$Writer.append(IFile.java:242)
at org.apache.hadoop.mapred.Task$CombineOutputCollector.collect(Task.java:1186)
at org.apache.hadoop.mapred.Task$NewCombinerRunner$OutputConverter.write(Task.java:1507)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.DistinctCombiner$Combine.reduce(DistinctCombiner.java:67)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.DistinctCombiner$Combine.reduce(DistinctCombiner.java:1)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.Task$NewCombinerRunner.combine(Task.java:1528)
at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.mergePerPartition(MapTask.java:2178)
at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1457)
at org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:616)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:683)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
at org.apache.hadoop.mapred.Child.main(Child.java:264)

Outcomes