AnsweredAssumed Answered

Failure committing: Error: Not a directory

Question asked by sorenmacbeth on Nov 2, 2013
Latest reply on Aug 27, 2015 by dannyman

I'm running into an issue on our cluster where a task fails to commit. It typically happens when a job has more map tasks than slots, so all slots are used for a solid period of time. here is the full stack trace:

2013-11-02 20:30:40,084 WARN org.apache.hadoop.mapred.Task: Failure committing: Error: Not a directory
  at com.mapr.fs.MapRFileSystem.rename(
  at org.apache.hadoop.mapred.FileOutputCommitter.moveTaskOutputs(
  at org.apache.hadoop.mapred.FileOutputCommitter.moveTaskOutputs(
  at org.apache.hadoop.mapred.FileOutputCommitter.commitTask(
  at org.apache.hadoop.mapred.OutputCommitter.commitTask(
  at org.apache.hadoop.mapred.Task.commit(
  at org.apache.hadoop.mapred.Task.done(
  at org.apache.hadoop.mapred.Child$
  at Method)
  at org.apache.hadoop.mapred.Child.main(

There is also the follow errors reported in stderr from the same task:

Timing out request 28.15 sent to
Other ips are:
2013-11-02 20:28:45,1607 ERROR Client fs/client/fileclient/cc/ Thread: 139716839499520 rpc err Connection timed out(110) 28.15 to, fid 2565.2555.1742558, upd 1

This is a cluster running MapR M3  v.

Any help is greatly appreciated.