AnsweredAssumed Answered

root partition filling up in M3 cluster on EMR

Question asked by sorenmacbeth on Jul 16, 2012
Latest reply on Jul 17, 2012 by sorenmacbeth
Hello,

I'm using Mapr M3 on EMR and my job flows keep failing because the root partition keeps getting filled up. I've tried setting the "mapred.child.tmp" hadoop config property to ${hadoop.tmp.dir}, but I'm still hitting issues. I noticed that the tasktracker processes and the mapred child processes both set -Djava.io.tmpdir -Djava.io.tmpdir=/tmp/mapr-hadoop/mapred/local/taskTracker/hadoop/jobcache. I believe this is what is filling up the root partition.

Is there a bootstrap action I can do or a jobconf property that I can do to set that property to something on the NFS partition?

I'm using a 16 node, cc2.8xlarge instance cluster.

TIA

Outcomes