AnsweredAssumed Answered

local cache dir size limit setting?

Question asked by jamespoole on Aug 8, 2013
Latest reply on Aug 8, 2013 by jamespoole
Can anyone verify that there is a Hadoop setting for M3 that allows the local cache size to be limited?

I am seeing the folder:  /tmp/mapr-hadoop/mapred/local/taskTracker/mapr/distcache fill up the drive.

From what I found online it defaults to limit this to 10 GB by default, however if the drive is smaller than 10 GB it will get full and cause a Null Pointer Exception when executing jobs.

I found references to the following properties online relating to this:

local.disk.cache
or
mapreduce.tasktracker.cache.local.size

Can someone verify that one of these properties will work with this version and also provide an example of what it should be set to?  (Example, should it be set to "5000000" just "5" for 5 GB)

Outcomes