AnsweredAssumed Answered

task tracker - all local directories are not writable

Question asked by namato on May 11, 2014
Latest reply on May 11, 2014 by namato
When I submit Hive jobs I get the below error -

<code>
WARN org.apache.hadoop.mapred.TaskTracker: Task Tracker local Incorrect permission for /data/mapr/mapred/local, expected: rwxr-xr-x, while actual: rwxrwxr-x
ERROR org.apache.hadoop.mapred.TaskTracker: Can not start TaskTracker because org.apache.hadoop.util.DiskChecker$DiskErrorException: all local directories are not writable
    at org.apache.hadoop.mapred.TaskTracker.checkLocalDirs(TaskTracker.java:5268)
    at org.apache.hadoop.mapred.TaskTracker.initializeDirectories(TaskTracker.java:907)
    at org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:979)
    at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:2176)
    at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:5310)

</code>
mapred.local.dir in both mapred-site.xml and taskcontroller.cfg point to /data/mapr/mapred/local

For my Hive sessions, I use the following settings:

<code>
SET hive.exec.scratchdir=/dev/tmp/hive;
SET hive.metastore.warehouse.dir=/dev/warehouse; (setting works for Hive jobs that do not launch MR i.e a create table stmt creates the table in this directory)

</code>
What other local directories could the error be referring to ?
Any pointers would be appreciated.

Outcomes