AnsweredAssumed Answered

task tracker - all local directories are not writable

Question asked by namato on May 11, 2014
Latest reply on May 11, 2014 by namato
When I submit Hive jobs I get the below error -

WARN org.apache.hadoop.mapred.TaskTracker: Task Tracker local Incorrect permission for /data/mapr/mapred/local, expected: rwxr-xr-x, while actual: rwxrwxr-x
ERROR org.apache.hadoop.mapred.TaskTracker: Can not start TaskTracker because org.apache.hadoop.util.DiskChecker$DiskErrorException: all local directories are not writable
    at org.apache.hadoop.mapred.TaskTracker.checkLocalDirs(
    at org.apache.hadoop.mapred.TaskTracker.initializeDirectories(
    at org.apache.hadoop.mapred.TaskTracker.initialize(
    at org.apache.hadoop.mapred.TaskTracker.<init>(
    at org.apache.hadoop.mapred.TaskTracker.main(

mapred.local.dir in both mapred-site.xml and taskcontroller.cfg point to /data/mapr/mapred/local

For my Hive sessions, I use the following settings:

SET hive.exec.scratchdir=/dev/tmp/hive;
SET hive.metastore.warehouse.dir=/dev/warehouse; (setting works for Hive jobs that do not launch MR i.e a create table stmt creates the table in this directory)

What other local directories could the error be referring to ?
Any pointers would be appreciated.