AnsweredAssumed Answered

Permission Denied in MapReduce

Question asked by matt on Oct 20, 2011
Latest reply on Aug 24, 2012 by matt
I'm having a peculiar problem with a permission denied error.

I'm trying to run a map-reduce job over a set of input files. I have checked that I can view the files on every node with the user I am submitting the job as.  Yet, the map tasks can't get started due to the following:

    attempt_201110031503_0065_m_000088_0: 2011-10-20 17:37:51,9814 ERROR Client fs/client/fileclient/cc/client.cc:466 Thread: 139886113474304 Open failed for file <filename-removed>, LookupFid error Permission denied(13)

Is the Child process getting run as a different user? I'm able to catch some of the Child java processes on the tasktracker nodes using 'ps' and they appear to be getting executed as my user.

That said, my user id's and groups come from openldap, could that be a problem for map reduce? As I said, I can view the files just fine in either the shell or using 'hadoop fs -cat'

Outcomes