AnsweredAssumed Answered

Why is user Job failing even though user has access to the Machine and Directory specified.  -- org.apache.hadoop.security.AccessControlException:

Question asked by bgajjela on Mar 21, 2016
Latest reply on Apr 21, 2016 by maprcommunity

Job attempts are failing with below Error and jobs are launching on other nodes. But need to Understand why the user Job is failing even user has access to the Machine and Directory Specified.

 

 

2016-03-18 11:52:24,624 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : org.apache.hadoop.security.AccessControlException: Open failed for file: /var/mapr/local/hostname.com/mapred/nodeManager/spill/job_1457619643458_1732/attempt_1457619643458_1732_m_000033_0/spill0.out, error: Permission denied (13)
at com.mapr.fs.MapRClientImpl.open(MapRClientImpl.java:196)
at com.mapr.fs.MapRFileSystem.open(MapRFileSystem.java:862)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:800)
at org.apache.hadoop.mapred.Merger$Segment.init(Merger.java:300)
at org.apache.hadoop.mapred.Merger$MergeQueue.merge(Merger.java:634)
at org.apache.hadoop.mapred.Merger$MergeQueue.merge(Merger.java:581)
at org.apache.hadoop.mapred.Merger.merge(Merger.java:150)
at org.apache.hadoop.mapred.MapRFsOutputBuffer.mergeParts(MapRFsOutputBuffer.java:1415)
at org.apache.hadoop.mapred.MapRFsOutputBuffer.flush(MapRFsOutputBuffer.java:1627)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:442)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1566)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)

2016-03-18 11:52:24,625 INFO [main] org.apache.hadoop.mapred.Task: Runnning cleanup for the task

Outcomes