AnsweredAssumed Answered

Cannot access Hive tables-AccessControlException

Question asked by Karthee on May 18, 2017
Latest reply on May 24, 2017 by maprcommunity

Hi There,

 

my user id and my team cannot access any of the internal tables in hive db.when we fire up the queries in HUE and CLI as well, we are getting AccessControlException, please find the log below

 

INFO  : set mapreduce.job.reduces=<number> INFO  : Cleaning up the staging area maprfs:/var/mapr/cluster/yarn/rm/staging/keswara/.staging/job_1494760161412_0139 

ERROR : Job Submission failed with exception 'org.apache.hadoop.security.AccessControlException(User keswara(user id 1802830393)  does not have access to maprfs:///user/hive/warehouse/bistore_sit.db/wt_consumer/d_partition_number=0/000114_0)'
org.apache.hadoop.security.AccessControlException: User keswara(user id 1802830393)  does not have access to maprfs:///user/hive/warehouse/bistore_sit.db/wt_consumer/d_partition_number=0/000114_0   
   at com.mapr.fs.MapRFileSystem.getMapRFileStatus(MapRFileSystem.java:1320)   
   at com.mapr.fs.MapRFileSystem.getFileStatus(MapRFileSystem.java:942)    
  at org.apache.hadoop.fs.FileSystem.getFileBlockLocations(FileSystem.java:741)  
    at org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1762)   
   at org.apache.hadoop.fs.FileSystem$4.next(FileSystem.java:1747)      at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:307)      at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:265)      at org.apache.hadoop.hive.shims.Hadoop23Shims$1.listStatus(Hadoop23Shims.java:148)      at org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat.getSplits(CombineFileInputFormat.java:218)      at org.apache.hadoop.mapred.lib.CombineFileInputFormat.getSplits(CombineFileInputFormat.java:75)      at org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileInputFormatShim.getSplits(HadoopShimsSecure.java:310)      at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getCombineSplits(CombineHiveInputFormat.java:472)      at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:573)      at org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:331)      at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:323)      at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:199)      at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)      at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)      at java.security.AccessController.doPrivileged(Native Method)      at javax.security.auth.Subject.doAs(Subject.java:421)      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)      at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)      at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:562)      at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:557)      at java.security.AccessController.doPrivileged(Native Method)      at javax.security.auth.Subject.doAs(Subject.java:421)      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)      at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:557)      at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:548)      at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:431)      at org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:137)      at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)      at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88)      at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:75)

any of the user can't access the internal tables right now,am part of the mapr group and sudo user as well!

 

and the table and partitions ownership belongs to the mapr group and the permissions are look good though!

 

[mapr@SAN2LPMR03 mapr]$ hadoop fs -ls /user/hive/warehouse/bistore.db/wt_consumer
Found 1 items
drwxrwxrwt - mapr mapr 1 2017-03-24 11:51 /user/hive/warehouse/bistore.db/wt_consumer/d_partition_number=__HIVE_DEFAULT_PARTITION__

 

 

 

Please help me to sort this out!

Outcomes