AnsweredAssumed Answered

java.lang.RuntimeException: class org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback not org.apache.hadoop.security.GroupMappingServiceProvider

Question asked by ihijazi on Jul 31, 2016
Latest reply on Aug 1, 2016 by ihijazi

Hi,

 

I'm trying to execute a Pig script, not from the shell, but I'm hitting the following exception. All JARs should be fully loaded...

 

Any idea why?

 

Caused by: java.lang.RuntimeException: java.lang.reflect.InvocationTargetException

    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:134)

    at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2688)

    at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:94)

    at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2723)

    at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2705)

    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:407)

    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:172)

    at org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:72)

    at org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:58)

    at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:241)

    at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:111)

    at org.apache.pig.impl.PigContext.connect(PigContext.java:311)

    at org.apache.pig.PigServer.<init>(PigServer.java:226)

    at org.apache.pig.PigServer.<init>(PigServer.java:214)

    at createMRPigServer(PigExecutor.java:97)

    ... 42 more

Caused by: java.lang.reflect.InvocationTargetException

    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)

    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)

    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:132)

    ... 56 more

Caused by: java.lang.RuntimeException: java.lang.RuntimeException: class org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback not org.apache.hadoop.security.GroupMappingServiceProvider

    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2240)

    at org.apache.hadoop.security.Groups.<init>(Groups.java:78)

    at org.apache.hadoop.security.Groups.<init>(Groups.java:74)

    at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:303)

    at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:293)

    at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:197)

    at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:718)

    at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:688)

    at com.mapr.fs.MapRFileSystem.InitializeUserInfo(MapRFileSystem.java:197)

    at com.mapr.fs.MapRFileSystem.<init>(MapRFileSystem.java:250)

    ... 61 more

Caused by: java.lang.RuntimeException: class org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback not org.apache.hadoop.security.GroupMappingServiceProvider

    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2234)

    ... 70 more

Outcomes