AnsweredAssumed Answered

not able to run pig script(using java wrapper) over hadoop cluster

Question asked by peeyush on Sep 15, 2012
Latest reply on Sep 18, 2012 by peeyush
i am getting following error:


     [java] Sat Sep 15 14:35:15 2012 org.apache.hadoop.security.Groups DEBUG  Creating new Groups object
     [java] Sat Sep 15 14:35:15 2012 org.apache.hadoop.security.Groups DEBUG Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000
     [java] Sat Sep 15 14:35:15 2012 org.apache.hadoop.conf.Configuration DEBUG java.io.IOException: config()
     [java]  at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:226)
     [java]  at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:213)
     [java]  at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:177)
     [java]  at org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:229)
     [java]  at org.apache.hadoop.security.KerberosName.<clinit>(KerberosName.java:83)
     [java]  at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:202)
     [java]  at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:177)
     [java]  at org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:229)
     [java]  at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:428)
     [java]  at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:414)
     [java]  at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1494)
     [java]  at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1395)
     [java]  at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
     [java]  at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:123)
     [java]  at org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:72)
     [java]  at org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:58)
     [java]  at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:205)
     [java]  at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:118)
     [java]  at org.apache.pig.impl.PigContext.connect(PigContext.java:208)
     [java]  at org.apache.pig.PigServer.<init>(PigServer.java:246)
     [java]  at org.apache.pig.PigServer.<init>(PigServer.java:231)
     [java]  at org.apache.pig.PigServer.<init>(PigServer.java:227)

i already have <path location="/opt/mapr/hadoop/hadoop-0.20.2/conf/"/>
                <path path="/opt/mapr/hadoop/hadoop-0.20.2/lib/hadoop-0.20.2-dev-core.jar"/>
                <path path="/opt/mapr/hadoop/hadoop-0.20.2/lib/maprfs-0.1.jar"/>
in my classpath.

Outcomes