AnsweredAssumed Answered

Error while running Hello World Twill Application in MapR Sandbox

Question asked by sabamu28 on Apr 24, 2017
Latest reply on May 10, 2017 by maprcommunity

I tried to run the Hello World twill application in MapR sandbox it shows this error. Any idea? apache-twill

 Followed this documentation: Apache Twill – Getting started 

export CP=twill-examples-yarn-0.10.0.jar:`hadoop classpath`  java -cp $CP org.apache.twill.example.yarn.HelloWorld localhost:5181

SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/mapr/demo.mapr.com/opt/twill-master/twill-examples/yarn/target/twill-examples-yarn-0.12.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/mapr/hadoop/hadoop-2.7.0/share/hadoop/common/lib/twill-examples-yarn-0.12.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/mapr/lib/slf4j-log4j12-1.7.12.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder] 10:08:32.590 [main] DEBUG org.apache.hadoop.util.Shell - setsid exited with exit code 0 10:08:34.274 [main] DEBUG org.apache.hadoop.conf.Configuration - Loaded org.apache.hadoop.conf.CoreDefaultProperties 10:08:34.314 [main] DEBUG org.apache.hadoop.conf.Configuration - Loaded org.apache.hadoop.yarn.conf.YarnDefaultProperties 10:08:34.392 [main] DEBUG o.a.h.m.lib.MutableMetricsFactory - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[Rate of successful kerberos logins and latency (milliseconds)]) 10:08:34.401 [main] DEBUG o.a.h.m.lib.MutableMetricsFactory - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[Rate of failed kerberos logins and latency (milliseconds)]) 10:08:34.401 [main] DEBUG o.a.h.m.lib.MutableMetricsFactory - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[GetGroups]) 10:08:34.402 [main] DEBUG o.a.h.m.impl.MetricsSystemImpl - UgiMetrics, User and group related metrics 10:08:34.414 [main] DEBUG org.apache.hadoop.conf.Configuration - Loaded org.apache.hadoop.conf.CoreDefaultProperties 10:08:34.423 [main] DEBUG org.apache.hadoop.conf.Configuration - Loaded org.apache.hadoop.yarn.conf.YarnDefaultProperties 10:08:34.426 [main] DEBUG o.a.h.security.UserGroupInformation - HADOOP_SECURITY_AUTHENTICATION is set to: SIMPLE 10:08:34.426 [main] DEBUG o.a.h.security.UserGroupInformation - Login configuration entry is hadoop_simple 10:08:34.426 [main] DEBUG o.a.h.security.UserGroupInformation - authenticationMethod from JAAS configuration:SIMPLE 10:08:34.442 [main] DEBUG org.apache.hadoop.conf.Configuration - Loaded org.apache.hadoop.conf.CoreDefaultProperties 10:08:34.455 [main] DEBUG org.apache.hadoop.conf.Configuration - Loaded org.apache.hadoop.yarn.conf.YarnDefaultProperties 10:08:34.461 [main] DEBUG org.apache.hadoop.security.Groups - Creating new Groups object 10:08:34.465 [main] DEBUG o.a.hadoop.util.NativeCodeLoader - Trying to load the custom-built native-hadoop library... 10:08:34.466 [main] DEBUG o.a.hadoop.util.NativeCodeLoader - Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path 10:08:34.466 [main] DEBUG o.a.hadoop.util.NativeCodeLoader - java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 10:08:34.466 [main] WARN o.a.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 10:08:34.467 [main] DEBUG o.a.hadoop.util.PerformanceAdvisory - Falling back to shell based 10:08:34.467 [main] DEBUG o.a.h.s.JniBasedUnixGroupsMappingWithFallback - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping 10:08:34.495 [main] DEBUG org.apache.hadoop.conf.Configuration - Loaded org.apache.hadoop.conf.CoreDefaultProperties 10:08:34.507 [main] DEBUG org.apache.hadoop.conf.Configuration - Loaded org.apache.hadoop.yarn.conf.YarnDefaultProperties 10:08:34.539 [main] DEBUG org.apache.hadoop.conf.Configuration - Loaded org.apache.hadoop.conf.CoreDefaultProperties 10:08:34.550 [main] DEBUG org.apache.hadoop.conf.Configuration - Loaded org.apache.hadoop.yarn.conf.YarnDefaultProperties 10:08:34.560 [main] DEBUG org.apache.hadoop.conf.Configuration - Loaded org.apache.hadoop.mapreduce.conf.MapReduceDefaultProperties 10:08:34.582 [main] DEBUG o.a.h.security.UserGroupInformation - HADOOP_SECURITY_AUTHENTICATION is set to: SIMPLE 10:08:34.582 [main] DEBUG o.a.h.security.UserGroupInformation - Login configuration entry is hadoop_simple 10:08:34.583 [main] DEBUG o.a.h.security.UserGroupInformation - authenticationMethod from JAAS configuration:SIMPLE 10:08:34.583 [main] DEBUG org.apache.hadoop.security.Groups - Creating new Groups object 10:08:34.583 [main] DEBUG o.a.hadoop.util.PerformanceAdvisory - Falling back to shell based 10:08:34.583 [main] DEBUG o.a.h.s.JniBasedUnixGroupsMappingWithFallback - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping 10:08:34.607 [main] DEBUG org.apache.hadoop.security.Groups - Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000 10:08:34.608 [main] DEBUG org.apache.hadoop.conf.Configuration - Loaded org.apache.hadoop.mapreduce.conf.MapReduceDefaultProperties 10:08:34.611 [main] DEBUG org.apache.hadoop.security.Groups - Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000 10:08:34.619 [main] DEBUG o.a.h.s.login.HadoopLoginModule - Priority principal search list is [class javax.security.auth.kerberos.KerberosPrincipal] 10:08:34.619 [main] DEBUG o.a.h.s.login.HadoopLoginModule - Additional principal search list is [class com.sun.security.auth.UnixPrincipal] 10:08:34.619 [main] DEBUG o.a.h.s.login.HadoopLoginModule - hadoop login 10:08:34.620 [main] DEBUG o.a.h.s.login.HadoopLoginModule - hadoop login commit 10:08:34.704 [main] DEBUG o.a.h.s.rpcauth.RpcAuthRegistry - Added SIMPLE to registry. 10:08:34.704 [main] DEBUG o.a.h.s.rpcauth.RpcAuthRegistry - Added KERBEROS to registry. 10:08:34.705 [main] DEBUG o.a.h.s.rpcauth.RpcAuthRegistry - Added TOKEN to registry. 10:08:34.705 [main] DEBUG o.a.h.s.rpcauth.RpcAuthRegistry - Added FAKE to registry. 10:08:34.705 [main] DEBUG o.a.h.security.UserGroupInformation - Found no authentication principals in subject. Simple? 10:08:34.706 [main] DEBUG o.a.h.security.UserGroupInformation - UGI loginUser:mapr (auth:SIMPLE) 10:08:34.707 [main] DEBUG o.a.h.security.UserGroupInformation - PrivilegedAction as:mapr (auth:SIMPLE) from:org.apache.hadoop.fs.FileContext.getAbstractFileSystem(FileContext.java:331) 10:08:34.718 [main] DEBUG org.apache.hadoop.conf.Configuration - Loaded org.apache.hadoop.conf.CoreDefaultProperties 10:08:34.725 [main] DEBUG org.apache.hadoop.conf.Configuration - Loaded org.apache.hadoop.yarn.conf.YarnDefaultProperties 10:08:34.732 [main] DEBUG org.apache.hadoop.conf.Configuration - Loaded org.apache.hadoop.mapreduce.conf.MapReduceDefaultProperties 10:08:34.820 [ STARTING] INFO org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT 10:08:34.820 [ STARTING] INFO org.apache.zookeeper.ZooKeeper - Client environment:host.name=maprdemo 10:08:34.820 [ STARTING] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_121 10:08:34.820 [ STARTING] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation 10:08:34.820 [ STARTING] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.home=/mapr/demo.mapr.com/opt/jdk1.8.0_121/jre 10:08:34.820 [ STARTING] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=twill-examples-yarn-0.12.0-SNAPSHOT.jar:/opt/mapr/hadoop/hadoop-2.7.0/etc/hadoop:/opt/mapr/hadoop/hadoop-2.7.0/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/opt/mapr/hadoop/hadoop-2.7.0/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar: 10:08:34.847 [ STARTING] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 10:08:34.847 [ STARTING] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp 10:08:34.847 [ STARTING] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.compiler= 10:08:34.847 [ STARTING] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux 10:08:34.847 [ STARTING] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64 10:08:34.847 [ STARTING] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.version=2.6.32-642.el6.x86_64 10:08:34.847 [ STARTING] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.name=mapr 10:08:34.847 [ STARTING] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.home=/home/mapr 10:08:34.848 [ STARTING] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/mapr/demo.mapr.com/opt/twill-master/twill-examples/yarn/target 10:08:34.849 [ STARTING] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:5181 sessionTimeout=10000 watcher=org.apache.twill.internal.zookeeper.DefaultZKClientService$5@c8ff72a 10:08:34.856 [ STARTING] DEBUG org.apache.zookeeper.ClientCnxn - zookeeper.disableAutoWatchReset is false 10:08:34.914 [ STARTING-SendThread(localhost.localdomain:5181)] DEBUG o.a.z.client.ZooKeeperSaslClient - JAAS loginContext is: Client_simple 10:08:34.932 [ STARTING-SendThread(localhost.localdomain:5181)] INFO o.a.z.client.ZooKeeperSaslClient - Client will use GSSAPI as SASL mechanism. 10:08:34.932 [ STARTING-SendThread(localhost.localdomain:5181)] DEBUG o.a.z.client.ZooKeeperSaslClient - creating sasl client: client=mapr;service=zookeeper;serviceHostname=localhost.localdomain 10:08:34.961 [ STARTING-SendThread(localhost.localdomain:5181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost.localdomain/127.0.0.1:5181. Will attempt to SASL-authenticate using Login Context section 'Client_simple' 10:08:34.975 [ STARTING-SendThread(localhost.localdomain:5181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost.localdomain/127.0.0.1:5181, initiating session 10:08:34.979 [ STARTING-SendThread(localhost.localdomain:5181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on localhost.localdomain/127.0.0.1:5181 10:08:34.989 [ STARTING-SendThread(localhost.localdomain:5181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost.localdomain/127.0.0.1:5181, sessionid = 0x15b85a7fb8b0011, negotiated timeout = 10000 10:08:34.990 [ STARTING-SendThread(localhost.localdomain:5181)] DEBUG o.a.z.client.ZooKeeperSaslClient - ClientCnxn:sendSaslPacket:length=0 10:08:34.992 [ STARTING-SendThread(localhost.localdomain:5181)] DEBUG o.a.z.client.ZooKeeperSaslClient - saslClient.evaluateChallenge(len=0) 10:08:34.993 [zk-client-EventThread] DEBUG o.a.t.i.z.DefaultZKClientService - Connected to ZooKeeper: localhost:5181 10:08:34.996 [ STARTING-SendThread(localhost.localdomain:5181)] ERROR o.a.z.client.ZooKeeperSaslClient - An error: (java.security.PrivilegedActionException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]) occurred when evaluating Zookeeper Quorum Member's received SASL token. Zookeeper Client will go to AUTH_FAILED state. 10:08:34.998 [ STARTING-SendThread(localhost.localdomain:5181)] ERROR org.apache.zookeeper.ClientCnxn - SASL authentication with Zookeeper Quorum member failed: javax.security.sasl.SaslException: An error: (java.security.PrivilegedActionException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]) occurred when evaluating Zookeeper Quorum Member's received SASL token. Zookeeper Client will go to AUTH_FAILED state. Exception in thread "main" com.google.common.util.concurrent.UncheckedExecutionException: java.util.concurrent.ExecutionException: org.apache.zookeeper.KeeperException$AuthFailedException: KeeperErrorCode = AuthFailed for / at com.google.common.util.concurrent.Futures.wrapAndThrowUnchecked(Futures.java:1015) at com.google.common.util.concurrent.Futures.getUnchecked(Futures.java:1001) at com.google.common.util.concurrent.AbstractService.startAndWait(AbstractService.java:220) at com.google.common.util.concurrent.AbstractIdleService.startAndWait(AbstractIdleService.java:106) at org.apache.twill.yarn.YarnTwillRunnerService.start(YarnTwillRunnerService.java:183) at org.apache.twill.example.yarn.HelloWorld.main(HelloWorld.java:69) Caused by: java.util.concurrent.ExecutionException: org.apache.zookeeper.KeeperException$AuthFailedException: KeeperErrorCode = AuthFailed for / at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:294) at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:281) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116) at org.apache.twill.yarn.YarnTwillRunnerService.startUp(YarnTwillRunnerService.java:354) at org.apache.twill.yarn.YarnTwillRunnerService.access$000(YarnTwillRunnerService.java:112) at org.apache.twill.yarn.YarnTwillRunnerService$3.startUp(YarnTwillRunnerService.java:171) at com.google.common.util.concurrent.AbstractIdleService$1$1.run(AbstractIdleService.java:43) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.zookeeper.KeeperException$AuthFailedException: KeeperErrorCode = AuthFailed for / at org.apache.zookeeper.KeeperException.create(KeeperException.java:123) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.twill.internal.zookeeper.DefaultZKClientService$Callbacks$1.processResult(DefaultZKClientService.java:574) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495) Exception in thread " STARTING" java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.apache.zookeeper.KeeperException$AuthFailedException: KeeperErrorCode = AuthFailed for / at com.google.common.base.Throwables.propagate(Throwables.java:160) at com.google.common.util.concurrent.AbstractIdleService$1$1.run(AbstractIdleService.java:47) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: org.apache.zookeeper.KeeperException$AuthFailedException: KeeperErrorCode = AuthFailed for / at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:294) at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:281) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116) at org.apache.twill.yarn.YarnTwillRunnerService.startUp(YarnTwillRunnerService.java:354) at org.apache.twill.yarn.YarnTwillRunnerService.access$000(YarnTwillRunnerService.java:112) at org.apache.twill.yarn.YarnTwillRunnerService$3.startUp(YarnTwillRunnerService.java:171) at com.google.common.util.concurrent.AbstractIdleService$1$1.run(AbstractIdleService.java:43) ... 1 more Caused by: org.apache.zookeeper.KeeperException$AuthFailedException: KeeperErrorCode = AuthFailed for / at org.apache.zookeeper.KeeperException.create(KeeperException.java:123) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.twill.internal.zookeeper.DefaultZKClientService$Callbacks$1.processResult(DefaultZKClientService.java:574) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.

Outcomes