AnsweredAssumed Answered

WebHcat error in Hive 0.11

Question asked by bailey on Aug 9, 2013
Latest reply on Sep 10, 2013 by vkorukanti
Hi,

I'm running Hive0.11 with MapR 3.0 M7.

WebHcat is up and I'm able to get good server status {"status":"ok","version":"v1"}.

After I issued a hive query string through REST API, I got the jobId returned, however I cannot retrieve the status of this jobId, look into the directory in MapR File system of this jobID, only a file named user exist in there.

Is this a permission issue?

It will be great that anybody can show me how to configure a user in WebHcat.

Here is the exception from webhcat-console-error.log,

2013-08-09 02:43:08,4497 ERROR Client fs/client/fileclient/cc/client.cc:663 Thread: 140489141466880 Open failed for file /templeton-hadoop/jobs/job_201307190743_0017/completed, LookupFid error No such file or directory(2)

Exception in webhcat.log,

<code>
DEBUG | 09 Aug 2013 02:42:44,065 | com.mapr.fs.jni.MapRClient | Create: /var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201307190743_0017/libjars/zookeeper-3.4.3.jar mode = 493 replication = 3 chunkSize = default overwrite = true
DEBUG | 09 Aug 2013 02:42:44,073 | com.mapr.fs.Inode | >Inode GetAttr: file: /var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201307190743_0017/libjars/zookeeper-3.4.3.jar, size: 0, chunksize: 268435456, fid: 2055.117.788240
DEBUG | 09 Aug 2013 02:42:44,314 | com.mapr.fs.jni.MapRClient | Create: /var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201307190743_0017/job.jar mode = 493 replication = 3 chunkSize = default overwrite = true
DEBUG | 09 Aug 2013 02:42:44,315 | com.mapr.fs.Inode | >Inode GetAttr: file: /var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201307190743_0017/job.jar, size: 0, chunksize: 268435456, fid: 2055.120.788246
DEBUG | 09 Aug 2013 02:42:44,453 | com.mapr.fs.jni.MapRClient | Create: /var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201307190743_0017/job.split mode = 493 replication = 3 chunkSize = default overwrite = true
DEBUG | 09 Aug 2013 02:42:44,453 | com.mapr.fs.Inode | >Inode GetAttr: file: /var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201307190743_0017/job.split, size: 0, chunksize: 268435456, fid: 2055.122.788250
DEBUG | 09 Aug 2013 02:42:44,462 | com.mapr.fs.jni.MapRClient | Create: /var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201307190743_0017/job.splitmetainfo mode = 493 replication = 3 chunkSize = default overwrite = true
DEBUG | 09 Aug 2013 02:42:44,463 | com.mapr.fs.Inode | >Inode GetAttr: file: /var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201307190743_0017/job.splitmetainfo, size: 0, chunksize: 268435456, fid: 2055.123.788252
DEBUG | 09 Aug 2013 02:42:44,475 | com.mapr.fs.jni.MapRClient | Create: /var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201307190743_0017/job.xml mode = 493 replication = 3 chunkSize = default overwrite = true
DEBUG | 09 Aug 2013 02:42:44,476 | com.mapr.fs.Inode | >Inode GetAttr: file: /var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201307190743_0017/job.xml, size: 0, chunksize: 268435456, fid: 2055.124.788254
DEBUG | 09 Aug 2013 02:42:44,545 | org.apache.hcatalog.templeton.Server | queued job job_201307190743_0017 in 723 ms
DEBUG | 09 Aug 2013 02:42:44,545 | com.mapr.fs.jni.MapRClient | Create: /templeton-hadoop/jobs/job_201307190743_0017/user mode = 493 replication = 3 chunkSize = default overwrite = true
DEBUG | 09 Aug 2013 02:42:44,550 | com.mapr.fs.Inode | >Inode GetAttr: file: /templeton-hadoop/jobs/job_201307190743_0017/user, size: 0, chunksize: 268435456, fid: 2049.56.792714
DEBUG | 09 Aug 2013 02:43:08,449 | com.mapr.fs.jni.MapRClient | Open: path = /templeton-hadoop/jobs/job_201307190743_0017/completed
ERROR | 09 Aug 2013 02:43:08,450 | org.apache.hcatalog.templeton.CatchallExceptionMapper |
java.lang.NullPointerException
at com.mapr.fs.MapRClientImpl.open(MapRClientImpl.java:125)
at com.mapr.fs.MapRFileSystem.open(MapRFileSystem.java:410)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:463)
at org.apache.hcatalog.templeton.tool.HDFSStorage.getField(HDFSStorage.java:94)
at org.apache.hcatalog.templeton.tool.JobState.getField(JobState.java:310)
at org.apache.hcatalog.templeton.tool.JobState.getCompleteStatus(JobState.java:253)
at org.apache.hcatalog.templeton.CompleteDelegator.run(CompleteDelegator.java:62)
at org.apache.hcatalog.templeton.Server.completeJob(Server.java:731)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1480)
at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1411)
at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1360)
at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1350)
at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:538)
at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:716)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:565)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:479)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1031)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:406)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:965)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
at org.eclipse.jetty.server.Server.handle(Server.java:349)
at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:449)
at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:910)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:634)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:230)
at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:76)
at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:609)
at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:45)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
at java.lang.Thread.run(Thread.java:662)

</code>

Outcomes