AnsweredAssumed Answered

Hive 0.10 - Metastore Java Heap Space Issue

Question asked by mandoskippy on Apr 3, 2013
Latest reply on Apr 3, 2013 by mandoskippy
Hey all, I am using the MapR Hive 0.10 package, I installed it, I ran the upgrade script for the mysql metastore, and hive starts properly, but when I do anything (show tables, show databases, use database) I get the following error...

I am stuck at this point... ideas?

3/04/03 19:02:00 DEBUG conf.MapRConf: Fetching MapR default for: hive.metastore.end.function.listeners
13/04/03 19:02:00 DEBUG conf.MapRConf: Fetching MapR default for: hive.metastore.end.function.listeners
13/04/03 19:02:00 DEBUG conf.MapRConf: Fetching MapR default for: hive.metastore.partition.inherit.table.properties
13/04/03 19:02:00 DEBUG conf.MapRConf: Fetching MapR default for: hive.metastore.partition.inherit.table.properties
13/04/03 19:02:00 DEBUG conf.MapRConf: Fetching MapR default for: hive.metastore.pre.event.listeners
13/04/03 19:02:00 DEBUG conf.MapRConf: Fetching MapR default for: hive.metastore.pre.event.listeners
13/04/03 19:02:00 INFO hive.metastore: Trying to connect to metastore with URI thrift://localhost:3306
13/04/03 19:02:00 INFO hive.metastore: Waiting 1 seconds before next connection attempt.
13/04/03 19:02:01 INFO hive.metastore: Connected to metastore.
java.lang.OutOfMemoryError: Java heap space
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:353)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:215)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_database(ThriftHiveMetastore.java:412)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_database(ThriftHiveMetastore.java:399)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:736)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:74)
at $Proxy6.getDatabase(Unknown Source)
at org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:1110)
at org.apache.hadoop.hive.ql.metadata.Hive.databaseExists(Hive.java:1099)
at org.apache.hadoop.hive.ql.exec.DDLTask.switchDatabase(DDLTask.java:3516)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:238)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:138)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1336)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1122)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:935)
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:412)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:755)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:613)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:197)
13/04/03 19:02:01 DEBUG conf.MapRConf: Fetching MapR default for: hive.exec.failure.hooks
FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.DDLTask
13/04/03 19:02:01 ERROR ql.Driver: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.DDLTask
13/04/03 19:02:01 INFO ql.Driver: </PERFLOG method=Driver.execute start=1365030120286 end=1365030121480 duration=1194>
13/04/03 19:02:01 INFO ql.Driver: <PERFLOG method=releaseLocks>
13/04/03 19:02:01 INFO ql.Driver: </PERFLOG method=releaseLocks start=1365030121480 end=1365030121480 duration=0>

Outcomes