AnsweredAssumed Answered

Hive performance after 2.x to 4.0.2 upgrade

Question asked by packetboy2000 on Mar 20, 2015
Latest reply on Mar 31, 2015 by Hao Zhu

Post upgrade we are having a TON of problems hive problems.

Most recently it's not taking over a minute just to select a hive database.

    $ hive
    WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
    
    Logging initialized using configuration in jar:file:/opt/mapr/hive/hive-0.13/lib/hive-common-0.13.0-mapr-1501.jar!/hive-log4j.properties
    hive> use hive_flow;
    OK
    Time taken: 63.499 seconds
    hive>


Not sure where to even begin.  I assume it's a metastore problem.

We are also getting errors when trying to query some tables...all happened post upgrade...not sure if it's all related.

I believe we essentially upgraded from hive 0.11 to 0.13 during the upgrade process.


Outcomes