AnsweredAssumed Answered

Hive 2.1 Metastore column width limit - (Invalid column type name is too long)

Question asked by Karthee on Aug 16, 2017
Latest reply on Sep 26, 2017 by nishchai manjula

Hi Team,

 

When i tried to create a table in Hive -2.1, the syntax has a complex schema with many nested fields, Hive can't process it and as it reaches the current limit of 4000 characters columns length.

 

MapR - 5.2.2 

Hive - 2.1

Metastore DB: MySQL - 5.1.73

 

Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. InvalidObjectException(message:Invalid column type name is too long: 

<column names ......>

 

And i have found a JIRA regarding this issue, 

[HIVE-12274] Increase width of columns used for general configuration in the metastore. - ASF JIRA 

just changed the datatypes as they suggested with mediumtext and longtext as well...but nothing helps me so far!

  • COLUMNS_V2.TYPE_NAME
  • TABLE_PARAMS.PARAM_VALUE
  • SERDE_PARAMS.PARAM_VALUE
  • SD_PARAMS.PARAM_VALUE

and the JIRA suggests, After updating the maximum length the metastore database needs to be configured and restarted with the new settings!!  But am not sure how to re-configure the metastore database after the changes!!!

 

 

Am i missing something here or any other alternate workaround to overcome this problem !???

 

Really appreciate your assistance.

 

Thanks,

karthi

Outcomes