AnsweredAssumed Answered

Impala Avro defined table

Question asked by scratch28 on Mar 26, 2014
Latest reply on Mar 27, 2014 by scratch28
I have a file ingested via Sqoop into Avro and I have defined the table correctly for Hive
CREATE EXTERNAL TABLE IF NOT EXISTS Ingest_DataScience.INGEST_AAAA ROW FORMAT  
SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe'  
STORED as INPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat' 
OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
location '/user/hive/ingest/DATASCIENCE/AAAA'
TBLPROPERTIES ('avro.schema.url'='maprfs:///user/AvroSchema/DATASCIENCE/AAAA.avsc');

Avro schema generated via avro-tools-1.7.6.jar getschema and it is placed correctly above

hive query works fine with the above definition
select * from Ingest.ingest_AAAA limit 10

Impala query
yields the following error

 select * from Ingest.ingest_AAAA limit 10
ERROR: AnalysisException: Failed to load metadata for table: Ingest_DataScience.ingest_AAAA
CAUSED BY: TableLoadingException: avro.schema.url must be of form "http://path/to/schema/file" or "hdfs://namenode:port/path/to/schema/file", got maprfs:///user/AvroSchema/DATASCIENCE/AAAA_DATASCIENCE__SPECIALTY.avsc





Outcomes