AnsweredAssumed Answered

hive regexserde virtual column support

Question asked by communityadmin on Jun 12, 2014
Latest reply on Jun 16, 2014 by mandoskippy
Hello forum

I have created a hive table using regexserde to translate the raw text file into columns.  The table works ie can be queried and returns correct results.

With other tables I am able to use virtual columns to see the file the data comes from but with the table created using regexserde this failes and I get this error.

    Driver returned: 2.  Errors: OK
    Total MapReduce jobs = 1
    Launching Job 1 out of 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201406111157_0008, Tracking URL = http://mapr-001:50030/jobdetails.jsp?jobid=job_201406111157_0008
    Kill Command = /opt/mapr/hadoop/hadoop-0.20.2/bin/../bin/hadoop job  -kill job_201406111157_0008
    Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0
    2014-06-12 19:45:34,764 Stage-1 map = 0%,  reduce = 0%
    2014-06-12 19:45:59,878 Stage-1 map = 100%,  reduce = 100%
    Ended Job = job_201406111157_0008 with errors
    FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
    MapReduce Jobs Launched:
    Job 0: Map: 1   MAPRFS Read: 0 MAPRFS Write: 0 FAIL
    Total MapReduce CPU Time Spent: 0 msec

Does hive support virtual columns for regexserde tables?  If so any hints as to what might be wrong?

Thanks

Outcomes