AnsweredAssumed Answered

hive-insert overwrite data to the bucket table,it is so slowly to copy data to hdfs after finishing reduce stage? why

Question asked by tony on Nov 12, 2013
Latest reply on Nov 13, 2013 by vkorukanti
I found out it is so slow to copy data to hdfs after finishing reduce stage about insert overwrite data to bucket table. it is similar only one thread to execute copy the reduce result. anyone know why and how to optimized them?
sql:

     create table if not exists ca_bucket (cookie string, lid int, wt double,i_date string)
     clustered  by (cookie)  into 200 buckets row format delimited fields terminated by '\t';
    
     insert overwrite table ca_bucket select * from bl_cookie where i_date= 20131110.

Outcomes