In Hive , Pig all these running Mapreduce job behind the scene. why people did not still developed that it can run spark job instead of Mapreduce?
Why don't you just use Spark directly and execute your Hive queries from there?
Vimox Shah Can you try setting this property?
Retrieving data ...