I created a table using drill CTAS and stored it in parquet format. Can I export this file to database using sqoop?
Hi Sabamu L,
Could you please provide more details about your environment such as which version you are on etc.?
I am using drill 1.6.0 and using sqoop 2.
First according to MapR's documentation... Sqoop2 to Oracle is not supported.
I've never tried to use sqoop to write to Oracle, usually its from RDBMS to Hadoop.
However... if you're using Drill, why are you using sqoop? I would imagine it would be a simple select from parquet insert into oracle?
Michael Segel Drill does not support insert operations, so is it possible to insert results from the select query to an oracle table?
Drill does not support insert operations, so is it possible to insert results from the select query to an oracle table?
Well that's not good for Drill. (Extract is only half the battle. )
(Which is the main reasons people use sqoop to pull data from RDBMs not push)
Depending on the size, I'd say first choice is to create a file for Oracle to bulk load. While not a direct process, its going to put less stress on the Oracle data warehouse. (Sqoop or any other parallel job will create multiple JDBC connections and you could easily put a load on your Database. )
You could look at SparkSQL and read from Parquet files, repartition if necessary, write out to RDBMS.
You could write a simple map only job, but you need to be careful if failures occur.
Again, the release notes say that Sqoop2 to Oracle doesn't work, so that kills your initial idea.
Do you need more assistance before I close this discussion thread?
Retrieving data ...