Sqoop – data import from MySQL using custom SQL query
April 13, 2019
We are happy to inform that a new video related to Sqoop has just been released! Today it is shown how it is possible to import data from MySQL to HDFS using free-form SQL query with condition. Also it is shown how a custom delimiter could be used to separate columns in the output file
In the upcoming days we will create a detailed post about what MapReduce actually is – we have mentioned MapReduce many times in videos so far, but it was still not explained what it is and why it is so popular, so stay turned and do not forget to bookmark this page and subscribe to our youtube channel. Stay turned!
One Reply to “Sqoop – data import from MySQL using custom SQL query”
Hi, you can import all tables from the entire DB by using import-all-tables option -> check this manual http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal
However, if you need to import only a subset of tables available in DB, u need to write a custom bash script which will iterate over a list of tables needed to be imported.
This topic seems to be quite interesting and I am going to shoot a video about this.
Thanks for your feedback!