Data Transfer Using Sqoop

sqoop n.w
1 / 25
Embed
Share

Sqoop is a powerful tool for importing and exporting data between Hadoop and relational databases. It allows for efficient provisioning of Hive Metastore, populating HBase tables, and utilizing various connectors for seamless data transfer. Learn about Sqoop's features, performance benchmarks, and how it facilitates efficient data migration in a cluster environment.

  • Data Transfer
  • Sqoop
  • Big Data
  • Hadoop
  • Hive

Uploaded on | 0 Views


Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.

E N D

Presentation Transcript


  1. Sqoop Mr. Sriram Mr. Sriram Email: hadoopsrirama@gmail.com

  2. Objectives What is Sqoop? Why Sqoop? Importing & Exporting Data using Sqoop Provisioning Hive Metastore Populating Hbase Tables Sqoop Connectors Sqoop Features Performance Benchmark in cluster for Sqoop

  3. What is Sqoop? What is Sqoop? Why Sqoop? Why Sqoop? Importing & Exporting Data using Sqoop Importing & Exporting Data using Sqoop Provisioning Hive Metastore Provisioning Hive Metastore Populating Hbase Tables Populating Hbase Tables Sqoop Connectors Sqoop Connectors Sqoop Features Sqoop Features Performance Benchmark in cluster for Sqoop Performance Benchmark in cluster for Sqoop Sqoop Introduction Sqoop Introduction

  4. Sqoop Intro Sqoop is a data transfer tool Sqoop transfer data between hadoop and relational DB servers Sqoop is used to import data from relational DB such as MySQL, Oracle Sqoop is used to export data from HDFS to relational DB Tools -> Sqoop Import / Export SQOOP Import Import individual tables from RDBMS to HDFS Each row in a table is treated as records in HDFS All record are stored as text data in text files or binary files SQOOP Export Export a set of files from HDFS back to RDBMS Files given an input to SQOOP contains records called as rows in table

  5. What is Sqoop?

  6. Why Sqoop?

  7. Working of Sqoop

  8. MySQL to HDFS

  9. MySQL to HDFS

  10. Selective Imports

  11. Selective Imports

  12. Joining Table

  13. Option File

  14. Controlling Import Process

  15. Controlling Import Process

  16. Import to Hive

  17. Import to Hive

  18. Import to HBase

  19. Import to HBase

  20. Export from HDFS to Mysql

  21. Export from HDFS to MySql

  22. Export to Hive

  23. Export to HBase

  24. Performance

  25. Thank You !!!!!!!!!!!

Related


More Related Content