K.P.H.B, Hyderabad, Telangana, India -500085
+91 97005 23635
onlinetrainingstech@gmail.com
Big Data Hadoop Training

Big Data Hadoop Training

Big Data Hadoop Training Syllabus

Introduction to Big Data
• Big Data relies on volume, velocity, and variety with respect to processing.
• Data can be divided into three types—unstructured data, semi-structured data, and structured data.
• Big Data technology understands and navigates big data sources, analyzes unstructured data, and ingests data at a high speed.
Introduction Apache Hadoop
• Type of Data generation
• Apache ecosystem & its projects
• Hadoop distributors
• HDFS core concepts
• Modes of Hadoop employment
• HDFS Flow architecture
• HDFS MrV1 vs. MrV2 architecture
• Yarn Architecture
• Unix commands
• Hadoop commands
• Hands on exercises
MapReduce
• MapReduce Design flow
• MapReduce Program (Job) execution
• Types of Input formats & Output Formats
• MapReduce Datatypes
• Performance tuning of MapReduce jobs
• Word-count program example explanation
• Hands on with word-count program
Apache Hive
• Introduction to Hive
• Hive features
• Hive architecture flow
• Hive vs Pig
• HCatalog
• Hive Limitations
• Hive Data Types
• Hive Complex Data Types
• DML/DDL commands explanation
• Hive data loading
• Hive Functions
• Hive Joins
• Partitioning static & Dynamic logic
• Bucketing logic
• Skewed by logic
• Hive File formats
• Performance Techniques
• Hive script execution in shell & HUE
• Hive exercises
• Hive hands on
Apache Pig
• Introduction to Pig concepts and Architecutre
• Pig Components
• Pig Execution modes
• Pig Latin Basics
• Pig Data Flow
• Pig Latin Concepts
• Pig Commands
• Pig Data Types
• Pig Latin – Examples
• Advance Pig Programming concepts like COGROUP, pig UDF
• Pig modes of execution
• Pig script execution in shell/HUE
• Pig hands on
Apache Hbase
• Introduction to Hbase concepts
• Introduction to NoSQL/CAP theorem concepts
• Hbase design/architecture flow
• Hbase table commands
• HDFS vs Hbase
• RDBMS vs Hbase
• Hbase execution in shell/HUE
• Hbase Example
• Hands on
Apache Sqoop
• Introduction to Sqoop concepts
• Sqoop internal design/architecture
• Sqoop Import statements concepts
• Sqoop Export Statements concepts
• Quest Data connectors flow
• Incremental updating concepts
• Creating a database in MySQL for importing to HDFS
• Sqoop commands execution in shell/HUE
• Sqoop Examples
• Sqoop Hands on
Apache Flume
• Introduction to Flume & features
• Flume topology & core concepts
• Property file parameters logic
• Flume NetCat example & Spooldir example
• Flume Hands on
Impala
• Impala Architecture
• Creating tables in Impala
• Accessing Hive Metastore
• Hands on
Apache Spark
• About Spark
• Spark History
• MapReduce and Spark
• Spark – Layered Architecture
• Spark – Cluster Architecture
• Cluster Manager – Deployment Modes
• About Scala
• Word count example on Scala
Project
• Using Hive & Power BI

Leave a Reply

Your email address will not be published. Required fields are marked *