Grow Data Skills

Complete Data Engineering 3.0 With Azure - Basic To Advance (Live Batch)

LanguageEnglish
Sessions 24
Duration 3 Months
Starts On 1-June-2024
Validity 1 Year
Mode Live

INR 6500

Admission Open - 105 Seats Left

Buy Now

This course includes

100+ hours content
60 minute doubt session after each class
5 Industry level real world projects
Learn while solving real life examples in live lectures
BigData Projects on AZURE Cloud
Projects will be covered from scratch
Hands on exercises & quizzes after each module
Career & Interview Preparation guidance session
Resume Preparation session
Linkedin Profile Making
Certificate of completion

Tech stack you'll learn

Course Content

MySQL Installation guide Connection & set up
DDL, DML, DCL in SQL
Data type of SQL
Create, Insert, Update, Alter, Delete, Drop, Truncate Operations
Views in SQL
Operators in SQL
WHERE clause, ORDER BY clause, GROUP BY & Having Clause
Aggregations Group Concat & Roll UP
CASE-WHEN Statement
Joins in SQL - Inner, Left, Right, Full, Self
Correlated subqueries IN, NOT IN, ANY, ALL, EXISTS, NOT EXISTS
Window Functions
Frame Clause in Window Functions
Common Table Expressions - Recursive, Iterative

5 V’s of BigData
Distributed Computation
Distributed Storage
Cluster, Commodity Hardware
File Formats
Types of Data
Hadoop Complete Architecture - HDFS, Map Reduce, YARN

Hive Architecture
Hadoop & Hive Setup on GCP Dataproc Cluster
HQL (Hive Query Language)
Working with different file formats in Hive
Partitioning and Bucketing in Hive
Optimized Joins in Hive
Optimizing Hive Queries

Kafka Cluster
Brokers
Topics
Partitions
Producer-Consumer
Offset Management
Replicas
Commits
Sync & Async Commits
Confluent Kafka Setup
Topic Creation
Schema Registry
Key, Value Message
Message in Kafka Topics based on Random and Constant Keys
Kafka Producer Code with Serialisation
Kafka Consumer Code with De-Serialization
Consumer Groups
Working with JSON, CSV Data

CAP Theorem
What is MongoDB and MongoDB Atlas?
MongoDB vs Relational Database
MongoDB features
MongoDB use cases and applications
MongoDB architecture
Node
Data Centre
Cluster
Data replication
Write operation
Read operation
Indexing
MongoDB Atlas Setup
Understanding different ways to communicate with MongoDB
Query data from MongoDB tables
Create APIs for MongoDB table data
Queries on MongoDB using Python
Bonus - Apache Cassandra Complete (Recorded Session)

Spark Complete Architecture
Memory Management in Spark
Spark Core, Dataframes & Functions in PySpark
Use SQL in PySpark
PySpark Structured Streaming With Kafka
Common Failures in Spark and their solutions
Optimization Techniques in Spark
Implement PySpark Application on GCP Dataproc Cluster
What is Databricks?
Databricks Setup
Create Cluster on Databricks
Data Import & Export in Databricks
PySpark Notebook on Databricks
Delta Table Operations
Excute PySpark Code on Databricks Cluster
Workflows On Databricks

Introduction of Airflow
Different Components of Airflow
Installing Airflow
Setup Airflow Using GCP Cloud Composer
Understanding Airflow Web UI
DAG Operators & Tasks in Airflow Job
Create & Schedule Airflow Jobs For Data Processing

OLAP vs OLTP
What is a Data Warehouse?
Difference between Data Warehouse, Data Lake and Data Mart
Fact Tables
Dimension Tables
Slowly changing Dimensions
Types of SCDs
Star Schema Design
Snowflake Schema Design
Data Warehousing Case Studies
Inroduction of SnowFlake Data Warehousing Service
SnowFlake Architecture
Complete Setup of SnowFlake
Create Data Warehouse on SnowFlake
Analytical Queries on SnowFlake Data Warehouse
Undestanding SnowPark (Execute PySpark Application on SnowFlake)
SnowPipe Implementation
What is GCP BigQuery?
GCP BigQuery Architecture
Complete Setup of GCP BigQuery
BigQuery Tables & Data Load
Create Data Warehouse on GCP BigQuery
Analytical Queries on GCP BigQuery Tables
Data Read & Write From BigQuery Tables in PySpark

Azure Blob Storage
Azure Functions
Azure Role-Based Access Control (RBAC)
Azure Monitor
Azure Virtual Machines (VMs)
Azure Notification Hubs
Azure Queue Storage
Azure Event Grid
Azure Logic Apps
Azure Event Hubs
Azure Event Hubs Capture
Azure Cosmos DB
Azure Durable Functions
Azure HDInsight
Azure Data Factory
Azure SQL Database
Azure Synapse
Azure Delta Lake

Batch Data Pipeline Project - 1 (GCP/AZURE, Hive, PySpark, Airflow)
Batch Data Pipeline Project - 2 (GCP/AZURE, Hive, PySpark, MongoDB/Cassandra, Airflow)
Real Time Data Pipeline Project - 1 (GCP/AZURE, Kafka, PySpark Structure Streaming)
Real Time Data Pipeline Project - 2 (GCP/AZURE, Kafka, PySpark Structure Streaming)
Batch & Real Time Data Pipeline Project on AZURE

Attention Seeking Resume Preparation and Interview Strategies
Strategies To Crack Tech Interviews
Linkedin Profile Making
How To Expand Your Professional Network On Linkedin
How To Use Various Job Portals
How To Approach For Referrals

Course Schedule

Course Starts:

Live

1-June-2024

Course Duration:

3 Months

Class Timings:

Saturday & Sunday [9:00 AM - 12:00 PM Live Teaching, 12:00 PM to 01:00 PM Live Doubt Session] (IST)

Class Duration:

3 Hours Live Teaching, 60 minutes Doubt Solving

Class Recording Provided:

Yes

Course Validity:

1 year

Programming Language Used:

Python

Prerequisite:

Check Our Python Bootcamp

Instructor

Shashank Mishra

Shashank Mishra is a seasoned Data Engineer with over 6 years of industry experience, worked at leading companies like Amazon, PayTM, and McKinsey & Company.

Why Data Engineer?

Map your interest to check if Data Engineer profile is a close match for you.

Who should become a Data Engineer?

Check if you are a good fit for a Data Engineer role.

Mandatory skill sets

You need to acquire these skill sets to become a Data Engineer.

Career growth of a Data Engineer

Growth of a Data Engineer from 0 to 10+ Years Of Experience.

More Similar Courses
Related Courses

View Details

View Details

Complete Data Engineering 3.0 With Azure - Basic To Advance (Live Classes)

INR 6500

Buy Now

Empowering aspiring data professionals to soar with upskilling opportunities.

Connect With Us

Our Courses

Programming

Data Engineering

Data Analyst

Data Science

All Courses

Useful Links

All Course

Success Stories

Hall of Fame

Free Workshops

FAQ's

Get Contact

E-mail: support@growdataskills.com

Location: Gurgaon

Copyright © 2023 Grow Data Skills All Rights Reserved

Terms of service

Privacy policy

Refund Policy

Namaste 🙏

Welcome To Grow Data Skills !!!
Our chat support representative will respond within an hour.

Support Chat Support
9893181542

Support E-Mail Support
9893181542
Send Message To Us

Hello! How Can I Help You?

Send

×
How can I help you?

Complete Data Engineering 3.0 With Azure - Basic To Advance (Live Batch)

LanguageEnglish

Sessions 24

Duration 3 Months

Starts On 1-June-2024

Validity 1 Year

Mode Live

Tech stack you'll learn

Course Content

Module 1 - SQL

Module 2 - BigData Fundamentals & Hadoop

Module 3 - Apache Hive

Module 4 - Confluent Kafka

Module 5 - MongoDB (NoSQL DataBase) & Cassandra

Module 6 - Apache Spark (PySpark) & Databricks

Module 7 - Apache Airflow

Module 8 - Data Warehousing With SnowFlake & GCP BigQuery

Module 9 - AZURE Cloud

Module 10 - Industrial Projects

Module 11 - Resume, LinkedIn & Interview Strategies

Course Schedule

Instructor

Shashank Mishra

Why Data Engineer?

Who should become a Data Engineer?

Mandatory skill sets

Career growth of a Data Engineer

Related Courses

Complete Data Engineering 3.0 With Azure - Basic To Advance (Live Classes)

Namaste 🙏