Grow Data SKills | Most Affordable Courses | Become Top Data Professional

Light
Dark

AWS Services For Data Engineering With Projects

By Shashank In Grow Data Skills

Self Paced
English
Completion Certificate

Demo Class Video

1 Year

Validity (From the date of Enrollment)

50 Hours

Duration

12

Sessions

6

Projects

INR 2500

Buy Now

This course includes

Content Duration50 Hours
Total Video Sessions12
Total Industry Projects6
AWS Cloud
Quality Assignments & quizzes after each module
Interview preparation guide
Dedicated placement assistance
Resume & Linkedin profile making
Doubt support on private discord community
Certificate of completion

Tech stack you'll learn

Course Content

✅ Class - 1

Importance of Cloud
Difference between Cloud and On Premises solution
AWS vs Azure vs GCP
Free Tier AWS Account setup
AWS CLI Setup with IAM user
AWS S3
Create S3 Bucket, Folders and Files
Access S3 using AWS CLI

✅ Class - 2

AWS Lambda
AWS lambda implementation and Execution
S3 event notification trigger in AWS Lambda
AWS Lambda code testing with test event
AWS Lambda code packaging and deployment without external library dependency
Layers in AWS Lambda
AWS Lambda code packaging and deployment with layers

✅ Class - 3

Lambda with external python dependencies
Triggers in Lambda
Setup S3 Create/Update/Delete Object notification trigger event
Read CSV data from S3 in Lambda using S3 notification trigger
CICD in AWS
Setup AWS Code Build and Connect with Github
CICD pipeline for AWS Lambda function using AWS Code Build
AWS SNS Fundamentals
Create SNS topics
Email subscriber for SNS topic
S3 Object notification publish into SNS topic
Send custom message into SNS topic from AWS Lambda function using boto3 library

✅ Class - 1

AWS EC2 Fundamentals
AWS EC2 instance types and pricing
How to create setup EC2 instance?
SSH based access of EC2 instance
AWS SQS Fundamentals
AWS SQS vs Kafka
Setup first SQS on AWS & properties configuration
FIFO vs LIFO - SQS Type
Send & Receive dummy messages in SQS
Publish bulk messages on SQS from Lambda Function using boto3 library
SQS trigger for Lambda function and consume bulk messages in Lambda function
AWS Event Bridge fundamentals
Event Bridge Pipe
Event Bridge Pipeline where source is SQS and target is AWS Lambda function
Event Bridge Schedule for time based trigger of AWS Lambda

✅ Class - 2

AWS RDS Fundamental
Setup MySQL database using AWS RDS
Stores secrets using AWS Secret Manager
Connect & execute queries on MySQL From Terminal
Connect & execute queries on MySQL using Python
AWS Glue Overview
AWS Glue Catalog
AWS Glue Crawler
AWS Glue Connection
AWS Glue Crawler setup to crawl csv file in S3
Crawl partitioned structure in S3
AWS Glue connection setup for MySQL on AWS RDS
AWS Glue crawler setup to crawl MySQL table
Incremental Data load in Glue using Job Bookmark
S3 to MySQL Data ingestion using Glue Visual ETL JOB

✅ Class - 1

AWS Athena Overview
Choice between Athena vs Spark
Queries in Athen using Glue catalog tables
Create External Table in Athena to query data from S3
Read and manager table in Glue Catalog for Athena Queries
Run Athen queries from Lambda function
Athena queries for JDBC Data Sources
Federated Queries in Athena using Lambda
AWS Redshift Architecture
AWS Redshift Cluster Setup
Redshift Spectrum
Create Schema, Create Table command
COPY Command to load data in Redshift table
Unload queries data from Redshift into S3 as multiple files
Unload queries data from Redshift into S3 as single file
Unload and Load data in Redshift using Manifest file

✅ Class - 2

Apache Airflow Overview & Architecture
Complete Setup of Airflow on AWS
Airflow UI walkthrough
Create first Airflow Dag
Sequential & Parallel tasks in Airflow Dag
AWS EMR Overview & Architecture
Complete setup of AWS EMR
AWS EMR Tunnel & Proxy Management Tool Setup
Access Hadoop, Hive and other applications on EMR
Create Scheduled Airflow job to use EMRStepOperator to run Spark Job with Hive
Data pipelines to process Food Inspection Data in Spark and load it in Hive
Access & Run Queries using HUE UI

✅ Class - 3

AWS Kinesis Fundamentals
AWS Kinesis vs Kafka
AWS DynamoDB Overview & Architecture
AWS Kinesis Stream Setup
DynamoDB & DynamoDB Stream Setup
Event Bridge Pipe to capture CDC events from DynamoDB Streams
Kinesis Firehose Setup
Kinesis Firehose To S3 Data Ingestion
Industry Project - 1: Detailed project on Gadget Sales Data Projection
Tech Stack: DynamoDB CDC Events via Stream, Event Bridge Pipe, Kinesis, Kinesis Firehose, S3 and Athena

✅ Class - 1

AWS Step Function Overview
Step Function Key Components
Create first Step Function in AWS
Step Function to read event from one Lambda Function and Invoke another Lambda function
Industry Project 2 : Event driven sales data analysis
Tech Stack: S3, Event Bridge Pattern, Step Function, Lambda, SQS, DynamoDB

AWS Services Covered
S3, Lambda, IAM, CLOUDWATCH, EC2, SNS, SQS
Event Bridge Scheduler, Event Bridge Pipe, Kinesis, Kinesis Firehose, DynamoDB, SNS, SQS
Step Function, EMR, GLUE, RDS, ATHENA, REDSHIFT, AWS Code Build For CICD
Industry Project - 3 : Incremental ingestion & analysis of Airlines data
Tech Stack: S3, S3 Cloudtrail Notification, Event Bridge Pattern Rule, Glue Crawler, Glue Visual ETL, SNS, Redshift, Step Function
Industry Project - 4 : Weather data analysis using weather api (CICD Pipeline)
Tech Stack: Weather api, Python, AWS S3, AWS Managed Airflow, AWS Glue, Crawler & Catalog, AWS Redshift, AWS Code Build for CICD
Industry Project - 5 : Quality Movie Data Analysis
Tech Stack: S3, Glue Crawler, Glue Catalog, Glue Catalog Data Quality, Glue Low Code ETL (With PySpark), Redshift, Event Bridge, SNS
Industry Project - 5 : Real Time Food Delivery Analysis (CICD Pipeline)
Tech Stack: S3, AWS Managed Airflow, AWS Kinesis Stream, AWS EMR, AWS Redshift, AWS Quick Sight, AWS Code Build

Attention Seeking Resume Preparation and Interview Strategies
Strategies To Crack Tech Interviews
Linkedin Profile Making
How To Expand Your Professional Network On Linkedin
How To Use Various Job Portals
How To Approach For Referrals

Course Schedule

Mode of the Course:

Recorded

Course Duration:

50 Hours

Total Sessions:

Total Projects:

Course Validity:

1 year (Starting From Day Of Enrollment)

Programming Language Used:

Python

Prerequisite:

Basics of Python, SQL, Spark OR You Can Check 👉

Data Engineering & Python

⚠️ Important Notice :

The video may not work on Linux due to DRM restrictions. It is only accessible on Chrome when using Windows or macOS.

Workaround: To access the video on Linux, you can create a Windows virtual machine (VM) and watch the video through the VM. Alternatively, you can use our Android or iOS application to view the video on your mobile device.

Instructor

Shashank Mishra

Shashank Mishra is a seasoned Data Engineer with over 7 years of experience at top companies like Expedia, Amazon, PayTM, and McKinsey & Company. He specializes in Big Data, Cloud, and architecting scalable data pipelines across industries. A proud MCA graduate from NIT Allahabad, Shashank is passionate about sharing his expertise. Through his YouTube channel, E-Learning Bridge (177k+ subscribers), and LinkedIn (175k+ followers), he has mentored over 14,000 aspiring data professionals, helping them launch successful careers in Data Engineering.