Login
Login

AWS Services For Data Engineering With Projects (Self Paced)


  • Image Icon

    LanguageEnglish

  • Image Icon

    Validity 1 Year

  • Image Icon

    Mode Recorded


Demo Class Video
Video Images
Shape Images
Shape Images
Shape Images
INR 2200
Buy Now
This course includes
  • Content Duration - 50+ Hours
  • 6 Industry Projects (End-to-End Implementation)
  • Hands on Exercises, Quizzes & Interview Preparation Material
  • Resume & Linkedin Profile Making
  • Discord Community For Networking
  • Offline Doubt Support
  • Certificate of completion
Show More

Tools you'll learn

  • Brand Image
  • Brand Image
  • Brand Image
  • Brand Image
  • Brand Image
  • Brand Image
  • Brand Image
  • Brand Image
  • Brand Image
  • Brand Image
  • Brand Image
  • Brand Image

Course Content

  • Class - 1
    • Importance of Cloud
    • Difference between Cloud and On Premises solution
    • AWS vs Azure vs GCP
    • Free Tier AWS Account setup
    • AWS CLI Setup with IAM user
    • AWS S3
    • Create S3 Bucket, Folders and Files
    • Access S3 using AWS CLI

  • Class - 2
    • AWS Lambda
    • AWS lambda implementation and Execution
    • S3 event notification trigger in AWS Lambda
    • AWS Lambda code testing with test event
    • AWS Lambda code packaging and deployment without external library dependency
    • Layers in AWS Lambda
    • AWS Lambda code packaging and deployment with layers

  • Class - 3
    • Lambda with external python dependencies
    • Triggers in Lambda
    • Setup S3 Create/Update/Delete Object notification trigger event
    • Read CSV data from S3 in Lambda using S3 notification trigger
    • CICD in AWS
    • Setup AWS Code Build and Connect with Github
    • CICD pipeline for AWS Lambda function using AWS Code Build
    • AWS SNS Fundamentals
    • Create SNS topics
    • Email subscriber for SNS topic
    • S3 Object notification publish into SNS topic
    • Send custom message into SNS topic from AWS Lambda function using boto3 library

  • Class - 1
    • AWS EC2 Fundamentals
    • AWS EC2 instance types and pricing
    • How to create setup EC2 instance?
    • SSH based access of EC2 instance
    • AWS SQS Fundamentals
    • AWS SQS vs Kafka
    • Setup first SQS on AWS & properties configuration
    • FIFO vs LIFO - SQS Type
    • Send & Receive dummy messages in SQS
    • Publish bulk messages on SQS from Lambda Function using boto3 library
    • SQS trigger for Lambda function and consume bulk messages in Lambda function
    • AWS Event Bridge fundamentals
    • Event Bridge Pipe
    • Event Bridge Pipeline where source is SQS and target is AWS Lambda function
    • Event Bridge Schedule for time based trigger of AWS Lambda

  • Class - 2
    • AWS RDS Fundamental
    • Setup MySQL database using AWS RDS
    • Stores secrets using AWS Secret Manager
    • Connect & execute queries on MySQL From Terminal
    • Connect & execute queries on MySQL using Python
    • AWS Glue Overview
    • AWS Glue Catalog
    • AWS Glue Crawler
    • AWS Glue Connection
    • AWS Glue Crawler setup to crawl csv file in S3
    • Crawl partitioned structure in S3
    • AWS Glue connection setup for MySQL on AWS RDS
    • AWS Glue crawler setup to crawl MySQL table
    • Incremental Data load in Glue using Job Bookmark
    • S3 to MySQL Data ingestion using Glue Visual ETL JOB

  • Class - 1
    • AWS Athena Overview
    • Choice between Athena vs Spark
    • Queries in Athen using Glue catalog tables
    • Create External Table in Athena to query data from S3
    • Read and manager table in Glue Catalog for Athena Queries
    • Run Athen queries from Lambda function
    • Athena queries for JDBC Data Sources
    • Federated Queries in Athena using Lambda
    • AWS Redshift Architecture
    • AWS Redshift Cluster Setup
    • Redshift Spectrum
    • Create Schema, Create Table command
    • COPY Command to load data in Redshift table
    • Unload queries data from Redshift into S3 as multiple files
    • Unload queries data from Redshift into S3 as single file
    • Unload and Load data in Redshift using Manifest file

  • Class - 2
    • Apache Airflow Overview & Architecture
    • Complete Setup of Airflow on AWS
    • Airflow UI walkthrough
    • Create first Airflow Dag
    • Sequential & Parallel tasks in Airflow Dag
    • AWS EMR Overview & Architecture
    • Complete setup of AWS EMR
    • AWS EMR Tunnel & Proxy Management Tool Setup
    • Access Hadoop, Hive and other applications on EMR
    • Create Scheduled Airflow job to use EMRStepOperator to run Spark Job with Hive
    • Data pipelines to process Food Inspection Data in Spark and load it in Hive
    • Access & Run Queries using HUE UI

  • Class - 3
    • AWS Kinesis Fundamentals
    • AWS Kinesis vs Kafka
    • AWS DynamoDB Overview & Architecture
    • AWS Kinesis Stream Setup
    • DynamoDB & DynamoDB Stream Setup
    • Event Bridge Pipe to capture CDC events from DynamoDB Streams
    • Kinesis Firehose Setup
    • Kinesis Firehose To S3 Data Ingestion
    • Project - 1 : Detailed project on Gadget Sales Data Projection using DynamoDB CDC Events via Stream, Event Bridge Pipe, Kinesis, Kinesis Firehose, S3 and Athena

  • Class - 1
    • AWS Step Function Overview
    • Step Function Key Components
    • Create first Step Function in AWS
    • Step Function to read event from one Lambda Function and Invoke another Lambda function
    • Project - 2 : Event driven sales data analysis using S3, Event Bridge Pattern, Step Function, Lambda, SQS, DynamoDB

  • AWS Services Covered
    • S3, Lambda, IAM, CLOUDWATCH, EC2, SNS, SQS
    • Event Bridge Scheduler, Event Bridge Pipe, Kinesis, Kinesis Firehose, DynamoDB, SNS, SQS
    • Step Function, EMR, GLUE, RDS, ATHENA, REDSHIFT, AWS Code Build For CICD

  • Project 3 : Incremental ingestion & analysis of Airlines data
    • Tech Stack:
      • S3
      • S3 Cloudtrail Notification
      • Event Bridge Pattern Rule
      • Glue Crawler
      • Glue Visual ETL
      • SNS
      • Redshift
      • Step Function

  • Project 4 : Weather data analysis using weather api (CICD Pipeline)
    • Tech Stack:
      • weather api
      • Python
      • AWS S3
      • AWS Managed Airflow
      • AWS Glue, Crawler & Catalog
      • AWS Redshift
      • AWS Code Build for CICD
  • Project - 5 : Quality Movie Data Analysis
    • Tech Stack:
      • S3
      • Glue Crawler
      • Glue Catalog
      • Glue Catalog Data Quality
      • Glue Low Code ETL (With PySpark)
      • Redshift
      • Event Bridge
      • SNS

  • Project - 6 : Real Time Food Delivery Analysis (CICD Pipeline)
    • Tech Stack:
      • S3
      • AWS Managed Airflow
      • AWS Kinesis Stream
      • AWS EMR
      • AWS Redshift
      • AWS Quick Sight
      • AWS Code Build

Course Schedule

Mode of the Course:
Recorded
Class Recording Provided:
Yes
Course Validity:
1 year (Starting From Day Of Enrollment)
Programming Language Used:
Python
Prerequisite:
Basics of Python, SQL, Spark  OR You Can Check 👉
Data Engineering + Python
⚠️ Important Notice :
The video may not work on Linux due to DRM restrictions. It is only accessible on Chrome when using Windows or macOS.

Workaround: To access the video on Linux, you can create a Windows virtual machine (VM) and watch the video through the VM. Alternatively, you can use our Android or iOS application to view the video on your mobile device.

Instructor

Author Images
Shashank Mishra

Shashank Mishra is a seasoned Data Engineer with over 6 years of experience at top companies like Expedia, Amazon, PayTM, and McKinsey & Company. He specializes in Big Data, Cloud, and architecting scalable data pipelines across industries. A proud MCA graduate from NIT Allahabad, Shashank is passionate about sharing his expertise. Through his YouTube channel, E-Learning Bridge (175k+ subscribers), and LinkedIn (170k+ followers), he has mentored over 14,000 aspiring data professionals, helping them launch successful careers in Data Engineering.

AWS Services For Data Engineering With Projects (Self Paced)
INR 2200
Buy Now

Copyright © 2023 Grow Data Skills All Rights Reserved

Namaste 🙏

Welcome To Grow Data Skills !!!
Our chat support representative will respond within an hour.

Whatsapp Enquiry On Whatsapp
9893181542
Email Enquiry On Email
9893181542
Send Message To Us
Hello! How Can I Help You?
Send
×

Enquiry