Mastering Amazon Redshift and Serverless for Data Engineers
In-Depth Course on Amazon Redshift, Redshift Serverless, Integration with EMR, AWS Step Functions, AWS Lambda and more
- Description
- Curriculum
- FAQ
- Reviews
AWS or Amazon Redshift is one of the key AWS Services used in building Data Warehouses or Data Marts to serve reports and dashboards for business users. As part of this course, you will end up learning AWS or Amazon Redshift by going through all the important features of AWS or Amazon Redshift to build Data Warehouses or Data Marts.
We have covered features such as Federated Queries, Redshift Spectrum, Integration with Python, AWS Lambda Functions, Integration of Redshift with EMR, and End-to-End Pipeline using AWS Step Functions.
Here is the detailed outline of the course.
- First, we will understand how to Get Started with Amazon Redshift using AWS Web Console. We will see how to create a cluster, how to connect to the cluster, and also how to run the queries using a Web-based query editor. We will also go ahead and create a Database and tables in the Redshift Cluster. Once we set up a Database and tables, we will also go through the details related to CRUD Operations against tables in Databases in Redshift Cluster.
- Once we have the databases and tables in Redshift Cluster, it is time for us to understand how to get data into the tables in Redshift Cluster. One of the common approaches we use to get data into the Redshift cluster is by Copying Data from s3 into Redshift Tables. We will go through the step-by-step process of copying the data into Redshift tables from s3 using the copy command.
- Python is one of the prominent programming languages to build Data Engineering or ETL Applications. It is extensively used to build ETL Jobs to get data into Database Tables in Redshift Cluster. Once we understand how to get data from s3 to Redshift tables using Copy Command, we will learn how to Develop Python-based Data Engineering or ETL Applications using Redshift Cluster. We will learn how to perform CRUD operations and also how to take run COPY Commands using Python-based programs.
- Once we understand how to build applications using Redshift Cluster, we will go through some of the key concepts used while creating Redshift Tables with Distkeys and Sortkeys.
- We can also connect to remote databases such as Postgres and run queries directly on the remote database tables using Redshift Federated Queries and also we can run queries on top of Glue or Athena Catalog using Redshift Spectrum. You will learn how to leverage Redshift Federated Queries and Spectrum to process data in remote Database tables or s3 without copying the data.
- You will also get an overview of Amazon Redshift Serverless as part of Getting Started with Amazon Redshift Serverless.
- Once you learn Amazon Redshift Serverless, you will end up deploying a Pipeline where a Spark Application is deployed on AWS EMR Cluster which will load the data processed by Spark into Redshift.
Getting Started with Amazon Redshift
Copy Data from s3 into Redshift Tables
-
2
Getting Started with Amazon Redshift - Introduction -
3
Create Redshift Cluster using Free Trial
-
4
Connecting to Database using Redshift Query Editor
-
5
Get list of tables querying information schema
-
6
Run Queries against Redshift Tables using Query Editor
-
7
Create Redshift Table using Primary Key
-
8
Insert Data into Redshift Tables
-
9
Update Data in Redshift Tables
-
10
Delete data from Redshift tables
-
11
Redshift Saved Queries using Query Editor
-
12
Deleting Redshift Cluster
-
13
Restore Redshift Cluster from Snapshot
Develop Applications using Redshift Cluster
-
14
Copy Data from s3 to Redshift - Introduction
-
15
Setup Data in s3 for Redshift Copy
-
16
Create Database and Table for Redshift Copy Command
-
17
Create IAM User with full access on s3 for Redshift Copy
-
18
Run Copy Command to copy data from s3 to Redshift Table
-
19
Troubleshoot Errors related to Redshift Copy Command
-
20
Run Copy Command to copy from s3 to Redshift table
-
21
Validate using queries against Redshift Table
-
22
Overview of Redshift Copy Command
-
23
Create IAM Role for Redshift to access s3
-
24
Copy Data from s3 to Redshift table using IAM Role
-
25
Setup JSON Dataset in s3 for Redshift Copy Command
-
26
Copy JSON Data from s3 to Redshift table using IAM Role
Redshift Tables with Distkeys and Sortkeys
-
27
Develop application using Redshift Cluster - Introduction
-
28
Allocate Elastic Ip for Redshift Cluster
-
29
Enable Public Accessibility for Redshift Cluster
-
30
Update Inbound Rules in Security Group to access Redshift Cluster
-
31
Create Database and User in Redshift Cluster
-
32
Connect to database in Redshift using psql
-
33
Change Owner on Redshift Tables
-
34
Download Redshift JDBC Jar file
-
35
Connect to Redshift Databases using IDEs such as SQL Workbench
-
36
Setup Python Virtual Environment for Redshift
-
37
Run Simple Query against Redshift Database Table using Python
-
38
Truncate Redshift Table using Python
-
39
Create IAM User to copy from s3 to Redshift Tables
-
40
Validate Access of IAM User using Boto3
-
41
Run Redshift Copy Command using Python
Redshift Federated Queries and Spectrum
-
42
Redshift Tables with Distkeys and Sortkeys - Introduction
-
43
Quick Review of Redshift Architecture
-
44
Create multi-node Redshift Cluster
-
45
Connect to Redshift Cluster using Query Editor
-
46
Create Redshift Database
-
47
Create Redshift Database User
-
48
Create Redshift Database Schema
-
49
Default Distribution Style of Redshift Table
-
50
Grant Select Permissions on Catalog to Redshift Database User
-
51
Update Search Path to query Redshift system tables
-
52
Validate table with DISTSTYLE AUTO
-
53
Create Cluster from Snapshot to the original state
-
54
Overview of Node Slices in Redshift Cluster
-
55
Overview of Distribution Styles
-
56
Distribution Strategies for retail tables in Redshift
-
57
Create Redshift tables with distribution style all
-
58
Troubleshoot and Fix Load or Copy Errors
-
59
Create Redshift Table with Distribution Style Auto
-
60
Create Redshift Tables using Distribution Style Key
-
61
Delete Cluster with manual snapshot
Getting Started with Amazon Serverless Redshift
-
62
Redshift Federated Queries and Spectrum - Introduction
-
63
Overview of integrating RDS and Redshift for Federated Queries
-
64
Create IAM Role for Redshift Cluster
-
65
Setup Postgres Database Server for Redshift Federated Queries
-
66
Create tables in Postgres Database for Redshift Federated Queries
-
67
Creating Secret using Secrets Manager for Postgres Database
-
68
Accessing Secret Details using Python Boto3
-
69
Reading Json Data to Dataframe using Pandas
-
70
Write JSON Data to Database Tables using Pandas
-
71
Create IAM Policy for Secret and associate with Redshift Role
-
72
Create Redshift Cluster using IAM Role with permissions on secret
-
73
Create Redshift External Schema to Postgres Database
-
74
Update Redshift Cluster Network Settings for Federated Queries
-
75
Performing ETL using Redshift Federated Queries
-
76
Clean up resources added for Redshift Federated Queries
-
77
Grant Access on Glue Data Catalog to Redshift Cluster for Spectrum
-
78
Setup Redshift Clusters to run queries using Spectrum
-
79
Quick Recap of Glue Catalog Database and Tables for Redshift Spectrum
-
80
Create External Schema using Redshift Spectrum
-
81
Run Queries using Redshift Spectrum
-
82
Cleanup the Redshift Cluster
Setup Redshift Spectrum Schema using Redshift Serverless
-
83
Create Workgroup and Namespace for Amazon Redshift Serverless
-
84
Overview of Amazon Redshift Serverless Namespaces and Workgroups
-
85
Quick Preview of Amazon Redshift Serverless Dashboard
-
86
Validate Amazon Redshift Serverless Workgroup by running a query
-
87
Enable Public Accessbility to Redshift Serverless Workgroup
-
88
Understand Redshift Serverless Workgroup Capacity measured in RPUs
How long do I have access to the course materials?
You can view and review the lecture materials indefinitely, like an on-demand channel.
Can I take my courses with me wherever I go?
Definitely! If you have an internet connection, courses on Udemy are available on any device at any time. If you don't have an internet connection, some instructors also let their students download course lectures. That's up to the instructor though, so make sure you get on their good side!
Stars 5
63
Stars 4
24
Stars 3
9
Stars 2
6
Stars 1
1
30-Day Money-Back Guarantee
Course details
Video
16 hours
Lectures
1
Certificate of Completion
Full lifetime access
Access on mobile and TV
Popular courses
