AWS Container Services - ECS ECR with Fargate and EC2

Welcome to AWS Container Services course

• Introduction to Elastic Container Service

• Introducing features like Performance, Container service, Reliability, Serverless option - Fargate

• Pay as you go model, High Scalability and High Availability

• Introducing different components of Container service and Docker

• Introducing Cluster - Orchestrator

• Role played by Service, Task and Cluster

• Compute provisioning by EC2 and Fargate

• Quick start of Elastic Container Service

• Using builtin Task definition

• Creating Service

• Using task in Service and creating complete stack using cloud formation

• Verifying created service, task and cluster

• Check the running task using public ip

• Deleting the cluster

• Introduction to AWS Regions and Zones

• Purpose of Regions and Zones

• Leveraging Zones for High availability

• Concept of task distribution across zones

• Introduction to Free Tier

• AWS Simple calculator usage

• AWS Billing calculation methodology

• Verifying billing in AWS Account

• Setting billing alerts

• Introduction to AWS Identity and Access Management (IAM)

• Creating IAM Users and Groups

• Setting user policies

• Difference between root user and IAM Users

• Login using IAM users

• Reasons to protect root users

• Different components of docker

• Working of docker containers

• Advantages of docker isolation

• Lifecycle of docker container

• Introduction to docker image, dockerfile, Repository and Registry

• Role of docker and security groups

• Creating AWS EC2 Instances

• Creating security groups

• Generating private and public key in AWS

• Login to EC2 Instance using Putty client

• Installing required components for Docker

• Creating docker group and starting docker daemon

• Verifying docker installation

• Creating dockerfile

• Building and verifying docker image

• Creating a container using a docker image

• Creating a docker image with php

• Running multiple containers

• Opening ports for containers in the security group

• Verify AWS CLI Version

• Installation of AWS CLI in Linux and Windows

• Creating an access key and security key for the user

• Making the access key active/inactive

• Configure AWS CLI to use the security key

• Introduction to Elastic Container Registry (ECR)

• Creating new Repository

• Concepts of tagging in the repository

• Setting options like Tag immutability and scan on push

• Login and getting password for Elastic Container Registry (ECR)

• Using ECR CLI

• Describe repositories using CLI

• Tagging image with Repository URI

• Pushing image using docker push

• Verify image vulnerabilities using image scan

• Creating a custom image with change/new version

• Tagging image using repository URI and tag

• Pushing image with different tag

• Exploring options in AWS ECR CLI

• Creating a repository using CLI

• Tagging and pushing an image to a repository

• Describe images in a repository

• List images within a repository

• Triggering scan using AWS CLI

• View / List vulnerabilities identified for an image

Elastic Container Service (ECS) high-level overview

Overview of the cluster creation process

Overview of cluster, service, task and cloud formation stack

Different compute options like EC2 and Fargate

• Create task using Fargate for Fargate provisioned cluster

• Exploring various options while creating a task

• Overview of ECSTaskExecution policy

• Using task memory and task CPU (vCPU)

• Adding container to tasks

• Introduction to port mapping

• Running the task anonymously

• Create a cluster using network only option

• Use task definition and run the task

• Setup VPC to run the task

• Verify running task

Create new service for the cluster of type replica

Setup service security group

Verify the running task for service

• The relation between cluster, service, and tasks

• Create multiple tasks using Service

• Terminate a task manually and test auto-creation of task

• Verify deployments of Service

• Relation of Running Counts and desired counts of tasks

• Updating the service

• Deleting the service

• Introduction to Daemon Type Service

• Starting Daemon Type service

• Verify the service

• Create Scheduled Task

• Configure schedule run type

• Configure Cron expression

• Configure schedule target

• Verify the scheduled task

• The concept of using EC2 as compute provisioning for the cluster

• Trade-off between using EC2 and Fargate

• Create a new cluster with on-demand EC2

• Create a new VPC and configure the security group

• Verify created ECS Instances

• Create a new task definition for ECS cluster

• Overview of IAM roles, VPC, policy, etc.,

• Running the task and verify with an external link

• Create a new service for EC2 provisioned cluster

• Verify the deployments for running and desired count of tasks

• Verify the running tasks in services

• Concept of EC2 Elastic Network Interface (ENI)

• Functioning of ENI with EC2

• Limitation of ENI while running containers

• Need for ENI trunking in ECS Instances

• Enabling ENI trunking as part of ECS account settings

• Bridge networking overview

• Limitation and how bridge networking works in Docker environment

• ENI and port mapping as part of bridge networking

• Overview of AWSVPC networking

• Difference between AWSVPC and bridge networking

• Need for AWSVPC networking in Docker environment

• Mapping of ENI and ports in AWSVPC networking

• The behavior of containers in AWSVPC networking distributed across multiple hosts

• Comparing with overlay networking of Docker

• Create a cluster using AWSVPC

• Creating a role and new VPC

• Create a task and add a container for AWSVPC

• Detailed discussion on AWSVPC

• Understand the purpose of the load balancer

• Create a load balancer

• Configure routing

• Register targets

• Use the load balancer and configure with VPC

• Create multiple tasks for a service

• Access tasks using a load balancer

• Updating task definition by changing image

• Using updated task version with service

• Verify primary and active deployments

• Validate working of rolling update

• Discussion on registration delay, slow start duration, load balancing algorithm, and stickiness

• Adding more capacity to the auto-scaling group

• Discussion on desired capacity, minimum capacity and maximum capacity

• Changing the desired capacity to change the ECS instance capacity

• Verify deployments, discussion on the minimum and maximum health percentage

• Reducing the capacity and discussion on placement/movement of task to other ECS Instances

• Concept of spot instances in AWS EC2

• Difference between spot instances and on-demand instances

• Finding the right price to bid with spot instance

• Checking the spot instance pricing history

• Create a cluster using spot instance

• Difference between diversified and lowest bid spot instance allocation strategy

• Verify spot instance fulfilled or not

• Stopping cluster by updating the desired capacity

• Reason and advantages of stopping the cluster than deleting it

• Verify whether instances got registered from the cluster

• Start the stopped cluster by changing the desired capacity number

• Verifying the number of running tasks on the existing service after starting the cluster

• Introduction to scaling policy and autoscaling

• Understand the concept of auto-scaling

• Understand launch config

• Setting the numbers like Maximum, Minimum, and Desired capacity

• Setting the policy pair to increase and decrease the capacity

• Creating autoscaling policy

• Setting the scaleup policy

• Create an alarm for policy

• Understand the concept of consecutive period

• Set the action to be taken on alarm trigger

• Monitor the metrics

• Verify the status of different alarm

• Test the policy by manually executing it

• Verify the status of alarm after executing the alarm manually

• Verify instance status as part of auto-scaling group

• Check the activity history

• Update service for autoscaling

• Setting minimum, maximum and desired number of tasks for the service

• Adding the policy pair to scale up and scale down

• Setting target value, scaleout and in cooldown period

• Creating alarm for ECS service metric

• Setting scaling action with a cooldown period

• Verify scaling actions for the service after a successful trigger of policy

• Concept of service discovery and service registry

• Need for service discovery in a microservice environment

• Advantage of having service discovery

• Understand environmental variable in containers

• Setting the environment variable for sample MySQL task definition

• Create a sample task and verify how environment variable is used

• Connect to MySQL using public IP and verify

• Create Service with service discovery integration

• Create sample namespace for service discovery

• Verify Route 53 hosted zone for namespace

• Create a WordPress task definition using MySQL service name

• Set environment variable for startup values

• Open the ports to access WordPress

• Create service for using WordPress definition

• Verify how WordPress using the environment variables

• Access public IP and setup WordPress

• Verify database on tables created by WordPress

• Scaleup the task and realize the advantage of service discovery

• Delete service and tasks created for demo

• Clear namespace in Route 53 hosted zone

• Overview of Blue-Green deployment

• Need and advantage of Blue-Green deployment

• Underlying working of Blue-Green deployment

• Create a task definition with multiple versions

• Create a task and test task definition

• Create Elastic Load Balancer (ELB) and configure routing

• Register targets with ELB

• Configure deployment type as Blue/Green

• Overview of default configuration in Code Deploy

• Overview of Deployments, Applications, Deployment configuration in Code Deploy

• Change original revision termination duration in code deploy deployment configuration

• Setup service role for code deploy

• Configure target groups, listener port, and protocol

• Review created tasks

• Update service with the new version

• Verify the task deployment and code deploy application status

• Overview of different deployment hooks

• Monitor primary and active deployment status

• Verify and monitor traffic shifting progress in deployment status

• Confirm deployment at service events

• Delete and clean the resource created and Code deploy, IAM and ECS Task definitions

• Delete the code deploy application, deployment groups

• Delete ECS Service

• Delete Elastic Load Balancer (ELB)

• Verify and clean up EC2 security groups, Elastic IP and keys