/aws-tools

Some of my tools and sample code for building with AWS.

Primary LanguagePythonMIT LicenseMIT

aws-tools

Some tools and sample code I created for building with AWS.

Most of the Python scripts support multi accounts and regions.

githubactions travisci codecov

For running Python scripts

# Create virtual env and install the required packages

virtualenv env -p python3.8
. env/bin/activate
pip install -r requirements.txt

# Optional
source .aliases

For running shell scripts

pip install -r requirements-cli.txt

Useful Links

CDK

Description Repo/Link
AWS CDK (Cloud Development Kit) aws/aws-cdk
AWS CDK for Kubernetes (cdk8s) awslabs/cdk8s
AWS CDK Assume Role Credential Plugin aws-samples/cdk-assume-role-credential-plugin
AWS Solutions Constructs awslabs/aws-solutions-constructs
CDK Patterns cdk-patterns/serverless
Serverless Stack Toolkit (SST) (extension of AWS CDK) serverless-stack/serverless-stack
Awesome CDK kolomied/awesome-cdk
kyhau/cdk-examples kyhau/cdk-examples

CloudFormation

Description Repo/Link
AWS CloudFormation CLI (cloudformation-cli) aws-cloudformation/aws-cloudformation-cli
AWS CloudFormation Guard aws-cloudformation/cloudformation-guard
AWS CloudFormation Linter (cfn-lint) aws-cloudformation/cfn-python-lint
AWS CloudFormation Resources and Projects aws-cloudformation/awesome-cloudformation
AWS CloudFormation Resource Provider Python Plugin aws-cloudformation/cloudformation-cli-python-plugin
AWS CloudFormation Handling Region parity aws-samples/aws-cloudformation-region-parity
AWS CloudFormation Sample Templates awslabs/aws-cloudformation-templates
AWS CloudFormation Template Flip (cfn-flip) awslabs/aws-cfn-template-flip
AWSUtility::CloudFormation::CommandRunner aws-cloudformation/aws-cloudformation-resource-providers-awsutilities-commandrunner
CloudMapper duo-labs/cloudmapper
CloudFormer CloudFormer for creating templates from existing AWS resources
Former2 generates CloudFormation / Terraform / Troposphere templates from existing AWS resources iann0036/former2

Serverless

Description Repo/Link
Amazon API Gateway Serverless Developer Portal awslabs/aws-api-gateway-developer-portal
AWS Chalice - Python Serverless Microframework for AWS aws/chalice
AWS Lambda Developer Guide awsdocs/aws-lambda-developer-guide
AWS Lambda Extensions sample projects aws-samples/aws-lambda-extensions
AWS Lambda Powertools awslabs/aws-lambda-powertools-python
AWS Lambda Power Tuning alexcasalboni/aws-lambda-power-tuning
AWS Lambda Runtime Interface Emulator aws/aws-lambda-runtime-interface-emulator
AWS Lambda Python Runtime Interface Client aws/aws-lambda-python-runtime-interface-client
AWS Serverless Application Model (SAM) awslabs/serverless-application-model
AWS Serverless Application Model (SAM) CLI awslabs/aws-sam-cli
AWS Serverless Application Model (SAM) Examples awslabs/serverless-application-model/examples/
Cookiecutter SAM for Python Lambda functions aws-samples/cookiecutter-aws-sam-python
AWS Serverless Application Repository AWS Serverless Application Repository
AWS Step Functions Data Science SDK (Python) aws/aws-step-functions-data-science-sdk-python
A sandboxed local environment that replicates the live AWS Lambda environment lambci/docker-lambda
LocalStack localstack/localstack
LocalStack AWS CLI (awslocal) ocalstack/awscli-local
Serverless Framework serverless/serverless
Serverless Components serverless/components
Serverless Components CLI serverless/cli
Serverless Stack (SST) (extension of CDK) serverless-stack/serverless-stack
Stelligent mu (a tool for managing your microservices platform) stelligent/mu
Zappa Serverless Python Miserlou/Zappa
Serverless Microservice Patterns for AWS Blog post

ECS, EFS, Container-based development

Description Repo/Link
Amazon ECR Docker Credential Helper awslabs/amazon-ecr-credential-helper
Amazon ECS CLI v2 aws/amazon-ecs-cli-v2
Amazon EKS CLI weaveworks/eksctl
Amazon EKS-vended aws-iam-authenticator Amazon EKS-vended aws-iam-authenticator
Amazon EKS-vended kubectl Amazon EKS-vended kubectl
AWS App2Container Containerize a Java or .NET app
AWS Controllers for Kubernetes (ACK) aws/aws-controllers-k8s
AWS Copilot CLI - containerize apps on ECS/Fargate aws/copilot-cli
AWS Node Termination Handler aws/aws-node-termination-handler
Docker CLI plugin for ECS docker/ecs-plugin
A simple terminal UI for both docker and docker-compose jesseduffield/lazydocker

AWS SDKs and CLIs

Description Repo/Link
Amazon CloudWatch Embedded Metric Format Client Library (Python) awslabs/aws-embedded-metrics-python
Amazon Ion Python amzn/ion-python
Authorization Lambda@Edge (Node.js) aws-samples/authorization-lambda-at-edge
AutoML Toolkit for Deep Learning awslabs/autogluon
AWS Amplify CLI aws-amplify/amplify-cli
AWS Amplify Flutter aws-amplify/amplify-flutter
AWS Cloud Digital Interface (CDI) Software Development Kit (SDK) aws/aws-cdi-sdk
AWS CLI aws/aws-cli
AWS CLI interactive productivity booster (aws-shell) awslabs/aws-shell
AWS Config Rules Development Kit (RDK) CLI awslabs/aws-config-rdk
AWS Config Rules Development Kit (RDK) Library (Python) awslabs/aws-config-rdklib
AWS DynamoDB Encryption Client (Python) aws/aws-dynamodb-encryption-python
AWS EC2 ENI Utilities (ec2-net-utils) aws/ec2-net-utils
AWS EFS Utilities (efs-utils) aws/efs-utils
AWS Elastic Beanstalk CLI aws/aws-elastic-beanstalk-cli
AWS Encryption SDK (Python) aws/aws-encryption-sdk-python
AWS Encryption SDK CLI aws/aws-encryption-sdk-cli
AWS IoT Greengrass Core SDK (Python) aws/aws-greengrass-core-sdk-python
AWS IoT Device SDK (Python) aws/aws-iot-device-sdk-python
AWS ParallelCluster (enhanced version of CfnCluster) aws/aws-parallelcluster
AWS SageMaker SDK (Python) aws/sagemaker-python-sdk
AWS Tools for Microsoft VSTS AWS Tools for Microsoft Visual Studio Team Services
AWS Tools for PowerShell AWS Tools for PowerShell
AWS Tools and sample code provided by AWS Premium Support awslabs/aws-support-tools
AWS Trusted Advisor Tools aws/Trusted-Advisor-Tools
AWS X-Ray Daemon aws/aws-xray-daemon
AWS X-Ray SDK (Python) aws/aws-xray-sdk-python
bash-my-aws bash-my-universe/bash-my-aws
coldsnap - command-line tool that uses the EBS direct APIs to upload and download snapshots awslabs/coldsnap
Neptune Graph Notebook (Python) aws/graph-notebook
kubectl kubernetes/kubectl

Security

Description Repo/Link
AWS Exposable Resources SummitRoute/aws_exposable_resources
AWS Security Documentation by Category docs.aws.amazon.com/security
A Secure Cloud - Repository of customizable AWS security configurations and best practices asecure.cloud/
Open source tools for AWS security toniblyx/my-arsenal-of-aws-security-tools
AWS IAM Policy Simulator IAM Policy Simulator Console
AWS Managed Policies (list/monitor) z0ph/aws_managed_policies
AWS Policy Generator AWS Policy Generator
AWS Security Benchmark awslabs/aws-security-benchmark
AWS Security Hub Multiaccount Scripts awslabs/aws-securityhub-multiaccount-scripts
AWS Shield Engagement Lambda https://s3.amazonaws.com/aws-shield-lambda/ShieldEngagementLambda.pdf
AWS WAF Security Automations awslabs/aws-waf-security-automations
Automated Incident Response with SSM aws-samples/automated-incident-response-with-ssm
Import AWS Config Findings into AWS Security Hub aws-samples/aws-securityhub-config-integration
amazon-detective-multiaccount-scripts aws-samples/amazon-detective-multiaccount-scripts
AWS Self-Service Security Assessment tool awslabs/aws-security-assessment-solution
aws-securityhub-to-email aws-samples/aws-securityhub-to-email
aws-securityhub-to-slack aws-samples/aws-securityhub-to-slack
cloud-custodian cloud-custodian/cloud-custodian
CloudGoat RhinoSecurityLabs/cloudgoat
git-secrets awslabs/git-secrets
Pacu an open source AWS exploitation framework RhinoSecurityLabs/Pacu
Redboto elitest/Redboto
Endgame: Creating Backdoors in AWS hirajanwin/endgame

Chaos Engineering

Description Repo/Link
AWS SSM Chaos Runner amzn/awsssmchaosrunner
Chaos Injection for AWS resources using Amazon SSM Run Command and Automation adhorn/chaos-ssm-documents

Networking

Description Repo/Link
AWS Network Firewall CFN templates aws-samples/aws-networkfirewall-cfn-templates
AWS CIDR Finder aws-samples/aws-cidr-finder
Serverless Transit Network Orchestrator awslabs/serverless-transit-network-orchestrator
TGW (Transit Gateway) Migrator Tool TGW Migrator Tool
TGW to solve overlapping CIDRs aws-samples/aws-transit-gateway-overlapping-cidrs

Closing account

Description Repo/Link
How do I close my AWS account? How do I close my AWS account?
aws-nuke Remove all resources from an AWS account rebuy-de/aws-nuke

Other AWS useful tools

Description Repo/Link
Amazon DynamoDB NoSQL Workbench NoSQL Workbench for Amazon DynamoDB
Amazon Honeycode builder.honeycode.aws
AWS Auto Scaling Custom Resources aws/aws-auto-scaling-custom-resource
AWS Deployment Framework (ADF) awslabs/aws-deployment-framework
AWS Distributed Load Testing awslabs/distributed-load-testing-on-aws
AWS Glue ETL Code Samples aws-samples/aws-glue-samples
AWS Glue Libs awslabs/aws-glue-libs
AWS Instance Scheduler AWS Instance Scheduler
AWS Multi Account Viewer awslabs/aws-multi-account-viewer
AWS Perspective awslabs/aws-perspective
AWS Proton Sample Templates aws-samples/aws-proton-sample-templates
AWS Proton Sample Fargate Templates aws-samples/aws-proton-sample-fargate-service
awslimitchecker jantman/awslimitchecker

Data sources

Description Repo/Link
Registry of Open Data on AWS registry.opendata.aws
Landset 8 satellite imagery of all land on Earth registry.opendata.aws/landsat-8,
landsatonaws.com

Other tools

Description Repo/Link
CNCF Cloud Native Interactive Landscape landscape.cncf.io
Awesome Hacking Hack-with-Github/Awesome-Hacking
FastAPI tiangolo/fastapi
OpenFaaS openfaas/faas
Regex tester and debugger: PHP, PCRE, Python, Golang and JavaScript regex101.com
Subnet Calculator - MxToolbox mxtoolbox.com

Best Practices Guides

Workshops