A curated collection of publicly available resources on how technology and tech-savvy organizations around the world use Amazon Web Services (AWS)
How they AWS is a curated knowledge repository of engineering blog posts and videos covering architectures, deployment patterns and use of various AWS services by the leading technology or tech-savvy organizations.
Many organizations regularly come forward and share their best practices, architecture, trade-offs, tools, techniques and offer an insight into engineering culture on various public platforms like blogs, conferences & meetups. The content is curated from these avenues and shared in this repository.
Note to readers: This list refers to some of the articles, posts, videos, tools, and techniques published before 2015 (marked with ❗). Please use such material with caution as there may be recent advances in technology and practices which offer better alternatives and perspectives.
- AWS Compute, Storage, Network, Database services
- Architectures
- Deployment Patterns
- Infrastructure as Code
- SRE, DevOps
- Incidents
- Automation
- Scalability, Performance
- Security
Airbnb
Algolia
Asana
Atlassian
- Automated Testing: 5 Lessons from Atlassian’s Kubernetes team on testing infrastructure as code, 2020
- Using an event-driven architecture to improve Jira Software responsiveness, 2019
- Caching in: performance engineering in Jira Cloud, 2019
- Our not-so-magic journey scaling low latency, multi-region services on AWS, 2019
Migrating the Atlassian Identity Platform to AWSScaling React server-side rendering in Jira Cloud
Basecamp
Box
CapitalOne
- Advice on Taking the AWS Machine Learning — Specialty Exam, 2021
- Automate AWS Infrastructure with Boto 3 — AWS Instance Tags, 2020
- Automate AWS Infrastructure with Boto 3: AWS Health Checks, 2020
- Automate Your AWS Infrastructure with Boto 3 — AWS Snapshots, 2020
- Guardrails for AWS Event-Driven Serverless Architectures, 2020
- Starting Out with AWS & DevOps — 10 Tips From an Expert, 2020
- Active-Active Shared-Nothing Database Architecture, 2020
- AWS Lambda Java Tutorial: Best Practices to Lower Cold Starts, 2020
- AWS Glue: An ETL Solution with Huge Potential, 2020
- Terraform Poka-Yokes — Writing Effective, Scalable, Dynamic, and Error-Resistant Terraform, 2020
- A Developer Walks into Amazon SageMaker…, 2029
- A Deep Dive Into Seamless Blue/Green Deployment Using AWS CodeDeploy, 2019
- 4 Serverless Myths to Understand Before Getting Started with AWS, 2019
- Best Practices for AWS Lambda Container Reuse, 2019
- Building Feature Toggles into Terraform, 2019
- Multi-Region Deployments with Terraform, 2018
- Applying Minification and Uglification to AWS Lambda Functions, 2018
- Serverless Transactions Serve Customers, 2017
- Building CelebritySleuth — A Serverless Framework Application, 2017
- Moving One of Capital One’s Largest Customer-Facing Apps to AWS, 2017
Deliveroo
Disney Hotstar
- High Slope Traffic & K8s Shenanigans, 2020
- Journey from EC2 to Containers, 2020
- GoCD on Kubernetes, 2020
- Building Pubsub for 50M concurrent socket connections, 2019
- Scaling for Tsunami traffic, 2019
- Infrastructure Security as a product for Hotstar, 2020
- Saving Millions : Leveraging EC2 Spots at scale, 2018
Dropbox
Expedia
- DynamoDB: Guidelines for faster reads and writes, 2019
- DynamoDB: Efficient Indexes, 2019
- How to run a Hadoop Application in an ECS Cluster, 2019
- DynamoDB: Data Modeling, 2018
- DynamoDB: Why migrate to DynamoDB from Cassandra?, 2018
- Using API Gateway for Authorization and Authentication, 2018
- re:Invent 2017 — Getting Started with Amazon Aurora, 2017
- AWS Lessons Learned for Data Processing Pipelines, 2016
Figma
Grab
- Trident - Real-time event processing at scale, 2021
- Optimally scaling Kafka consumer applications, 2020
- How We Simplified Our Data Ingestion & Transformation Process, 2019
- A Lean and Scalable Data Pipeline to Capture Large Scale Events and Support Experimentation Platform, 2019
- Querying Big Data in Real-Time with Presto & Grab's TalariaDB, 2019
- Troubleshooting Unusual AWS ELB 5XX Error, 2017
Grammarly
GoDaddy
Instacart
Lyft
- IAM whatever you say IAM, 2020
- Announcing cni-ipvlan-vpc-k8s: IPvlan overlay-free Kubernetes Networking in AWS, 2017
- SaltStack as an Alternative to Terraform for AWS Orchestration, 2017
- Overcoming AWS Complexity with SaltStack patterns, 2017
- Extending IAM Policy and AWS APIs Using KMS and Lambda, 2016
- Scoping AWS IAM roles to Docker containers, 2016
Medium
Netflix
- Unbundling Data Science Workflows with Metaflow and AWS Step Functions, 2020
- Building Netflix’s Distributed Tracing Infrastructure, 2020
- How Netflix is able to enrich VPC Flow Logs at Hyper Scale to provide Network Insight, 2020
- Byte Down: Making Netflix’s Data Infrastructure Cost-Effective, 2020
- How Netflix microservices tackle dataset pub-sub, 2019
- Cache warming: Agility for a stateful service, 2018
- Netflix Information Security: Preventing Credential Compromise in AWS, 2018
- Netflix Cloud Security: Detecting Credential Compromise in AWS, 2018
- Auto Scaling Production Services on Titus, 2018
- Netflix Billing Migration to AWS, 2016
- Netflix Billing Migration to AWS — Part II, 2016
- Netflix Billing Migration to AWS — Part III, 2016
- Creating Your Own EC2 Spot Market, 2015
- Using Presto in our Big Data Platform on AWS, 2014 ❗
- Lessons Netflix Learned from the AWS Outage, 2011 ❗
- 5 Lessons We’ve Learned Using AWS, 2010 ❗
- AWS re:Invent 2019: Capacity management made easy with Amazon EC2 Auto Scaling (CMP326-R1)
- AWS re:Invent 2019: A day in the life of a Netflix engineer (NFX202)
- AWS re:Invent 2019: Capacity management made easy with Amazon EC2 Auto Scaling (CMP326-R1)
- AWS re:Invent 2019: Monitoring anomalous application behavior (NFX205)
Practo
Postman
Quora
Scribd
Stripe
Udemy
Yelp!
- You can also find over 500+ videos in This is My Architecture Series presented by various customers of AWS.
- The list of organizations is referred from my other repo awesome-engineering.
- Banner image Cartoon vector created by vectorjuice - www.freepik.com
Contributions welcome! Read the contribution guidelines first.
To the extent possible under law, Unmesh Gundecha has waived all copyright and related or neighboring rights to this work.
If you decide to use this anywhere please give a credit to @upgundecha on twitter, also If you like my work, check out other projects on my Github.