/centralized-logging-with-opensearch

Build your own log analytics platform on OpenSearch in 20 minutes

Primary LanguagePythonApache License 2.0Apache-2.0

Centralized Logging with OpenSearch

The Centralized Logging with OpenSearch solution provides comprehensive log management and analysis functions to help you simplify the build of log analytics pipelines. Built on top of Amazon OpenSearch Service, the solution allows you to streamline log ingestion, log processing, and log visualization. You can leverage the solution in multiple use cases, such as to abide by security and compliance regulations, achieve refined business operations, and enhance IT troubleshooting and maintenance.

Table of content

Solution Overview

The solution has the following features:

  • All-in-one log ingestion: provides a single web console to ingest both application logs and AWS service logs into the Amazon OpenSearch (AOS) domains.

  • Codeless log processor: supports log processor plugins developed by AWS. You are allowed to enrich the raw log data through a few clicks on the web console.

  • Out-of-box dashboard template: offers a collection of reference designs of visualization templates, for both commonly used software such as Nginx and Apache HTTP Server, and AWS services such as Amazon S3 and Amazon CloudTrail.

Architecture

Deploying this solution with the default parameters builds the following environment in the AWS Cloud.

Architecture

Deployment

Please follow the Implementation Guide to deploy the solution in your AWS account.

Customization

Please follow the Customization Guide for custom build.