/video-on-demand-on-aws-foundations

How to implement a video-on-demand workflow on AWS leveraging AWS Lambda, AWS Elemental MediaConvert, Amazon s3 and Amazon CloudWatch. Source code for Video on Demand on AWS Foundation solution.

Primary LanguageJavaScriptApache License 2.0Apache-2.0

Video on Demand on AWS Foundation

Deploy a customizable architecture to build a video-on-demand workflow.

About this solution

Video on Demand on AWS Foundation is a reference implementation that automatically provisions the Amazon Web Services (AWS) services necessary to build a scalable, distributed video-on-demand workflow.

Solution overview

We designed this solution to help you start encoding video files with AWS Elemental MediaConvert. You can customize and use this solution as the starting point to create a more complex workflow.

Out of the box, this solution helps you to accomplish the following:

  • Automatically transcode videos uploaded to Amazon Simple Storage Service (Amazon S3) into formats suitable for playback on a wide range of devices.
  • Customize MediaConvert job settings by uploading your own file and using different job settings for different inputs.
  • Store transcoded files in a destination bucket and use Amazon CloudFront to deliver to end viewers.
  • Manage costs, view logs, implement patching, and run automation runbooks for this solution from a central location.

In addition to the transcoded video, the outputs include input file metadata, job settings, and output details. These outputs are stored in a separate JSON file that can be used for further processing.

Benefits

Reference implementation - Leverage this solution as a reference implementation to automatically provision the AWS services necessary to build a scalable, distributed video-on-demand workflow.

Customization - Customize this solution and then use it as the starting point to create a more complex workflow.

Use cases

Streaming media - As consumer demand for video streaming increases, media and entertainment companies are looking for secure and reliable web-based video streaming alternatives to traditional television. This solution automatically provisions the services necessary to build a scalable, distributed architecture that ingests, stores, processes, and delivers video content. Using this solution, you can avoid inefficient trial-and-error approaches, and save on time and costs for your streaming media projects.

Educational content delivery - Professional development and educational initiatives create incentives and can be important revenue generators for nonprofit organizations. This solution can help you create modern, scalable content delivery and learning management systems to support your membership and programming offerings. The solution streamlines the processes for delivering online training and learning content.

Architecture overview

Architecture reference diagram

Deploying this solution with the default parameters deploys the following components in your AWS account. Architecture

Prerequisites

How to deploy the solution

  1. Sign in to the AWS Management Console and launch the video-on-demand-on-aws-foundation.template CloudFormation template, which is available on the solution home page: Video on Demand on AWS.
  2. The template launches in the US East (N. Virginia) Region by default. To launch the solution in a different AWS Region, use the Region selector in the console navigation bar.

For more detailed instructions, see the solution implementation guide.

Solution resources, post deployment

  • Source S3 bucket to store the source video files. The solution uploads a job-settings.json file, used to define the encoding settings for MediaConvert, to the source S3 bucket.
  • Destination S3 bucket to store the outputs from MediaConvert.
  • Job submit AWS Lambda function to create the encoding jobs in MediaConvert.
  • Job complete Lambda function to process the outputs.
  • Amazon CloudWatch to track encoding jobs in MediaConvert and invoke the Lambda job complete function.
  • An Amazon SNS topic to send notifications of completed jobs.
  • Amazon CloudFront configured with the destination S3 bucket as the origin for global distribution of the transcoded video content.

Creating a custom build

We developed this solution using the AWS Cloud Development Kit (CDK) and leveraging three of the AWS Solutions Constructs. To make changes to the solution:

  1. Download or clone this repo.
  2. Update the source code.
  3. Either deploy the solution using the CDK or run the deployment/build-s3-dist.sh script. The build script:
    1. Generates the CloudFormation template from the CDK source code using cdk synth.
    2. Runs deployment/cdk-solution-helper to update the template so that it pulls the Lambda source code from Amazon S3.
    3. Packages the Lambda code ready to be deployed to an Amazon S3 bucket in your account.

For details on deploying the solution using the CDK see the CDK Getting Started guide.

1. Run unit tests for customization

Run unit tests to ensure that your added customization passes the tests:

cd deployment
chmod +x ./run-unit-tests.sh
./run-unit-tests.sh

2. Create an S3 bucket

We configured the CloudFormation template to pull the Lambda deployment packages from an S3 bucket in the Region the template is being launched in. Create a bucket in the desired Region and append the Region name to the bucket name (for example, my-bucket-us-east-1).

aws s3 mb s3://my-bucket-us-east-1

3. Create the deployment packages

Build the distributable:

chmod +x ./build-s3-dist.sh
./build-s3-dist.sh my-bucket video-on-demand-on-aws-foundation v1.2.0

Note: The _build-s3-dist_ script expects the bucket name as one of its parameters, and this value should not include the Region suffix.

Deploy the distributable to the S3 bucket in your account:

aws s3 cp ./regional-s3-assets/ s3://my-bucket-us-east-1/video-on-demand-on-aws-foundation/v1.2.0/ \
    --recursive --acl bucket-owner-full-control

4. Launch the CloudFormation template

Deploy the CloudFormation template from deployment/global-assets/video-on-demand-on-aws-foundation.template into the same Region as your newly created S3 bucket.

Troubleshooting

The email address you provided when deploying this solution receives notifications both when MediaConvert jobs complete successfully and when they fail. The email address also receives notifications about errors that might have occurred while trying to submit a job or process the output from a job.

If you’re notified about a MediaConvert job failure, complete the following steps.

  1. From the main account where the solution is deployed, sign in to the AWS Elemental MediaConvert console.
  2. In the navigation pane, select Jobs.
  3. Select the job ID of the job that failed.
  4. On the Job Summary page, review the Overview section for an error message with more information on why the job failed. On this page, you can also find MediaConvert error codes for details on how to address the issue.

If the error is not a MediaConvert job failure, possibly one of the two Lambda functions, job_submit or job_complete, encountered an error. The email you received has an ErrorDetails link that takes you directly to the CloudWatch logs generated by the failed function. The logs have additional details on why it failed.

Note: When overriding the sample job-settings.json, we recommend exporting job settings from a MediaConvert job that’s successfully completed. Incorrect encoding settings will result in the job_submit Lambda function to fail.

How to uninstall the solution

You can uninstall this solution from the AWS Management Console or by using the AWS CLI. You must manually delete the S3 buckets and CloudWatch logs created by this solution. AWS Solutions do not automatically delete these resources in case you have stored data to retain.

For more detailed instructions, see the solution implementation guide.

Collection of operational metrics

This solution collects anonymized operational metrics to help AWS improve the quality and features of the solution. For more information, including how to disable this capability, please see the implementation guide.

License information

Copyright Amazon.com, Inc. or its affiliates. All Rights Reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0.

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.