/fastapi-async-sagemaker-app

A sample application that calls the sagemaker endpoint asynchronously using FastAPI.

Primary LanguagePython

fastapi-async-sagemaker-app

A sample application that calls the sagemaker endpoint asynchronously using FastAPI.

Creating a Samemaker endpoint

  • Build the container image with a dockerfile.
$ docker build -t sagemaker-endpoint-test -f ./Dockerfile.sagemaker .
  • Push a Docker image to an Amazon ECR repository.
$ docker push [aws_account_id].dkr.ecr.[region].amazonaws.com/sagemaker-endpoint-test
  • Create a samemaker endpoint by referring to this page.

Usage

## Copy the dotenv file
$ cp ./dotenv.sample ./.env

## configure the aws credentials
$ vi .env

## Start the container.
$ docker-compose up -d

## Launch the application
$ docker-compose exec app python main.py

## Execute the script for the test request
$ docker-compose exec app python request_test.py