joepfortunato/sagemaker-huggingface-llama-2-samples

Getting Started with LLaMa 2 and Hugging Face

This repository contains instructions/examples/tutorials for getting started with LLaMA 2 and Hugging Face libraries like transformers, datasets.

Training

• Fine-tune LLaMA 2 on Amazon SageMaker
• Deploy Llama 2 (7B - 70B) on Amazon SageMaker

Requirements

Before we can start make sure you have met the following requirements

• AWS Account with quota
• AWS CLI installed
• AWS IAM user configured in CLI with permission to create and manage ec2 instances

Commands

watch -n0.1 nvidia-smi