/LLMevaluation

Primary LanguageJupyter NotebookApache License 2.0Apache-2.0

LLM Evaluation Framework

This notebook provides a systematic approach for LLM evaluation, starting from a given business problem.

Business problem:
A financial analyst wants to use financial statements (balance sheets, income statements, operational reports, annual reports) to better understand the financial strength of a company to help assess risk and guide future investment decisision. To do this efficiently they need to extract information from these documents which consist largely of unstructured text.

To deploy a Amazon SageMaker Domain along with the source code of this repository, log into your AWS Managagement Console and launch the CloudFormation stack below.
Launch CloudFormation Stack