This notebook provides a systematic approach for LLM evaluation, starting from a given business problem.
Business problem:
A financial analyst wants to use financial statements (balance sheets, income statements, operational reports, annual reports) to better understand the financial strength of a company to help assess risk and guide future investment decisision. To do this efficiently they need to extract information from these documents which consist largely of unstructured text.
To deploy a Amazon SageMaker Domain along with the source code of this repository, log into your AWS Managagement Console and launch the CloudFormation stack below.