This project is designed to ingest data and run an application using Python.
- Python should be installed on your system. If not, you can download it from the official Python website.
- Clone the repository to your local machine.
- Navigate to the project directory.
- Install the required dependencies by running the following command:
pip install -r requirements.txt
To ingest all the data, follow these steps:
- Run the following command to ingest files:
Must be run in the provided order.
python ingest_sitemap.py
- Run the following command to ingest the sitemap:
python ingest_files.py
- Run the following command to ingest web links:
python ingest_web_link.py
To run the application, execute the following command:
python app.py