Summarize the bitcoin-dev and lightning-dev mailing lists with the goal of creating a feed for public consumption. This project scrapes the mailing lists and then creates summaries based on date.
- Install all the dependencies from requirements.txt file:
pip install -r requirements.txt
- Set up environment variables: Create
.env
file in the root folder and add following keys -OPENAI_API_KEY="<your_api-Key>" ES_CLOUD_ID = "<your_es_cloud_id>" ES_USERNAME = "<your_es_username>" ES_PASSWORD = "<your_es_password>" ES_INDEX = ""<your_es_index>""
- In
src > config.py
file, setCHATGPT=True
if you want to generate results using chatgpt model, else set it toFalse
and assignCOMPLETION_MODEL
variable with the model's name. - Run an app using command:
python app.py
- Directories:
postman_collection
: APIsoutput
: generate results on api callnotebook
: jupyter-notebook with all the scripts