/science_scraper

Downloads science (topical) articles from Springer Nature, generate word embeddings. Soon(tm) extract named entities (NER) and load them into a vector database like Weaviate.

Primary LanguagePython

science_scraper

Commands

poetry shell
./run_module.py scraper.get_articles
./run_module.py scraper.download_articles