/scrapaw

Primary LanguagePython

GuruPod

python + fastapi + beautiful soup + prawl

  • scrape episode data
  • keep data in sql db
  • auto-post new episodes to reddit
  • update reddit wiki
  • monitor subreddit
  • add flair to posts with given tags in title

.. automodule:: scraper.implementations.dtg_scraper :members: :private-members: :member-order: groupwise

.. automodule:: scraper.implementations.dtg_selectors :members: :private-members: :member-order: groupwise

.. automodule:: scraper.implementations.captivate_selectors :members: :private-members: :member-order: groupwise

.. automodule:: scraper.selectors.captivate :members: :private-members: :member-order: groupwise

.. automodule:: scraper.selectors.dtg_selectors :members: :private-members: :member-order: groupwise

.. automodule:: scraper.episode :members: :private-members: :member-order: groupwise