It is a project that allows for real-time monitoring of posts from a specific subreddit on Reddit
- Flask: A lightweight Python web framework utilized for building the web application.
- SQLAlchemy: A powerful Python SQL toolkit and Object-Relational Mapping (ORM) library employed for efficient database management.
- Beautigulsoup: Beautiful Soup is a Python-based library used for web scraping and parsing HTML and XML documents. It is commonly used in web scraping projects. Beautiful Soup analyzes the structure of a specific web page's HTML or XML, provides users with an easy-to-use API for selecting specific elements, and allows for manipulation of those elements. It can be used for various use cases, such as data mining, web scraping, and automated content extraction.
- Playwright:Playwright, on the other hand, is an open-source library for web browser automation. It is primarily used for testing and automation scenarios. Playwright supports browsers such as Chromium, Firefox, and WebKit, and provides an API to control these browsers. It can perform operations like opening pages, clicking elements, filling forms, taking screenshots, and simulating user interactions. Playwright is compatible with various programming languages, including Python.
- pymongo: A Python library for interacting with MongoDB, providing a convenient and flexible interface for managing MongoDB databases and performing CRUD operations.
To run the Flask Reddit Dashboard locally, follow these steps:
1-Clone the repository:git clone https://github.com/Mertumul/RedditPostCrawler.git
2-Install the required dependencies: pip install -r requirements.txt
3-Set up the database by running the following commands:
4-Run the application: python3 crawler.py
5-Open your web browser and access the application at http://127.0.0.1:5000/
This video demonstrates the step-by-step installation process of the application and how it functions. You can follow the installation steps and learn how to use it by watching the video.
If you need further assistance or have any other questions, please let me know.
Video:https://drive.google.com/file/d/1zOpHScB0SaesxWZaedmDxq57ct4t-Ulr/view?usp=sharingGo to http://127.0.0.1:5000