Video Demo: YouTube
This project is a Python application that analyzes the word frequency in a given month's CNN article sitemap. It provides functionality to retrieve the most frequently used words, generate a bar chart of the top 20 words, and export the word frequency data to a CSV file.
- Analyzes word frequency in a specific month's CNN article sitemap.
- Retrieves the most frequently used words.
- Generates a bar chart of the top 20 most frequently used words.
- Exports word frequency data to a CSV file for further analysis.
- Python 3.x
requestslibraryBeautifulSouplibrarymatplotliblibraryspacylibrarytkinterlibrary (for GUI)
-
Clone or download the project files to your local machine.
-
Install the required Python libraries by running the following command:
pip install -r requirements.txt -
Download the English language model for Spacy run:
python -m spacy download en_core_web_sm
( in new versions it will download and load the model automatically)
To run the project using the graphical user interface, navigate to the project directory and execute the following command:
python project.py
The application will open a GUI window where you can enter the month and year for analysis. Click the "Analyze" button to start the analysis process. The program will retrieve the sitemap for the specified month and year from CNN's website and display the most repeated words in the console. It will also generate a bar chart showing the top 20 most frequently used words.
The project includes a test file test_project.py that uses pytest for unit testing. To run the tests, execute the following command:
pytest test_project.py
The tests validate the functionality of the project's functions and ensure that they behave as expected.
The test_project.py file contains unit tests for the project functions.
To run tests, execute the following command:
pytest test_project.py
This project is licensed under the MIT License.
If you have any questions or need assistance, you can reach out to the project maintainers at shojaei.dev@gmail.com
This project is licensed under the MIT License. See the LICENSE file for more information.
While the current version of the Word Frequency Analyzer is functional and provides valuable insights into word frequencies, we have plans for future enhancements and additions. Some of the planned features and improvements include:
- Adding AI Analyze using chatgpt.
- Adding support for analyzing word frequencies from multiple sources, such as different news websites or RSS feeds.
- Implementing advanced text analytics techniques, such as sentiment analysis and entity recognition, to gain deeper insights from the analyzed data.
- Enhancing the visualization capabilities by providing more interactive and customizable charts and graphs.
- Improving the performance and efficiency of the word frequency analysis algorithm.
- Expanding the project's documentation and providing more comprehensive user guides and tutorials.
We are committed to continuously improving the Word Frequency Analyzer and welcome any feedback or suggestions from the user community.