Use the Spambase dataset to classify spam. This data is already parsed down from email to features.
After completing this assignment, you should understand:
- Simple Bayesian analysis
- The importance of separating training and test data
After completing this assignment, you should be able to:
- Create a Bayesian classifier
- Train your classifier
- Test your classifier
- A Git repo called spambase containing at least:
README.mdfile explaining how to run your project- a
requirements.txtfile
- No PEP8 or Pyflakes warnings or errors
Go to the UCI Machine Learning repository and download the Spambase dataset. Make sure you read the documentation for the data. This explains what the attributes are in the data file.
Subsample the data set so 60% is training data and 40% is test data. You can subsample however you like, including splitting the original file. Just make sure that you have a representative data set. (The original is about 60% not-spam and 40% spam.)
Then write code to classify the data into spam and not-spam, training with your training data and testing on your test data.
In addition to the normal mode requirements, try reducing or changing your features in order to get better results.