ProphitBet is a Machine Learning Soccer Bet prediction application. The name is a combination of "Profit" & "Prophet". It analyzes the form of teams with stunning visualizations, computes statistics from previous matches of a selected league and predicts the outcomes of a match using Advanced Machine Learning (ML) methods. The supported algorithms in this application are Neural Networks, Random Forests & Ensemble models. Additionally, the users may analyze the features of the models and adjust the models accordingly. The model extracts soccer data for multiple leagues from football-data(https://www.football-data.co.uk/). Additionally, the application can parse upcoming fixtures from Footystats(https://footystats.org/) and predict the upcoming matches for a league. There is also an auto-save feature, which saves the training of the models, so that users can re-load them on the next run. Finally, the application requires Internet Connection, in order to download the league data.
The user interface is pretty simple: Every action can be done via a menu-bar on the top of the application. There are 5 available menus:
- Application: Create/Load/Delete Leagues
- Analysis: Data Analysis & Feature Importance
- Model: Train/Evaluate Models & Predict Matches
- Theme: Select a Theme for the Application Window
- Help: Additional Resources to Read about Machine Learning Topics
Also, 4 custom themes have been added and can be selected via "Theme" menu. The themes are:
- Breeze-Light
- Breeze-Dark
- Forest-Light
- Forest-Dark
For each league, the application computes several statistics (features) about the teams, including their form, the performance of the last N matches, etc. The stats are computed for both the home team and the away team. More specifically:
- Home Wins (HW): Last N wins of the home team in its home
- Home Losses (HL): Last N losses of the home team in its home
- Home Goal Forward (HGF): Sum of goals that the home team scored in the last N matches in its home
- Home Goal Against (HGA): Sum of goals that the away teams scored in the last N matches.
-
Home G-Goal Difference Wins (HGD-W) Last N wins of the home team with G difference in the final score in its home (
${HG - AG \geq 2}$ ) -
Home G-Goal Difference Losses (HGD-L) Last N losses of the home team with G difference in the final score in its home (
${HG - AG \geq 2}$ ) - Home Win Rate (HW%) Total win rate of the home team from the start of the league in its home
- Home Loss Rate (HL%) Total loss rate of the home team from the start of the league in its home
- Away Wins (AW): Last N wins of the away team away its home
- Away Losses (AL): Last N losses of the away team away its home
- Away Goal Forward (AGF): Sum of goals that the away team scored in the last N matches away its home
- Away Goal Against (AGA): Sum of goals that the home teams scored in the last N matches.
-
Away G-Goal Difference Wins (AGD-W) Last N wins of the away team with G difference in the final score away its home(
${HG - AG \geq 2}$ ) -
Away G-Goal Difference Losses (AGD-L) Last N losses of the away team with G difference in the final score away its home (
${HG - AG \geq 2}$ ) - Away Win Rate (AW%) Total win rate from the start of the league away its home
- Away Loss Rate (AL%) Total loss rate from the start of the league away its home
Each column can be added or removed from a league during the creating phase.
ProphitBet provides 11 main soccer leagues and 2 extras, which are downloaded by https://www.football-data.co.uk/. More specifically, these leagues are:
- Premier League (England)
- Premiership (Scotland)
- Bundesliga I (Germany)
- Serie A (Italy)
- La Liga (Spain)
- Ligue I (Franch)
- Eredivisie (Netherlands)
- Jupiler Pro League (Belgium)
- Liga I (Portugal)
- Super Lig (Turkey)
- Super League (Greece)
- Serie A (Brazil)
- Allsvenskan (Sweden)
You can add additional leagues by modifying the database/leagues.csv configuration file. In order to add a new league, you need to specify:
- Country (The country of the league, e.g. Russia)
- League Name (The name of the league e.g. Premier League)
- Base Url (The link to the .csv file from football-data, e.g. https://www.football-data.co.uk/new/RUS.csv)
- Year Start (The year that ProphitBet will stop collecting data, e.g. 2015)
- League Type (Since it's an extra league, it always has to be "
extra") - Fixtures Url (The fixture's url from footystats, which will be used to parse upcoming matches, e.g. https://footystats.org/russia/russian-premier-league)
This is particulary useful, when analyzing the quality of the training data). ProphitBet provides a headmap for the computed stats, which shows the correlations
between the columns. The correlation is described by an arithmetic value
ProphitBet also comes with a built-in module for "interpretability". In case you are wondering which stats are the most important, there are 4 methods provided:
- Ensemble Learning (https://www.knowledgehut.com/blog/data-science/bagging-and-random-forest-in-machine-learning)
- Variance Analysis (https://corporatefinanceinstitute.com/resources/knowledge/accounting/variance-analysis/)
- Univariate Analysis (https://link.springer.com/referenceworkentry/10.1007/978-94-007-0753-5_3110)
- Recursive Feature Elimination (https://bookdown.org/max/FES/recursive-feature-elimination.html)
It is noticed that the training dataset of several leagues contains imbalanced classes, which means that the number of matches that ended in a win for the home team is a lot larger than the number of the matches that ended in a win for the away team. This often leads models to overestimate their prediction probabilities and tend to have a bias towards the home team. ProphitBet provides a plot to detect such leagues, using the Target Distrubution Plot, as well as several tools to deal with that, including:
- Noise Injection (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2771718/)
- Output Probability Calibration (https://davidrosenberg.github.io/ttml2021/calibration/2.calibration.pdf)
A detailed description of neural networks can be found in the link below: https://www.investopedia.com/terms/n/neuralnetwork.asp
A detailed description of random forests can be found in the link below: https://www.section.io/engineering-education/introduction-to-random-forest-in-machine-learning/
This type of combines the predictions of a Neural Network & Random Forest. Typically, a well tuned Random Forest makes similar predictions with a Neural Network. However, there are some cases where these 2 model output different output probabilities (e.g. Random Forest might give higher probability that an outcome is Home). In that case, the ensemble model can be used which averages the output probabilities of both models and decides on the predicted outcome.
Before using a trained model, it is wise to first evaluate the model on unseen matches. This should reveal the quality of the model training, as well as its output probabilities. You can compare the probabilities of random forest with the neural network's probabilities and choose the most confident and well-trained model. Additionally, you can request an analytical report of the accuracy of the classifiers for specific odd intervals (e.g. the accuracy between 1.0 and 1.3, 1.3, and 1.6, etc., for the home or away team).
In order to request a prediction for a match, You need to select the home/away team, as well as the book odds. You should use both models to make a prediction. If both models agree, then the prediction should probably be good. If the models disagree, then it's best to avoid betting on that match.
An alternative way to predict multiple matches at once is to use the "Fixture Parsing" option. When you click on that option, it will open the browser and ask you to download the specified fixture from footystats.org. This can be done by pressing Ctrl + S or right click and "Save As" option. Then, You will need to specify the filepath of the downloaded fixture and the application will automatically parse and predict the upcoming matches for you. You may also choose to export these predictions to a csv file, which you can open with Microsoft Excel.
A requirements.txt file has been added to the project directory. However, the following table also presents the required libraries. Check the requirements.txt file for library versions.
| Library/Module | Download Url | Installation |
|---|---|---|
| Python Language | https://www.python.org/ | Download from website |
| Numpy | https://numpy.org/ | pip install numpy |
| Pandas | https://pandas.pydata.org/ | pip install pandas |
| Matplotlib | https://matplotlib.org/ | pip install matplotlib |
| Seaborn | https://seaborn.pydata.org/ | pip install seaborn |
| Scikit-Learn | https://scikit-learn.org/stable/ | pip install scikit-learn |
| Imbalanced-Learn | https://imbalanced-learn.org/stable/ | pip install imbalanced-learn |
| XGBoost | https://xgboost.readthedocs.io/en/stable/ | pip install xgboost |
| Tensorflow | https://www.tensorflow.org/ | pip install tensorflow |
| Tensorflow-Addons | https://www.tensorflow.org/addons | pip install tensorflow_addons |
| TKinter | https://docs.python.org/3/library/tkinter.html | pip install tk |
| Optuna | https://optuna.org/ | pip install optuna |
| Fuzzy-Wuzzy | https://pypi.org/project/py-stringmatching (https://pypi.org/project/fuzzywuzzy/) | pip install fuzzywuzzy |
To run pip commands, open CMD (windows) using Window Key + R or by typing cmd on the search. In linux, You can use the linux terminal.
- Download & Install python. During the installation, you should choose add to "Path" It is recommended to download python 3.9.
- After you download & install python, you can Download the above libraries using pip module (e.g.
pip install numpy). These modules can be installed via the cmd (in windows) or terminal (in linux). IMPORTANT: To download the correct versions, just add "==" after pip install to specify version, as described on requirements.txt file. For example, to installtensorlfow 2.9.1, you can use:pip install tensorflow==2.9.1. - On windows, you can double click the main.py file. Alternatively (Both Windows & Linux), You can open the cmd on the project directory and run:
python main.py.
Cannot install tensorflow.Sometimes, it requires visual studio to be installed. Download the community edition which is free here: https://pypi.org/project/py-stringmatchingpip command was not foundin terminal. In this case, you forgot to choose add to Path option during the the installation of python. Delete python and repeat download instructions 1-3.File main.py was not found. This is because when you open command line (cmd) tool on windows, or terminal on linux, the default directory that cmd is looking at is the home directory, not prophitbet directory. You need to navigate to prophitbet directory, where the main.py file exists. To do that, you can use thecdcommand. e.g. if prophitbit is downloaded on "Downloads" folder, then typecd Downloads/ProphitBet-Soccer-Bets-Predictorand then typepython main.pypython command not foundon linux. This is because python command ispython3on linux systemsParsing date is wrongwhen trying to parse fixtures from the html file. The html file has many fixtures. Each fixture has a date. You need to specify the correct date of the fixture you are requesting, so the parser identifies the fixtures from the given date and grab the matches. You need to specify the date before importing the fixture file into program.
- Windows
- Linux
- Mac
In case there is an error with the application, open a Github Issue so that I can get informed and (resolve the issue if required).
- Neural Network's Training Dialog Height is too large and as a result, "Train" button cannot be displayed.
Solution: You can press "ENTER" button to start training. The same applies to Random Forest Training Dialog, as well as the tuning dialogs.
- Improved Graphical User Interface (GUI)
- Added Custom Themes
- Added "Ensemble" Model
- Training can now start by pressing "ENTER" button
- Added option for SVM-Smote resampling method (https://imbalanced-learn.org/stable/references/generated/imblearn.over_sampling.SVMSMOTE.html). It requires imbalanced-learn to be installed
- Replaced
py_stringmatchinglibrary, which was a bit confusing to install, withfuzzywuzzy(Check requirements.txt) - Fixtures are now imported, even if odds are missing. You can also manually add them or edit them
- Fixed Bugs (Leagues not updating, Fixtures not being imported, etc.)
- Added
Weightingmethod to Random Forest. - Neural Networks may now have different activation, regularization or batch normalization option on each layer separately.
- Added more metrics (F1-Score, Precision, Recall)
- Tuning may now focus on maximizing F1-Score, Precision and Recall of a specified target (Home, Draw or Away).
- Updated Documentation!
- Fixed a bug in Evaluation Filters
- Fixed Fixture Parser
- Added 2 new statistic features (columns): HGA, AGA
- Neural Network now supports different noise ranges for each odd (1/x/2)
- Neural Network may now add noise only to favorite teams (teams with odd < 2.0)
- Fixed a bug where several leagues would not be updated
- Fixed a bug in evaluation filters
- Improved Model's Training
- Added more training parameters, including, Dropout layers, Batch Normalization, Optimizers, Learning Rate, Regularizers
- Model may now achieve higher accuracies
- Added option to automatically search for best parameters, using OPTUNA package (Requires the installation of optuna, see instructions)
- Updated Documentation: Added more detailed instruction + common errors and how they are dealt
- Fixed a bug where leagues wouldn't be updated up to last day
- Smaller windows sizes
- Better parameter selection for neural network tuning
- Train Dialogs may now initiate training by hitting "ENTER" button
- Small bug fixes
- Fixed a bug where model could not be saved during training
- Fixed a bug where validation accuracy was not properly monitored during tuning
- Increased number of available Trials to 2000
- Added more options, including layers of neural network during training
- Updated documentation
If you liked the app and would like to contribute, You are allowed to make changes to the code and make a pull request! Usually, it takes 1-3 days for me to review the changes and accept them or reply to you if there is something wrong.
A lot of people request more football training data (e.g. corners, shots, cards, injuries, etc.). I found a football API that does provide such data https://footystats.org/api/
However, such data are not available for free. I would like your help to improve the quality of the training data that the algorithms use. Higher quality data should increase the performance of the algorithms and get better predictions in every league. Addiotioanlly, more options could be supported (e.g. Under 2.5 or Over 2.5, Num Corners, etc.). I made it available for everyone who liked to app and would like to contribute to donate any amount. The money will be spent on monthly subscription on footystats API, where I will be able to download a whole more data.
or via QR-Code:
5.0€/20.0€
- Agnieszka Fidura (5€)