This project explores the capability of Large Language Models (LLMs), particularly BERT-based models, to understand and perform arithmetic tasks involving numerals.
- Epochs: 10
- Batch size: 32
- Learning rate: Started at
To set up the project, follow these steps:
- Clone the repository:
git clone http://github.com/abbassix/numeracy
(optional) 1½. Create a virtual environment:
python3.10 -m venv .venv
1½.a. On Windows:
.venv\Scripts\activate
1½.b. On macOS/Linux:
source .venv/bin/activate
- Install the required dependencies:
pip install -r requirements.txt