A Spring Boot project to read data from csv files to the database using Spring Batch framework.
Java version 11.
The data stored in the database will be used as a source to the API project (https://github.com/gabriel-ramalho-albuquerque/dpttransportationapi)
The database used is MySQL and the schema name is "transportation" (localhost:3306/transportation)
The project has a migration file that will create the databases (src\main\resources\db\migration\V1__createTables.sql).
A job will be created and will have a scheduler to read and save the data from the csv files every month.
It has also an endpoint that can be used to start the job.
Has also a Postman collection in the "postman" folder.
http://localhost:9191/v3/api-docs
http://localhost:9191/swagger-ui/index.html
POST api/v1/dataLoader/importCSVData
- Change the file path to external path
- Change the file name to be dynamic
- Try to refactor the trip type code (green and yellow) without affecting the job functionality
- Create tables to handle the borough and service zone data to remove duplicate data in the location table
- Add performance tests
- Docker