A project to scrape anime meta from lots of websites using anilist id's
- Node.js
- TypeScript
- Prisma
A Postgresql database needs to already be setup. You can use Neon.tech, Planetscale and Railway. They offer amazing free tiers that you can utilize
- Clone the repository:
git clone https://github.com/illusionTBA/AniMappings.git
- Install dependencies:
npm install
- Make a .env file with a variable called
DATABASE_URL
and set it to your Postgresql connection URL string.
DATABSE_URL="postgresql://user:password@host/db"
- crawl anilist to populate DB:
npm run crawl
- Start the server:
npm start
- You can export all of the DB into a json file using the
npm run export
command - Using the webserver (
npm start
) you can request the/anilist/id
route to recieve the meta for that anime (replacingid
with the anilist id) - Crawling is how the database populates itself. You can use
npm run crawl
to start crawling anilist and other providers. If it crashes it will start off where it left off.
- Mr Ethical Integrated the lastId feature.
- Eltik Inspired me to do this project with his AniSync Project.