tardis-sn/carsus

Chianti database

Closed this issue · 3 comments

The purpose of this issue is to gather all issues regarding the chianti database

  • Ingestion of Fe 8 takes over 18 GB of memory
  • Noting database version in the datasource

What this issue is about?

Sorry, I updated the description

I did a small research on the first point and came to the conclusion that ORM is not meant for bulky ingests. I think the ingestion part should be re-written using SQLAlchemy Core. That will be (in theory) as robust as raw SQL and should save memory.