EBISPOT/gwas-sumstats-harmoniser

Improve the harmonisation pipeline efficiency

Opened this issue · 0 comments

jiyue1214 commented

Currently, we can harmonise 11,000 studies per month using two accounts. However, we still process the input file row by row. This ticket is created to see if we can increase the pipeline speed by:

  1. Any technique from 1 million projects
  2. Using array to process the data.