eliangcs/pystock-crawler

A batch size option for crawling reports

eliangcs opened this issue · 0 comments

#2 only occurs when the symbol list is large (~5k symbols). To work around it, maybe I can add a --batch-size option to the pystock-crawler reports command. This option splits a large symbol list into smaller parts and merges them into one output file when crawling is done.