jeremiak/motley-fool-earning-transcripts

Scrape way more transcripts

jeremiak opened this issue · 0 comments

There are only about a thousand transcripts in the database at the time of this issue: would be better to have all of the available transcripts.

The scraper will only click the "Load More" button on the Motley Fool's site 20 times by default but that leaves a lot of transcripts out of the database.

I tried running the scraper without a limit and it ran for over an hour and barely got through FY 2022 so I gave up.