Only fetch Crunchbase ODM when missing/old
Closed this issue · 1 comments
bloudermilk commented
We currently query the Crunchbase ODM API for all organizations, even when we already have a profile. The thinking here was that we wanted to get any changes that Crunchbases added/changed over time. That was working fine but we're now hitting Crunchbase API limits and getting back 429: Too Many Requests
from their API.
Solution: Fetch existing "Crunchbase ODM" entries from Airtable and only query the Crunchbase API when either A) there is no Crunchbase ODM for a given organization or B) it was created more than X days ago
Let's start with 7 days and see how that works for us.
bloudermilk commented
Fixed this recently