climatescape/climatescape.org

Only fetch Crunchbase ODM when missing/old

Closed this issue · 1 comments

We currently query the Crunchbase ODM API for all organizations, even when we already have a profile. The thinking here was that we wanted to get any changes that Crunchbases added/changed over time. That was working fine but we're now hitting Crunchbase API limits and getting back 429: Too Many Requests from their API.

Solution: Fetch existing "Crunchbase ODM" entries from Airtable and only query the Crunchbase API when either A) there is no Crunchbase ODM for a given organization or B) it was created more than X days ago

Let's start with 7 days and see how that works for us.

Fixed this recently