joeyism/linkedin_scraper

add job filter keywords to avoid 429 error

an-bluecat opened this issue · 0 comments

Problem:
for anonamous strategy, currently we have to slow down the by setting a very long interval because we are looking into every job in details, clicking into it to get the job place, date, and descriptions.

Potential solution:
add a regex filter on the API so that we don't have to click into every job and only click into jobs that is really interesting to us.

@joeyism Do you think that's a good idea? If so, I can write it up and create a pull request.