tasos-py/Search-Engines-Scraper

How to search more pages and links

Closed this issue · 2 comments

Hello, thanks for your work very much. I have a question now, how to search more results like links, I have changed the parameter of 'SEARCH_ENGINE_RESULTS_PAGES', but it doesn't work!

The SEARCH_ENGINE_RESULTS_PAGES is in config.py

Hi, it's very easy to set the max number of pages. For the CLI script you can use the -p argument, and for the lib the .search(pages=) argument. However, the actual number of pages can be smaller, depending on the query and search engine. For example Google doesn't go further than the 2-3rd page sometimes