ecoron/SerpScrap
SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.
PythonMIT
Issues
- 0
Not Able to Install package
#71 opened by dpal126 - 2
scrapcore.scraper.selenium - ERROR - Scrape Exception pass. Selector: #resultStats: I just copy pasted the example present in how to use section and it is giving me this error. Any help on why this might be happening is much appreciated.
#66 opened by AnkNova - 3
Issue with proxies
#49 opened by pquadri - 0
Not able to install package
#68 opened by Ashish32112 - 1
Scrape Exception pass. Selector: #resultStats
#60 opened by Tasaqi - 0
issue with amount of results
#63 opened by tanyafilo - 0
Standard example example_simple.py returns only SERP Youtube results insertions
#62 opened by MindaugasVaitkus2 - 0
Scraper standard exmaple returns only Youtube results in Lithuanian search
#61 opened by MindaugasVaitkus2 - 1
csv_writer.py csvWriter cannot handle ? in urls
#54 opened by fcbits - 2
scrapcore.scraper.selenium - ERROR - Message: session not created: This version of ChromeDriver only supports Chrome version 76
#56 opened by kartzke - 0
Only returning 'shopping' serp_types
#59 opened by kyleholgate - 0
- 2
Getting "People Also Ask" results as results
#46 opened by smithellis - 0
- 1
- 0
Proxy do not work
#53 opened by lorenzoromani1983 - 0
- 4
SQL Error while runing your first example
#12 opened by mlifemaker - 0
Add Top Stories box
#50 opened by danipolo - 2
Add maps/local results detection
#45 opened by siparker - 1
No scraping Ads
#44 opened by PragmaticBartolini - 1
- 1
Data from Knowledge Panel
#48 opened by ranjit6789 - 0
Parsing of serps needs some attention
#42 opened by ecoron - 1
Http proxies with username:password
#41 opened by zmaren - 4
Issue with SerpScrap package on Linux box
#40 opened by majila - 3
Similar Text_Raw field for all search results
#36 opened by MNCTTY - 1
Extracting to CSV starts from rank_2
#38 opened by SnowHow21 - 1
Error when running in Jupyter Notebook..
#34 opened by djporterco - 4
100 results from google search
#30 opened by tobyhage - 1
mobile SERP
#35 opened by cristiano74 - 1
- 2
keyerror: Using your own configuration
#31 opened by tobyhage - 2
TimeoutException waiting for search input field
#26 opened by deepdad - 1
quit question, how do you handle catchas?
#22 opened by crawldnet - 2
Error at first run on Windows
#28 opened by ochronus - 1
Finding ranking of single domain?
#24 opened by chrisfromthelc - 1
TimeoutException?
#21 opened by midjji - 1
Element not visible
#15 opened by xjuric29 - 2
Proxy table unique constraint errors
#17 opened by ihopethiswillfi - 1
Uncaught exceptions
#18 opened by ihopethiswillfi - 0
Not alternating between proxies
#16 opened by ihopethiswillfi - 0
Issue date in path of screenshots
#11 opened by ecoron - 0
update docs
#7 opened by ecoron - 0
Handle malicious requests in http mode
#2 opened by ecoron