/research_paper_scraping

Web scraping for research papers from different sources for a set of given keywords

Primary LanguagePython

research_paper_scraping

Web scraping for research papers from different sources for a set of given keywords

Scholar2.py : Webscrape research papers from Google Scholar. Config.py : Change this file with the Keywords for your search on Google Scholar.

Pubme_.py : Webscrape research papers from PubMe. Change the file ('query') for your search

Scholar_pages.py: Webscrape research papers from Google Scholar. The user needs to provide the query and the number of pages to be scraped.

removeDup.ipynb: Even the query is different, the outcome would have duplications. Hence, to remove those, this file can be used.