/rightmove_webscraper.py

Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object

Primary LanguageJupyter Notebook

rightmove_webscraper

rightmove.co.uk is one of the UK's largest property listings websites, hosting thousands of listings of properties for sale and to rent.

The rightmove_webscraper.py class is a simple Python interface to scrape property listings from the website and prepare them in a Pandas dataframe for analysis.

The class uses the lxml and requests libraries to scrape data from the rightmove website.

How to use

  1. Go to rightmove.co.uk and search for whatever listings you are interested in ...

  1. Filter the search however you choose ...

  1. Run the search and copy the URL of the results page ...

  1. Create an instance of the class on the URL ...
url = "http://www.rightmove.co.uk/property-for-sale/find.html?locationIdentifier= [...] "
rightmove_object = rightmove_data(url)
  1. Access the data using the methods and attributes of the object ...

The full results can be created as a Pandas dataframe using the .get_results() method.