Hemnet (https://www.hemnet.se) is the largest listing website for the Swedish property market. Almost all available apartments, houses and summer cottages for sale in Sweden are listed there.
The success of Hemnet is not a surprise - the website and app are brilliant. However, there are a few features that I found myself looking for when searching for a new house. Hemnet Commuter is a pet-project developed in my spare time to address these.
- Interactive map showing details in a sidebar when clicking houses (a bit like the AirBnb website)
- Live filtering of metrics, map refreshes as you adjust limits
- Map overlay showing area covered by one or more commute times (from TravelTime)
- Tools for one or more people to rate houses (Yes / No / Maybe), write comments and add custom tags
- Ability to filter on custom fields not available on Hemnet, such as:
- Total house area (Bo + Bi)
- Hide houses with active bidding
- Show only Kommande (upcoming) houses
- Customisable map marker display with colours and icons. For example:
- Continuous colour scales showing graduation of price / commute times etc
- Map marker icons showing rating, bidding status, and many more.
- Auto-translation of house description texts to your language of choice
You use the tool by creating one or more Saved searches on Hemnet.
You enter these IDs into the saved_searches DB table and Hemnet Commuter pulls information about each house from the Hemnet API.
This is the API that the main Hemnet website uses, and is not publicly documented. So if they change anything without warning, this could break.
If one or more workplace addresses are added, Hemnet Commuter does extra commute-time things:
- Uses the Google Maps API to calculate commute times for each house to each workplace
- Fetches a commute time isochrone (map of maximum commute time) from TravelTime for each place, including the intersection
This back-end data retrieval is done with PHP scripts, which save results to a MySQL database. The front-end is built using AngularJS with Leaflet maps and Bootstrap CSS.
Whilst it would be fairly easy to extend this so that a single installation could be used for multiple people, I haven't done that. So you'll have to run the web server yourself I'm afraid.
Before you start, you'll need:
- Docker installed to run the web server locally on your computer (recommended) or an alternative method of running an Apache / PHP / MySQL web server (eg. MAMP).
- An API key for Google Maps / Google Translate (costs money, but easy to get loads of free credits for a trial. You won't need loads.)
- A developer API key for TravelTime
For Google you will need to register and set up a cloud computing account, then make a service account for Hemnet Commuter
and set up some API keys which are allowed to use the Geocoding API, Distance Matrix API and Cloud Translation API.
There are plenty of docs on how to do this, for example here.
First, clone this repository and move to the local repository root directory.
Now create a new Docker container using the mattrayner/lamp image. This comes with a full LAMP stack
(Linux, Apache, MySQL, PHP). See https://github.com/mattrayner/docker-lamp for more details.
docker create --name hemnet_commuter -t -p "80:80" -v ${PWD}/app:/app -v ${PWD}/mysql:/var/lib/mysql mattrayner/lamp:latestdocker start hemnet_commuterThis container will now start up in the background and create a new MySQL database for you in a new mysql directory.
Give the server a few seconds to start, you can tail the logs with the following command:
docker logs hemnet_commuter -fNext, create a new database and fill it with the required table structures in the supplied SQL file:
docker exec -i hemnet_commuter mysql -uroot -e "CREATE DATABASE hemnet_commuter"docker exec -i hemnet_commuter mysql -uroot hemnet_commuter < hemnet_commuter.sqlYou can read the server logs by going into the container and tailing the apache log (which gets the PHP logs):
docker exec -it hemnet_commutertail -f /var/log/apache2/error.logGo to http://localhost in your web browser. Hopefully Hemnet Commuter should load.
On the right hand side of the map there is a toolbar with several buttons. Use the map-marker icon to open the Map Settings sidebar. Click Update Saved Searches and enter the e-mail address and password that you use to log in to https://www.hemnet.se and click Sign in to Hemnet.
If the login works successfully, you should see a list of the names of your saved searches, each with a toggle button. Select the searches that you would like to use for Hemnet Commuter and click Update. Hemnet Commuter will now pull in all houses from Hemnet and hopefully plot them on the map. If your saved searches have a lot of houses (> 1000) this can take a long time. A maximum of ~500 houses seems to work well.
Your hemnet.se email and password is not saved to the database and will be forgotten as soon as you close or refresh the web page. Only the saved search IDs and details are logged in the DB. You need to sign and refresh your saved searches each time you update their settings on Hemnet.
Once the Docker container is set up, you can use the following commands to start and stop the server:
docker start hemnet_commuterdocker stop hemnet_commuterYou can check the status of any running Docker containers with the docker ps command.
To use Hemnet Commuter, go to http://localhost in your browser.
The default database credentials are public on GitHub, so anyone will be able to log in to your database if it's on the web. They are used in the Dockerfile to create an empty skeleton database and user.
If you are running Hemnet Commuter anywhere where another (potentially malicious) user could get to it, you should change
the database credentials. Make a copy of app/config_defaults.ini called app/config.ini and save them there (this file will be ignored by git).
If you want to use phpMyAdmin to view or manage the database, you'll need the login credentials created
when you first set up the docker container. The username is always admin and password is auto-generated
on this first run. You can find this info by running the docker logs hemnet_commuter | less command.
Look for the log that says something like: => Creating MySQL admin user with random password followed by
You can now connect to this MySQL Server with XXXXXXX.
Once you have the çredentials, you can use phpMyAdmin at http://localhost/phpmyadmin.
See the readme from the LAMP docker image for more details: mattrayner/docker-lamp.
Hemnet Commuter uses the Google Maps API to fetch travel times between houses and your commute locations. The Google Translate API is used to be able to translate the description text from Hemnet to your chosen language. It uses TravelTime to fetch a map of all potential commute locations within your criteria.
For these features to work, you will need to get API keys for the two services. Make a copy of app/config_defaults.ini
called app/config.ini and save them there (this file will be ignored by git).
The code for Hemnet Commuter is released with an open-source MIT licence. You are free to use it, tinker, build on it or do whatever you like with it.
This was a pet project for personal use by Phil Ewels, an Englishman living in Stockholm. It's pretty fragile code and is likely to break as soon as Hemnet changes anything. I can't promise to maintain it, but hopefully it'll come in helpful for others!
Please consider contributing / reporting issues via GitHub and I'll do my best to help.
This tool is in no way endorsed by Hemnet. But it does use their publicly-visible data. Thanks!
