This repository contains the tools to make the build image that Netlify's continuous deployment buildbot uses to build a site from a connected Git repository.
If you're having problems with your build, you can also use these tools to test locally.
Netlify maintains multiple build images for testing new development as well as supporting legacy builds. Each image uses a different version of Ubuntu Linux, with a slightly different list of included language and software versions.
The following images are currently available:
trusty- Legacy build image for older sites; running Ubuntu 14.04 and this softwarexenial- Default build image for all new sites; running Ubuntu 16.04 and this software
Each image name above corresponds to a branch in this repository.
Emulating Netlify's buildbot on your local machine requires the following:
- Docker
- A local clone of this build-image repository
- A local clone of the site repository you want to test, checked out to the branch you want to be built, with a clean git status (nothing to commit).
Open your Docker terminal, and run the following command to pull the default image:
docker pull netlify/build:xenial
or
docker pull netlify/build:v3.0.2 # replace the version with a git tag of the specific version you want to test
Still in your Docker terminal, change directories into your local clone of this build-image repository.
If you pulled an alternate image in Step 1, check out the corresponding branch in this repository.
Run the following command to start the interactive shell within the container:
./test-tools/start-image.sh path/to/site/repo
If you receive a command not found message, make sure you are in the baase of the build-image repository.
If the command works correctly, you should see a new prompt, with the user buildbot.
In the buildbot shell, run build followed by your site build command. For example, for a site build command of npm run build, you would run the following:
build npm run build
This will run the build as it would run on Netlify, displaying logs in your terminal as it goes. When you are done testing, you can exit the buildbot shell by typing exit.
Your local buildbot emulator doesn't have access to build environment variables set in the Netlify UI or netlify.toml file. However, you can explicitly set them in the interactive buildbot shell before running your build command.
Here is an example that sets NODE_VERSION and NODE_ENV before running a build command of npm run build:
export NODE_VERSION=8 NODE_ENV=production ; build npm run build
If you'd like to run a debugging build using our caching mechanisms, with verbose shell output, you can replace steps 2 and 3 above with the following command:
./test-tools/test-build.sh path/to/site/repo 'your build command'
This will create a tmp directory that will have the repo that the buildbot cloned, the scripts run by the buildbot, and the cache (with hidden files). The terminal displays the path to the tmp directory at the start of each build. You specify this path in an environment variable prepended to the command above, like so:
T=tmp/tmp.XXXXX ./test-tools/test-build.sh path/to/site/repo 'your build command'
Pull requests welcome, as long as they're not overly specific to a niche use-case.
How we use this and some best practices are documented here: https://www.netlify.com/blog/2016/10/18/how-our-build-bots-build-sites/