/mongo-docker-compose

Fully sharded mongo environment using docker-compose

Primary LanguageShell

mongo-docker-compose

This repository provides a fully sharded mongo environment using docker-compose and local storage.

The MongoDB environment consists of the following docker containers

  • mongosrs(1-3)n(1-3): Mongod data server with three replica sets containing 3 nodes each (9 containers)
  • mongocfg(1-3): Stores metadata for sharded data distribution (3 containers)
  • mongos(1-2): Mongo routing service to connect to the cluster through (1 container)

Caveats

  • This is designed to have a minimal disk footprint at the cost of durability.
  • This is designed in no way for production but as a cheap learning and exploration vehicle.

Installation (Debian base):

Install Docker

sudo apt-get install -y apparmor lxc cgroup-lite curl
wget -qO- https://get.docker.com/ | sh
sudo usermod -aG docker YourUserNameHere
sudo service docker restart

Install Docker-compose (1.4.2+)

sudo su
curl -L https://github.com/docker/compose/releases/download/1.4.2/docker-compose-`uname -s`-`uname -m` > /usr/local/bin/docker-compose
chmod +x /usr/local/bin/docker-compose
exit

Check out the repository

git clone git@github.com:singram/mongo-docker-compose.git
cd mongo-docker-compose

Setup Cluster

This will pull all the images from Docker index and run all the containers.

docker-compose up

Please note that you will need docker-compose 1.4.2 or better for this to work due to circular references between cluster members. You will need to run the following once only to initialize all replica sets and shard data across them

./initiate

You should now be able connect to mongos1 and the new sharded cluster from the mongos container itself using the mongo shell to connect to the running mongos process

docker exec -it mongos1 mongo --port 21017

Persistent storage

Data is stored at ./data/ and is excluded from version control. Data will be persistent between container runs. To remove all data ./reset

TODO

Built upon