Yorkie

Yorkie is an open source document store for building collaborative editing applications.

Yorkie consists of three main components: Client, Document and Agent.

 +--Client "A" (Go)----+
 | +--Document "D-1"-+ |               +--Agent------------------+
 | | { a: 1, b: {} } | <-- Changes --> | +--Collection "C-1"---+ |
 | +-----------------+ |               | | +--Document "D-1"-+ | |      +--Mongo DB--+
 +---------------------+               | | | { a: 1, b: {} } | | |      | Changes    |
                                       | | +-----------------+ | | <--> | Snapshot   |
 +--Client "B" (JS)----+               | | +--Document "D-2"-+ | |      +------------+
 | +--Document "D-1"-+ |               | | | { a: 1, b: {} } | | |
 | | { a: 2, b: {} } | <-- Changes --> | | +-----------------+ | |
 | +-----------------+ |               | +---------------------+ |
 +---------------------+               +-------------------------+
                                                    ^
 +--Client "C" (JS)------+                          |
 | +--Query "Q-1"------+ |                          |
 | | db.['C-1'].find() | <-- MongoDB query ---------+
 | +-------------------+ |
 +-----------------------+

Clients can have a replica of the document representing an application model locally on several devices.
Each client can independently update the document on their local device, even while offline.
When a network connection is available, the client figures out which changes need to be synced from one device to another, and brings them into the same state.
If the document was changed concurrently on different devices, Yorkie automatically syncs the changes, so that every replica ends up in the same state with resolving conflict.

Agent and SDKs

Agent: https://github.com/yorkie-team/yorkie
JS SDK: https://github.com/yorkie-team/yorkie-js-sdk
Go Client: https://github.com/yorkie-team/yorkie/tree/main/client

Quick Start

For now, we didn't deploy binary yet. So you should compile Yorkie yourself.

Yorkie uses MongoDB to store it's data. To start MongoDB, type docker-compose -f docker/docker-compose.yml up -d.

Next, let's start a Yorkie agent. Agent runs until they're told to quit and handle the communication of maintenance tasks of Agent. and start the agent:

$ ./bin/yorkie agent

Use the -c option to change settings such as the MongoDB connectionURI.

$ ./bin/yorkie agent -c yorkie.json

The configuration file with default values is shown below.

https://github.com/yorkie-team/yorkie/blob/main/yorkie/config.sample.json

Documentation

Full, comprehensive documentation is viewable on the Yorkie website:

https://yorkie.dev/docs/main/

Developing Yorkie

For building Yorkie, You'll first need Go installed (version 1.17+ is required). Make sure you have Go properly installed, including setting up your GOPATH. Then download a pre-built binary from release page and install the protobuf compiler (version 3.4.0+ is required).

We need to install Golang packages to build Yorkie locally. You can run make tools to install the required packages.

Next, clone this repository into some local directory and then just type make build. In a few moments, you'll have a working yorkie executable:

$ make build
...
$ bin/yorkie

Tests can be run by typing make test.

NOTE: make test includes integration tests that require local applications such as MongoDB, etcd. To start them, type docker-compose -f docker/docker-compose-ci.yml up --build -d.

If you make any changes to the code, run make fmt in order to automatically format the code according to Go standards.

Contributing

See CONTRIBUTING for details on submitting patches and the contribution workflow.

Contributors ✨

Thanks goes to these incredible people:

parkjh688/yorkie