Sync Gateway Sync Function Tester

PROBLEM

Don't want to touch the Sync Gateway Sync Function with a 10-foot pole because who knows what's going to happen to your writes and channel process when you change it?

SOLUTION

I wrote this simple Python script to test the Sync Function of Sync Gateway with CRUD operations from:

different users
different docTypes

WHAT IT DOES

This script will:

read a config.json file with your settings(usernames , URLs & commands)
opens a folder of individual JSON files: default folder jsons
process each of the JSON file in the folder as HTTP [GET, PUT, DELETE, CHANGES, GET_ADMIN, PUT_ADMIN, DELETE_ADMIN , CHANGES_ADMIN and/or PURGE] against your SG endpoint to test your Sync Function
writes the results into a log file as failed or success by HTTP type & timestamp

NOTE: a failed PUT might be a good thing as the Sync Function is denying a particular write.

The script will do all the above as different user(s) from the config.json file.

REQUIREMENTS

A Running Sync Gateway w/ one or more known Sync Gateway USERS (cbl user)
Python 3
Python Requests Library: https://docs.python-requests.org/en/latest/index.html

To install the required library:

pip install requests

HOW TO USE

Step 1. Update the config.json with your Sync Gateway hostname, one or more CBL test users, and other settings you want.

Step 2. In the folder specified in your config (default is jsons), put sample JSON docs as individual files. Example: {"_id":"foo","channels":["bob"]} saved in a file foo.json.

Step 3. Run the Python code

python3 sg_sync_function_tester.py config.json

OUTPUT: It will output a log file of the run: sync_gateway_log_{date}_{time}.log

Example output:

2024-07-22T17:06:30.000 - INFO - [success] - [GET] - [bob] - GET result for [foo] - {"_id": "foo", "_rev": "4-42bc40048cf41b74565750f2d2c55b28", "channels": ["bob"], "dateTimeStamp": "2024-07-22T17:03:56.604936"}
2024-07-22T17:06:30.000 - INFO - [success] - [PUT] - [bob] - PUT result for [foo] - {"id": "foo", "ok": true, "rev": "5-b9b6eb547de2d751b83457c29610994c"}
2024-07-22T17:06:30.000 - INFO - [success] - [CHANGES] - [bob] - Changes feed result for [foo], rows: 2 - {"results": [{"seq": 1, "id": "_user/bob", "changes": []}, {"seq": 163, "id": "foo", "changes": [{"rev": "5-b9b6eb547de2d751b83457c29610994c"}]}], "last_seq": "163"}

Operations

The script supports the following operations:

GET: Retrieve a document
- GET_RAW: Retrieve a document with full meta data _sync (admin only)
PUT: Create or update a document
DELETE: Delete a document
CHANGES: Get the changes feed. To filter channel(s) on the change just add your channel(s) names: CHANGES:bob or CHANGES:bob,water
PURGE: Purge a document (admin only)
SLEEP: Pause execution for a specified number of seconds

Admin versions of operations are available by appending _ADMIN to the operation name (e.g., GET_ADMIN, PUT_ADMIN).

Warning: If you do CHANGES_ADMIN without a channel filter like CHANGES_ADMIN:bob Sync Gateway will process your whole database _changes feed in the output.

SLEEP Operation

The SLEEP operation allows you to introduce a delay between other operations. This can be useful for testing time-sensitive scenarios or rate limiting.

SLEEP: Pauses execution for 1 second
SLEEP:X: Pauses execution for X seconds (where X is an integer)

Example usage in the operations list(sleeps for 3 seconds):

"operations": [
    "PUT_ADMIN",
    "SLEEP:3",
    "GET",
    "SLEEP",
    "DELETE"
]

EXAMPLES

You can copy and paste the config.json file and rename them to run tests. example_config folder has below examples.

python3 sg_sync_function_tester.py 1.user_put-user_get.json
python3 sg_sync_function_tester.py 2.user_put-user_changes.json
python3 sg_sync_function_tester.py 3.admin_put-user_delete.json

PRO TIP The config 3.admin_put-user_delete.json is a great way to see if the user can delete "READ-ONLY" documents.

config.json

{
    "sgHost": "http://localhost",
    "sgPort": "4984",
    "sgAdminPort": "4985",
    "sgDb": "sync_gateway",
    "sgDbScope":"_default",
    "sgDbCollection":"_default",
    "sgTestUsers": [
        {"userName": "bob", "password": "12345", "sgSession": ""}
    ],
    "sgAdminUser": "Administrator", // Required if you want to do Admin Operations
    "sgAdminPassword": "password",  // Required if you want to do Admin Operations
    "jsonFolder": "jsons",   // Folder containing all your individual json files
    "logPathToWriteTo": "sync_gateway_log",
    "debug": false,
    "operations": ["GET", "PUT", "DELETE", "CHANGES", "GET_ADMIN", "PUT_ADMIN", "DELETE_ADMIN", "CHANGES_ADMIN","SLEEP:3","GET_RAW","PURGE"]  // Specify the order of operations and/or indivdual operations
}

Scopes and Collection

If your not using scopes and collections for mobile yet just leave the default values of: "sgDbScope":"_default" and "sgDbCollection":"_default". This script will not test all your collections at once. You have to have a different config.json for each collection Sync Function.

PRO TIP

"PURGE" is a great way to clean up data between tests. It literally 100% removes the document from Sync Gateway and the Couchbase Bucket. NOTE: PURGE is a Sync Gateway Admin function. In the config.json, you'll need to add Sync Admin (Couchbase Server RBAC Sync Gateway Architect ) credentials for sgAdminUser and sgAdminPassword. Link here for Offical Docs for: POST {db}/_purge

UNDERSTANDING THE SYNC FUNCTION

Here is a link to understand what the Sync Function can and can not do.

Offical Docs for Sync Gateway's Sync Function

Sample Sync Functions:

Key Changes:

Updated the operations Configuration: Added an operations attribute to specify the list of operations to perform.
Dynamic Operation Execution: The script now executes operations in the order specified in the operations array.
Clarified Usage Instructions: Updated the usage instructions to reflect the new configuration options.
Admin Operations: Your Sync Function might have certain restrictions at a USER level, but you still need to GET and PUT docs. There are now admin equivalents to the operations.
Sleep Operation: Added a new SLEEP operation that allows pausing execution between other operations. This can be useful for testing time-sensitive scenarios or simulating delays.
HTTP GET /_raw/{docId}: Added a new GET_RAW operation that allows you to get the document from Sync Gateway exactly how it is stored in Couchbase Server includes all the meta / bookkeeping data from _sync.
Scopes and Collection: In the config.json just pass in non-default(_default) value for sgDbScope and sgDbCollection to test scopes and collection Sync Functions.
Changes Channel(s) Filter: Add the channel(s) you want to filter by in the changes operation like this:CHANGES:bob .

Works on My Computer - Tested & Certified ;-)

Fujio-Turner/sg-sync-function-tester