turkserver-meteor

TurkServer is a package for building interactive web-based user experiments on the Meteor web app framework. It uses Meteor's powerful publish/subscribe data model and reactivity to make building real-time user interfaces less error-prone, and provides facilities for deploying your app and collecting data.

Features

Design interfaces using the power and flexibility of Meteor.
Multi-user, interactive experiments are as easy to build as single-user experiments.
Highly configurable randomization of treatments.
Deploying experiments from a live web interface and watch the progress of experiments in real time.

Getting Started

See the guide, which has information about getting started, system architecture, experiment design, and examples.

To add this to a Meteor app, follow these instructions:

Install Meteor and create a Meteor app.
In the app directory, install TurkServer locally (once we publish TurkServer to the Meteor packaging server, you will be able to omit this step):
```
git clone https://github.com/TurkServer/turkserver-meteor.git packages/turkserver
```
meteor add mizzao:turkserver to install the package and its dependencies.
Start your app with the meteor command.
Navigate to /turkserver to log into the administration interface, and develop your experiment!

Documentation

See the API documentation to get an idea of what you can use in your app.

This documentation is generated directly from JSDoc comments in the code. To build the documentation locally, make sure you have meteor-jsdoc installed:

npm install -g meteor-jsdoc

Then build and view the docs with the following commands:

meteor-jsdoc build
meteor-jsdoc start

The documentation will be visible as a Meteor app on the specified port (default 3333).

Research

If you use TurkServer in your work and publish a paper, please cite

Andrew Mao, Yiling Chen, Krzysztof Z. Gajos, David Parkes, Ariel D. Procaccia, and Haoqi Zhang. TurkServer: Enabling Synchronous and Longitudinal Online Experiments. In the Fourth Workshop on Human Computation (HCOMP 2012).

Note that this paper doesn't refer to the latest version of the system, but it is the same core idea. We plan to publish an improved paper detailing the methods behind TurkServer in the near future.

Testing

Clone this entire repository:

git clone https://github.com/TurkServer/turkserver-meteor.git turkserver

Then run the tests:

cd turkserver
meteor test-packages ./

If you checked out the repository into an existing Meteor app, you can run meteor test-packages turkserver from your app instead.

Browse to http://localhost:3000 to run the tests.