/snowfinch

Realtime web analytics

Primary LanguageRubyMIT LicenseMIT

Snowfinch

Snowfinch is a realtime web analytics application written in Ruby, and using MongoDB. It provides everything you need to track and visualize analytics from multiple sites. While it may not be as full featured as commercial alternatives, it is free and released under the MIT license.

Currently, Snowfinch supports: tracking of pageviews, active visits, and visitors for a site; pageviews and active visitors for a given page; monitoring based on a URI query key-value pair, or based on any given number of referrers (think campaigns or tracking the number of visits from social media sites). It's not much, but this is only the beginning.
Take a look at the Roadmap section to see what's coming.

Getting started

You will need recent versions of Ruby (1.9.2 recommended) and MongoDB.

If you don't have Bundler installed, install it with:

gem install bundler

Clone the repository:

git clone https://github.com/jcxplorer/snowfinch.git

Edit the following files to suit your needs:

  • config/database.yml
  • config/snowfinch.yml

Some information is stored in a relational database, so you can use any that is supported by Rails. By default it will use PostgreSQL. Edit the config/database.yml and Gemfile files accordingly if you want to use a different database.

Install the application dependencies by running bundle in the application directory.

Run rake db:setup to create a database and an initial user.

You are now ready to launch the application using your favorite Ruby application server such as Passenger or Unicorn. Sign in with the email address user@snowfinch.net and password snowfinch. Don't forget to change those credentials on your account page!

High performance and scaling

Are the pages you are tracking getting too many hits? Good for you!
Fortunately you don't need to deploy entire instances of Snowfinch in multiple hosts. All data collection and storing is a done by a Rack application available as a gem. Just install the snowfinch-collector gem, and deploy using a config.ru file similar to the following example:

require "snowfinch/collector"
Snowfinch::Collector.db = Mongo::Connection.new.db("snowfinch")
run Snowfinch::Collector

Now you can deploy that on several hosts and get the web scale fix you were looking for. Throw some MongoDB shards at it as needed.

By default snowfinch-collector is mounted in the Rails application at "/collector" for easier deployment. If you run your own instance, remember to make sure that the MongoDB database is the same that the Rails application is using, and configure the URI to the collector in config/snowfinch.yml.

Just running one separate instance of snowfinch-collector will perform better than when mounted in the Rails application, as there will be no overhead from the Rails router and middleware.

Roadmap

  • Display data for any given period of time (currently the past 2 days).
  • Collect and display referrer information.
  • Custom visitor tagging.
  • Geographic location of visitors.
  • Filter by custom page metadata (e.g. for A/B testing).
  • Asynchronous data collector.

Reporting bugs

If you think you found a bug, please file an issue on GitHub. Please try your best to provide steps on how to reproduce the issue you are experiencing. Failing tests are highly appreciated!

Contributing

If you want to contribute, fork away and send a pull request. If you want to be sure something will be merged before spending time on it, feel free to contact me. Don't worry, hard work won't be thrown away.

Always try to provide tests with your pull requests. If you're not sure on how to test something, mention it on the pull request so that you can get some help.

I appreciate if you try to stick to the existing coding style, but I can always refactor later on. If you can stick to 80 characters a line, please do. If you don't yet, try it. It makes you write better code.

Copyright and licensing

Copyright 2011, João Cardoso. Snowfinch is released under the MIT license.