satvik007/redisstorage

Redis based storage backend for Colly

Redis Storage for Colly

This is a redis based storage backend for Colly collectors.

Install

go get -u github.com/gocolly/redisstorage

Usage

import (
	"github.com/gocolly/colly"
	"github.com/gocolly/redisstorage"
)

c := colly.NewCollector()

storage := &redisstorage.Storage{
    Address:  "127.0.0.1:6379",
    Password: "",
    DB:       0,
    Prefix:   "job01",
}

err := c.SetStorage(storage)
if err != nil {
    panic(err)
}

Bugs

Bugs or suggestions? Visit the issue tracker or join #colly on freenode