elastigo

A Go (Golang) based Elasticsearch client, implements core api for Indexing and searching. GoDoc http://godoc.org/github.com/mattbaird/elastigo

To get the Chef based Vagrantfile working, be sure to pull like so::

# This will pull submodules.
git clone --recursive git@github.com:mattbaird/elastigo.git

status updates

2013-7-10 Improvments/changes to bulk indexor (includes breaking changes to support TTL), Search dsl supports And/Or/Not
- SearchDsl should still be considered beta at this point, there will be minor breaking changes as more of the elasticsearch feature set is implemented.
2013-1-26 expansion of search dsl for greater coverage
2012-12-30 new bulk indexing and search dsl
2012-10-12 early in development, not ready for production yet.

Adding content to Elasticsearch

examples:

import "github.com/mattbaird/elastigo/api"
import "github.com/mattbaird/elastigo/core"

type Tweet struct {
  User     string    `json:"user"`
  Message  string    `json:"message"`
}

// Set the Elasticsearch Host to Connect to
api.Domain = "localhost" 
// api.Port = "9300"

// add single go struct entity
response, _ := core.Index(true, "twitter", "tweet", "1", Tweet{"kimchy", "Search is cool"})

// you have bytes
tw := Tweet{"kimchy", "Search is cool part 2"}
bytesLine, err := json.Marshall(tw)
response, _ := core.Index(true, "twitter", "tweet", "2", bytesLine)

// Bulk Indexing 
core.IndexBulk("twitter", "tweet", "3", &time.Now(), Tweet{"kimchy", "Search is now cooler"})

// Search Using Raw json String
searchJson := `{
    "query" : {
        "term" : { "user" : "kimchy" }
    }
}`
out, err := core.SearchRequest(true, "twitter", "tweet", searchJson, "")
if len(out.Hits.Hits) == 1 {
  fmt.Println(string(out.Hits.Hits[0].Source))
}

Search DSL Examples

A Faceted, ranged Search using the Search DSL :

import "github.com/mattbaird/elastigo/api"
import "github.com/mattbaird/elastigo/core"

// Set the Elasticsearch Host to Connect to
api.Domain = "localhost" 
// api.Port = "9300"

out, err := Search("github").Size("1").Facet(
  Facet().Fields("actor").Size("500"),
).Query(
  Query().Range(
     Range().Field("created_at").From("2012-12-10T15:00:00-08:00").To("2012-12-10T15:10:00-08:00"),
  ).Search("add"),
).Result()

A Ranged Search using the Search DSL :

out, err := Search("github").Type("Issues").Pretty().Query(
  Query().Range(
     Range().Field("created_at").From("2012-12-10T15:00:00-08:00").To("2012-12-10T15:10:00-08:00"),
  ).Search("add"),
).Result()

A Simple Search using the Search DSL :

out, err := Search("github").Type("Issues").Size("100").Search("add").Result()

A Direct Search using the api :

qry := map[string]interface{}{
  "query":map[string]interface{}{
     "term":map[string]string{"user:"kimchy"},
  },
}
core.SearchRequest(true, "github", "Issues", qry, "", 0)

A Direct Search using the query string Api :

core.SearchUri("github", "Issues", "user:kimchy", "", 0)

A Filtered search Search DSL :

out, err := Search("github").Filter(
  Filter().Exists("repository.name"),
).Result()

Adding content to Elasticsearch in Bulk

example:

import "github.com/mattbaird/elastigo/api"
import "github.com/mattbaird/elastigo/core"

// Set the Elasticsearch Host to Connect to
api.Domain = "localhost" 
// api.Port = "9300"

indexor := core.NewBulkIndexorErrors(10, 60)
done := make(chan bool)
indexor.Run(done)

go func() {
  for errBuf := range indexor.ErrorChannel {
    // just blissfully print errors forever
    fmt.Println(errBuf.Err)
  }
}()
for i := 0; i < 20; i++ {
  indexor.Index("twitter", "user", strconv.Itoa(i), "", nil, `{"name":"bob"}`)
}
done <- true

license