/logstash_benchmark

Simple Logstash Benchmarking for testing purposes

Primary LanguageRubyMIT LicenseMIT

logstash_benchmark

Simple Logstash Benchmarking for testing purposes. This is a benchmark that was setup to test redis speed input and diagnose an issue in the Time Parsing facility of Logtash. The Time Parsing speed improvements are integrated in logstash since: https://github.com/logstash/logstash/pull/894/files

Also, some variables to tweak on the redis input and the Elasticsearch output.

  • batch_count: should contain a large enough value to speed up redis reading
  • in the ES output, flush_size controls the size of the bulk insert.

Protocol

  • start a localhost redis
  • run ruby benchmark.rb
  • run java -jar logstash-1.2.2-flatjar.jar agent -f null.conf
  • See result in benchmark.rb output
  • Create a meaningful folder with information about your JVM and system specs and the benchmark results
  • PR to update and add you results

Contributors

  • Pierre Baillet (@octplane), original author
  • Carlos (nzlosh on Github), port of script to Python