/quickwit

Sub-second search & analytics engine on cloud storage

Primary LanguageRustOtherNOASSERTION

CI codecov Contributor Covenant License: AGPL V3 Twitter Follow Discord



Quickwit Cloud-Native Search Engine Quickwit Cloud-Native Search Engine

Sub-second search & analytics engine on cloud storage


We just released Quickwit 0.6! Read the blog post to learn about the latest powerful features!


gharchive-demo.mp4

Quickwit is the fastest search engine on cloud storage. It is a great fit for:

💡 Features

  • Full-text search and aggregation queries
  • Elasticsearch query language support
  • Sub-second search on cloud storage (Amazon S3, Azure Blob Storage, …)
  • Decoupled compute and storage, stateless indexers & searchers
  • Schemaless or strict schema indexing
  • Schemaless analytics
  • Grafana data source
  • Jaeger-native
  • OTEL-native for logs and traces
  • Kubernetes ready - See our helm-chart
  • RESTful API

Enterprise ready

  • Multiple data sources Kafka / Kinesis / Pulsar native
  • Multi-tenancy: indexing with many indexes and partitioning
  • Retention policies
  • Delete tasks (for GDPR use cases)
  • Distributed and highly available* engine that scales out in seconds (*HA indexing only with Kafka)

🚀 Quickstart

For a quick guide on how to install Quickwit, start a server, add documents to index, and search them - check out our Quickstart guide.

📑 Architecture overview

Quickwit Distributed TracingQuickwit Distributed Tracing

📕 Documentation

📚 Resources

🔮 Roadmap

🙋 FAQ

How can I switch from Elasticsearch to Quickwit?

Quickwit has an Elasticsearch-compatible Ingest-API to make it easier to migrate your log shippers (Vector, Fluent Bit, Syslog, ...) to Quickwit. However, we only support ES aggregation DSL, the query DSL support is planned for Q2 2023.

How is Quickwit different from traditional search engines like Elasticsearch or Solr?

The core difference and advantage of Quickwit are its architecture built from the ground to search on cloud storage. We optimized IO paths, revamped the index data structures and made search stateless and sub-second on cloud storage.

How does Quickwit compare to Elastic in terms of cost?

We estimate that Quickwit can be up to 10x cheaper on average than Elastic. To understand how, check out our blog post about searching the web on AWS S3.

What license does Quickwit use?

Quickwit is open-source under the GNU Affero General Public License Version 3 - AGPLv3. Fundamentally, this means you are free to use Quickwit for your project if you don't modify Quickwit. However, if you do and you are distributing your modified version to the public, you have to make the modifications public. We also provide a commercial license for enterprises to provide support and a voice on our roadmap.

Is it possible to setup Quickwit for a High Availability (HA)?

HA is available for search, for indexing it's available only with a Kafka source.

What is Quickwit's business model?

Our business model relies on our commercial license. There is no plan to become SaaS soon.

🤝 Contribute and spread the word

We are always super happy to have contributions: code, documentation, issues, feedback, or even saying hello on Discord! Here is how you can help us build the future of log management:

✨ And to thank you for your contributions, claim your swag by emailing us at hello at quickwit.io.

💬 Community

We always welcome contributions: code, documentation, issues, feedback, or even say hello on Discord! Here is how you can help us build the next-gen search engine:

✨ Contributors can claim our swag by emailing us at hello at quickwit.io.