Chat • Mailing List • Blog • Download 0.7.0
New post! Prometheus Source
Vector is an open-source utility for building observability pipelines. Collect, transform, and route log, metrics and events with one simple tool.
Built in Rust, Vector places high-value on performance, correctness, and operator friendliness. It compiles to a single static binary and is designed to be deployed across your entire infrastructure, serving both as a light-weight agent and a highly efficient service. Take back ownership and control of your observability data with Vector.
Documentation
About
Setup
- Installation - containers, operating systems, package managers, from archives, from source
- Configuration
- Deployment - topologies, roles
- Guides - getting started
Reference
- Sources - docker, file, journald, kafka, socket, syslog, and 6 more...
- Transforms - json_parser, log_to_metric, logfmt_parser, lua, regex_parser, sampler, tokenizer, and 12 more...
- Sinks - aws_cloudwatch_logs, aws_s3, clickhouse, elasticsearch, gcp_pubsub, http, kafka, and 13 more...
Administration
Resources
Features
- Fast - Built in Rust, Vector is fast and memory efficient. No runtime. No garbage collector.
- Correct - Obsessed with getting the details right.
- Vendor Neutral - Does not favor a specific storage. Fair, open, with the user's best interest in mind.
- Agent or Service - One simple tool to get data from A to B. Deploys as an agent or service.
- Logs, Metrics, or Events - Logs, metrics, and events. Collect, unify, and ship all observability data.
- Correlate Logs & Metrics - Derive metrics from logs, add shared context with transforms.
- Clear Guarantees - A guarantee support matrix helps you understand your tradeoffs.
- Easy To Deploy - Cross-compiles to a single static binary with no runtime.
- Hot Reload - Reload configuration on the fly, without skipping a beat.
Performance
Test | Vector | Filebeat | FluentBit | FluentD | Logstash | SplunkUF | SplunkHF |
---|---|---|---|---|---|---|---|
TCP to Blackhole | 86mib/s | n/a | 64.4mib/s | 27.7mib/s | 40.6mib/s | n/a | n/a |
File to TCP | 76.7mib/s | 7.8mib/s | 35mib/s | 26.1mib/s | 3.1mib/s | 40.1mib/s | 39mib/s |
Regex Parsing | 13.2mib/s | n/a | 20.5mib/s | 2.6mib/s | 4.6mib/s | n/a | 7.8mib/s |
TCP to HTTP | 26.7mib/s | n/a | 19.6mib/s | <1mib/s | 2.7mib/s | n/a | n/a |
TCP to TCP | 69.9mib/s | 5mib/s | 67.1mib/s | 3.9mib/s | 10mib/s | 70.4mib/s | 7.6mib/s |
To learn more about our performance tests, please see the Vector test harness.
Correctness
Test | Vector | Filebeat | FluentBit | FluentD | Logstash | Splunk UF | Splunk HF |
---|---|---|---|---|---|---|---|
Disk Buffer Persistence | ✅ | ✅ | ❌ | ❌ | ✅ | ✅ | |
File Rotate (create) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
File Rotate (copytruncate) | ✅ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ |
File Truncation | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
Process (SIGHUP) | ✅ | ❌ | ❌ | ❌ | ✅ | ✅ | |
JSON (wrapped) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ |
To learn more about our performance tests, please see the Vector test harness.
Installation
Run the following in your terminal, then follow the on-screen instructions.
curl --proto '=https' --tlsv1.2 -sSf https://sh.vector.dev | sh
Or use your own preferred method.
Latest Posts & Announcements
- Prometheus Source
- EC2 Metadata Enrichments
- Alpha Kubernetes Source
- Use Custom DNS Servers
- Unit Testing Your Vector Config Files
Developed with ❤️ by Timber.io