bradumbaugh/vector

Collect, transform, & route all observability data with one simple tool.

Chat  •  Mailing List  •  Blog  •  Download 0.7.1

---

---

New post! Prometheus Source

---

Vector is an open-source utility for building observability pipelines. Collect, transform, and route log, metrics and events with one simple tool.

Built in Rust, Vector places high-value on performance, correctness, and operator friendliness. It compiles to a single static binary and is designed to be deployed across your entire infrastructure, serving both as a light-weight agent and a highly efficient service. Take back ownership and control of your observability data with Vector.

Documentation

About

• Concepts
• Data model (Event) - log event, metric event
• Guarantees

Setup

• Installation - containers, operating systems, package managers, from archives, from source
• Configuration
• Deployment - topologies, roles
• Guides - getting started

Reference

• Sources - docker, file, journald, kafka, socket, syslog, and 6 more...
• Transforms - json_parser, log_to_metric, logfmt_parser, lua, regex_parser, sampler, tokenizer, and 12 more...
• Sinks - aws_cloudwatch_logs, aws_s3, clickhouse, elasticsearch, gcp_pubsub, http, kafka, and 13 more...

Administration

• Process management
• Monitoring
• Updating
• Validating

Resources

• Community - chat, twitter, mailing list
• Releases - v0.7.1 (latest)
• Roadmap - vote on new features

Features

• Fast - Built in Rust, Vector is fast and memory efficient. No runtime. No garbage collector.
• Correct - Obsessed with getting the details right.
• Vendor Neutral - Does not favor a specific storage. Fair, open, with the user's best interest in mind.
• Agent or Service - One simple tool to get data from A to B. Deploys as an agent or service.
• Logs, Metrics, or Events - Logs, metrics, and events. Collect, unify, and ship all observability data.
• Correlate Logs & Metrics - Derive metrics from logs, add shared context with transforms.
• Clear Guarantees - A guarantee support matrix helps you understand your tradeoffs.
• Easy To Deploy - Cross-compiles to a single static binary with no runtime.
• Hot Reload - Reload configuration on the fly, without skipping a beat.

Performance

Test	Vector	Filebeat	FluentBit	FluentD	Logstash	SplunkUF	SplunkHF
TCP to Blackhole	86mib/s	n/a	64.4mib/s	27.7mib/s	40.6mib/s	n/a	n/a
File to TCP	76.7mib/s	7.8mib/s	35mib/s	26.1mib/s	3.1mib/s	40.1mib/s	39mib/s
Regex Parsing	13.2mib/s	n/a	20.5mib/s	2.6mib/s	4.6mib/s	n/a	7.8mib/s
TCP to HTTP	26.7mib/s	n/a	19.6mib/s	<1mib/s	2.7mib/s	n/a	n/a
TCP to TCP	69.9mib/s	5mib/s	67.1mib/s	3.9mib/s	10mib/s	70.4mib/s	7.6mib/s

To learn more about our performance tests, please see the Vector test harness.

Correctness

Test	Vector	Filebeat	FluentBit	FluentD	Logstash	Splunk UF	Splunk HF
Disk Buffer Persistence	✅	✅	❌	❌	⚠️	✅	✅
File Rotate (create)	✅	✅	✅	✅	✅	✅	✅
File Rotate (copytruncate)	✅	❌	❌	❌	❌	✅	✅
File Truncation	✅	✅	✅	✅	✅	✅	✅
Process (SIGHUP)	✅	❌	❌	❌	⚠️	✅	✅
JSON (wrapped)	✅	✅	❌	✅	✅	✅	✅

To learn more about our performance tests, please see the Vector test harness.

Installation

Run the following in your terminal, then follow the on-screen instructions.

curl --proto '=https' --tlsv1.2 -sSf https://sh.vector.dev | sh

Or use your own preferred method.

Latest Posts & Announcements

• Prometheus Source
• EC2 Metadata Enrichments
• Alpha Kubernetes Source
• Use Custom DNS Servers
• Unit Testing Your Vector Config Files

view all...

---

Developed with ❤️ by Timber.io