/datahub

A Generalized Metadata Search & Discovery Tool

Primary LanguageTypeScriptApache License 2.0Apache-2.0

DataHub

DataHub: A Generalized Metadata Search & Discovery Tool

Version build & test Docker Pulls Slack PRs Welcome GitHub commit activity License YouTube Medium Follow


Quickstart | Documentation | Features | Roadmap | Adoption | FAQ | Demo | Town Hall


📣 Next DataHub town hall meeting on May 27th, 9am-10am PDT (convert to your local time)

✨ Latest Update:

Introduction

DataHub is LinkedIn's generalized metadata search & discovery tool. Read about the architectures of different metadata systems and why DataHub excels here. Also read our LinkedIn Engineering blog post, check out our Strata presentation and watch our Crunch Conference Talk. You should also visit DataHub Architecture to get a better understanding of how DataHub is implemented and DataHub Onboarding Guide to understand how to extend DataHub for your own use cases.

Quickstart

Please follow the DataHub Quickstart Guide to get a copy of DataHub up & running locally using Docker. As the guide assumes some basic knowledge of Docker, we'd recommend you to go through the "Hello World" example of A Docker Tutorial for Beginners if Docker is completely foreign to you.

Demo and Screenshots

There's a hosted demo environment where you can play around with DataHub before installing.

DataHub Demo GIF

Source Code and Repositories

  • linkedin/datahub: This repository contains the complete source code for both DataHub's frontend & backend services. We currently follow a hybrid open source model for development in this repository. See this blog post for details on how we do it.
  • linkedin/datahub-gma: This repository contains the source code for DataHub's metadata infrastructure libraries (Generalized Metadata Architecture, or GMA). We follow an open-source-first model for development in this repository.

Documentation

We have documentation available at https://datahubproject.io/docs/.

Releases

See Releases page for more details. We follow the SemVer Specification when versioning the releases and adopt the Keep a Changelog convention for the changelog format.

FAQs

Frequently Asked Questions about DataHub can be found here.

Features & Roadmap

Check out DataHub's Features & Roadmap.

Contributing

We welcome contributions from the community. Please refer to our Contributing Guidelines for more details. We also have a contrib directory for incubating experimental features.

Community

Join our slack workspace for discussions and important announcements. You can also find out more about our upcoming town hall meetings and view past recordings.

Adoption

Here are the companies that have officially adopted DataHub. Please feel free to add yours to the list if we missed it.

Here is a list of companies that are currently building POC or seriously evaluating DataHub.

Select Articles & Talks

See the full list here.

License

Apache License 2.0.