Ecosystem to Transform Any Database into a Distributed Database System, and Enhance it with Sharding, Elastic Scaling, Encryption Features & More
Official Website: https://shardingsphere.apache.org/
| Stargazers Over Time | Contributors Over Time |
|---|---|
 |
ShardingSphere Overview
Apache ShardingSphere follows Database Plus - our community's guiding development concept for creating a complete ecosystem that allows you to transform any database into a distributed database system, and easily enhance it with sharding, elastic scaling, data encryption features & more.
It focuses on repurposing existing databases, by placing a standardized upper layer above existing and fragmented databases, rather than creating a new database.
The goal is to provide unified database services, and minimize or eliminate the challenges caused by underlying databases' fragmentation. This results in applications only needing to communicate with a single standardized service.
The concepts at the core of the project are Connect, Enhance and Pluggable.
Connect:Flexible adaptation of database protocol, SQL dialect and database storage. It can quickly connect applications and heterogeneous databases.Enhance:Capture database access entry to provide additional features transparently, such as: redirect (sharding, readwrite-splitting and shadow), transform (data encrypt and mask), authentication (security, audit and authority), governance (circuit breaker and access limitation and analyze, QoS and observability).Pluggable:Leveraging the micro kernel and 3 layers pluggable mode, features and database ecosystem can be embedded flexibly. Developers can customize their ShardingSphere just like building with LEGO blocks.
Virtually all databases are supported including MySQL, PostgreSQL, SQL Server, Oracle Database, MariaDB or any other SQL-92 database.
ShardingSphere became an Apache Top-Level Project on April 16, 2020.
Documentation:
For full documentation & more details, visit: Docs
Contribution:
For guides on how to get started and setup your environment, contributor & committer guides, visit: Contribution Guidelines
Community & Support:
Status:
We are currently working towards our 5.0.1 milestone. Keep an eye on the milestones page of this repo to stay up to date.
Nightly Builds:
A nightly build of ShardingSphere from the latest master branch is available. The package is updated daily and is available here.
‼️ Notice:
Use this nightly build at your own risk! The branch is not always fully tested. The nightly build may contain bugs, and there may be new features added which may cause problems with your environment.
How it Works:
Apache ShardingSphere includes 3 independent products: JDBC, Proxy & Sidecar (Planning). They all provide functions of data scale-out, distributed transaction and distributed governance, applicable in a variety of situations such as Java isomorphism, heterogeneous language and Cloud-Native.
ShardingSphere-JDBC
A lightweight Java framework providing extra services at the Java JDBC layer. With the client end connecting directly to the database, it provides services in the form of a jar and requires no extra deployment and dependence.
ShardingSphere-Proxy
A transparent database proxy, providing a database server that encapsulates database binary protocol to support heterogeneous languages. Friendlier to DBAs, the MySQL and PostgreSQL version now provided can use any kind of terminal.
Hybrid Architecture
ShardingSphere-JDBC adopts a decentralized architecture, applicable to high-performance light-weight OLTP applications developed with Java. ShardingSphere-Proxy provides static entry and all languages support, suitable for OLAP application and sharding databases management and operation.
Through the mixed use of ShardingSphere-JDBC & ShardingSphere-Proxy together with a unified sharding strategy by the same registry center, the ShardingSphere ecosystem can build an application system suitable to all kinds of scenarios.
Solution
| Solutions/Features | Distributed Database | Data Security | Database Gateway | Stress Testing |
|---|---|---|---|---|
| Data Sharding | Data Encrypt | Heterogeneous Databases Supported | Shadow Database | |
| Readwrite-splitting | Row Authority (TODO) | SQL Dialect Translate (TODO) | Observability | |
| Distributed Transaction | SQL Audit (TODO) | |||
| Elastic Scale-out | SQL Firewall (TODO) | |||
| Highly Available |
Roadmap
How to Build Apache ShardingSphere:
Check out Wiki section for details on how to build Apache ShardingSphere and a full guide on how to get started and setup your local dev environment.
Landscapes
Apache ShardingSphere enriches the CNCF CLOUD NATIVE Landscape.