Sqlidity

Simplified sqlite3 implementation on-chain written in Solidity.

Contract: @high_byte | Contributing

Usage

Run tests:

forge test -vv

Generate new test queries:

python ./script/parser.py

Example: echo "SELECT * FROM votes WHERE votes > 100" | python ./script/parser.py | pbcopy

(pbcopy will copy solidity code to the clipboard, paste it in ./test/Sqlite.t.sol)

Debugging

Make sure DEBUG = true in ./src/Types.sol

Why?

Sqlidity is part of an experiment to merge the world of classic databases and blockchains.

Blockchain is a database but it is hardly used as a classic database. With strange account-storage trees, 32-byte slots and niche languages to access and manipulate them, the friction of using such database as an actual database is very high.

Ideally one key benefit this technological improvement will allow is to easily on-board the 20 million web2 developers such that the transition is seamless, while inheriting web3 properties such as security, accessibility, liveness, integrated finance, etc.

How?

There are several approaches to bring classic databases on chain.

Sqlidity aims to implement SQLite databases on EVM chains, starting as a Solidity smart contract.

SQLite is a perfect candidate for initial proof of concept:

synchronous, no multiprocess / multithreaded access (just like EVM blockchains)
built-in rollbacks (simply revert the transaction)
aimed towards small-mid sized databases
simple structure

See opcodes.md to see implementation progress.

Different Approaches

Several frameworks have taken different approaches to bringing the worlds of databases and blockchains together.

TheGraph is a blockchain indexing network anyone can participate in. Indexing and querying happens off-chain.
Dune Analytics is the largest off-chain index service and can be queries with PostgreSQL.
Tableland implement a query oracle that can be instantiated on-chain. Query strings are built on chain and emitted as an event to be executed by the oracle off-chain.
BigchainDB is an experiment to bring blockchain to databases, rather than bring databases to blockchain. It seems inactive, but is one interesting approaching the Sqlidity experiment is interested in.
MUD engine by @latticexyz is building data querying on-chain.

Roadmap

The future of on-chain SQL (and databases in general) is unknown, but I believe it has a bright future.

Table database smart contract (SQLite) <== we are here - PoC ready
Production deployed to mainnet, optimistic and ZK rollups
Implement as a whole new rollup
Add ZK proofs to new rollup
Implement on cosmos ecosystem as L0 or whatever

Contributing

Feel free to experiment with this repository. Contributions of any form are welcome, including:

Code contributions to this repo
Additional research & development with (or without) relation to the roadmap
Grants to fund future research.

Contract: @high_byte

aravindhkm/sqlidity