algorand/conduit-cockroachdb

CDB indexing performance x3 lower compared to PgDB

urtho opened this issue · 0 comments

urtho commented

I tried optimizing CDB and underlying ext4 but still indexing a round to CockroachDB takes x3 compared to PostgreSQL.

Postgres:

{"__type":"Conduit","_name":"main","level":"info","msg":"FINISHED Pipeline round r=35494258 (1110 txn) exported in 370.316375ms","time":"2024-01-24T09:31:15.821575315Z"}
{"__type":"Conduit","_name":"main","level":"info","msg":"FINISHED Pipeline round r=35494259 (1144 txn) exported in 655.002598ms","time":"2024-01-24T09:31:18.986001274Z"}
{"__type":"Conduit","_name":"main","level":"info","msg":"FINISHED Pipeline round r=35494260 (1077 txn) exported in 360.993149ms","time":"2024-01-24T09:31:21.545702223Z"}

CockroachDB:

{"__type":"Conduit","_name":"main","level":"info","msg":"FINISHED Pipeline round r=35494258 (1110 txn) exported in 1.510760827s","time":"2024-01-24T11:38:02.009128255Z"}
{"__type":"Conduit","_name":"main","level":"info","msg":"FINISHED Pipeline round r=35494259 (1144 txn) exported in 1.545093518s","time":"2024-01-24T11:38:03.5545641Z"}
{"__type":"Conduit","_name":"main","level":"info","msg":"FINISHED Pipeline round r=35494260 (1077 txn) exported in 1.462953122s","time":"2024-01-24T11:38:05.017789308Z"}

It this only me or this is how CockroachDB is and in return we get unlimited read scalability ?