topling/mytopling

Generate data pack/unpack code at runtime

Opened this issue · 0 comments

Now MyTopling inherited MyRocks's pack/unpack code, which is slow because it pack/unpack data dynamically, in table scan stage, pack/unpack consume , as show in this flame graph:
image

We can optimize it as below:

  1. generate pack/unpack C++ code on create/alter table and create index
  2. compile the code into shared lib
  3. calling pack/unpack function in the shared lib

We expecting this will greatly improve pack/unpack performance.