Build for alpine

Question

Build for alpine

ErikJansenIRefact opened this issue a year ago · 8 comments

Hi Markus,

Is it a lot of work to build for Alpine?
We are running a NodeJS server on Alpine and are calling (via an os spawn) the odbc2parquet executable on this machine (a docker container).

Answer 1 · 2023-09-20T17:22:34.000Z

Maybe. You need a rust toolchain and the ability to dynamically link against unixODBC. I think Rust uses the musl C library in Alpine, which is also tied to static linking. Yet I am not sure about this. Just give it a try, and tell me how it goes. musl platforms are Tier 2 in the Rust ecosystem, so you might hit some hindrance.

Answer 2 · 2023-09-20T17:57:18.000Z

We aren't Rust experts. No knowledge how to build.
Debian is also an option. NodeJS official docker images run on Debian or Alpine.
Is this easy for you to add as a build option?

We check the OS in nodejs (osx, windows or some other linux distribution). When running on Debian it will try to execute the Ubuntu build but we get the following error:

./bin/odbc2parquet-x86_64-ubuntu: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.33' not found (required by ./bin/odbc2parquet-x86_64-ubuntu)

On debian 11 glib 2.31 is installed.

We're happy to donate if this will help you.

Answer 3 · 2023-09-20T18:59:36.000Z

Latest info. We unfortunately cannot use Debian version 12 because Microsoft ODBC driver is only supported on Debian 11 (and lower).

I think if you could build on Ubuntu with 2.31 libc it will run on Debian 11 as well.

Answer 4 · 2023-09-20T20:39:12.000Z

We're happy to donate if this will help you.

My first duty is to my full time employer. A donation might help me convince my girlfriend that building Debian release pipeline is a suitable activity for a weekend.

We unfortunately cannot use Debian version 12 because Microsoft ODBC driver is only supported on Debian 11 (and lower).

Debian 11 should be no problem.

I think if you could build on Ubuntu with 2.31 libc it will run on Debian 11 as well.

This is likely to be the case. Might build it on Debian 11 still, just to be on the safe side.

Best, Markus

Answer 5 · 2023-09-20T20:45:58.000Z

@ErikJansenIRefact FYI: there is a conda-forge feedstock for odbc2parquet.

Answer 6 · 2023-09-20T20:53:03.000Z

I tried building on the Docker image: installed rust, cloned your repo, installed odic-dev and ran cargo build.
I now have a working program. But it's quite cumbersome to do all of this in a docker build.

Thanks at least for your help so far.

Answer 7 · 2023-09-20T21:19:19.000Z

Set the --release flag then building, otherwise the executable might turn out to be much slower

Answer 8 · 2023-09-28T05:58:47.000Z

Hello @ErikJansenIRefact ,

I'll close this issue. I could probably only support alpine sensibly once it is a first tier Rust platform anyway. Building odbc2parquet from source might be cumbersome, but unless somebody includes it into popular package managers like Homebrew or creates a debian package for it, this is probably the way to go to reach most Linux distributions.

I am happy to support anything with binary releases, for which free GitHub runners are readily available. Otherwise I do not see myself wrestling to much with build systems in my spare time.

Best, Markus