Distribute Linux Binaries for .NET Core on NuGet

Question

Distribute Linux Binaries for .NET Core on NuGet

mattleibow opened this issue 8 years ago · 45 comments

For most users of the common linux distros (Ubuntu, Debian, Red Hat, OpenSUSE, etc) it may be possible to distribute a binary in the NuGet package.

There are some limitations and reason why this is not such a good idea, but this is just an issue to track this thought.

Just want to link the main, but old, linux issue: #90

To make life easier for everyone, I moved code around and added a new target to the GN files. Now, the native libSkiaSharp build is done with GN and ninja directly: https://github.com/mono/SkiaSharp/wiki/Building-on-Linux

Answer 1 · 2017-06-08T17:30:10.000Z

For people looking for prebuilt binaries: there is a prebuilt nuget package maintained by AvaloniaUI team. Despite the name it only contains libSkiaSharp.so. For docker images provided by microsoft you need to install libfontconfig1 package via apt-get.

Regarding providing prebuilt binaries in official package:

Please, link libstdc++ statically and use something with sufficiently old GLIBC as your build machine. This will allow to produce a single binary for almost every modern distro.

Ubuntu 14.04 is a good candidate for that since it has GLIBC 2.19 and modern compiler toolchain available from official repositories

Answer 2 · 2017-09-24T12:26:26.000Z

@kekekeks, I am trying to use this package with .NET Core 2.0 in linux in a container based on https://hub.docker.com/r/microsoft/aspnetcore/ and get runtime exception

System.TypeInitializationException: The type initializer for 'SkiaSharp.SKImageInfo' threw an exception. ---> System.DllNotFoundException: Unable to load DLL 'libSkiaSharp': The specified module or one of its dependencies could not be found.

though I can see the file in the output folder runtimes\linux-x64\native\libSkiaSharp.so . I am new to linux and not sure where to look for a solution. Do you know what I might be doing wrong? Or do you have any manual on how to use it? I have only installed the package.

Answer 3 · 2017-09-24T18:17:00.000Z

Try to use self-contained deployment, something like:

dotnet restore -r debian.8-x64
dotnet publish -r debian.8-x64 -o publish-dir

It should properly pack all dependencies for you.

You can also use microsoft/dotnet:2.0-runtime-deps-jessie as your base docker image in that case.

Answer 4 · 2017-09-25T09:20:09.000Z

@kekekeks thank you for your response! I have tried different docker packages and different runtime configurations like debian.8-x64 and linux-x64. I can see libSkiaSharp.so in startup folder, but still get same exception. Probably I should wait for official support on Linux.

Answer 5 · 2017-09-25T13:47:14.000Z

Check if you have all dependencies in your docker image. You can find them using lddtree libSkiaSharp.so. You image probably doesn't have libfontconfig1 package installed.

You can also try /lib/ld-linux.so.2 --verify ./libSkiaSharp.so or this simple utility to check for loader errors.

Answer 6 · 2017-09-25T14:06:46.000Z

@kekekeks I run ldd libSkiaSharp.so because it looks like that my image does not have lddtree. And it indeed says that it cannot find it: libfontconfig.so.1 => not found.

Answer 7 · 2017-09-25T14:36:03.000Z

I have done RUN apt-get update && apt-get install -y libfontconfig1 in my Dockerfile and and it worked 😄, thanks for the hints!

Answer 8 · 2017-11-22T07:46:17.000Z

Isn't https://www.nuget.org/packages/Avalonia.Skia.Linux.Natives/ outdated?

Answer 9 · 2017-11-22T08:07:47.000Z

Do you need any particular feature of the recent SkiaSharp? It's kinda troublesome to build portable Linux binaries, so we avoid updating it unless it's really required.

Answer 10 · 2017-11-22T09:05:00.000Z

No, it was just a question.
I've download libSkiaSharp.so from 1.59.2 release and it works,
Anyway I am working on mono, still need to migrate to .NET Core.

Answer 11 · 2017-11-28T21:53:25.000Z

What about a native library for Raspberry Pi (Raspbian)? Any news on the Linux ARM front?

Answer 12 · 2017-11-29T15:01:29.000Z

You need to build it manually. I think @mterwoord had some success with ARM

Answer 13 · 2017-11-29T17:18:46.000Z

See https://github.com/terwoord/skiasharp-raspberry for my script.
I think, it currently only requires debian-based operating system. The script currently is hardcoded at (at least) one spot t o a specific base directory (/home/matthijs/skiasharp-raspberry).

PR's are welcome!

Answer 14 · 2017-11-29T17:42:31.000Z

@mterwoord thanks for the information. So this is a cross-compilation, right? Would it be possible to compile skia/skiasharp on an actual Raspberry Pi? Did you try it?

Answer 15 · 2017-11-29T17:43:25.000Z

This is cross-compilation, correct. I think I tried it, but the google tooling isn't available on arm.
Why would you want to compile on the actual pi?

Answer 16 · 2017-11-29T17:44:49.000Z

@mterwoord nothing special, just out of curiosity. It is actually much easier and faster on an Ubuntu VM for me...

Answer 17 · 2017-11-29T17:47:50.000Z

That's my whole point.. ;)
If you have improvements for my script, please make PR! Thanks! :)

Answer 18 · 2017-11-29T18:17:09.000Z

@mterwoord it seems I need something on the 'rpi' directory. Could you add instructions on your readme file on how to configure your 'skiasharp-raspberry' base directory?

Answer 19 · 2017-11-29T18:22:47.000Z

Edit build.sh, fix the BASE_DIR.
then run build.sh, possibly as admin (due to chroot usage)

Answer 20 · 2017-11-29T18:28:24.000Z

Ok, this wont' work with an empty base directory. I think you need to describe what goes on your base directory. An empty one won't work, obviously:

+ export BASE_DIR=/home/parallels/Desktop/skia-rasp/skiasharp-raspberry
 + BASE_DIR=/home/parallels/Desktop/skia-rasp/skiasharp-raspberry
 + export BUILD_DIR=/home/parallels/Desktop/skia-rasp/skiasharp-raspberry/build
 + BUILD_DIR=/home/parallels/Desktop/skia-rasp/skiasharp-raspberry/build
 + export RPI_ROOT=/home/parallels/Desktop/skia-rasp/skiasharp-raspberry/rpi
 + RPI_ROOT=/home/parallels/Desktop/skia-rasp/skiasharp-raspberry/rpi
 + true
 + rm -Rf /home/parallels/Desktop/skia-rasp/skiasharp-raspberry/rpi
 + mkdir -p /home/parallels/Desktop/skia-rasp/skiasharp-raspberry/rpi
 + cd /home/parallels/Desktop/skia-rasp/skiasharp-raspberry/rpi
 + qemu-debootstrap --foreign --arch armhf jessie /home/parallels/Desktop/skia-rasp/skiasharp-raspberry/rpi http://ftp.debian.org/debian
 ./build.sh: line 17: qemu-debootstrap: command not found
 + chroot /home/parallels/Desktop/skia-rasp/skiasharp-raspberry/rpi apt -q -y --force-yes install build-essential
 chroot: failed to run command ‘apt’: No such file or directory
 + chroot /home/parallels/Desktop/skia-rasp/skiasharp-raspberry/rpi apt -q -y --force-yes install gcc-multilib g++-multilib
 chroot: failed to run command ‘apt’: No such file or directory
 + chroot /home/parallels/Desktop/skia-rasp/skiasharp-raspberry/rpi apt -q -y --force-yes install 
 libstdc++-4.8-dev
 chroot: failed to run command ‘apt’: No such file or directory
 + chroot /home/parallels/Desktop/skia-rasp/skiasharp-raspberry/rpi apt -q -y --force-yes install 
libfontconfig1-dev
 chroot: failed to run command ‘apt’: No such file or directory
 + true
 + rm -Rf /home/parallels/Desktop/skia-rasp/skiasharp-raspberry/build
 + mkdir -p /home/parallels/Desktop/skia-rasp/skiasharp-raspberry/build
 + cd /home/parallels/Desktop/skia-rasp/skiasharp-raspberry/build
 + git clone https://github.com/mono/SkiaSharp.git skia
 Cloning into 'skia'...

Answer 21 · 2017-11-29T18:29:32.000Z

Start off with installing qemu-debootstrap.

Answer 22 · 2017-11-29T18:32:07.000Z

I've already installed all the prerequisites as per your README file.

Answer 23 · 2017-11-29T18:32:32.000Z

Well, my readme may be out of date. qemu-debootstrap isn't installed as it seems.

Answer 24 · 2017-11-29T18:45:07.000Z

Ok, you need to add 'qemu-user-static' as a prerequisite, qemu-debootstrap is on it (ubuntu 16.04). I also had to install 'apt'. Couldn't you add the install commands of all prerequisites to the script itself?

Answer 25 · 2017-11-30T06:57:42.000Z

Could you make a PR for that please? :)

Answer 26 · 2017-11-30T07:54:48.000Z

When I run the chroot line
sudo chroot $RPI_ROOT apt -q -y --force-yes install build-essential
I get the following error:
chroot: failed to run command ‘apt’: No such file or directory

note: apt is installed on my system

Don't know if this is relevant: the preceding qemu-debootstrap runs successfully, but at the beginning it shows the following message
W: Cannot check Release signature; keyring file not available /usr/share/keyrings/debian-archive-keyring.gpg

Answer 27 · 2017-11-30T07:57:14.000Z

Interesting. I'm happy to help out, but am not too familiar with debootstrap, chrooting and stuff. I'm a Windows-based .NET developer. Was very proud of myself when I got this script working..

Answer 28 · 2017-11-30T08:00:59.000Z

I have the same background as you, so I'm pretty unfamiliar with all this low level linux stuff too. ;)

Answer 29 · 2017-11-30T08:03:28.000Z

See https://wiki.debian.org/EmDebian/CrossDebootstrap#Installing_required_packages
That's the process I used..

Answer 30 · 2017-11-30T08:13:00.000Z

We have been building a release for Linux on Ubuntu 14.04:
https://jenkins.mono-project.com/view/Components/job/Components-SkiaSharp-Linux/89

Currently we just do a release for x64: https://github.com/mono/SkiaSharp/releases/download/v1.59.2/libSkiaSharp.so

Release:
https://github.com/mono/SkiaSharp/releases/tag/v1.59.2

Answer 31 · 2017-11-30T10:39:58.000Z

Got it working with ubuntu 17.10 on a separate VM (WSL didn't work).
For those who are insterested in a pre built binary: https://github.com/toburger/skiasharp-raspberry/releases/tag/arm

Answer 32 · 2017-11-30T12:08:15.000Z

@mterwoord @toburger I was also able to compile the library successfully. I modified the script a little bit and will make a PR soon. I found it strange that the compiled library is a 32-bit one, I thought that Raspbian was a 64-bit OS...

Answer 33 · 2017-11-30T12:10:22.000Z

Any reason why you want 64-bit apps? They consume more memory... 2017-11-30 13:08 GMT+01:00 Daniel Medeiros <notifications@github.com>:

…

@mterwoord <https://github.com/mterwoord> I was also able to compile the library successfully. I modified the script a little bit and will make a PR soon. I found it strange that the compiled library is a 32-bit one, I thought that Raspbian was a 64-bit OS... — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#312 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAG9301aQ14pTCYB8_1o5CLUf5xI-KK0ks5s7pqxgaJpZM4N0Mhv> .

Answer 34 · 2017-11-30T12:12:54.000Z

@mterwoord nothing special, I just thought that raspbian was 64-bit and was unconsciously expecting a 64-bit library.

Answer 35 · 2017-11-30T12:55:48.000Z

@mterwoord I've submitted a PR, please take a look.

Answer 36 · 2017-12-03T03:54:42.000Z

For Linux, I suggest that we package/distribute independently the unmanaged bits using the proper system packaging tool, and not try to solve the problem with NuGet.

Details here: #365

Answer 37 · 2017-12-03T11:11:12.000Z

I've tested the arm native library with my rasp 2, it worked on Ubuntu MATE normally. On Raspbian Stretch, it seems that the g++4.8-multilib library is missing from the default apt-get repository. I didn't try to find one and went back to Ubuntu.

Answer 38 · 2017-12-03T11:24:21.000Z

Curious, what behavior do you see on raspbian?

Answer 39 · 2017-12-04T00:06:05.000Z

@mterwoord nevermind, I was putting an unnecessary dependency on g++4.8-multilib, which doesn't exist on Raspbian. The library worked fine on it too once I removed the dependency.

Answer 40 · 2018-02-21T15:43:54.000Z

Just asking this question in multiple places:

Right now I have a x64 build for Linux that was compiled on Ubuntu 14.04. I am thinking of adding a few more to help the average dev use SkiaSharp without having to build their own. What other distros or CPUs would be helpful?

Leave a comment on this issue and track progress: #453

Answer 41 · 2018-02-21T15:48:07.000Z

As long as you are linking libfreetype and libstdc++ statically, that x64 library should work across all modern glibc-based distros.

Answer 42 · 2018-02-21T15:57:34.000Z

@kekekeks Thanks for your continual support. I hope to get the best out for everyone.

I created an issue to help track requests and implementations: #453

Answer 43 · 2018-03-25T11:27:51.000Z

To make life easier for everyone, I moved code around and added a new target to the GN files. Now, the native libSkiaSharp build is done with GN and ninja directly: https://github.com/mono/SkiaSharp/wiki/Building-on-Linux

Answer 44 · 2018-10-06T21:32:36.000Z

All right folks, I have been doing some work and I think I am able to meet you in the middle of "we don't really support Linux as it is not a priority" and "using Linux is a real pain because of X". Let me know what you think of this:

I have created a new package SkiaSharp.NativeAssets.Linux that will be going out with v1.68.0 that I would like to try. It will just contain the various Linux binaries that I have built and tested on. Right now, this is just going to be the binary I build on Ubuntu 16.04 amd64. I have done some testing and it appears to work on several distros (Ubuntu 14, OpenSUSe and CentOS), so I am going to put it in the linux-x64 runtime folder. (This may not work on alpine just yet - haven't tested - but I can always add a more specific build when I can.)

The overall result of this is that you will do everything as usual, but in the "app" part of the solution, just add the package. You should not release a NuGet to nuget.org that depends on this directly as you will then force all your uses to use my binary.

An example of a use case where a separate package is useful is this:

Matthew builds SkiaSharp and a binary for Ubuntu 16.
John builds an Ubuntu app and includes the SkiaSharp and SkiaSharp.NativeAssets.Linux packages. John is very happy.
Janet builds an Alpine app and includes SkiaSharp and her custom build of libSkiaSharp.so. Janet is not as happy as John. Janet has SKILLZ and can build for Alpine.
Joe is a great guy. Joe likes community. Joe likes Alpine Linux. Joe builds libSkiaSharp.so for Alpine. Joe creates a new NuGet package (JoesCodes.SkiaSharp.NativeAssets.Alpine) that just contains the Alpine binary.
Jane is also building for Alpine. Jane uses the JoesCodes.SkiaSharp.NativeAssets.Alpine package. Jane is happy.
Matthew has a look at JoesCodes.SkiaSharp.NativeAssets.Alpine and sees 1 million downloads! Matthew is blown away. Matthew knows everyone is using Alpine. Matthew has a chat to Big Boss: "We NEED Alpine". Big Boss has a look. Big Boss agrees. Matthew builds for Alpine and adds it to the SkiaSharp.NativeAssets.Linux package. Everyone is happy.
Janet and Jane now have options: use "official" or use "community". Janet is very happy. Jane is very happy.
- Janet is Matthew's friend. Janet decides to use SkiaSharp.NativeAssets.Linux. Janet and Matthew are happy.
- Jane is happy with JoesCodes.SkiaSharp.NativeAssets.Alpine. Jane is Joe's friend. Jane does not change.
Joe also has options: keep independent and free, or, update JoesCodes.SkiaSharp.NativeAssets.Alpine to be an empty shell package with a dependency.
- Joe decides to update to depend on Matthew.
  - Janet updates. Janet is happy.
  - Jane updates. Jane gets the new package that gets Matthew's build. Jane is happy.
- Joe stays free and builds the next version.
  - Janet updates. Janet is happy.
  - Jane updates. Jane gets Joe's new package. Jane is happy.

(Hope you folks like my story about Matthew and the Big Boss working to make life better for John, Janet, Joe and Jane. I had fun.)

Answer 45 · 2018-10-15T11:08:12.000Z

Closing this as it is going out. Although it just has a single debian-based binary, more can be added if there is a demand. Since .NET Core is on Alpine, that will be the next build most likely.

To request a particular build of Linux to be included in the NuGet, just add a vote/comment to this issue and I will make sure to keep adding the most popular ones to the package: #453

If there are any issues with the new Linux bits, just open a new issue and let me know.