Problem running JavaFX on touch display using linux-aarch64 on Raspberry Pi 4
maebli opened this issue · 7 comments
NOTE: This question is related to Issue #43
AIM
I want to run liberica on my RPI4 for an application using JAVAFX to display a GUI on a 7'' touch display.
OS on RPI4 is Debian/GNU Linux 11 (bullseye)
ISSUE DESCRIPTION
bellsoft-jdk17.0.4.1+1-linux-aarch64-full.tar.gz downloaded from liberica and installed on a RPI4. With the command:
I ran "sudo java -Dprism.verbose=true -jar NameFile.jar"
and got the following error output
Prism pipeline init order: es2 sw
Using Double Precision Marlin Rasterizer
Using dirty region optimizations
Not using texture mask for primitives
Not forcing power of 2 sizes for textures
Using hardware CLAMP_TO_ZERO mode
Opting in for HiDPI pixel scaling
Prism pipeline name = com.sun.prism.es2.ES2Pipeline
Loading ES2 native library ... prism_es2
succeeded.
GLFactory using com.sun.prism.es2.X11GLFactory
(X) Got class = class com.sun.prism.es2.ES2Pipeline
GraphicsPipeline.createPipeline: error initializing pipeline com.sun.prism.es2.ES2Pipeline
*** Fallback to Prism SW pipeline
Prism pipeline name = com.sun.prism.sw.SWPipeline
(X) Got class = class com.sun.prism.sw.SWPipeline
Initialized prism pipeline: com.sun.prism.sw.SWPipeline
Exception in thread "main" java.lang.reflect.InvocationTargetException
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at java.base/sun.launcher.LauncherHelper$FXHelper.main(LauncherHelper.java:1082)
Caused by: java.lang.UnsupportedOperationException: Unable to open DISPLAY
at javafx.graphics/com.sun.glass.ui.gtk.GtkApplication.lambda$new$6(GtkApplication.java:181)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
at javafx.graphics/com.sun.glass.ui.gtk.GtkApplication.<init>(GtkApplication.java:179)
at javafx.graphics/com.sun.glass.ui.gtk.GtkPlatformFactory.createApplication(GtkPlatformFactory.java:41)
at javafx.graphics/com.sun.glass.ui.Application.run(Application.java:146)
at javafx.graphics/com.sun.javafx.tk.quantum.QuantumToolkit.startup(QuantumToolkit.java:291)
at javafx.graphics/com.sun.javafx.application.PlatformImpl.startup(PlatformImpl.java:293)
at javafx.graphics/com.sun.javafx.application.PlatformImpl.startup(PlatformImpl.java:163)
at javafx.graphics/com.sun.javafx.application.LauncherImpl.startToolkit(LauncherImpl.java:659)
at javafx.graphics/com.sun.javafx.application.LauncherImpl.launchApplicationWithArgs(LauncherImpl.java:410)
at javafx.graphics/com.sun.javafx.application.LauncherImpl.launchApplication(LauncherImpl.java:364)
... 5 more
Also tried with jdk11 from liberica and openjfx installed separately and not bundled. I had to create a new class which I only needed to call the main function of another class and after added some libs in the java path and downloaded libGL.so.1 and I got a similar exception.
JDK11 und OPENJFX
Prism pipeline init order: es2 sw
Using Double Precision Marlin Rasterizer
Using dirty region optimizations
Not using texture mask for primitives
Not forcing power of 2 sizes for textures
Using hardware CLAMP_TO_ZERO mode
Opting in for HiDPI pixel scaling
Prism pipeline name = com.sun.prism.es2.ES2Pipeline
Loading ES2 native library ... prism_es2
succeeded.
GLFactory using com.sun.prism.es2.X11GLFactory
GLFactory com.sun.prism.es2.X11GLFactory@f676333 could not be initialized. ES2Pipeline not available.
(X) Got class = class com.sun.prism.es2.ES2Pipeline
GraphicsPipeline.createPipeline: error initializing pipeline com.sun.prism.es2.ES2Pipeline
Reason: could not create an instance
*** Fallback to Prism SW pipeline
Prism pipeline name = com.sun.prism.sw.SWPipeline
(X) Got class = class com.sun.prism.sw.SWPipeline
Initialized prism pipeline: com.sun.prism.sw.SWPipeline
Exception in thread "main" java.lang.UnsupportedOperationException: Unable to open DISPLAY
at com.sun.glass.ui.gtk.GtkApplication.lambda$new$6(GtkApplication.java:202)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
at com.sun.glass.ui.gtk.GtkApplication.<init>(GtkApplication.java:200)
at com.sun.glass.ui.gtk.GtkPlatformFactory.createApplication(GtkPlatformFactory.java:41)
at com.sun.glass.ui.Application.run(Application.java:146)
at com.sun.javafx.tk.quantum.QuantumToolkit.startup(QuantumToolkit.java:290)
at com.sun.javafx.application.PlatformImpl.startup(PlatformImpl.java:293)
at com.sun.javafx.application.PlatformImpl.startup(PlatformImpl.java:163)
at com.sun.javafx.application.LauncherImpl.startToolkit(LauncherImpl.java:659)
at com.sun.javafx.application.LauncherImpl.launchApplication1(LauncherImpl.java:679)
at com.sun.javafx.application.LauncherImpl.lambda$launchApplication$2(LauncherImpl.java:196)
at java.base/java.lang.Thread.run(Thread.java:833)
I tested also $export DISPLAY=0 without success.
Also tested adding -X and -Y in the ssh connection without success.
SIMILAR, BUT WORKING SETUP
Using Java 8 from Oracle (which has also JavaFX included) running on a RPI3 Modul B+ everything works fine.
Running the code on my local computer (not an ARM) which has the jdk full from liberica, everything works fine.
Do you use ssh to run a JavaFX app on Raspbery Pi 4?
Could you set the DISPLAY to :0.0 in ssh and run the JavaFX program without sudo:
ssh login@host
export DISPLAY=:0.0
java JavaFXExample
If this works then root needs to be granted to have access to Xorg:
ssh login@host
export DISPLAY=:0.0
xhost +SI:localuser:root
sudo -E java JavaFXExample
Thanks for your comment.
I executed: export DISPLAY=:0.0 (and tested other versions which I have found online)
With echo $DISPLAY I checked. This is fine.
The output of my application is still the same. Yes I have an ssh connection.
I tried also to connect a keyboard on the RPI an execute the jar file.
Output is still the same.
After execute: xhost +SI:localuser:root I got the following error
xhost: unable to open display "0.0" (Same error with ssh and local on RPI)
Could you run w command? It should show which display x session uses:
> w
12:08:57 up 2 min, 2 users, load average: 1,04, 1,00, 0,43
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
user :0 :0 Вт14 ?xdm? 1:31 0.02s /usr/libexec/gdm-x-session --run-script env
Could you also run xclock to check if a native X11 app can find the display?
Thanks again for your comment.
I ran the following commands:
To make sure, that is not an ssh problem, I used a keyboard and let run the commands on the RPI.
The weird thing is, as you can see in the picture, the display works.
Ironically, if I execute libcamera-hello (via ssh) I can also see the output of the camera on the display.
Connection with the display is DSI.
Thanks for your help.
There are several platforms which JavaFX can use.
The default one on Linux system is gtk which uses GTK library and requires X11 server running on the system and DISPLAY environment variable setting.
The X11 server is included in Debian Bullseye with Raspberry Pi Desktop.
The another one is using JavaFX monocle:
https://wiki.openjdk.org/display/OpenJFX/Monocle
sudo java -Dglass.platform=Monocle -Dmonocle.platform=Linux JavaFXExample
It should be run with sudo to have access to system events.
Only software pipeline is supported by JavaFX on Raspberry Pi 4 just because Broadcom restricts its EGL support on that system:
https://github.com/raspberrypi/firmware/blob/ab68242d6131d078b757a6962d7b22a3da79d3d9/opt/vc/src/hello_pi/hello_triangle/triangle.c#L533
sudo java -Dglass.platform=Monocle -Dmonocle.platform=Linux JavaFXExample got us a step further! Currently, there is an unrelated issue that is keeping the application from launching, but I will report back when I know more, so we can close this issue.
Thanks again for the prompt support!
It's working now thank you very much!
EDIT: Adding info related
The setup is the following:
installed liberica jdk17.0.4 (This version is not the full and does not contain JavaFX) on the RPI4
Downloaded openjfx on my computer (javafx-sdk-18.0.2 Monocle version for Linux aarch64)
I used IntelliJ as IDE and gradle for the setup. I created a jar file and copied it on the RPI4
In gradle, in the plugin section I wrote: id 'org.openjfx.javafxplugin' version '0.0.13'
And then wrote the following lines to import the modules:
javafx{
sdk= 'C:/javafx-sdk-18.0.2'
modules = ['javafx.controls', 'javafx.fxml']
}
The modules can also be added in the VM with --add module path (or something like that. A lot of tutorials online)
I'm not developing on the RPI, but on my local computer and let run the application on the RPI.
The goal at the end, is to have an executable jar file. So I choose this solution.
The modules here are just the jar files which are located in the sdk folder I downloaded.
As advice: The downloaded folder contained other elements. I eliminated them and let only the lib folder
After I executed the jar on the RPI, I got an error like: JavaFX Runtime components missing
My main class looked like : public class NameClass extends Application
It seems that " extends Application" causes an issue. Other users created a class which only calls the main function of the class with “extend Application“ and solved the problem. I did the same and it worked.
Then I imported the librarys for JavaFX (or at least I think I can call them this way), which were in the downloaded folder (.so files) and I copied them in the path from which java takes the librarys. For me as example: /usr/lib
(I'm not sure but I think the .so file which contained monocle in the name and others are missing in the JDK FX from Liberica)
The error I got then was Caused by: java.lang.UnsatisfiedLinkError: /usr/lib/libjavafx_font_pango.so which called a missing .so file
So I installed: libpangoft2-1.0-0 (This was missing)
at the end I executed:
sudo java -Dglass.platform=Monocle -Dmonocle.platform=Linux -jar NameOfJarFile.jar
and it worked