/LVGL-Touch-Display-USB-Mouse

Testing LVGL and ili9341 touch display with USB-Mouse and USB-Keyboard using the library ESP32-USB-Soft-Host by tobozo

Primary LanguageC++MIT LicenseMIT

LVGL + Touch Display + USB-Mouse + USB-Keyboard

Tested with ESP32 DevKitC v4 ( or Lolin ESP32 lite ), ili9341 display and Arduino IDE 2.1.0 ( PlatformIO ).

A second test with an ESP32-S3 is in the folder S3.

The library ESP32-USB-Soft-Host 0.1.4 supports only USB1.1 and known working HID devices can be found here or below.

The display works with LVGL, TFT_eSPI by Bodmer or LovyanGFX. Details about this display and the installation of the libraries can be found here. Remember that here the CS pin has changed from GPIO15 to GPIO14, because GPIO15 is needed as second USB device.

cursor_00.jpg cursor_07.jpg

Connections for ESP32 DevKitC V4

Share SPI - MOSI, MISO and CLK, so you need only 11 Pin's for 3 SPI devices.

GPIO USB TFT Touch SD-Card Description
16 DP_P0 D+ ( green )
17 DM_P0 D- ( white )
13 DP_P3 D+ ( green )
15 DM_P3 D- ( white )
5V ( red )
GND ( black )
------ ------- ------- ------- --------- ----------------
EN RESET RST
23 SDI T_DIN (SD_MOSI) MOSI
19 (SDO) T_DO (SD_MISO) MISO
18 SCK T-CLK (SD_SCK) CLK
2 DC DC
14 CS CS (TFT)
4 T_CS CS (Touch)
(5) (SD_CS) CS (SD)
T_IRQ IRQ (not used)
GND GND
VCC 3.3V
LED 3.3V

D+ and D- are directly connected to the GPIO's without using any resistor. SD-card and GPIO 5 are not used in this test.

Quick installation

  • Arduino :
    • Install the libraries "lvgl", "TFT_eSPI" and "LovyanGFX".
    • Copy the program file(s) from the folder "Arduino/" and especially "Arduino/libraries/", which contain all configuration files and the library "ESP32-USB-Soft-Host-main" version 1.0.4 .
    • Copy the demos folder "Arduino\libraries\lvgl\demos" to "Arduino\libraries\lvgl\ src\demos"
    • Copy the examples folder "Arduino\libraries\lvgl\examples" to "Arduino\libraries\lvgl\ src\examples".
  • PlatformIO :
    • Copy all files from the folder "PlatformIO/LVGL_Demo_USB_kbd/" or "PlatformIO/LVGL_Demo_USB_Lovyan_kbd/" to your project folder.
    • PlatformIO should now install the missing libraries.
    • Copy the folder ".pio/libdeps/esp32dev/lvgl/demos" to ".pio/libdeps/esp32-s3-devkitc-1/lvgl/ src/demos".
    • Copy the folder ".pio/libdeps/esp32dev/lvgl/examples" to ".pio/libdeps/esp32-s3-devkitc-1/lvgl/ src/examples".

Test programs

Details about installation and configuration of the libraries LVGL, TFT_eSPI and LovyanGFX can be found here. All modified files can be found above in the folders Arduino or PlatformIO. Version 0.1.4 of ESP32-USB-Soft-Host is used and must be copied e.g. from here.

  • USB_Test_Scan.ino ( PlatformIO version )

    • Used for testing, whether there are mice and keyboards, that work with "ESP32-USB-Soft-Host". Only this library must be installed or copied. The line "#define DEBUG_ALL" is not commented, so a lot of informations are shown. For further informations every 10 seconds or so ( USB0: Ack = 0 Nack = 0 ... ) set the "Core Debug Level" to "Debug" or "Verbose" in the Arduino IDE.

  • USB_Test_Input.ino ( PlatformIO version ).

    • More/other information are shown in the serial monitor.
      • Which Mouse Button is pressed
      • Direction of mouse movement and scrolling.
      • Keyboard input is shown directy for english ( //#define lang_DE ) or german keyboard ( #define lang_DE ), also special characters ( @€µöäü etc. )

  • LVGL_Arduino_USB.ino ( PlatformIO version )

    • Libraries needed : LVGL , TFT_eSPI and ESP32-USB-Soft-Host 0.1.4.
    • Mouse and all mouse buttons are working fine in LVGL.
    • Custom mouse cursor is shown (see comments in "Cursor_XXxXX.c" files.
    • Keyboard works except special keys ( äöü߀... ).
    • Mouse position x/y , buttons and Keyboard keys are shown in the serial monitor.

  • LVGL_Arduino_USB_Lovyan.ino ( PlatformIO version mouse does not work properly)

    • Version for the library LovyanGFX

The target of these programs is to find out how HID mice and keyboards can be used with an ESP32.

Problems with the PlatformIO versions :

Compiling errors and warnings are related to the special characters ( öäü߀ etc.) in the library "usbkbd_de.h".

To avoid the [-Wnarrowing] errors the "platformio.ini" should contain the build flag "-Wno-narrowing" :

; ...
lib_deps = 
  ESP32-USB-Soft-Host
build_flags =
  -Wno-narrowing      ; disable [-Wnarrowing] errors
  ;-Wno-multichar     ; disable [-Wmultichar] warnings
; ...

The mouse does not work properly in PlatformIO/LVGL_Demo_USB_Lovyan_kbd.

Library files ESP32-USB-Soft-Host

Some files of ESP32-USB-Soft-Host are slightly modified for minimal output of messages in the serial monitor, if "DEBUG_ALL" is commented in the line "//#define DEBUG_ALL".

The library files i downloaded and used for testing are recognized by VSCode/PlatformIO as "ESP32-USB-Soft-Host @ 0.1.4".

My working HID devices

Type bcdUSB idVendor idProduct 3.3V Description
Mouse 0x0200 0x04f2 0x0923 Yes HP MSU0923
Mouse 0x0110 0x062a 0x0000 Yes Speedlink Snappy BL-6141
Keyboard 0x0110 0x04ca 0x0050 No Acer SK-9621
Keyboard 0x0200 0x04f2 0x1516 Yes HP KU-1516
Keyboard 0x0110 0x03f0 0x1441 No HP SK-2029

None of my wireless HID devices work. Neither the keyboard HP KBAR211.

Some usb devices work with 3.3V .

No device was found when i use the logic level shifter TXS0108E (YF08E).