Sometimes unable to enroll fingers

[abc123me]

Most of the time I try to enroll a finger it fails with an unknown error, sometimes it works but after it works it seems to have to cool down or something before it can be used again?! When it fails it fails with the following error:
Console logs:

[user@p50 tmp]$ fprintd-enroll -f "right-index-finger" "$USER";
Using device /net/reactivated/Fprint/Device/0
Enrolling right-index-finger finger.
Enroll result: enroll-unknown-error

Journalctl logs:

Oct 26 00:54:02 p50 kernel: usb 1-9: reset full-speed USB device number 3 using xhci_hcd
Oct 26 00:54:05 p50 fprintd[606312]: fpi_print_add_print: assertion 'print->type == FPI_PRINT_NBIS' failed
Oct 26 00:54:05 p50 fprintd[606312]: Driver did not set the type on the returned print!
Oct 26 00:54:05 p50 fprintd[606312]: Device reported an error during enroll: Driver provided incorrect print data!

I am using the most recent commit as of posting this (c6f5f0e) on Linux kernel 5.8.11 with Manjaro + KDE plasma the sensor in use is the troubled 138a:0090 Validity Sensors, Inc. VFS7500 Touch Fingerprint Sensor

EDIT: I've found it seems to work a good 50% of the time if you let the sensor sit for about 1-2 minutes