mudler/LocalAI

WebUI enhancements

mudler opened this issue · 7 comments

mudler commented

There are many parts of the WebUI that can be improved, I'm trying to create a tracker here to collect some thoughts and areas that needs improvements, for instance:

  • model card description: (support markdown, fixed size, visual improvements )
  • delete models (ability to uninstall a model after installation)
  • cancel installation (abort an installation which is in progress)
  • chat with a model ( a simple, no frill chat interface just for sake of debugging and experimenting )
  • Show the number of models available in the gallery
  • Filter installed/not installed
  • Pagination
  • resume downloading of partially downloaded models?
  • delete all external dependencies
  • Add image gen interface
  • Add TTS interface
  • Add transcription interface
  • Add model manually from interface mask (ask for URL to feed the gallery service) and show installation progress
  • Add embeddings
  • Add rerankings (?)
  • multimodal chat
  • Make possible to access the WebUI without any browser extensions if an API_KEY is specified (#2227)
  • #2763
localai-bot commented

Hello! I'm a bot, an experiment of @mudler. Thank you for opening issue 2156 about WebUI enhancements in the LocalAI repository.

It seems like you have listed some great suggestions for improving the WebUI. Here's a brief summary of the requested features:

  • Model card description improvements: Support markdown, fixed size, and visual upgrades.
  • Ability to delete models (uninstallation).
  • Ability to cancel installation (abort progress).
  • A simple, no-frill chat interface with models for debugging and experimentation.

I suggest we use this issue to collect more feedback and ideas from other users and developers. Once we have a comprehensive list of enhancements, we can prioritize and work on them accordingly.

Feel free to add any additional suggestions or comments to this issue, and I'll be monitoring any updates. Let's make the WebUI even better together!

Nold360 commented

I'm having pretty bad performance issues on the /browse endpoint. Guess it might be too many repos/JS? it kinda kills my firefox & chromium. :(

Besides that i love the UI so far 👍

//Edit:
nvm.. for now i just reverted to the default galleries, so it's use able now. :)

lessneek commented

How about:

  • resume downloading of partially downloaded models?
  • delete all external dependencies, so it can be run completely offline?
  • 👍1
mudler commented

How about:

* [ ]  resume downloading of partially downloaded models?

* [ ]  delete all external dependencies, so it can be run completely offline?

good points, adding it to the ticket 👍

bunder2015 commented

I'm having pretty bad performance issues on the /browse endpoint. Guess it might be too many repos/JS? it kinda kills my firefox & chromium. :(

Besides that i love the UI so far 👍

I'm also noticing heavy lag and extreme memory usage while using the chat interface. When printing large blocks of text repeatedly, memory in firefox can grow over 16gb of memory. I also get a lot of "slow tab" and "slow script" warnings as a result of the lag. It's probably fine for a small handful of back-and-forth, but asking a model to print out a 100 line C++ code block can crash my laptop (assuming the model doesn't cut off the reply mid-file for no reason 😓 )