mckaywrigley/chatbot-ui

Advice: Customize for a single FT model

Opened this issue · 1 comments

Not an actual issue, but a broad question about customization. Probably not at all what you are excited to talk about.

I am currently serving a custom model through my own homebuilt UI (https://bot.wmod.es), but am considering switching to chatbot-ui. What do you suggest is the most elegant way to tailor the app to serve a single fine-tuned model? I've been staring at and experimenting with various hacks.

  • Hack the database migrations scripts? Or the code?
  • If I hack the database migrations (in general, just adding records to workspaces and models), how do I automatically apply these when new users are created?
  • How to lock down features so most of the fancy customization features are disabled for ussers?
  • Is there an admin role that would still allow me to use these features to try out new models?

I'm trying not to make too drastic changes because I want to still be able to pull updates from the upstream repo without a freeway pileup of conflicts.

There's an unused "sharing" flag on each of the custom models/assistants I've been using to set master models. Superusers can see and edit the models directly but regular users can just use the models. It's a bit custom but it's definitely doable. To hide the extra functionality you'd probably just want to add logic so that only superusers get to see those features etc.