brave/brave-browser

Need to improve visibility of LLM used by `Leo` when "Automatic" mode is selected

Closed this issue · 3 comments

hffvld commented

Description

Need to improve visibility of LLM used by Leo when "Automatic" mode is selected. It's hard to find out what LLM was used to provide an answer right now. The user must tap/click the Refresh button under the answer, and then check what LLM is highlighted. This is not very intuitive. Maybe we can show used LLM under the answer.

Steps to reproduce

  1. Launch Brave
  2. Open Leo
  3. Make sure that Automatic LLM mode is selected
  4. Ask any question > Wait for the response
  5. Observe that there is no clear representation of what LLM was used to provide an answer

Actual result

We don't show a clear representation of what LLM was used to provide an answer when Automatic mode is selected.

Android Desktop
1 2

Expected result

Need to improve visibility of LLM used by Leo when "Automatic" mode is selected.

Reproduces how often

Easily reproduced

Brave version

Brave build: 1.84.68
Chromium: 140.0.7339.133 (Official Build) canary (64-bit)

Device

  • Brand/model: ANY

Channel information

  • release (stable)
  • beta
  • nightly

Reproducibility

  • with Brave Shields disabled
  • with Brave Rewards disabled
  • in the latest version of Chrome

Miscellaneous information

cc @kjozwiak

mattmcalister commented

agreed. it's not hidden but it could be more accessible.

  • 👍1
aguscruiz commented

Proposal on how to make it more obvious here:

  • Remove the "Regenerate" icon and in its place show the name of the model used.
  • If the name of the model is longer than the space available, cut the name using elipsis
  • Distance between model name and carat arrow is leo-spacing-xs

Design here:
https://www.figma.com/design/m0Gdbf0wtqyfEFGm32VLLc/%F0%9F%94%84-Leo--IN-PROGRESS-?node-id=10755-95285&t=EQaNrahw3COBWL1P-1

Image
  • 🎉2
MadhaviSeelam commented

Verification PASSED using

Brave | 1.85.90 Chromium: 142.0.7444.53 (Official Build) beta (64-bit)
-- | --
Revision | 0e3f2217f76afb53dfa372a741c10de68ceca838
OS | Windows 11 Version 25H2 (Build 26200.6899)

Installed 1.85.90
launched Brave
opened Leo panel
verified Automatic LLM mode is selected
started a conversation
Confirmed the LLM model name (eg. Claude Haiku) is shown in place of Regenerate Answer button
opened brave://settings/leo-ai
Selected an LLM Llama 3.1 8B for default model

Leo sidepanel

example example example
Image Image Image

Leo full page

example example example
Image Image Image

Selected Llama 3.1 8B as a default model

example example
Image Image