janhq/jan

idea: Load Models from folder

Closed this issue · 2 comments

Problem Statement

I used LM studio and have hundreds of gigabytes of models downloaded. Jan on Windows requires I re-download those models.

Feature Idea

Enable Jan to load models from a directory and subfolders such as from lm studio.

Found 3 possible duplicate issues:

  1. #5075
  2. #2843
  3. #6018

Hi @cndjonno you can import model in Jan using the Import function in the llama.cpp settings. just have to locate to the gguf file and load it (LMStudio might have removed the extension name, but loading the file should still work)