nilsherzig/LLocalSearch

Disable embeddings timeout

Opened this issue · 0 comments

Is your feature request related to a problem? Please describe.
The embeddings model does not work fast enough on CPUs to create embeddings within the defined timeframe.

Describe the solution you'd like
Disable the embeddings timeout.

Describe alternatives you've considered

  • Adding a check if the model is running on GPU
  • Some sort of speed test
  • an adjustable timeout in the Webinterface