michaelfeil/infinity

Issues

• BUG ERROR: Server stops accepting new requests after _core_batch(self) exceptions

  #242 opened a month ago by vitteloil
  1

• nvidia/NV-Embed-v1

  #239 opened a month ago by Strive-for-excellence
  6

• Deberta v3 not working

  #241 opened a month ago by Stealthwriter
  1

• Multi-Modal Inference / Clip

  #147 opened 3 months ago by michaelfeil
  2

• API Key Authentication for Michaelfeil Infinity

  #207 opened a month ago by AjayKarma05
  6

• infinity_emb failed at startup using `torch.compile` when installed via pip

  #126 opened a month ago by beebopkim
  9

• [Docs] Add quantization / dtype doc

  #150 opened a month ago by michaelfeil
  0

• deberta support

  #235 opened a month ago by Stealthwriter
  1

• Tensor-parallelism for multi-gpu support

  #213 opened 2 months ago by SalomonKisters
  1

• ValueError: No onnx files found

  #225 opened a month ago by netw0rkf10w
  6

• Error in offline mode with `trust_remote code`: SFR-Embedding-Mistral and nomic does not work without `einops`

  #185 opened a month ago by prasannakrish97
  4

• Include `einops` in docker image

  #231 opened a month ago by chiragjn
  2

• Different results with mixedbread-ai/mxbai-embed-large-v1 model

  #208 opened a month ago by stephenleo
  3

• Scores slightly off/get rounded up to 1.0

  #203 opened a month ago by ruben-vb
  6

• API Token

  #226 opened a month ago by vladimirmujagic
  1

• Docker path not in readme

  #222 opened a month ago by hughesadam87
  3

• BAAI/bge-reranker-base startup error

  #218 opened a month ago by andrew-at-rise
  9

• Update docs based on feeback.

  #148 opened a month ago by michaelfeil
  2

• docker compose with folder with models

  #215 opened a month ago by shuther
  1

• mxbai-rerank-large-v1 starup error

  #219 opened a month ago by edisonzf2020
  2

• Loading models from local path

  #217 opened a month ago by vladimirmujagic
  2

• The jinaai/jina-embeddings-v2-base-zh model reports an error when importing documents into RAG.

  #220 opened a month ago by edisonzf2020
  1

• Hanging after first embedding generated on MPS

  #206 opened 2 months ago by semoal
  3

• Support for instructur/instructor-xl models

  #125 opened 4 months ago by BBC-Esq
  9

• japanese-reranker-cross-encoder-large-v1 does not work with CLI

  #192 opened 2 months ago by nassie256
  4

• Support for Python 3.8 in infinity

  #209 opened 2 months ago by BarryRun
  1

• Load local model

  #204 opened 2 months ago by jmoney
  1

• Missing library for nomic-ai/nomic-embed-text-v1.5 model

  #197 opened 3 months ago by shubham-bnxt
  2

• HF_HOME not respected

  #194 opened 3 months ago by WinsonSou
  6

• shrink: docker image size by pruning venv

  #139 opened 3 months ago by peebles
  6

• Move `.detach().cpu()` into `encode_core`, and option to use cuda streams

  #155 opened 3 months ago by jobright-jiyuan
  5

• Add a TextSplitter in LangChain to share the model of the embedding model

  #193 opened 3 months ago by Jimmy-Newtron
  0

• Issue templates

  #149 opened 3 months ago by michaelfeil
  1

• model name is not consistent across endpoints

  #178 opened 3 months ago by bufferoverflow
  1

• Safetensors or to be sure not to load pickled weights

  #164 opened 3 months ago by wllhf
  3

• Does this work with re-rankers?

  #165 opened 3 months ago by cduk
  0

• float16 and other optimizations help?

  #159 opened 3 months ago by BBC-Esq
  6

• The embeddings are random When use multithreading requests

  #163 opened 3 months ago by xuwei6
  5

• How to run or access infinity on hf a space?

  #161 opened 3 months ago by ffreemt
  1

• Love the repo! Wish I could help!

  #157 opened 3 months ago by BBC-Esq
  1

• benchmarks?

  #158 opened 3 months ago by BBC-Esq
  1

• Dynamic loading - different models at request time / multiple models

  #151 opened 3 months ago by cduk
  4

• Question: Support for sparse embeddings?

  #146 opened 3 months ago by Matheus-Garbelini
  2

• Content-Encoding: gzip

  #136 opened 3 months ago by andrew-at-rise
  7

• Adding mkdocs url

  #138 opened 3 months ago by michaelfeil
  0

• Adding torch.compile + fp16 + bettertransformer a CLI argument

  #122 opened 4 months ago by michaelfeil
  0

• "msg":"Input should be a valid list"

  #130 opened 4 months ago by fishfree
  6

• Reranker model fails to load (maidalun1020/bce-reranker-base_v1) - no max token length is set

  #127 opened 4 months ago by Matheus-Garbelini
  4

• Support for nomic-ai/nomic-embed-text-v1.5

  #123 opened 4 months ago by SupreethRao99
  1

• Asking to truncate to max_length but no maximum length

  #121 opened 4 months ago by semoal
  1