nomic-ai/contrastors

Issues

• mlm pretrain error

  #65 opened 3 months ago by charliedream1
  2

• Unable to run MLM pretraining on 8xH100 GPU server.

  #64 opened 4 months ago by sandeep-krutrim
  1

• Cannot train new tokens while finetuning

  #31 opened 4 months ago by sandeep-krutrim
  2

• Are there reranker framework?

  #63 opened 4 months ago by sigridjineth
  1

• Generating hard negatives for BEIR datasets

  #62 opened 5 months ago by dipamgoswami
  1

• Dataset issues (EOF error)

  #60 opened 5 months ago by dipamgoswami
  3

• Is it possible to train the model using data stored locally? (not bucket)

  #56 opened 5 months ago by upskyy
  1

• how can i get : tokenized_dataset: "nomic-ai/bert-pretokenized-2048-wiki-2023", for MLM training~

  #57 opened 6 months ago by BeHappyForMe
  1

• How to use different encoding functions for query and documents during evaluation?

  #54 opened 6 months ago by dipamgoswami
  1

• Inquiry on the Design of Gradient Calculation in grad_cache Function

  #53 opened 6 months ago by biuboomc
  1

• Install faiss

  #52 opened 6 months ago by DanielMitiku
  9

• Issues with loading pretrained checkpoints for further finetuning

  #51 opened 6 months ago by dipamgoswami
  2

• Can we continue finetune pretrained bert model on MLM task instead of doing from scratch

  #49 opened 6 months ago by AndrewNgo-ini
  1

• Running out of GPU memory on contrastive pretraining using default config

  #47 opened 6 months ago by DanielMitiku
  6

• Use of negatives during training

  #48 opened 6 months ago by gangiswag
  2

• Training stops after 1st epoch on contrastive finetuning

  #44 opened 7 months ago by DanielMitiku
  6

• How to use Huggingface Datasets?

  #37 opened 7 months ago by ms337
  1

• How to implement "fill the entire batch with samples from that single source"

  #39 opened 7 months ago by allhailzzq
  1

• Filtering Data For Contrastive Pretraining

  #43 opened 7 months ago by daegonYu
  1

• Installing Flash attention with custom kernels issue

  #40 opened 7 months ago by MohammadKhodadad
  2

• Questions about learning rate settings

  #38 opened 8 months ago by daegonYu
  1

• A question: Is it possible to use supervised-learn task to finetune embedding model?

  #35 opened 8 months ago by fengsxy
  0

• No module named 'contrastors'No module named 'contrastors'

  #36 opened 8 months ago by shrijayan
  1

• How to use grad cache for higher batch size?

  #32 opened 9 months ago by sandeep-krutrim
  5

• Questions about Training Specifics

  #33 opened 9 months ago by sukjunhwang
  3

• Incompatible Keys Error when loading pre-trained model

  #20 opened 9 months ago by Linhvjc
  1

• Different mask values when same model is loaded again

  #30 opened 9 months ago by sandeep-krutrim
  3

• unable to load local dataset for Constrastive Pretraining?

  #28 opened 10 months ago by PengchengShi00
  5

• Unable to save models in mlm pretraining

  #15 opened 10 months ago by sandeep-krutrim
  2

• Unable to restart training from checkpoint.

  #17 opened 10 months ago by sandeep-krutrim
  2

• protobuf vision problem

  #18 opened 10 months ago by cao-hy23
  2

• AWS dataset issues

  #19 opened 10 months ago by cao-hy23
  3

• Unable to get config in mlm pretraining

  #16 opened 10 months ago by Linhvjc
  3

• Regarding Further Training nomic-bert-2048

  #13 opened 10 months ago by pjchungmd
  1

• RuntimeError with Mixed Devices on GPU and CPU when Using Nomic Embed with SentEval

  #14 opened 10 months ago by ZBWpro
  1

• _IncompatibleKeys error when loading a contrastive pre-trained model

  #11 opened 10 months ago by kuanhsieh
  2

• Adaptation for Computer Vision

  #8 opened a year ago by vtrivedy
  1

• Error in the `_grad_cache_forward_step` function when running suggested contrastive pretraining command

  #9 opened a year ago by kuanhsieh
  1

• Amazin2 know

  #5 opened a year ago by Vin757
  0

• Problem related to nomic login

  #1 opened a year ago by nioxinjiang3
  2