princeton-nlp/AutoCompressors

Issues

• The usage of past_key_values in AutoCompressorMixin

  #29 opened 3 months ago by RewindL
  1

• Does Auto-Compressors support newer base model like LLama-3 or Qwen-2.5?

  #28 opened 3 months ago by RewindL
  2

• Evaluation datasets needed

  #27 opened 4 months ago by Mr-lonely0
  0

• Your shared model trained on LLAMA2 is not trained on Lora, It's full-finetuned model.

  #25 opened 5 months ago by jason9693
  1

• torchrun error when generating training split

  #24 opened 5 months ago by OswaldHe
  3

• substep & segment

  #23 opened 6 months ago by Lu-kuan-lpk
  1

• Install as python package?

  #22 opened 6 months ago by creisle
  1

• Some issue about ICL Experience

  #21 opened 8 months ago by broalantaps
  3

• Inquire on data of Table 1

  #20 opened 9 months ago by void-b583x2-NULL
  1

• Reduce the number of summary vectors

  #18 opened 9 months ago by rahulseetharaman
  2

• Question about the data preprocessing

  #19 opened 9 months ago by hxs91
  1

• Install instructions are not clear

  #12 opened 9 months ago by imbalu007
  2

• Dimension of last_hidden_state size

  #14 opened 9 months ago by imbalu007
  2

• question about `position_ids`

  #17 opened 9 months ago by hxs91
  2

• Held-out perplexity question

  #16 opened 10 months ago by broalantaps
  3

• Finetuning an autocompressor model

  #11 opened a year ago by imbalu007
  4

• AttributeError: 'SubstepTrainer' object has no attribute 'do_grad_scaling'

  #13 opened a year ago by msclar
  3

• RuntimeError: FlashAttention only support fp16 and bf16 data type

  #15 opened a year ago by stdKonjac
  3

• Summary Vector Failures and Incomplete Answers with Numerical Contexts

  #7 opened a year ago by iseesaw
  4

• BUG REPORT

  #8 opened a year ago by Patrick-Ni
  1

• CUDA out of memory.

  #6 opened a year ago by xuguohai
  3

• Inquiry for the release date of the pre-trained model

  #4 opened a year ago by siyuhsu
  1

• Question on the preprocessed data

  #5 opened a year ago by LouChao98
  3

• Follow-up on Code Release Timeline

  #3 opened 2 years ago by mpoemsl
  4

• Timeline for Release of Code and Pre-Trained Models

  #2 opened 2 years ago by mpoemsl
  2