microsoft/Llama-2-Onnx

Issues

• Model inference accuracy

  #43 opened 6 months ago by realhaik
  1

• What is the difference between 7B_float16 and 7B_FT_float16

  #45 opened 6 months ago by mszhanyi
  0

• ONNX visualization issue with Netron

  #44 opened 6 months ago by junde-cadence
  0

• Submodules are bad and defaulting to https

  #39 opened 7 months ago by IanLeeClaxton
  2

• Access permissions to the Llama 2 model.

  #41 opened 6 months ago by realhaik
  0

• Still waiting for access to the ONNX optimized Llama 2 models

  #42 opened 6 months ago by realhaik
  0

• git submodule update fails

  #18 opened a year ago by SpaceCowboy850
  4

• I need help

  #40 opened 6 months ago by Nancyberry31
  0

• No module named 'ChatApp'

  #37 opened 7 months ago by dhgouveia2
  3

• I/O binding to speed up inference

  #36 opened 8 months ago by merveermann
  0

• Not able to run Llama 7B float 16 not in my system or google colab

  #25 opened a year ago by Anindyadeep
  8

• 7B_FT_float16 model size

  #31 opened 8 months ago by sania96
  3

• Cannot access new optimized model variants despite having permissions for existing variants

  #32 opened 8 months ago by AustinDoolittle
  1

• LlamaV2_7B_float32 failing onnx checker

  #30 opened 8 months ago by alnah005
  0

• why not embedding_file and tokenizer_file convert to ONNX format?

  #29 opened 9 months ago by caofx0418
  0

• how about the performace 7B inference compare with llama.cpp?

  #28 opened 9 months ago by caofx0418
  0

• fatal: repository 'https://github.com/microsoft/Llama-2-Onnx-7-16/' not found

  #26 opened a year ago by empty2enrich
  4

• Cannot download the model. Is it due to access problem?

  #20 opened a year ago by KexinFeng
  9

• Does llama2 support int8 quantization?

  #16 opened a year ago by shaonianyr
  3

• failed:Protobuf parsing failed

  #19 opened a year ago by zren18
  7

• Where can i find the script to convert llama-2 to ONNX?

  #23 opened a year ago by taoxunqiang
  1

• This repo is missing important files

  #7 opened a year ago by microsoft-github-policy-service
  0

• This repo is missing a LICENSE file

  #1 opened a year ago by microsoft-github-policy-service
  0

• This repo is missing important files

  #3 opened a year ago by microsoft-github-policy-service
  0