seanmor5/honeycomb

Issues

• Support local model repositories

  #12 opened 8 months ago by seanmor5
  2

• Add benchmark scripts/tasks

  #1 opened 8 months ago by seanmor5
  0

• Handle all OpenAI configuration options

  #2 opened 8 months ago by seanmor5
  0

• Dependency based API

  #4 opened 8 months ago by seanmor5
  0

• Support vision-text models

  #15 opened 8 months ago by seanmor5
  0

• Add prefix caching

  #14 opened 8 months ago by seanmor5
  0

• Official docker image

  #13 opened 8 months ago by seanmor5
  0

• Support configurable generation options

  #11 opened 8 months ago by seanmor5
  0

• Support guidance-based decoding

  #10 opened 8 months ago by seanmor5
  0

• Add speculative decoding

  #9 opened 8 months ago by seanmor5
  0

• Support configurable quantization schemes

  #8 opened 8 months ago by seanmor5
  0

• Add response caching

  #7 opened 8 months ago by seanmor5
  0

• Setup CI/CD

  #6 opened 8 months ago by seanmor5
  0

• Support batch size configuration

  #3 opened 8 months ago by seanmor5
  0