microsoft/aici

Issues

• Scaling performance as sequences exceeds core count

  #115 opened 3 months ago by AaronFriel
  3

• promptlib is broken

  #105 opened 5 months ago by renatolfc
  0

• Support for phi3 - llama.cpp update

  #99 opened 8 months ago by superchargez
  2

• crash

  #100 opened 8 months ago by pelikhan
  0

• pytctrl backtracking is non-idempotent

  #93 opened 8 months ago by matthai
  2

• token length limit

  #98 opened 8 months ago by mmoskal
  0

• graceful mid_process() timeout handling

  #94 opened 8 months ago by mmoskal
  0

• add logLevel and setLogLevel in jsctrl

  #77 opened 8 months ago by mmoskal
  0

• guidance controller

  #91 opened 8 months ago by mmoskal
  0

• support native controllers

  #90 opened 8 months ago by mmoskal
  0

• Exception when no token generated

  #88 opened 9 months ago by matthai
  1

• confusing error for missing CUDA compute cap 8.0

  #87 opened 9 months ago by vargonis
  2

• investigate Wasm component model for AICI functions

  #70 opened 9 months ago by mmoskal
  2

• add "prompted virtualized repl agent" as pseudo model

  #59 opened 9 months ago by darvin
  2

• JSON output doesn't conform to pattern

  #74 opened 9 months ago by samrat
  3

• better error on prompt len exceeded in rllm

  #81 opened 9 months ago by mmoskal
  0

• Expose the server on 0.0.0.0 in order to be called from outside

  #80 opened 9 months ago by anielennova
  1

• can't build pyctrl on WSL (windows 11)

  #79 opened 9 months ago by superchargez
  1

• duplicate tokens in tokenizers

  #78 opened 9 months ago by mmoskal
  1

• vLLM integration

  #63 opened 10 months ago by emrekiciman
  1

• Server crashes with `index out of bounds`

  #75 opened 9 months ago by samrat
  2

• add TokenSet.num_set/repr in jsctrl

  #64 opened 9 months ago by mmoskal
  3

• Question about FixedToken (insertion)?

  #71 opened 9 months ago by JohnPeng47
  0

• Remove unused parameter of function `controllers/uppercase/src/main.rs - append(&self, state: usize, _byte: u8)`

  #69 opened 9 months ago by Raboro
  1

• [RFC] drop pre/post callback, only leave mid

  #67 opened 9 months ago by mmoskal
  0

• add samples to jsctrl readme

  #33 opened a year ago by mmoskal
  1

• have bump.sh update version field in cargo.toml

  #54 opened 10 months ago by mmoskal
  0

• file format aware mounted "file directory" virtualized repl agent / pseudomodel (vm/docker instance that exposes open ai interface and has access to all mounted (cloud/github / bitbucket/gitlab included)

  #60 opened 9 months ago by darvin
  2

• update comms.py for new interface

  #43 opened 10 months ago by mmoskal
  0

• allow aici tool to download controllers from github

  #55 opened 10 months ago by mmoskal
  1

• split out common rllm from rllm-cuda

  #48 opened 10 months ago by mmoskal
  0

• better folder structure

  #56 opened 10 months ago by mmoskal
  2

• GPU acceleration on mac M1

  #46 opened 10 months ago by mmoskal
  0

• add more lr grammars

  #58 opened 10 months ago by darvin
  1

• allow passing binary data to controllers

  #57 opened 10 months ago by mmoskal
  0

• aicirt native Windows support

  #42 opened a year ago by mmoskal
  1

• return non 500 on "instantiate" timeout

  #52 opened 10 months ago by mmoskal
  0

• Warning(s) when starting rLLM-cpp

  #50 opened 10 months ago by dluc
  1

• llama CPU phi2 model wrong generation

  #47 opened a year ago by mmoskal
  0

• use pyaici.cli.build_rust and pyaici.rest.upload_wasm

  #44 opened a year ago by mmoskal
  1

• document interface between aicirt and LLM engine

  #38 opened a year ago by mmoskal
  1

• join post+pre into one RPC call to aicirt

  #40 opened a year ago by mmoskal
  1

• support for Python 3.8 in aici command line

  #36 opened a year ago by mmoskal
  0

• introduce new REST API for controller running

  #39 opened a year ago by mmoskal
  0

• allow JSON-encoded "files" to pyctrl/jsctrl

  #41 opened a year ago by mmoskal
  0

• integrate with llama.cpp

  #34 opened a year ago by mmoskal
  0

• rewrite promptlib to use pyctrl not declctrl

  #37 opened a year ago by mmoskal
  0

• don't import numpy in aici cmd line

  #32 opened a year ago by mmoskal
  0

• Allow tagging wasm modules

  #29 opened a year ago by mmoskal
  0

• Create separate devcontainer files for rllm and pyvm

  #30 opened a year ago by mmoskal
  0