okwinds

Pinned Repositories

• rtp-llm

  RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

  Language:C++521128648

• chatglm.cpp

  C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)

  Language:C++2.9k42252334

• CogVLM2

  GPT4V-level open-source multi-modal model based on Llama3-8B

  Language:Python2k27163134

• inference

  Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

  Language:Python5k421.3k395

okwinds's Repositories