BLSharda

NVIDIA

Pinned Repositories

onnxruntime-genai
Generative AI extensions for onnxruntime
Language:C++0 0 00
onnxruntime-genai
Generative AI extensions for onnxruntime
Language:C++565 43 318140
trt-llm-as-openai-windows
This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.
Language:Python116 5 112

BLSharda's Repositories

BLSharda/onnxruntime-genai
Generative AI extensions for onnxruntime
Language:C++0 0 00