Pinned Repositories
TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
ray
Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Android_Fetch
An Android application to fetch data from an URL and automatically process and display the data with predefined rules.
aws-amplify-auth-component
codeSTACKr
Covid19-Data-Exploration
Implemented data cleaning, processing and exploration on Covid-19 related large data sets. Designed a Map Visualizer and Search engine for users to explore the data.
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
model_navigator
Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
shixianc's Repositories
shixianc/Android_Fetch
An Android application to fetch data from an URL and automatically process and display the data with predefined rules.
shixianc/aws-amplify-auth-component
shixianc/codeSTACKr
shixianc/Covid19-Data-Exploration
Implemented data cleaning, processing and exploration on Covid-19 related large data sets. Designed a Map Visualizer and Search engine for users to explore the data.
shixianc/Hadoop-ls-clone
Hadoop file system Clone with file listing and search functionalities. Developed in Python and xpath.
shixianc/JerryAITask
shixianc/Sorting-Visualizer
Visualize popular sorting algorithms
shixianc/tensorflow
An Open Source Machine Learning Framework for Everyone
shixianc/zebra-tester-poc
shixianc/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
shixianc/cloudflare-2020-general-engineering-assignment
shixianc/model_navigator
Triton Model Navigator is a tool that provides the ability to automate the process of model deployment on the Triton Inference Server.
shixianc/shixianc
shixianc/transformer-from-scratch
Implement a transformer from scratch using pytorch