Pinned Repositories
etcd-java
Alternative etcd3 java client
kv-utils
Abstracted helper classes providing consistent key-value store functionality, with zookeeper and etcd3 implementations
text-generation-inference
IBM development fork of https://github.com/huggingface/text-generation-inference
modelmesh
Distributed Model Serving Framework
netty
Netty project - an event-driven asynchronous network application framework
argo
Argo Workflows: Get stuff done with Kubernetes.
client_java
Prometheus instrumentation library for JVM applications
concurrentlinkedhashmap
A ConcurrentLinkedHashMap for Java
curator
Mirror of Apache Curator
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
njhill's Repositories
njhill/concurrentlinkedhashmap
A ConcurrentLinkedHashMap for Java
njhill/argo
Argo Workflows: Get stuff done with Kubernetes.
njhill/client_java
Prometheus instrumentation library for JVM applications
njhill/curator
Mirror of Apache Curator
njhill/etcd
Distributed reliable key-value store for the most critical data of a distributed system
njhill/flash-attention
Fast and memory-efficient exact attention
njhill/grpc
The C based gRPC (C++, Python, Ruby, Objective-C, PHP, C#)
njhill/grpc-java
The Java gRPC implementation. HTTP/2 based RPC
njhill/guava
Google core libraries for Java
njhill/ibm-common-service-operator
Operator to install IBM Common Services
njhill/jamm
Java Agent for Memory Measurements
njhill/java-dogstatsd-client
a java statsd client library
njhill/JCTools
njhill/kfserving
Serverless Inferencing on Kubernetes
njhill/litelinks-core
High-performance netty and thrift-based microservice RPC library for Java
njhill/manifestival
Create, manipulate, apply and delete Kubernetes resource manifests at runtime
njhill/metacontroller
Lightweight Kubernetes controllers as a service
njhill/MLServer
An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more
njhill/modelmesh
Distributed Model Serving Framework
njhill/modelmesh-runtime-adapter
Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods
njhill/netty
Netty project - an event-driven asynchronous network application framework
njhill/optimum
🏎️ Accelerate training and inference of 🤗 Transformers with easy to use hardware optimization tools
njhill/rest-proxy
KServe V2 Protocol Rest API Implementation Proxy
njhill/sdg
Python library for Synthetic Data Generation
njhill/serving
A flexible, high-performance serving system for machine learning models
njhill/text-generation-inference
Large Language Model Text Generation Inference
njhill/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
njhill/transformers-bloom-inference
Fast Inference Solutions for BLOOM
njhill/vert.x
Vert.x is a tool-kit for building reactive applications on the JVM
njhill/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs