Pinned Repositories
breeze
Breeze is a library for numerical processing, machine learning, and natural language processing. Its primary focus is on being generic, clean, and powerful without sacrificing (much) efficiency. Breeze is the merger of the ScalaNLP and Scalala projects, because one of the original maintainers is unable to continue development. The Scalala parts are largely rewritten.
draccus
Configuration with Dataclasses+YAML+Argparse. Fork of Pyrallis
epic
**Archived** Epic is a high performance statistical parser written in Scala, along with a framework for building complex structured prediction models.
gust
Gust is a set of GPU extensions for Breeze.
jax_sourceror
Turn jitted jax functions back into python source code
oldsmr
Scala Map Reduce
puck
Puck is a lightning-fast parser for natural languages using GPUs
sbt-jflex
JFlex plugin for sbt 0.13.x and 1.0
scalanlp-fst
(Weighted) Finite State Transducers for Scala NLP
smr
Scala MapReduce, redux
dlwh's Repositories
dlwh/jax_sourceror
Turn jitted jax functions back into python source code
dlwh/draccus
Configuration with Dataclasses+YAML+Argparse. Fork of Pyrallis
dlwh/obsidian-paper-clipper
dlwh/levanter-midi
Experiments with Jax and TPUs for Foundation Models - modified tokens for lakh
dlwh/sbt-breeze-expand-codegen
sbt plugin for doing Breeze's codegen as an explicit source generation step.
dlwh/xla
A machine learning compiler for GPUs, CPUs, and ML accelerators
dlwh/azure-storage-cpp
Microsoft Azure Storage Client Library for C++
dlwh/dotty
The Scala 3 compiler, also known as Dotty.
dlwh/equinox
Elegant easy-to-use neural networks in JAX. https://docs.kidger.site/equinox/
dlwh/fairscale
PyTorch extensions for high performance and large scale training.
dlwh/filesystem_spec
A specification that python filesystems should adhere to.
dlwh/flan-2
dlwh/fsspec-debug
Debugging question for interviews
dlwh/hfseqio
Extensions for Google's SeqIO library to make it play nice with Huggingface's ecosystem
dlwh/html2text
Convert HTML to Markdown-formatted text.
dlwh/jax
Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
dlwh/jcuda-maven
Mavenized and jniloaderized JCuda (0.5.5)
dlwh/lm-evaluation-harness
A framework for few-shot evaluation of language models.
dlwh/mlir-sys
Rust bindings to the MLIR C API.
dlwh/onnx-mlir
Representation and Reference Lowering of ONNX Models in MLIR Compiler Infrastructure
dlwh/PyTreeClass
Visualize, create, and operate on JAX PyTree in the most intuitive way possible.
dlwh/quinine
A library to create and manage configuration files, especially for machine learning projects.
dlwh/seqio
Task-based datasets, preprocessing, and evaluation for sequence models.
dlwh/SimpleParsing
Simple, Elegant, Typed Argument Parsing with argparse
dlwh/tesseract
Collection of Singularity Definition Files and .sif Images for Reproducibility.
dlwh/text-to-text-transfer-transformer
Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"
dlwh/trafilatura
Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments
dlwh/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
dlwh/webdataset
dlwh/yahp
hyperparameter management