Pinned Repositories
flyte
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
anamnesis
In-memory, data sketch aligned HDFS implementation
bluebird
Twitter API for rust
inquest
A distributed service probing application
kvstore
mrt-rs
MRT/BGP parsing library in rust
NahFS
NahFS is a distribution spatio-temporal file system presenting an HDFS compliant interface
netparse-rs
Rust native network packet parsing library.
omniscient
A collection of scripts for distributed resource monitoring.
stip
A distributed spatiotemporal image management framework.
hamersaw's Repositories
hamersaw/kvstore
hamersaw/omniscient
A collection of scripts for distributed resource monitoring.
hamersaw/stip
A distributed spatiotemporal image management framework.
hamersaw/stippy
stip python API
hamersaw/tumen
MongoDB cluster management scripts
hamersaw/scripts
Collection of general use scripts.
hamersaw/bitswap-cannon
Benchmarking utility for the bitswap protocol in IPFS
hamersaw/conduit-poc
hamersaw/datacatalog
Data Catalog is a service for indexing parameterized, strongly-typed data artifacts across revisions. It also powers Flytes memoization system
hamersaw/dotfiles
hamersaw/flyte
Kubernetes-native workflow automation platform for complex, mission-critical data and ML processes at scale. It has been battle-tested at Lyft, Spotify, Freenome, and others and is truly open-source.
hamersaw/flyteadmin
Control Plane for Flyte. Flyteadmin is a gRPC + REST Service written in golang and uses a RDBMs to store meta information and management information for Flyte Tasks and Workflows.
hamersaw/flytectl
A cross platform CLI for Flyte. Written in Golang. Offers an intuitive interface to Flyte https://flytectl.readthedocs.io/en/latest/
hamersaw/flyteidl
Flyte at its core has a declarative, type-safe language for declaring data dependencies between arbitrary computation units. This repository contains the core specification of this language in the form of protocol-buffers.
hamersaw/flytekit
Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
hamersaw/flyteplugins
Flyte Backend Plugins contributed by the Flyte community.
hamersaw/flytepropeller
FlytePropeller is a Kubernetes native operator, that executes Flyte Workflows and Tasks. It has its own kubectl-flyte CLI to interact and is extensible using the flyteplugins/pluginmachinery interface
hamersaw/flytesnacks
Flyte Examples, User-Guides and Tutorials - https://flytecookbook.readthedocs.io/en/latest/
hamersaw/flytestdlib
A apache commons style library in Golang, use by the Flyte project. Contains utilities for metrics, pflags, config management, storage abstraction, caching etc
hamersaw/go-ipfs-docker
IPFS cluster deployment using docker-compose
hamersaw/hamersaw
hamersaw/k8s-crd-benchmark
hamersaw/kubernetes
Production-Grade Container Scheduling and Management
hamersaw/NahSpark
Spark SQL datasource for the NahFS framework
hamersaw/ncproj
reproject gridded netCDF data using shapefiles
hamersaw/ncproj-rs
reproject netcdf data using shapefiles
hamersaw/personal-site
hamersaw/scm
extensible utility to extract static code metrics
hamersaw/sustain-canary
hamersaw/sustain-query-service