pdames

Software Engineer at Amazon

AmazonSan Francisco Bay Area, CA

Pinned Repositories

amazon-ray
Staging area for ongoing enhancements to Ray focused on improving integration with AWS and other Amazon technologies.
Language:Python66 13 1028
iceberg
Apache Iceberg
Language:Java6.7k 164 3.6k2.3k
iceberg-python
Apache PyIceberg
Language:Python528 30 429194
amazon-ray
Staging area for ongoing enhancements to Ray focused on improving integration with AWS and other Amazon technologies.
Language:Python0 0 00
arrow
Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
Language:C++0 0 00
beam
Apache Beam is a unified programming model for Batch and Streaming
Language:Java0 0 00
ray
A fast and simple framework for building and running distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.
Language:Python1 0 00
deltacat
A portable Pythonic Data Catalog API powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to your big data workloads.
Language:Python170 10 9323
ray
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Language:Python34.6k 480 19.1k5.9k
ray_beam_runner
Ray-based Apache Beam runner
Language:Python42 13 2712

pdames/ray
A fast and simple framework for building and running distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.
Language:Python1 0 00
pdames/amazon-ray
Staging area for ongoing enhancements to Ray focused on improving integration with AWS and other Amazon technologies.
Language:Python0 0 00
pdames/arrow
Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
Language:C++0 0 00
pdames/beam
Apache Beam is a unified programming model for Batch and Streaming
Language:Java0 0 00
pdames/deltacat
A Pythonic Data Catalog powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to your big data workloads.
Language:Python0 0 00
pdames/delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
pdames/delta-rs
A native Rust library for Delta Lake, with bindings into Python
pdames/hudi
Upserts, Deletes And Incremental Processing on Big Data.
pdames/iceberg
Apache Iceberg
Language:Java0 0
pdames/iceberg-python
Apache PyIceberg
Language:Python0 0
pdames/ray_beam_runner
Ray-based Apache Beam runner
Language:Python0 0