spark-connect
There are 10 repositories under spark-connect topic.
sjrusso8/spark-connect-rs
Apache Spark Connect Client for Rust
Wh1isper/sparglim
Sparglim✨ makes PySpark App Configurable and Deploy Spark Connect Server Easier!
kaoutaar/end-to-end-etl-pipeline-jcdecaux-API
velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docker Compose.
mlverse/pysparklyr
Extension to {sparklyr} that allows you to interact with Spark & Databricks Connect
gizmodata/spark-connect-proxy
A reverse proxy server which allows secure connectivity to a Spark Connect server
indierambler/data-environment
Docker Compose environment for big data research and machine learning development
agile-lab-dev/literate-programming-articles
Collection of articles, using the Literate Programming style, about Data Engineering and Software Tooling in general
japila-books/spark-connect-internals
The Internals of Spark Connect
buoyant-data/spark-connect-rust
Spark Connect client library in Rust
kaoutaar/streaming-app---k8s
Real-time insights on bike availability using the JCDECAUX API. Data flows through Kafka, processed by Spark, and visualized in a Streamlit app. Deployed on Kubernetes.