Databricks

Helping data teams solve the world’s toughest problems using data and AI

United States of America

Pinned Repositories

click
The "Command Line Interactive Controller for Kubernetes"
Language:Rust1.5k 275 8988
dbrx
Code examples and resources for DBRX, a large language model developed by Databricks
Language:Python2.6k 40 24242
jsonnet-style-guide
Databricks Jsonnet Coding Style Guide
228 15 622
koalas
Koalas: pandas API on Apache Spark
Language:Python3.4k 311 590367
learning-spark
Example code from Learning Spark book
Language:Java3.9k 389 272.4k
LearningSparkV2
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
Language:Scala1.4k 39 20786
megablocks
Language:Python1.5k 15 69216
scala-style-guide
Databricks Scala Coding Style Guide
2.8k 136 18586
spark-deep-learning
Deep Learning Pipelines for Apache Spark
Language:Python2k 153 106493
Spark-The-Definitive-Guide
Spark: The Definitive Guide's Code Repository
Language:Scala3.1k 184 502.9k

Databricks's Repositories

databricks/LearningSparkV2
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
Language:Scala1.4k 39 20786
databricks/tensorframes
[DEPRECATED] Tensorflow wrapper for DataFrames on Apache Spark
Language:Scala747 75 92161
databricks/devrel
This repository contains the notebooks and presentations we use for our Databricks Tech Talks
Language:HTML726 86 13442
databricks/reference-apps
Spark reference applications
Language:Scala652 423 47339
databricks/mlops-stacks
This repo provides a customizable stack for starting new ML projects on Databricks that follow production best-practices out of the box.
Language:Python615 27 64230
databricks/spark-xml
XML data source for Spark SQL and DataFrames
Language:Scala511 35 429227
databricks/sjsonnet
Language:Jsonnet297 247 17262
databricks/iceberg-kafka-connect
Language:Java274 10 16763
databricks/tmm
Language:Python194 12 3135
databricks/containers
Sample base images for Databricks Container Services
Language:Jupyter Notebook182 245 81124
databricks/iceberg-rest-image
Simple project to expose a catalog over REST using a Java catalog backend
Language:Java149 12 2564
databricks/notebook-best-practices
An example showing how to apply software engineering best practices to Databricks notebooks.
Language:Python145 14 073
databricks/tpcds-kit
TPC-DS benchmark kit with some modifications/fixes
Language:C100 67 079
databricks/congruity
The goal of this library is to provide a compatibility layer that makes it easier to adopt Spark Connect. The library is designed to be simply imported in your application and will then monkey-patch the existing API to provide the legacy functionality.
Language:Python18 2 11
databricks/sqltools-databricks-driver
SQLTools driver for Databricks SQL
Language:TypeScript13 10 304
databricks/databricks-sqlalchemy
See PECO-1396 for more details about this repository.
Language:Python12 3 1811
databricks/databricks-dbutils-scala
The Scala SDK for Databricks.
Language:Scala5 7 45
databricks/databricks-repos-proxy
Language:Jupyter Notebook5 8 42
databricks/rules_docker
Rules for building and handling Docker images with Bazel
Language:Python5 51 06
databricks/pex
Fork of pantsbuild/pex with a few Databricks-specific changes
Language:Python4 301 07
databricks/terraform-provider-tabular
Language:Go4 9 21
databricks/arcion-docs
Language:SCSS2 1 87
databricks/bazel
Correct, reproducible, and fast builds for everyone.
Language:Java2 37 06
databricks/fastar
Language:Go22
databricks/vector
A high-performance observability data pipeline.
Language:Rust2 3 03
databricks/cluster-api-provider-gcp-1
The GCP provider implementation for Cluster API
Language:Go1 2 02
databricks/data-sharing-materialization-orchestration
Language:Python1 4 12
databricks/data-classification-review-app
Language:Python2 0
databricks/jarjar-abrams
an experimental Scala extension of Jar Jar Links
Language:Java1 01
databricks/thanos-receive-controller
Kubernetes controller to automatically configure Thanos receive hashrings
Language:Go1 01