data-transformation

There are 425 repositories under data-transformation topic.

mahmoud/glom
☄️ Python's nested data operator (and CLI), for all your declarative restructuring needs. Got data? Glom it! ☄️
Language:Python1.8k 22 17360
hi-primus/optimus
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Language:Python1.4k 38 218233
2ndQuadrant/pglogical
Logical Replication extension for PostgreSQL 15, 14, 13, 12, 11, 10, 9.6, 9.5, 9.4 (Postgres), providing much faster replication than Slony, Bucardo or Londiste, as well as cross-version upgrades.
Language:C947 83 410151
zinggAI/zingg
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
Language:Java903 18 437109
mattt/TransformerKit
A block-based API for NSValueTransformer, with a growing collection of useful examples.
Language:Objective-C845 33 2295
raystack/optimus
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Language:Go737 18 268153
microsoft/prose
Microsoft Program Synthesis using Examples SDK is a framework of technologies for the automatic generation of programs from input-output examples. This repo includes samples and sample data for the Microsoft Program Synthesis using Example SDK.
Language:C#611 57 3196
ScriptFUSION/Porter
:lipstick: Durable and asynchronous data imports for consuming data at scale and publishing testable SDKs.
Language:PHP610 21 3528
SebKrantz/collapse
Advanced and Fast Data Transformation in R
Language:C609 10 19829
dbohdan/sqawk
Like awk but with SQL and table joins
Language:Tcl309 19 1514
jupyter-naas/naas
Low-code Python library to safely use notebooks in production: schedule workflows, generate assets, trigger webhooks, send notifications, build pipelines, manage secrets (Cloud-only)
Language:Python275 4 18625
feichao93/temme
📄 Concise selector to extract JSON from HTML.
Language:TypeScript272 8 1913
fastverse/fastverse
An Extensible Suite of High-Performance and Low-Dependency Packages for Statistical Computing and Data Manipulation in R
Language:R226 7 711
mahmoudparsian/data-algorithms-with-spark
O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian
Language:Python192 14 485
SETL-Framework/setl
A simple Spark-powered ETL framework that just works 🍺
Language:Scala177 13 9731
simongray/clojure-dsl-resources
A curated list of Clojure resources for dealing with domain-specific languages.
173 10 14
markus-wa/cq
Clojure Query: A Command-line Data Processor for JSON, YAML, EDN, XML and more
Language:Clojure157 5 89
strengejacke/sjmisc
Data transformation and utility functions for R
Language:R157 14 13224
mahmoudparsian/big-data-mapreduce-course
Big Data Modeling, MapReduce, Spark, PySpark @ Santa Clara University
Language:HTML146 30 0142
jim-schwoebel/allie
🤖 An automated machine learning framework for audio, text, image, video, or .CSV files (50+ featurizers and 15+ model trainers). Python 3.6 required.
Language:Python139 5 3836
ToucanToco/weaverbird
A visual data pipeline builder with various backends
Language:TypeScript94 13 17315
data-integrations/wrangler
Wrangler Transform: A DMD system for transforming Big Data
Language:Java84 9 056
galliaproject/gallia-core
A schema-aware Scala library for data transformation
Language:Scala84 6 14
aws-samples/aws-dbs-refarch-datalake
Reference Architectures for Datalakes on AWS
Language:HTML75 11 031
dry-rb/dry-transformer
Data transformation toolkit
Language:Ruby72 11 910
devsgnr/breadroll
breadroll 🥟 is a simple lightweight library for data processing operations written in Typescript and powered by Bun.
Language:TypeScript63 3 10
developerforce/DataWeaveInApex
Examples for working with DataWeave scripts from Apex.
Language:Apex58 7 015
bhrnjica/daany
Daany - .NET DAta ANalYtics .NET library with the implementation of DataFrame, Time series decompositions and Linear Algebra routines BLASS and LAPACK.
Language:C#56 8 55
assemblee-virtuelle/Semantic-Bus
object flow treatment, data transformation
Language:JavaScript55 20 1319
scopashq/typestream
⚡️ Next-generation data transformation framework for TypeScript that puts developer experience first
Language:TypeScript53 3 10
bruin-data/bruin
Bruin is a data pipeline tool that is designed to be easy-to-use. It allows building data pipelines using SQL and Python, and has built-in data quality checks.
Language:Go52 4 21
nilportugues/php-serializer
Serialize PHP variables, including objects, in any format. Support to unserialize it too.
Language:PHP48 5 1819
hopsoft/pipe_envy
Elixir style pipe operator for Ruby
Language:Ruby46 4 01
bloomberg/pycsvw
A tool to read CSV files with CSVW metadata and transform them into other formats.
Language:Python32 7 313
fiddlerwoaroof/data-lens
Functional utilities for Common Lisp
Language:Common Lisp30 7 60
tsantos84/serializer
A PHP serialization component focused on performance
Language:PHP28 5 01

data-transformation

mahmoud/glom

hi-primus/optimus

2ndQuadrant/pglogical

zinggAI/zingg

mattt/TransformerKit

raystack/optimus

microsoft/prose

ScriptFUSION/Porter

SebKrantz/collapse

dbohdan/sqawk

jupyter-naas/naas

feichao93/temme

fastverse/fastverse

mahmoudparsian/data-algorithms-with-spark

SETL-Framework/setl

simongray/clojure-dsl-resources

markus-wa/cq

strengejacke/sjmisc

mahmoudparsian/big-data-mapreduce-course

jim-schwoebel/allie

ToucanToco/weaverbird

data-integrations/wrangler

galliaproject/gallia-core

aws-samples/aws-dbs-refarch-datalake

dry-rb/dry-transformer

devsgnr/breadroll

developerforce/DataWeaveInApex

bhrnjica/daany

assemblee-virtuelle/Semantic-Bus

scopashq/typestream

bruin-data/bruin

nilportugues/php-serializer

hopsoft/pipe_envy

bloomberg/pycsvw

fiddlerwoaroof/data-lens

tsantos84/serializer