Pinned Repositories
apache-spark-docker
Dockerizing an Apache Spark Standalone Cluster
csv-schema-inference
A tool to automatically infer columns data types in .csv files
D3JS-Dashboard
Building Responsive DashBoard with D3.js and ASP.NET MVC from scratch (SQL SERVER - SSIS - API REST)
data-engineer-challenge
Challenge Data Engineer
Dropout-Students-Prediction
The goal of this project is to identify students at risk of dropping out the school
livyc
Apache Spark as a Service with Apache Livy Client
pyDag
Scheduling Big Data Workloads and Data Pipelines in the Cloud with pyDag
pyspark-on-aws-emr
The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on writing pyspark code.
uber-expenses-tracking
The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.
wbz
A parallel implementation of the bzip2 data compressor in python, this data compression pipeline is using algorithms like Burrows–Wheeler transform (BWT) and Move to front (MTF) to improve the Huffman compression. For now, this tool only will be focused on compressing .csv files, and other files on tabular format.
Wittline's Repositories
Wittline/uber-expenses-tracking
The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.
Wittline/csv-schema-inference
A tool to automatically infer columns data types in .csv files
Wittline/pyDag
Scheduling Big Data Workloads and Data Pipelines in the Cloud with pyDag
Wittline/D3JS-Dashboard
Building Responsive DashBoard with D3.js and ASP.NET MVC from scratch (SQL SERVER - SSIS - API REST)
Wittline/wbz
A parallel implementation of the bzip2 data compressor in python, this data compression pipeline is using algorithms like Burrows–Wheeler transform (BWT) and Move to front (MTF) to improve the Huffman compression. For now, this tool only will be focused on compressing .csv files, and other files on tabular format.
Wittline/docker-livy
Dockerizing and Consuming an Apache Livy environment
Wittline/csv-estimate-rows
Wittline/csv-shuffler
A tool to automatically Shuffle lines in .csv files
Wittline/livyc
Apache Spark as a Service with Apache Livy Client
Wittline/RESTful-APIs-Nodejs
Building fast, scalable and secure RESTful services with Node, Express and MongoDB
Wittline/apache-spark-course
Apache Spark with python
Wittline/csv-columnar
Wittline/Wittline
Take a look at my repository
Wittline/code_challenges
Scripts for different purposes
Wittline/csv-generator
Wittline/csv-splitter
csv-splitter
Wittline/model-catalog-grpc
A gRPC service to consume any machine learning model stored in a model catalog through a single endpoint.
Wittline/awesome-twitter-data
A list of Twitter datasets and related resources.
Wittline/bulk_json_sqlite
Efficiently Bulk Import a Large JSON File into SQLite
Wittline/data-eng-frubana
Wittline/Data-Quality
Data Quality
Wittline/dictionary-substitute
Dictionary substitute Python Coding Task
Wittline/fastapi-jwt
Jwt with fastapi
Wittline/fastapi-template
Completely Scalable FastAPI based template for Machine Learning, Deep Learning and any other software project which wants to use Fast API as an API framework.
Wittline/github-readme-stats
:zap: Dynamically generated stats for your github readmes
Wittline/learning-golang
Learning golang
Wittline/nlp-recipes
Natural Language Processing Best Practices & Examples
Wittline/ray-sql
Distributed SQL Query Engine in Python using Ray
Wittline/similarity-search-duckdb
Wittline/tuboleta
tuboleta.mx