rambabu-posa
18 Years as Data Engineer with Java, Scala, Python, Spark, Pyspark, Kafka, Hadoop, Snowflake, BigQuery, Athena, Redshift, GCP, AWS, AZure, Airflow, Terraform.
London
Pinned Repositories
airflow_tutorial
beam
Apache Beam is a unified programming model for Batch and Streaming
beginning-apache-spark-2
Source Code for 'Beginning Apache Spark 2' by Hien Luu
Data-Engineering-on-GCP-Cheatsheet
Learn-Scala---Fundamentals-of-Scala-2.13
Learn Scala - Fundamentals of Scala 2.13, published by Packt
LearningSpark
Scala examples for learning to use Spark
machine-learning-using-pyspark
Learn Machine Learning using PySpark from scratch
MovieAnalysis
spark-compose
All in docker-compose. (spark, zeppelin, hdfs)
SparkLearning
A comprehensive Spark guide collated from multiple sources that can be referred to learn more about Spark or as an interview refresher.
rambabu-posa's Repositories
rambabu-posa/SparkLearning
A comprehensive Spark guide collated from multiple sources that can be referred to learn more about Spark or as an interview refresher.
rambabu-posa/MovieAnalysis
rambabu-posa/net.jgp.books.spark.ch03
Spark in Action, 2nd edition - chapter 3
rambabu-posa/net.jgp.books.spark.ch10
Spark in Action, 2e - chapter 10
rambabu-posa/net.jgp.books.spark.ch12
Spark in Action, 2nd edition - chapter 12 - Data Transformations
rambabu-posa/net.jgp.books.spark.ch13
Spark in Action, 2nd edition - chapter 13 - Transforming documents
rambabu-posa/net.jgp.books.spark.ch14
Spark in Action, 2nd edition - chapter 14 - extending data transformation with UDFs
rambabu-posa/net.jgp.books.spark.ch15
Spark in Action, 2nd edition - chapter 15 - Aggregating your data
rambabu-posa/net.jgp.books.spark.ch17
Spark in Action, 2nd edition - chapter 16 - exporting data, using delta lake
rambabu-posa/agent-invitations-frontend
rambabu-posa/beam-college
Repository for Beam College sessions
rambabu-posa/bigquery-data-lineage
Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.
rambabu-posa/car-tax-check
rambabu-posa/Cloud-AI-Analytics
This Repo contain details related to Data Engineering tech stacks in GCP
rambabu-posa/data-contract-template
Template for a data contract used in a data mesh.
rambabu-posa/databricks-on-aws
rambabu-posa/dbt-experiments
rambabu-posa/Deploying-own-image-to-GKE-using-terraform
rambabu-posa/docker-images
Public Docker Images for popular services
rambabu-posa/examples
Examples for "Kubernetes Patterns - Reusable Elements for Designing Cloud-Native Applications"
rambabu-posa/GCP-Data-Engineering-Demo-Codes
Demo Codes will be shared here
rambabu-posa/gke-networking-demos
This project presents a number of best practices for establishing network links between Kubernetes Engine clusters, and exposing cluster services across Google Cloud projects. You will use a set of Deployment Manager templates to create networks, subnets, vpn connections, and Kubernetes Engine clusters.
rambabu-posa/Optimizing-Databricks-Workload
Optimizing Databricks Workload, published by Packt
rambabu-posa/soundclassifier-cloudrun
Sound Classifier made with Teachable Machines and hosted on Cloud Run
rambabu-posa/spark-experiments
My experiments trying to understand Spark better
rambabu-posa/spring-kafka-tutorial
Git tutorial Step By Step
rambabu-posa/terraform-cheat-sheet
Terraform cheat sheet
rambabu-posa/terraform-gcs-to-bigquery
Its a terraform based repository to copy data from GCS to Google BigQuery
rambabu-posa/terraform-provider-google
Terraform Google Cloud Platform provider
rambabu-posa/youtubeetl