SourabhSinghRana
Highly motivated Data Engineer with over 4 years of hands-on expertise in GCP, Snowflake, SQL, and Python. Proficient in data warehousing and Hadoop concept
EvidenDelhi
Pinned Repositories
BigDataAssignment
Crypto-Data-Pipeline
Data Pipeline for loading scraped data to redshift.
download-csv-file-using-python
DSA_SQL_problem_SOLUTION
multi_threading_web_scraper
Mini-project that involved scraping data from a website. What started as a simple data scraping endeavor turned into a profound lesson in the power of multi-threading.
OCR-reading-using-python
real-time_crypto_data_pipeline_using_kafka
I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that utilizes Kafka to scrape, process, and load data onto S3 in JSON format. With a producer-consumer architecture, I ensure that the data is in the right format for loading onto S3 by performing minor transformations
SourabhSinghRana
Config files for my GitHub profile.
zomato_data_warehouse_design
I recently tried designing a Data Warehouse for Zomato/Swiggy, one of the leading online food delivery platforms. This project has provided me with invaluable hands-on experience, allowing me to apply my skills and knowledge in a real-world scenario.
SourabhSinghRana's Repositories
SourabhSinghRana/real-time_crypto_data_pipeline_using_kafka
I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that utilizes Kafka to scrape, process, and load data onto S3 in JSON format. With a producer-consumer architecture, I ensure that the data is in the right format for loading onto S3 by performing minor transformations
SourabhSinghRana/Crypto-Data-Pipeline
Data Pipeline for loading scraped data to redshift.
SourabhSinghRana/OCR-reading-using-python
SourabhSinghRana/zomato_data_warehouse_design
I recently tried designing a Data Warehouse for Zomato/Swiggy, one of the leading online food delivery platforms. This project has provided me with invaluable hands-on experience, allowing me to apply my skills and knowledge in a real-world scenario.
SourabhSinghRana/BigDataAssignment
SourabhSinghRana/download-csv-file-using-python
SourabhSinghRana/DSA_SQL_problem_SOLUTION
SourabhSinghRana/multi_threading_web_scraper
Mini-project that involved scraping data from a website. What started as a simple data scraping endeavor turned into a profound lesson in the power of multi-threading.
SourabhSinghRana/SourabhSinghRana
Config files for my GitHub profile.
SourabhSinghRana/Apache-Beam-CSV-file-data-processing
✅ Read data from a CSV file. ✅ Filtered the data based on specific criteria. ✅ Saved the processed data back into a CSV file.