furqanshahid85-python

AWS-Glue-Pyspark-ETL-Job

aws_lambda_img_thumbail_processing

Aws lambda function that creates an img thumbnail of an image uploaded to S3.

Corona-Dataset-Analysis-Using-PySpark

This module performs statistical analysis on the noval corona virus dataset. The dataset being used was last updated on May 02, 2020. The Module performs the following Functions: * Displays the statistics of input dataset * Reads data from csv files and stores the aggregated output in parquet format * Counts the Number of records for each country/region and provice/state * Lists max Cases for each country/region and provice/state * Lists max Deaths for each country/region and provice/state * List max Recoveries for each country/region and provice/state *

Django_REST-FIFAWC2018

Django REST Project on FIFA-WC2018 Dataset

Kinesis

Kinesis Lambda Preprocessor Implementations

Python-FTP-File-Ingestion

This module provides the functionality of uploading files to s3 from a FTP server. An SFTP connection is created with the FTP server and all the files present in the specified directory are uploaded to the specified s3 bucket. Following are the key features of this module: Creates a secure ssh connection with FTP server. Handles multipart upload to s3 automatically, if file size is greater than 100MB (can be configured). Automatically handles retires in case of failed uploads during multipart upload. Partitions the data in s3 based on current year,month,day,hour. Ensures which file has been processed or needs to be processed.

python-monerepo

A python project repo in a monorepo codebase architecture

Python-Multi_Threading-Vs-Multi_Processing

furqanshahid85-python/AWS-Glue-Pyspark-ETL-Job

furqanshahid85-python/Python-FTP-File-Ingestion

This module provides the functionality of uploading files to s3 from a FTP server. An SFTP connection is created with the FTP server and all the files present in the specified directory are uploaded to the specified s3 bucket. Following are the key features of this module: Creates a secure ssh connection with FTP server. Handles multipart upload to s3 automatically, if file size is greater than 100MB (can be configured). Automatically handles retires in case of failed uploads during multipart upload. Partitions the data in s3 based on current year,month,day,hour. Ensures which file has been processed or needs to be processed.

furqanshahid85-python/Python-Multi_Threading-Vs-Multi_Processing

furqanshahid85-python/aws_lambda_img_thumbail_processing

Aws lambda function that creates an img thumbnail of an image uploaded to S3.

furqanshahid85-python/Corona-Dataset-Analysis-Using-PySpark

This module performs statistical analysis on the noval corona virus dataset. The dataset being used was last updated on May 02, 2020. The Module performs the following Functions: * Displays the statistics of input dataset * Reads data from csv files and stores the aggregated output in parquet format * Counts the Number of records for each country/region and provice/state * Lists max Cases for each country/region and provice/state * Lists max Deaths for each country/region and provice/state * List max Recoveries for each country/region and provice/state *

furqanshahid85-python/Django_REST-FIFAWC2018

Django REST Project on FIFA-WC2018 Dataset

furqanshahid85-python/Kinesis

Kinesis Lambda Preprocessor Implementations

furqanshahid85-python/python-monerepo

A python project repo in a monorepo codebase architecture

furqanshahid85-python/dropbox-sign-python

A python project demonstrating how to use the dropbox sign api in using a simple Flask based web app.

furqanshahid85-python/merge-freshbooks-integration

Repo contains python client that uses Merge's Python SDK for listing and creating new invoice data.

furqanshahid85-python/okta-create-get-user-api

Python code to create and get users using OKTA API.

furqanshahid85-python/s3-lambda-dynamodb-img-processor

S3 client to upload images to AWS S3 and AWS Lambda handler function to extract meta data from the image uploaded into S3 and store meta data information into DynamoDB.

furqanshahid85-python/sf-resolve-missing-col-spec-error

SQL Code and Data files used for creating missing columns specifications issue on snowflake

furqanshahid85-python/taxfix-event-validator

A Program to validate events schema and count the number of event objects present in the input JSON file.