ev2900

Amazon Web Services (AWS)

Pinned Repositories

Dev_Notes
Useful notes for setting up servers and explaining a few concepts
817
EMR_Studio_Hudi
Apache Hudi examples designed to be run on AWS Elastic Map Reduce (EMR) via. EMR Studio or EMR Notebooks
Language:Jupyter Notebook3 2 01
Flink_Kinesis_Data_Analytics
Apache Flink examples designed to be run by AWS Kinesis Data Analytics (KDA).
Language:Python10 4 010
OpenSearch_CloudWatch_Alarms
CloudFormation stack automating the deployment of recomended cloudwatch alarms for OpenSearch
19 5 37
OpenSearch_Dashboard_Nginx_Proxy
Access the OpenSearch dashboard of a domin deployed in a private subnet via. a Nginx Proxy
9 2 06
OpenSearch_Index_Shard_Size
Example covering ideal shard size + how to adjust # of primary, replicate shards for an index
4 3 00
OpenSearch_kNN_Vector_Search
Tokenize and convert sample text data into vectors using BERT. Load the vector representation of the text to OpenSearch and use kNN for semantic search
Language:Python2 3 10
OpenSearch_Log_Analytics
Introduction workshop to log analytics on AWS OpenSearch
Language:HTML4 4 04
OpenSearch_Neural_Search
OpenSearch Neural Search example. Load BERT to OpenSearch and create embeddings as data is indexed. Use the embedding to preform vector search
3 2 00
OpenSearch_Resource_Flow_Chart
Flow chart to help you navigate the OpenSearch resources I have built
Language:HTML30

ev2900's Repositories

ev2900/OpenSearch_CloudWatch_Alarms
CloudFormation stack automating the deployment of recomended cloudwatch alarms for OpenSearch
19 5 37
ev2900/OpenSearch_Dashboard_Nginx_Proxy
Access the OpenSearch dashboard of a domin deployed in a private subnet via. a Nginx Proxy
9 2 06
ev2900/OpenSearch_Index_Shard_Size
Example covering ideal shard size + how to adjust # of primary, replicate shards for an index
4 3 00
ev2900/OpenSearch_Log_Analytics
Introduction workshop to log analytics on AWS OpenSearch
Language:HTML4 4 04
ev2900/EMR_Studio_Hudi
Apache Hudi examples designed to be run on AWS Elastic Map Reduce (EMR) via. EMR Studio or EMR Notebooks
Language:Jupyter Notebook3 2 01
ev2900/OpenSearch_Neural_Search
OpenSearch Neural Search example. Load BERT to OpenSearch and create embeddings as data is indexed. Use the embedding to preform vector search
3 2 00
ev2900/OpenSearch_Refresh_Interval
Example covering how to adjust the refresh interval on an OpenSearch index
3 2 0
ev2900/OpenSearch_Resource_Flow_Chart
Flow chart to help you navigate the OpenSearch resources I have built
Language:HTML30
ev2900/Flink_Late_Arriving_Date_Event_Order
Helps explain how Flink handles late arriving data and the effects on message order
Language:Python2 2 0
ev2900/OpenSearch_Kafka_Anomaly_Detection
Log data -> Kafka (MSK) - Lambda -> OpenSearch - Anomaly Detection
Language:Python2 2 02
ev2900/OpenSearch_kNN_Vector_Search
Tokenize and convert sample text data into vectors using BERT. Load the vector representation of the text to OpenSearch and use kNN for semantic search
Language:Python2 3 10
ev2900/EMR_Studio_Iceberg
Apache Icebery examples designed to be run on AWS Elastic Map Reduce (EMR) via. EMR Studio or EMR Notebooks
Language:Jupyter Notebook1 2 0
ev2900/Glue_Examples
PySpark code samples designed for AWS Glue
Language:Python1 2 0
ev2900/Glue_Spark_History_Server
Host a Docker container for the Spark history server / Spark UI of AWS Glue jobs
Language:Dockerfile1 3 0
ev2900/Iceberg_EMR_Athena
Resources from an virtual tech talk / workshop - Set Up and Use Apache Iceberg Tables on Your Data Lake
Language:Jupyter Notebook1 2 01
ev2900/Iceberg_Glue_from_JARs
Configure any version of Apache Iceberg with AWS Glue by installing Iceberg from JAR files
Language:Python1 2 0
ev2900/OpenSearch_Sigv4_IAM_Auth
Authenticate with OpenSearch via. IAM Sigv4
Language:Python1 2 0
ev2900/OpenSearch_API_Examples
Example API calls to set up OpenSearch (via. Python) for anomaly detection, cross cluster replication, load sample data ...
Language:Python0 3 01
ev2900/BM25_Search_Example
Example to help understand how the BM25 term based ranking model works in search applications
Language:Python
ev2900/Cosine_Similarity_Search_Example
Example to help understand how to use hugging face sentance_transformers to encode searchable text into embeddings AND how to use cosine similarity search to determine similarity between a search prompt and the embeddings
Language:Python
ev2900/DataZone_Demo
Prebuilt demo of Amazon DataZone using fake data for Pharmaceutical drug discovery
Language:Python2 0
ev2900/Glue_Aggregate_Small_Files
PySpark script to aggregate small parquet files in a prefix into larger files. Designed to be run on AWS Glue
Language:Python2 0
ev2900/MongoDB_Streams_Glue_Iceberg
Process DynamoDB change streams via. AWS Glue w Iceberg to keep a copy of a collection in S3 upto date
Language:Python2 0
ev2900/OpenSearch_Audit_Logs
Breif explanation of REST layer audit logs for Amazon OpenSearch Service
ev2900/OpenSearch_DeletedDocuments
Examples explaining how deletes work in OpenSearch
Language:Python
ev2900/OpenSearch_DynamoDB_Example
Update OpenSearch to miror changes that happen in Dynamo DB via. a Lambda Function
Language:Python2 01
ev2900/OpenSearch_Local_Dashboard_Server
Connect a locally hosted OpenSearch dashboard server to an Amazon OpenSearch hosted domain
Language:Shell4 1
ev2900/OpenSearch_Read_Only_Index
Example covering how to set an OpenSearch index to read only. A common prerequisite for performance tuning tasks
ev2900/OpenSearch_User_Role_Premission_Managment
Example python code manipulating the OpenSearch RESTful API for user, role and permission management
Language:Python2 0
ev2900/Outlook_MSG_Parser_Python
Python script to process emails saved with .msg file extension
Language:Python2 0