Pinned Repositories
ads-privacy
airflow-plugin-demo
Example for an airflow plugin
airflow-rest-api-plugin-1
A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces
al-folio
A beautiful, simple, clean, and responsive Jekyll theme for academics
amundsen
Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.
apache-ranger-s3-plugin
Apache Ranger Plugin for S3
arrow-data-source
Spark DataSouce plugin for reading files from various formats like Parquet into Arrow compatible columnar vectors.
arrow-datafusion
Apache Arrow DataFusion and Ballista query engines
arx
ARX is a comprehensive open source data anonymization tool aiming to provide scalability and usability. It supports various anonymization techniques, methods for analyzing data quality and re-identification risks and it supports well-known privacy models, such as k-anonymity, l-diversity, t-closeness and differential privacy.
cloudmapper
CloudMapper helps you analyze your Amazon Web Services (AWS) environments.
yangchenghuang's Repositories
yangchenghuang/aurum-datadiscovery
yangchenghuang/awesome-document-understanding
A curated list of resources for Document Understanding (DU) topic
yangchenghuang/AzureSearch_JFK_Files
This repo contains the sample code of the Azure Search and Cognitive Services used to provide insights and analysis around the JFK Files.
yangchenghuang/cerbos
Cerbos is the open core, language-agnostic, scalable authorization solution that makes user permissions and authorization simple to implement and manage by writing context-aware access control policies for your application resources.
yangchenghuang/ConReader
yangchenghuang/DAFT
Dynamic Affine Feature Map Transform
yangchenghuang/databricks-ci-cd
Databricks CI/CD using Azure DevOps
yangchenghuang/decaton
High throughput asynchronous task processing on Apache Kafka
yangchenghuang/DPSDA
[ICLR 2024] Generating DP Synthetic Data without Training
yangchenghuang/gazelle_plugin
Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.
yangchenghuang/holmes-extractor
Information extraction from English and German texts based on predicate logic
yangchenghuang/image_tabular
Integrate image and tabular data for deep learning
yangchenghuang/legal_NER
OpenNyAI is a mission aimed at developing open source software and datasets to catalyze the creation of AI-powered solutions to improve access to justice in India. Legal NER is one the AI component developed under this mission
yangchenghuang/lexpredict-lexnlp
LexNLP by LexPredict
yangchenghuang/LM_Memorization
Training data extraction on GPT-2
yangchenghuang/matplotlib_for_papers
Handout for the tutorial "Creating publication-quality figures with matplotlib"
yangchenghuang/MMCL-Tabular-Imaging
yangchenghuang/mosaic
An extension to the Apache Spark framework that allows easy and fast processing of very large geospatial datasets.
yangchenghuang/negmas
Negotiation Multi-Agent System (A negotiation library designed for situated negotiations within business-like simulations)
yangchenghuang/NER-RE
A Named Entity Recognition + Entity Linker + Relation Extraction Pipeline built using spacy v3.0. Given a text, the pipeline will extract entities from the text as trained and will disambiguate the entities to its normalized form through an Entity Linker connected to a Knowledge Base and will assign a relation between the entities, if any.
yangchenghuang/overwatch
Capture deep metrics on one or all assets within a Databricks workspace
yangchenghuang/piicatcher
Scan databases and data warehouses for PII data. Tag tables and columns in data catalogs like Amundsen and Datahub
yangchenghuang/python-flask-with-javascript
This repository contains an example app to communicate between JavaScript and Python.
yangchenghuang/rivet
The open-source visual AI programming environment and TypeScript library
yangchenghuang/spark-nlp-workshop
Public runnable examples of using John Snow Labs' NLP for Apache Spark.
yangchenghuang/spark-search
Spark Search - high performance advanced search features based on Apache Lucene
yangchenghuang/spline-getting-started
yangchenghuang/spline-spark-agent
Spline agent for Apache Spark
yangchenghuang/textwash
yangchenghuang/UserBERT
UserBERT PyTorch implementation