JRC1995

Abstractive-Summarization

Implementation of abstractive summarization using LSTM in the encoder-decoder architecture with local attention.

BERT-Disaster-Classification-Capsule-Routing

Exploration of BERT-BiLSTM models with Layer Aggregation (attention-based and capsule-routing-based) and Hidden-State Aggregation (attention-based and capsule-routing-based).

Bi-GRU-CRF-NER

Attempted implementation of a Bi-directional GRU followed by a linear-chain-CRF (from scratch) for Named Entity Recognition.

Chatbot

Hybrid Conversational Bot based on both neural retrieval and neural generative mechanism with TTS.

Continuous-RvNN

Official Repository for "Modeling Hierarchical Structures with Continuous Recursive Neural Networks" (ICML 2021)

DemonRangerOptimizer

Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay

Machine-Translation-Transformers

Machine Translation using Transfromers

Multilingual-BERT-Disaster

Resources for: Cross-Lingual Disaster-related Multi-label Tweet Classification with Manifold Mixup (ACL SRW 2020)

TextRank-Keyword-Extraction

Keyword extraction using TextRank algorithm after pre-processing the text with lemmatization, filtering unwanted parts-of-speech and other techniques.

ZeroPromptSearch

Implementation of an LLM prompting pipeline combined with wrappers for auto-decomposing reasoning steps and for search through the reasoning-step-space (eg. by beam search, MCTS etc.) guided by self-evaluation.

JRC1995/Abstractive-Summarization

Implementation of abstractive summarization using LSTM in the encoder-decoder architecture with local attention.

JRC1995/TextRank-Keyword-Extraction

Keyword extraction using TextRank algorithm after pre-processing the text with lemmatization, filtering unwanted parts-of-speech and other techniques.

JRC1995/Chatbot

Hybrid Conversational Bot based on both neural retrieval and neural generative mechanism with TTS.

JRC1995/Machine-Translation-Transformers

Machine Translation using Transfromers

JRC1995/BERT-Disaster-Classification-Capsule-Routing

Exploration of BERT-BiLSTM models with Layer Aggregation (attention-based and capsule-routing-based) and Hidden-State Aggregation (attention-based and capsule-routing-based).

JRC1995/DemonRangerOptimizer

Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay

JRC1995/Self-Organizing-Map

SOM clustering on IRIS dataset

JRC1995/Continuous-RvNN

Official Repository for "Modeling Hierarchical Structures with Continuous Recursive Neural Networks" (ICML 2021)

JRC1995/Multilingual-BERT-Disaster

Resources for: Cross-Lingual Disaster-related Multi-label Tweet Classification with Manifold Mixup (ACL SRW 2020)

JRC1995/ZeroPromptSearch

Implementation of an LLM prompting pipeline combined with wrappers for auto-decomposing reasoning steps and for search through the reasoning-step-space (eg. by beam search, MCTS etc.) guided by self-evaluation.

JRC1995/Tweet-Disaster-Keyphrase

Official repository for "On Identifying Hashtags in Disaster Twitter Data" (AAAI 2020)

JRC1995/KPDrop

Official Implementation of Keyphrase Dropout

JRC1995/MonotonicLocationAttention

JRC1995/BeamTreeRecursiveCells

JRC1995/BeamRecursionFamily

JRC1995/CapsuleRoutingEncoders

In this work, we study and compare multiple capsule routing algorithms for text classification including dynamic routing, Heinsen routing, and capsule-routing inspired attention-based sentence encoding techniques like dynamic self-attention. Further, similar to some works in computer vision, we do an ablation test of the capsule network where we remove the routing algorithm itself. We analyze the theoretical connection between attention and capsule routing, and contrast the two ways of normalizing the routing weights. Finally, we present a new way to do capsule routing, or rather iterative refinement, using a richer attention function to measure agreement among output and input capsules and with highway connections in between iterations.

JRC1995/QuestionGenerationPub

JRC1995/Causal-Inference

UIC CS-594 Causal Inference Project Fall 2019

JRC1995/Neural_Net_Evolution

Learning Neural Net Parameters using Evolutionary Strategies

JRC1995/Faux-Reddit

CIS 761 Datatbase Project. Essentially a 'toy-Reddit-like' website. People can make accounts, comment, there are 'sub-forums' (sorry no capability to create new subforums for now) etc.

JRC1995/academicpages.github.io

Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes

JRC1995/COGS

JRC1995/entmax

The entmax mapping and its loss, a family of sparse softmax alternatives.

JRC1995/JRC1995.github.io

JRC1995/kg_one2set

Code for our ACL 2021 paper "One2Set: Generating Diverse Keyphrases as a Set"

JRC1995/QA-bAbi-R_NET

Attempted implementation of a minimal R-NET (with a different answer layer). Trained and tested only on the induction tasks of bAbi 10k dataset.

JRC1995/SocialMediaNER

We address the challenges posed by noise and emerging/rare entities in Named Entity Recognition task for social media domain. Following the recent advances, we employ Contextualized Word Embeddings from Language Models pretrained on large corpora along with some normalization techniques to reduce noise. Our best model achieves state-of-the-art results (F1 52.47%) on WNUT 2017 dataset. Additionally, we adapt a modular approach to systematically evaluate different contextual embeddings and downstream labeling mechanism using Sequence Labeling and a Question Answering framework.

JRC1995/SUT

Repository for Sparse Universal Transformers

JRC1995/Virtues-of-Sparsity

Attempted implementation and experiment with continuous sparsification and sparse representaions (with k-winner activation along with duty cycles and everything) with Transformers on Named Entity Recognition (CoNLL 2003).

JRC1995/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs