Pinned Repositories
llama
Inference code for Llama models
Estimator_Vectors
This library trains word embeddings on a corpus, along with context clue and subword embeddings jointly. The word embeddings are used for normal embeding tasks, and the context clue and subword embeddings are used for estimating out-of-vocabulary (OOV) word embeddings. This code is heavily based on the gensim code: https://radimrehurek.com/gensim/
Fast_Sentence_Embeddings
Helper Functions to compute Sentence Embeddings Fast
matchzoo-experiments
matchzoo experiments
SPRUCE
SubAtt
Implementation of SubAtt.
word_level_evaluation
In this repo we provide code and support for word evaluation for GPT, GPT-2, Bert, RoBerta following the paper:
one-token-approximation
This repository contains the code for applying One-Token Approximation to a pretrained language model using subword-level tokenization.
rajicon's Repositories
rajicon/matchzoo-experiments
matchzoo experiments
rajicon/Estimator_Vectors
This library trains word embeddings on a corpus, along with context clue and subword embeddings jointly. The word embeddings are used for normal embeding tasks, and the context clue and subword embeddings are used for estimating out-of-vocabulary (OOV) word embeddings. This code is heavily based on the gensim code: https://radimrehurek.com/gensim/
rajicon/Fast_Sentence_Embeddings
Helper Functions to compute Sentence Embeddings Fast
rajicon/SPRUCE
rajicon/SubAtt
Implementation of SubAtt.