toastynews

Open source from ToastyNews, mostly related to Hong Kongese NLP.

Pinned Repositories

cantonese-nlp-benchmark
Benchmark for Cantonese word segmentation and pos tagging
Language:Python6 1 01
ckip-transformers-hk
Hongkongese/Cantonese models compatible with CKIP Transformers
Language:Python2 0 00
electra-hongkongese
Pre-trained ELECTRA from Hong Kong data
Language:Python261
finetune-ckip-transformers
Create training files to fine-tune CKIP Transformers
Language:Python20
hong-kong-fastText
fastText vectors created from Hong Kong data.
210
hongkongese-identifier
Simple statistical detector for Hong Kongese/Standard Chinese/English languages.
Language:Python50
lihkg-cat-v2
Scraped forum threads from LIHKG for categorization task. Formatted to use with BERT.
51
openrice-senti
Scraped reviews from OpenRice for sentiment analysis. Formatted to use with BERT.
9 2 00
wordshk-sem
Scraped word definition pairs from words.hk for semantic similarity task. Formatted to use with BERT.
41

toastynews/electra-hongkongese
Pre-trained ELECTRA from Hong Kong data
Language:Python261
toastynews/hong-kong-fastText
fastText vectors created from Hong Kong data.
210
toastynews/openrice-senti
Scraped reviews from OpenRice for sentiment analysis. Formatted to use with BERT.
9 2 00
toastynews/cantonese-nlp-benchmark
Benchmark for Cantonese word segmentation and pos tagging
Language:Python6 1 01
toastynews/hongkongese-identifier
Simple statistical detector for Hong Kongese/Standard Chinese/English languages.
Language:Python50
toastynews/lihkg-cat-v2
Scraped forum threads from LIHKG for categorization task. Formatted to use with BERT.
51
toastynews/wordshk-sem
Scraped word definition pairs from words.hk for semantic similarity task. Formatted to use with BERT.
41
toastynews/ckip-transformers-hk
Hongkongese/Cantonese models compatible with CKIP Transformers
Language:Python2 0 00
toastynews/finetune-ckip-transformers
Create training files to fine-tune CKIP Transformers
Language:Python20
toastynews/pytorch-sentiment-analysis
Hong Kongese deep learning data set and notebooks forked from bentrevett/pytorch-sentiment-analysis tutorial
Language:Jupyter Notebook1 1 00
toastynews/fastText4j
Facebook's FastText for Java
Language:Java00
toastynews/hong-kong-bleu
Data for evaluating translation APIs using Hong Kong text.
Language:Python
toastynews/lihkg-cat
Scraped forum threads from LIHKG for categorization task. Formatted to use with BERT.