glotlid

There are 5 repositories under glotlid topic.

cisnlp/GlotLID
💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
Language:Python160 6 410
cisnlp/GlotCC
🕸 GlotCC Dataset and Pipline -- NeurIPS 2024
Language:Jupyter Notebook20 9 00
cisnlp/ungoliant
:spider: The pipeline for the OSCAR/GlotCC corpus
Language:Rust3 0 0
cisnlp/oscar-io
Readers/Writers for GlotCC/OSCAR corpus
Language:Rust1 0 0
cisnlp/oscar-tools
The original tooling for the GlotCC/OSCAR corpus rewritten in Rust
Language:Rust1 0 0