/doccano-transformer

The official tool for transforming doccano format into common dataset formats.

Primary LanguagePythonMIT LicenseMIT

doccano-transformer

Codacy Badge Build Status

Doccano Transformer helps you to transform an exported dataset into the format of your favorite machine learning library.

Supported formats

Doccano Transformer supports the following formats:

  • CoNLL 2003
  • spaCy

Install

To install doccano-transformer, simply use pip:

pip install doccano-transformer

Examples

Named Entity Recognition

The following formats are supported:

  • CoNLL 2003
  • spaCy
from doccano_transformer.datasets import NERDataset
from doccano_transformer.utils import read_jsonl

dataset = read_jsonl(filepath='example.jsonl', dataset=NERDataset, encoding='utf-8')
dataset.to_conll2003(tokenizer=str.split)
dataset.to_spacy(tokenizer=str.split)

Contribution

We encourage you to contribute to doccano transformer! Please check out the Contributing to doccano transformer guide for guidelines about how to proceed.

License

MIT