/wikidictools

Tools for crawling Wiktionary.

Primary LanguageGoMIT LicenseMIT

wikidictools
============

Tools and libraries for ripping and processing dumps of Wiktionary [1] for
import into SQLite. Written in Go.

Modules
-------

* "wdictosqlite" is a command line tool for importing Wiktionary XML dumps [2]
  into an SQLite database.

* "wikidictools" is a small Go library for reading Wiktionary XML dumps.

Credit
------

The source code in this directory is licensed under the terms and conditions of
the MIT license. See file LICENSE for a copy of the license.

References
----------

[1] https://en.wiktionary.org/
[2] https://dumps.wikimedia.org/enwiktionary/latest/enwiktionary-latest-pages-articles.xml.bz2