JMdict2SQL

Description

A script to convert the JMdict_e gzip file into a sqlite3 relational database.

Prerequisites

- python3
- JMdict_e.gz file (avaliable from edrdg.org)

Usage

1. Clone this respository to your computer
2. Download the latest JMdict_e.gz file (see below).
3. Copy JMdict_e.gz into the JMDict2SQL directory.
4. Run ./setup.sh to create an sqlite3 database (JMdict_e.db)*
5. Find the database file, JMdict_e.db, in the JMdict2SQL directory.

* you might need to run chmod +x setup.sh first.

Click here for the latest JMdict_e.gz file

JMdict_e.db Format

JMdict_e.db is a fully relational database. The format for the database tables is as follows:

Entry Table

entry [ (PK) id ]
- id: a unique ID for each entry

Kanji Tables

kanji [ (PK) id, (FK) entry_id, value ]
- id: a unique ID for each kanji
- entry_id: foreign key from entry table
- value: kanji value for the entry
kanji_tags [ (PK) id, (FK) kanji_id, value ]
- id: a unique ID for each kanji_tag record
- kanji_id: foreign key from kanji table
- value: info related to the associated kanji
kanji_common [ (PK) id, (FK) kanji_id, value ]
- id: a unique ID for each kanji_common record
- kanji_id: foreign key from kanji table
- value: denotes how common a kanji is

Kana Tables

kana [ (PK) id, (FK) entry_id, value, no_kanji ]
- id: a unique ID for each kana
- entry_id: foreign key from entry table
- value: kanji value for the entry
- no_kanji: if 0, the kana is not the true reading of the kanji
kana_tags [ (PK) id, (FK) kana_id, value ]
- id: a unique ID for each kana_tag record
- kana_id: foreign key from kana table
- value: info related to the associated kana
kana_common [ (PK) id, (FK) kana_id, value ]
- id: a unique ID for each kana_common record
- kana_id: foreign key from kana table
- value: denotes how common a kana is
kana_applies_to_kanji [ (PK) id, (FK) kana_id, value ]
- id: a unique ID for each kana_applies_to_kanji record
- kana_id: foreign key from kana table
- value: denotesthat the kanji applies to the current kana

Sense Tables

sense [ (PK) id, (FK) entry_id ]
- id: a unique ID for each sense
- entry_id: foreign key from entry table
sense_applies_to_kanji [ (PK) id, (FK) sense_id, value ]
- id: a unique ID for each sense_applies_to_kanji record
- sense_id: foreign key from sense table
- value: denotes that the sense applies to the current kanji
sense_applies_to_kana [ (PK) id, (FK) sense_id, value ]
- id: a unique ID for each sense_applies_to_kana record
- sense_id: foreign key from sense table
- value: denotes that the sense applies to the current kana
part_of_speech [ (PK) id, (FK) sense_id, value ]
- id: a unique ID for each record
- sense_id: foreign key from sense table
- value: denotes the part of speech of the sense (eg. noun, adjective...)
cross_reference [ (PK) id, (FK) sense_id, value ]
- id: a unique ID for each record
- sense_id: foreign key from sense table
- value: references another entry with a similar meaning
antonym [ (PK) id, (FK) sense_id, value ]
- id: a unique ID for each record
- sense_id: foreign key from sense table
- value: references another entry that is the antonym of the current sense
field [ (PK) id, (FK) sense_id, value ]
- id: a unique ID for each record
- sense_id: foreign key from sense table
- value: information about the field of application
misc [ (PK) id, (FK) sense_id, value ]
- id: a unique ID for each record
- sense_id: foreign key from sense table
- value: miscellaneous information about the sense
sense_info [ (PK) id, (FK) sense_id, value ]
- id: a unique ID for each record
- sense_id: foreign key from sense table
- value: indicates level of currency of a sense, the regional variations, etc. of the sense
lang_source [ (PK) id, (FK) sense_id, origin, lang, type, wasei ]
- id: a unique ID for each record
- sense_id: foreign key from sense table
- origin: where the entry originates from (can be NULL)
- lang: the language of the origin
- type: describes whether the sense fully or partially describes the source word
- wasei: denotes "Japanese-language expressions based on English words, or parts of word combinations, that do not exist in standard English or whose meanings differ from the words from which they were derived." Check Wasei-eigo
dialect [ (PK) id, (FK) sense_id, value ]
- id: a unique ID for each record
- sense_id: foreign key from sense table
- value: the dialect of the entry (Kansai-ben, Hokkaido-ben, etc.)
definition [ (PK) id, (FK) sense_id, value, lang, type ]
- id: a unique ID for each record
- sense_id: foreign key from sense table
- value: definition of the current entry
- lang: language of the definition
- type: denotes literal (lit), figurative (fig), explanation (expl)... of the sense

ER Diagram

(ER Diagram created using DbVisualizer)

lewisjwilson/JMDict2SQL