/node-translate-fdroid-metadata-text-files

Command-line utility to use the IBM Watson Language Translator service to translate F-Droid metadata text files.

Primary LanguageJavaScriptGNU General Public License v2.0GPL-2.0

translate-fdroid-metadata-text-files

Command-line utility to use the IBM Watson™ Language Translator service to translate F-Droid metadata text files.

Requirements:

Installation:

npm install --global @warren-bank/translate-fdroid-metadata-text-files

Usage:

translate-fdroid-metadata-text-files <options>

options:
========
"-h"
"--help"
    Print a help message describing all command-line options.

"-v"
"--version"
    Display the version.

"-k" <key>
"--api-key" <key>
    [optional] IBM Cloud account API key.
    Default: Value is read from "IBM_TRANSLATOR_API_KEY" environment variable.

"-u" <url>
"--api-url" <url>
    [optional] IBM Cloud account API URL.
    Default: Value is read from "IBM_TRANSLATOR_API_URL" environment variable.

"-i" <language>
"--input-language" <language>
    [required] Language code for input locale directory.

"-o" <language>
"--output-language" <language>
    [optional] Language code for output locale directory.
    Note: This flag can be repeated to output multiple locales.
    Note: Input language is ignored.
    Default: Produce output for all supported language codes.

"-d" <dirpath>
"--metadata-directory" <dirpath>
    [required] Directory path to F-Droid metadata.

"-c" <filename>
"--copy-file" <filename>
    [optional] File name of a non-translated asset to copy
    from the input locale directory to all output locale directories.
    Note: This flag can be repeated to copy multiple files.

"-f"
"--force-overwrite"
    [optional] Boolean flag to force the overwriting
    of files that already exist in output locale directories.
    Default: Pre-existing files are not modified.

"-p" <filepath>
"--plugin" <filepath>
  [optional] File path to a custom plugin.
  Note: This flag can be repeated to chain multiple plugins.

"--html-entities"
  [optional] Boolean flag to apply an embedded post-processor plugin,
  which converts limited markdown to html entities in "description.txt"
  for all locales after translation.
  Note: This plugin is applied before all post-processor plugins.

"--marked"
  [optional] Boolean flag to apply an embedded post-processor plugin,
  which converts markdown to html in "description.txt"
  for all locales after translation.
  Note: This plugin is applied before custom post-processor plugins.

"--debug"
  [optional] Saves raw translation string dump files for all locales.

language codes:
===============
  "ar"    Arabic
  "eu"    Basque [1]
  "bn"    Bengali
  "bs"    Bosnian
  "bg"    Bulgarian
  "ca"    Catalan [1]
  "zh"    Chinese (Simplified)
  "zh-TW" Chinese (Traditional)
  "hr"    Croatian
  "cs"    Czech
  "da"    Danish
  "nl"    Dutch
  "en"    English
  "et"    Estonian
  "fi"    Finnish
  "fr"    French
  "fr-CA" French (Canadian)
  "de"    German
  "el"    Greek
  "gu"    Gujarati
  "he"    Hebrew
  "hi"    Hindi
  "hu"    Hungarian
  "ga"    Irish
  "id"    Indonesian
  "it"    Italian
  "ja"    Japanese
  "ko"    Korean
  "lv"    Latvian
  "lt"    Lithuanian
  "ms"    Malay
  "ml"    Malayalam
  "mt"    Maltese
  "cnr"   Montenegrin
  "ne"    Nepali
  "nb"    Norwegian Bokmål
  "pl"    Polish
  "pt"    Portuguese
  "ro"    Romanian
  "ru"    Russian
  "sr"    Serbian
  "si"    Sinhala
  "sk"    Slovak
  "sl"    Slovenian
  "es"    Spanish
  "sv"    Swedish
  "ta"    Tamil
  "te"    Telugu
  "th"    Thai
  "tr"    Turkish
  "uk"    Ukrainian
  "ur"    Urdu
  "vi"    Vietnamese
  "cy"    Welsh

[1] Basque and Catalan are supported only for translation to and from Spanish.

Structure of F-Droid Metadata Directory:

  <repository-root>
  └─ metadata
     └─ <package-id>
        └─ <locale>
           ├─ icon.png
           ├─ ...
           ├─ title.txt
           ├─ summary.txt
           └─ description.txt

F-Droid Documentation

Behavior of App

  • walks the directory tree, starting in the metadata directory
  • for each <package-id>
    • look for a <locale> directory named: <input-language>
    • if found:
      • for each file named: [title.txt, summary.txt, description.txt]
        • read contents of file
        • for each <output-language>
          • perform translation
          • save to file path:
            metadata/<package-id>/<output-language>/<filename>

Example:

  source ~/IBM_TRANSLATOR_API_CREDENTIALS.sh

  translate-fdroid-metadata-text-files -i 'en' -d '/path/to/my-fdroid-repo/metadata' -c 'icon.png'

Plugins:

  • each plugin is a CommonJS module that exports a single function
  • the signature of this function is: 
      (processing_stage, file_name, strings_array) => undefined
  • where:
    • when processing_stage === 'pre'
      • strings_array contains all of the strings to translate in the input locale
      • strings_array can be modified before it is translated
    • when processing_stage === 'post'
      • strings_array contains translations in an output locale
      • strings_array can be modified before it is saved to file
  • for examples, please refer to the embedded plugins:

Embedded Plugins:

--html-entities encodes the following:

  • leading whitespace
    • indentation is preserved
  • markdown list syntax
    • "*" is replaced by a unicode black circle
    • "-" is replaced by a unicode white circle
    • ordered list numbering is preserved
    • when possible, list items are wrapped and indented; so each line contains a maximum of 40 characters

comparison of test results:

  • HTML entities and unicode characters are rendered correctly by f-droid clients
    • as produced by: --html-entities
  • HTML tags are NOT rendered correctly by f-droid clients,
    and look really bad
    • as produced by: --marked

Legal: