The censor.sh script searches for blacklisted words in target files. It uses an external file containing blacklisted words.
$ ./censor.sh BLACKLIST [FILE]...
# Examples:
$ ./censor.sh blacklist.txt .
$ ./censor.sh blacklist.txt.gpg .The BLACKLIST parameter of censor.sh script can be provided as a plain text file or as an encrypted file. When an encrypted blacklist file is used, it has to be created with gpg2 using a symmetric cipher. The encryption/decryption passphrase is expected to be in BLACKLIST_PASSWORD environment variable. For additional details on the encrypted blacklist file and encryption/decryption passphrase see this section below.
To learn about more usage options see the online help:
$ ./censor.sh -hChanges to the blacklist file are done on its plain text version. The censor.sh script is making use of the grep command, therefore, each blacklisted word has to be placed in a separate line (i.e., grep takes the whole line for pattern match).
Following are the two commands to encrypt/decrypt the blacklist file when needed. These commands are using blacklist.txt as an example:
# Encrypt:
$ gpg2 --batch --passphrase=$BLACKLIST_PASSWORD -c blacklist.txt
# Decrypt:
$ gpg2 --batch --passphrase=$BLACKLIST_PASSWORD -d blacklist.txt.gpg > blacklist.txtIf you decide to use the encrypted blacklist and would like to avoid uploading its plain text version to a public repository, then remember to add its name to the local .gitignore file. For example, the line *blacklist.txt ignores all plain text blacklists with filenames ending with "*blacklist.txt", such as "test-blacklist.txt.
When the local encryption/decryption passphrase in BLACKLIST_PASSWORD environment variable is defined in a local configuration file, then remember to add it to the git ignore list. For instance, when using an environment switcher for the shell, such as direnv, then the passphrase will typically be defined in the local .envrc and ignored globally in ~/.gitignore_global.
Typically, CI servers provide a way to define environment variables. This is used here to secretly store the encryption/decryption passphrase on Travis-CI. Note however that according to Travis-CI guidelines and Travis-CI Issues: "Encrypted variables are not available to untrusted builds such as pull requests coming from another repository".
Static Analysis is done using ShellCheck. It is done locally and is also part of the CI (performed by Travis-CI that already it pre-installed).
The censor.sh script is tested using multiple 'pass/fail' fixtures placed in their respective folders under ./test/.
Run all tests using:
$ cd test
$ ./test.sh
# Example output:
PASS: fixtures/pass/pass-prefixed.md
PASS: fixtures/pass/pass-suffixed.md
PASS: fixtures/fail/fail-all_lower_case.md
PASS: fixtures/fail/fail-all_upper_case.md
PASS: fixtures/fail/fail-email_address.md
PASS: fixtures/fail/fail-mixed_case.md
ALL PASS (total of 6 tests)