/encoding-test-files

Encoding test files

Primary LanguagePythonApache License 2.0Apache-2.0

Encoding test files

These are example test files for testing encoding issues.

They are generated by running generate.py with Python 2.7.

Assuming your browser can read this README as UTF-8, the content should be equivalent to:

première is first
première is slightly different
Кириллица is Cyrillic
𐐀 am Deseret

These are written into different encodings, where some characters might be replaced with ?.
Only UTF8 and UTF16 is able to do all encodings.

TODO: Add BOM test files