Output file encoding should be set to UTF-8

Question

Output file encoding should be set to UTF-8

rxzhangGH opened this issue 2 years ago · 2 comments

Hi,

When using the bifixer command line tool, I noticed an issue with line 53 of bifixer.py:

parser.add_argument('output', type=argparse.FileType('w'), default=sys.stdout, help="Fixed corpus")

Since no encoding is specified in the type, a platform-specific encoding will be used and that caused problems for me. I suggest changing the above to:

parser.add_argument('output', type=argparse.FileType('w', encoding='UTF-8'), default=sys.stdout, help="Fixed corpus")

Answer 1 · 2022-12-19T21:12:03.000Z

Could you please post the error? The OS and Python would be helpful, also.

Answer 2 · 2023-01-05T13:25:04.000Z

It's fixed anyway now.