s0md3v/uro

uro error

Iamsajidkhan opened this issue · 1 comments

cat urls.txt | uro > test

Traceback (most recent call last):
File "/usr/local/bin/uro", line 8, in
sys.exit(main())
File "/usr/local/lib/python3.10/dist-packages/uro/uro.py", line 123, in main
for line in sys.stdin:
File "/usr/lib/python3.10/codecs.py", line 322, in decode
(result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xff in position 0: invalid start byte

@s0md3v

Hi.

I've recently have this same issue. If you get this kind of problem and you don't want to complicate with encoding detection.

The solution is to add this try/except in the file:

  • /usr/local/lib/python3.11/dist-packages/uro/uro.py

uroErrorFixed

It will skip the links that have weird encoding, but it will merge all the others that are cool.

For @s0md3v , please don't leave this amazing project :).