felipecsl/wombat

Encoding Problem

Opened this issue · 0 comments

when request url is http://info.ntust.edu.tw/faith/edua/app/qry_linkoutline.aspx?semester=1031&courseno=ET5117701

it will get error
encoding error : input conversion failed due to input error, bytes 0xA8 0x8B 0xE8 0xB3, but other course page isn't. I guess the page used special character.
I have tried and I think this is Mechanize problem if I override get method to

doc = original_get *args
doc.encoding = 'utf-8'
doc

It will work fine, but in some case other normal page will get trouble....