ignores :utf8 => true argument

Question

ignores :utf8 => true argument

mattes opened this issue 11 years ago · 4 comments

m = RE2::Regexp.new(regex, :utf8 => true).match(content)
puts m[1].encoding
 => ASCII-8BIT

m = RE2::Regexp.new(regex).match(content)
puts m[1].encoding
 => ASCII-8BIT

Answer 1 · 2013-09-12T00:02:57.000Z

treat results with encode("utf-8", "iso-8859-1") should help for now.

Answer 2 · 2013-09-12T07:54:55.000Z

The issue here is that the :utf8 argument is passed through to the underlying re2 library but the gem itself doesn't use any of Ruby 1.9's string encoding. We'll have to make sure that any encoding support is conditional so that the gem remains compatible with Ruby 1.8.

Answer 3 · 2013-09-14T13:42:42.000Z

@tenderlove's "String Encoding in Ruby 1.9 Extensions" should help here.

Answer 4 · 2014-02-01T23:03:27.000Z

Fixed as of v0.6.0.