archive/ruby
1
0
Fork 0
mirror of https://github.com/ruby/ruby.git synced 2025-08-28 07:26:00 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 11

Fixed String#grapheme_clusters with wide encodings

Browse source 
* string.c (get_reg_grapheme_cluster): make regexp from properly
  encoded sources fro wide-char encodings.  [Bug #15965]

* regparse.c (node_extended_grapheme_cluster): suppress false
  duplicated range warning for the time being.
This commit is contained in:
Nobuyoshi Nakada 2019-06-29 10:10:17 +09:00
parent 8aecc90974
commit 2f6cc15cdb
No known key found for this signature in database
GPG key ID: 4BC7D6DF58D8DF60
3 changed files with 40 additions and 6 deletions
Download patch file Download diff file Expand all files Collapse all files

15
test/ruby/test_string.rb
View file

@ -1036,13 +1036,20 @@ CODE
"\u{1F468 200D 1F393}",
"\u{1F46F 200D 2642 FE0F}",
"\u{1f469 200d 2764 fe0f 200d 1f469}",
].each do |g|
].product([Encoding::UTF_8, *WIDE_ENCODINGS]) do |g, enc|
g = g.encode(enc)
assert_equal [g], g.grapheme_clusters
assert_predicate g.dup.taint.grapheme_clusters[0], :tainted?
assert_predicate g.taint.grapheme_clusters[0], :tainted?
end
assert_equal ["\u000A", "\u0324"], "\u{a 324}".grapheme_clusters
assert_equal ["\u000D", "\u0324"], "\u{d 324}".grapheme_clusters
[
"\u{a 324}",
"\u{d 324}",
"abc",
].product([Encoding::UTF_8, *WIDE_ENCODINGS]) do |g, enc|
g = g.encode(enc)
assert_equal g.chars, g.grapheme_clusters
end
assert_equal ["a", "b", "c"], "abc".b.grapheme_clusters
if ENUMERATOR_WANTARRAY