mirror of
https://github.com/rspeer/wordfreq.git
synced 2024-12-23 17:31:41 +00:00
Switch to more explanatory Unicode escapes when testing NFKC normalization.
Former-commit-id: 66c69e6fac
This commit is contained in:
parent
0711fb3c43
commit
b0fac15f98
@ -149,6 +149,6 @@ def test_ar():
|
|||||||
)
|
)
|
||||||
|
|
||||||
eq_(
|
eq_(
|
||||||
tokenize('إﻻ', 'ar'),
|
tokenize('\ufefb', 'ar'),
|
||||||
['إلا']
|
['\u0644\u0627']
|
||||||
)
|
)
|
||||||
|
Loading…
Reference in New Issue
Block a user