iskm/wordfreq
1
0
Fork 0
mirror of https://github.com/rspeer/wordfreq.git synced 2024-12-23 17:31:41 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
a0893af82e
wordfreq/tests
History
Rob Speer a0893af82e Tokenization in Korean, plus abjad languages (#38) 
* Remove marks from more languages

* Add Korean tokenization, and include MeCab files in data

* add a Hebrew tokenization test

* fix terminology in docstrings about abjad scripts

* combine Japanese and Korean tokenization into the same function


Former-commit-id: fec6eddcc3
2016-07-15 15:10:25 -04:00
..
test_chinese.py test_chinese: fix typo in comment 2015-09-24 13:41:11 -04:00
test_japanese.py Revert a small syntax change introduced by a circular series of changes. 2015-09-24 13:24:11 -04:00
test_korean.py Tokenization in Korean, plus abjad languages (#38) 2016-07-15 15:10:25 -04:00
test.py Tokenization in Korean, plus abjad languages (#38) 2016-07-15 15:10:25 -04:00