1
0
mirror of https://github.com/rspeer/wordfreq.git synced 2025-01-13 20:56:00 +00:00
wordfreq/MANIFEST.in
Robyn Speer 0a2bfb2710 Tokenization in Korean, plus abjad languages ()
* Remove marks from more languages

* Add Korean tokenization, and include MeCab files in data

* add a Hebrew tokenization test

* fix terminology in docstrings about abjad scripts

* combine Japanese and Korean tokenization into the same function


Former-commit-id: fec6eddcc3
2016-07-15 15:10:25 -04:00

9 lines
285 B
Plaintext

recursive-include wordfreq/data *.gz
include README.md
recursive-include wordfreq/data *.txt
recursive-include wordfreq/data *.bin
recursive-include wordfreq/data *.def
recursive-include wordfreq/data *.dic
recursive-include wordfreq/data dicrc
recursive-include wordfreq/data COPYING