wordfreq/MANIFEST.in
Rob Speer fec6eddcc3 Tokenization in Korean, plus abjad languages (#38)
* Remove marks from more languages

* Add Korean tokenization, and include MeCab files in data

* add a Hebrew tokenization test

* fix terminology in docstrings about abjad scripts

* combine Japanese and Korean tokenization into the same function
2016-07-15 15:10:25 -04:00

9 lines
285 B
Plaintext

recursive-include wordfreq/data *.gz
include README.md
recursive-include wordfreq/data *.txt
recursive-include wordfreq/data *.bin
recursive-include wordfreq/data *.def
recursive-include wordfreq/data *.dic
recursive-include wordfreq/data dicrc
recursive-include wordfreq/data COPYING