1
0
mirror of https://github.com/rspeer/wordfreq.git synced 2025-01-14 21:25:58 +00:00
wordfreq/MANIFEST.in
Rob Speer a0893af82e Tokenization in Korean, plus abjad languages ()
* Remove marks from more languages

* Add Korean tokenization, and include MeCab files in data

* add a Hebrew tokenization test

* fix terminology in docstrings about abjad scripts

* combine Japanese and Korean tokenization into the same function


Former-commit-id: fec6eddcc3
2016-07-15 15:10:25 -04:00

9 lines
285 B
Plaintext

recursive-include wordfreq/data *.gz
include README.md
recursive-include wordfreq/data *.txt
recursive-include wordfreq/data *.bin
recursive-include wordfreq/data *.def
recursive-include wordfreq/data *.dic
recursive-include wordfreq/data dicrc
recursive-include wordfreq/data COPYING