wordfreq/MANIFEST.in

recursive-include wordfreq/data *.gz
include README.md
recursive-include wordfreq/data *.txt
recursive-include wordfreq/data *.bin
recursive-include wordfreq/data *.def
recursive-include wordfreq/data *.dic
recursive-include wordfreq/data dicrc
recursive-include wordfreq/data COPYING
add new data files from wordfreq_builder Former-commit-id: 35aec061dedfdb3785306923ac5822bff3d246d8 2015-05-11 22:45:47 +00:00			`recursive-include wordfreq/data *.gz`
			`include README.md`
Revert "Remove the no-longer-existent .txt files from the MANIFEST." This reverts commit 20890901514ce950ba1c0cc8fc91d7a77b28e80e [formerly db41bc790271ec2fe6f12f63a0a1d2f7ffed74fc]. Former-commit-id: cd0797e1c8081acf96f4ff43b5f8ef76f3e10b7a 2015-09-24 17:31:34 +00:00			`recursive-include wordfreq/data *.txt`
Tokenization in Korean, plus abjad languages (#38) * Remove marks from more languages * Add Korean tokenization, and include MeCab files in data * add a Hebrew tokenization test * fix terminology in docstrings about abjad scripts * combine Japanese and Korean tokenization into the same function Former-commit-id: fec6eddcc3475f49a7541d8d3202ec87e581ed53 2016-07-15 19:10:25 +00:00			`recursive-include wordfreq/data *.bin`
			`recursive-include wordfreq/data *.def`
			`recursive-include wordfreq/data *.dic`
			`recursive-include wordfreq/data dicrc`
			`recursive-include wordfreq/data COPYING`