Robyn Speer 5762508e7c commit new data files (Italian changed for some reason)		2018-05-29 17:36:48 -04:00
..
data	commit new data files (Italian changed for some reason)	2018-05-29 17:36:48 -04:00
__init__.py	More explicit error message for a missing wordlist	2018-03-14 15:10:27 -04:00
chinese.py	Traditional Chinese should be preserved through tokenization	2018-03-08 18:08:55 -05:00
language_info.py	Handle Japanese edge cases in simple_tokenize	2018-04-26 15:53:07 -04:00
mecab.py	Allow MeCab to work in Japanese or Korean without the other	2016-08-19 11:41:35 -04:00
preprocess.py	fix az-Latn transliteration, and test	2018-03-08 16:47:36 -05:00
tokens.py	Handle Japanese edge cases in simple_tokenize	2018-04-26 15:53:07 -04:00
transliterate.py	fix az-Latn transliteration, and test	2018-03-08 16:47:36 -05:00