Rob Speer 45b9bcdbcb Separate preprocessing from tokenization		2018-03-08 16:26:17 -05:00
..
test_chinese.py	Separate preprocessing from tokenization	2018-03-08 16:26:17 -05:00
test_french_and_related.py	Use langcodes when tokenizing again (it no longer connects to a DB)	2017-04-27 15:09:59 -04:00
test_japanese.py	Revert a small syntax change introduced by a circular series of changes.	2015-09-24 13:24:11 -04:00
test_korean.py	Tokenization in Korean, plus abjad languages (#38)	2016-07-15 15:10:25 -04:00
test_serbian.py	Use langcodes when tokenizing again (it no longer connects to a DB)	2017-04-27 15:09:59 -04:00
test.py	Separate preprocessing from tokenization	2018-03-08 16:26:17 -05:00