Robyn Speer 46e32fbd36 v1.7: update tokenization, update data, add bn and mk		2017-08-25 17:37:48 -04:00
..
test_chinese.py	Use langcodes when tokenizing again (it no longer connects to a DB)	2017-04-27 15:09:59 -04:00
test_french_and_related.py	Use langcodes when tokenizing again (it no longer connects to a DB)	2017-04-27 15:09:59 -04:00
test_japanese.py	Revert a small syntax change introduced by a circular series of changes.	2015-09-24 13:24:11 -04:00
test_korean.py	Tokenization in Korean, plus abjad languages (#38)	2016-07-15 15:10:25 -04:00
test_serbian.py	Use langcodes when tokenizing again (it no longer connects to a DB)	2017-04-27 15:09:59 -04:00
test.py	v1.7: update tokenization, update data, add bn and mk	2017-08-25 17:37:48 -04:00