Commit Graph

3 Commits

Author SHA1 Message Date
Joshua Chin
cebca52ea3 removes combining marks from arabic words instead of treating them as punctuation 2015-06-25 12:36:41 -04:00
Joshua Chin
b198f4b0c2 added non_punct to MANIFEST.in and moved it into data 2015-06-24 17:30:01 -04:00
Rob Speer
35aec061de add new data files from wordfreq_builder 2015-05-11 18:45:47 -04:00