iskm/wordfreq
1
0
Fork 0
mirror of https://github.com/rspeer/wordfreq.git synced 2024-12-24 18:01:38 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
476 Commits 8 Branches 124 Tags 707 MiB
b3e5d1c9e9
Commit Graph

4 Commits

Author SHA1 Message Date
Rob Speer
f89ac5e400 test_chinese: fix typo in comment 
Former-commit-id: 2a84a926f5
 2015-09-24 13:41:11 -04:00
Rob Speer
e3a79ab8c9 add external_wordlist option to tokenize 
Former-commit-id: 669bd16c13
 2015-09-10 18:09:41 -04:00
Rob Speer
a13f459f88 Lower the frequency of phrases with inferred token boundaries 
Former-commit-id: 5c8c36f4e3
 2015-09-10 14:16:22 -04:00
Rob Speer
91cc82f76d tokenize Chinese using jieba and our own frequencies 
Former-commit-id: 2327f2e4d6
 2015-09-05 03:16:56 -04:00