iskm/wordfreq
1
0
Fork 0
mirror of https://github.com/rspeer/wordfreq.git synced 2024-12-24 01:41:39 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
429 Commits 8 Branches 124 Tags 707 MiB
1df97a579e
Commit Graph

28 Commits

Author SHA1 Message Date
Rob Speer
1df97a579e bump version to 1.4 2016-03-24 16:29:29 -04:00
slibs63
d18fee3d78 Merge pull request #30 from LuminosoInsight/add-reddit 
Add English data from Reddit corpus
 2016-01-14 15:52:39 -05:00
Sara Jewett
37f9e12b93 Specify encoding when dealing with files 2015-12-23 15:49:13 -05:00
Rob Speer
2dcf368481 rebuild data files 2015-11-30 17:06:39 -05:00
Rob Speer
2327f2e4d6 tokenize Chinese using jieba and our own frequencies 2015-09-05 03:16:56 -04:00
Rob Speer
694c28d5e4 bump to version 1.1 2015-08-25 17:44:52 -04:00
Rob Speer
95998205ad Use the regex implementation of Unicode segmentation 2015-08-24 17:11:08 -04:00
Rob Speer
c5708b24e4 put back the freqs_to_cBpack cutoff; prepare for 1.0 2015-07-28 18:01:12 -04:00
Rob Speer
a69ea5ad52 declare 'mecab' as an extra 2015-07-02 17:11:51 -04:00
Rob Speer
7b4ebd1805 declare that tests require mecab-python3 2015-07-02 11:29:11 -04:00
Rob Speer
7e3066d3fc add Twitter-specific wordlists 2015-07-01 17:49:33 -04:00
Rob Speer
053f372ebc bump version number 2015-06-30 14:54:13 -04:00
Rob Speer
ed19d79c5a clearer error on py2 2015-05-28 14:05:11 -04:00
Rob Speer
0f4ca80026 add installation instructions to the readme 2015-05-28 14:02:12 -04:00
Rob Speer
dd41e61c57 update README, another setup fix 2015-05-13 04:09:34 -04:00
Rob Speer
f13cca4d81 update dependencies 2015-05-12 12:30:01 -04:00
Rob Speer
bb18f741e2 restore missing line in setup.py 2015-05-12 12:24:18 -04:00
Rob Speer
35aec061de add new data files from wordfreq_builder 2015-05-11 18:45:47 -04:00
Rob Speer
9b63e54471 WIP: burn stuff down 2015-05-08 15:28:52 -04:00
Rob Speer
873ace87db v0.7: make a proper Dutch 'surfaces' list 2015-04-30 13:01:24 -04:00
Rob Speer
e931062b5a Don't download the DB if the right version is already there 2013-10-31 14:12:04 -04:00
Rob Speer
c1564908f2 try being really nonspecific about functools32 versions 2013-10-31 14:06:06 -04:00
Rob Speer
2542cf9e35 be less specific about the functools32 version 2013-10-31 14:02:40 -04:00
Rob Speer
40102a3f63 Normalize words when storing them or looking them up. 2013-10-30 14:59:57 -04:00
Lance
ce07c881c5 Another Py3 change, this one for functools32 2013-10-30 12:06:41 -04:00
Rob Speer
ca5b3e2f5d Implement the data uploady downloady stuff in setup. 2013-10-29 16:44:13 -04:00
Rob Speer
bc00bb3a8b prepare to write custom commands in setup.py 2013-10-29 12:43:41 -04:00
Rob Speer
709ca6be66 Initial version. 
Noticeably missing: data files or any way to get them.
 2013-10-28 19:26:44 -04:00