iskm/wordfreq
1
0
Fork 0
mirror of https://github.com/rspeer/wordfreq.git synced 2024-12-27 02:48:51 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
24 Commits 8 Branches 124 Tags 707 MiB
26852dde89
Commit Graph

24 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Rob Speer
26852dde89 try to match the wordlist metanl actually uses 
Former-commit-id: 90772e33fb
 2013-10-31 15:13:22 -04:00
Rob Speer
def8a71b44 The metanl scale is not what I thought it was. 
Former-commit-id: 0d2fb21726
 2013-10-31 14:38:01 -04:00
Rob Speer
63b465c767 Don't download the DB if the right version is already there 
Former-commit-id: e931062b5a
 2013-10-31 14:12:04 -04:00
Rob Speer
8c3e8f9eb4 try being really nonspecific about functools32 versions 
Former-commit-id: c1564908f2
 2013-10-31 14:06:06 -04:00
Rob Speer
676cba640f be less specific about the functools32 version 
Former-commit-id: 2542cf9e35
 2013-10-31 14:02:40 -04:00
Rob Speer
9fd9028d3c Add wordfreq_data files. 
Now the build process is repeatable from scratch, even if something goes
wrong with the download server.


Former-commit-id: 26c0d7dd28
 2013-10-31 13:39:02 -04:00
Rob Speer
2cf812a64e When strings are inconsistent between py2 and 3, don't test them on py2. 2013-10-31 13:11:13 -04:00
Rob Speer
10115f3965 add util.py, which provides standardize_word 2013-10-30 18:14:43 -04:00
Rob Speer
2f7572e3fc and of course this changes the metanl constant 2013-10-30 18:14:34 -04:00
Rob Speer
8ef11fd33c Turns out we need to change the metanl constant after normalizing words. 2013-10-30 16:58:10 -04:00
Rob Speer
40102a3f63 Normalize words when storing them or looking them up. 2013-10-30 14:59:57 -04:00
Rob Speer
3063b3915a Revise the build test to compare lengths of wordlists. 
The test currently fails on Python 3, for some strange reason.
 2013-10-30 13:22:56 -04:00
Lance
ce07c881c5 Another Py3 change, this one for functools32 2013-10-30 12:06:41 -04:00
Lance
357cbb531e Py3 tweak to urllib import 2013-10-30 11:57:50 -04:00
Rob Speer
be183b2564 Change default values to offsets. 2013-10-29 18:06:47 -04:00
Rob Speer
2907f7f077 now this package has tests 2013-10-29 17:21:55 -04:00
Rob Speer
ca5b3e2f5d Implement the data uploady downloady stuff in setup. 2013-10-29 16:44:13 -04:00
Rob Speer
793893e738 Deal with database connections more consistently 2013-10-29 16:43:58 -04:00
Rob Speer
c475415f74 Add a couple of useful statistics about wordlists 2013-10-29 16:42:38 -04:00
Rob Speer
79d6c56fed add query.iter_wordlist, to visit all words in a list 2013-10-29 12:44:16 -04:00
Rob Speer
bc00bb3a8b prepare to write custom commands in setup.py 2013-10-29 12:43:41 -04:00
Rob Speer
e2510d802d revise config.py, clarify some of query.py 2013-10-29 12:18:38 -04:00
Rob Speer
89ab7204fd better default parameters and better log messages in building 2013-10-29 12:04:17 -04:00
Rob Speer
709ca6be66 Initial version. 
Noticeably missing: data files or any way to get them.
 2013-10-28 19:26:44 -04:00