Robyn Speer
|
c55e44e486
|
fix the 'count' ninja rule
|
2015-05-05 14:06:13 -04:00 |
|
Robyn Speer
|
59409266ca
|
add and adjust some build steps
- more build steps for Wikipedia
- rename 'tokenize_twitter' to 'pretokenize_twitter' to indicate that
the results are preliminary
|
2015-05-05 13:59:21 -04:00 |
|
Robyn Speer
|
33c5f78c07
|
add wiki-parsing process
|
2015-05-04 13:25:01 -04:00 |
|
Robyn Speer
|
9ac4838eda
|
not using wordfreq.cfg anymore
|
2015-04-30 16:25:42 -04:00 |
|
Robyn Speer
|
efcf436112
|
WIP on new build system
|
2015-04-30 16:24:28 -04:00 |
|
Robyn Speer
|
98b3e51da1
|
use script codes for Chinese
|
2015-04-30 13:02:58 -04:00 |
|
Robyn Speer
|
76ea7f1bd5
|
define some ninja rules
|
2015-04-29 17:13:58 -04:00 |
|
Robyn Speer
|
524f7c760b
|
WIP on Ninja build automation
|
2015-04-29 15:59:06 -04:00 |
|
Robyn Speer
|
f77a61e675
|
move commands into cli/ directory
|
2015-04-29 15:22:04 -04:00 |
|
Robyn Speer
|
2bf8870832
|
always use surface forms
|
2015-04-29 15:17:00 -04:00 |
|
Robyn Speer
|
38261a6a0a
|
handle multi-word stems correctly
|
2015-04-29 13:45:53 -04:00 |
|
Robyn Speer
|
6b57075275
|
revise the process of building Wikipedia counts
|
2015-03-30 18:09:07 -04:00 |
|
Robyn Speer
|
bc780c63c8
|
enable wordlist balancing, surface form counting
|
2015-02-17 13:43:22 -05:00 |
|
Robyn Speer
|
07e61be7e3
|
add utility for combining wordlists
|
2015-02-11 11:45:10 -05:00 |
|
Robyn Speer
|
23bd5ba76c
|
command-line entry points
|
2015-02-10 12:28:29 -05:00 |
|
Robyn Speer
|
8b322ce534
|
Initial commit
|
2015-02-04 20:19:36 -05:00 |
|