iskm/wordfreq
1
0
Fork 0
mirror of https://github.com/rspeer/wordfreq.git synced 2024-12-24 09:51:38 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Remove redundant reference to wikipedia in builder README.

Browse Source 
Former-commit-id: 53621c34df
This commit is contained in:
Andrew Lin 2015-07-31 19:12:59 -04:00
parent be7bc11cad
commit f393086253
1 changed files with 0 additions and 13 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

13
wordfreq_builder/README.md
View File

@ -82,19 +82,6 @@ The specific rules are described by the comments in `rules.ninja`.
## Data sources
### Wikipedia
Wikipedia is a "free-access, free-content Internet encyclopedia".
These files can be downloaded from [wikimedia dump][wikipedia]
The original files are in `data/raw-input/wikipedia`, and they're processed
by the `wiki2text` rule in `rules.ninja`. Parsing wikipedia requires the
[wiki2text][] package.
[wikipedia]: https://dumps.wikimedia.org/backup-index.html
[wiki2text]: https://github.com/rspeer/wiki2text
### Leeds Internet Corpus
Also known as the "Web as Corpus" project, this is a University of Leeds