iskm/wordfreq
1
0
Fork 0
mirror of https://github.com/rspeer/wordfreq.git synced 2024-12-23 17:31:41 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

fix duplication

Browse Source 
Former-commit-id: d4d7b2f72e
This commit is contained in:
Robyn Speer 2015-07-07 18:18:27 -04:00
parent 2d32bc5579
commit 91edae8307
1 changed files with 1 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
wordfreq/__init__.py
View File

@ -230,10 +230,9 @@ def word_frequency(word, lang, wordlist='combined', minimum=0.):
- Full text of Wikipedia
- A sample of 72 million tweets collected from Twitter in 2014,
divided roughly into languages using automatic language detection
- Google Books Syntactic Ngrams 2013
- Frequencies extracted from OpenSubtitles
- The Leeds Internet Corpus
- Google Books Ngrams and Google Books Syntactic Ngrams
- Google Books Syntactic Ngrams 2013
Another available wordlist is 'twitter', which uses only the data from
Twitter.