iskm/wordfreq
1
0
Fork 0
mirror of https://github.com/rspeer/wordfreq.git synced 2024-12-23 17:31:41 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge pull request #10 from LuminosoInsight/returns-none-bugfix

Browse Source 
word_frequency no longer returns None if it does not detect tokens

Former-commit-id: 97bbb97f63
This commit is contained in:
Robyn Speer 2015-06-24 17:04:36 -04:00
commit f8ac142bcf
1 changed files with 6 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
wordfreq/__init__.py
View File

@ -227,7 +227,12 @@ def word_frequency(word, lang, wordlist='combined', default=0.):
"""
freqs = get_frequency_dict(lang, wordlist)
combined_value = None
for token in tokenize(word, lang):
tokens = tokenize(word, lang)
if len(tokens) == 0:
return default
for token in tokens:
if token not in freqs:
# If any word is missing, just return the default value
return default