iskm/wordfreq
1
0
Fork 0
mirror of https://github.com/rspeer/wordfreq.git synced 2024-12-23 09:21:37 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

disregard Arabic Reddit spam

Browse Source
This commit is contained in:
Rob Speer 2016-03-24 17:44:30 -04:00
parent 6feae99381
commit cfe68893fa
1 changed files with 1 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
wordfreq_builder/wordfreq_builder/config.py
View File

@ -42,8 +42,7 @@ CONFIG = {
'subtlex-other': ['de', 'nl', 'zh'],
'jieba': ['zh'],
'reddit': [
'ar', 'de', 'en', 'es', 'fr', 'it', 'ja', 'pl', 'pt', 'ro',
'ru', 'sv'
'de', 'en', 'es', 'fr', 'it', 'ja', 'pl', 'pt', 'ro', 'ru', 'sv'
]
},
# Subtlex languages that need to be pre-processed