iskm/wordfreq
1
0
Fork 0
mirror of https://github.com/rspeer/wordfreq.git synced 2024-12-23 17:31:41 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

disregard Arabic Reddit spam

Browse Source 
Former-commit-id: cfe68893fa
This commit is contained in:
Robyn Speer 2016-03-24 17:44:30 -04:00
parent 034d8f540b
commit 16841d4b0c
1 changed files with 1 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
wordfreq_builder/wordfreq_builder/config.py
View File

@ -42,8 +42,7 @@ CONFIG = {
'subtlex-other': ['de', 'nl', 'zh'], 'subtlex-other': ['de', 'nl', 'zh'],
'jieba': ['zh'], 'jieba': ['zh'],
'reddit': [ 'reddit': [
'ar', 'de', 'en', 'es', 'fr', 'it', 'ja', 'pl', 'pt', 'ro', 'de', 'en', 'es', 'fr', 'it', 'ja', 'pl', 'pt', 'ro', 'ru', 'sv'
'ru', 'sv'
] ]
}, },
# Subtlex languages that need to be pre-processed # Subtlex languages that need to be pre-processed