wordfreq/scripts/top_n.py

"""
A quick script to output the top N words (1000 for now) in each language.
You can send the output to a file and diff it to see changes between wordfreq
versions.
"""
import wordfreq


N = 1000


for lang in sorted(wordfreq.available_languages()):
    for word in wordfreq.top_n_list(lang, 1000):
        print('{}\t{}'.format(lang, word))
v1.7: update tokenization, update data, add `bn` and `mk` 2017-08-25 21:37:48 +00:00			`"""`
			`A quick script to output the top N words (1000 for now) in each language.`
			`You can send the output to a file and diff it to see changes between wordfreq`
			`versions.`
			`"""`
			`import wordfreq`


			`N = 1000`


			`for lang in sorted(wordfreq.available_languages()):`
remove unnecessary enumeration from top_n.py 2017-09-08 20:52:06 +00:00			`for word in wordfreq.top_n_list(lang, 1000):`
v1.7: update tokenization, update data, add `bn` and `mk` 2017-08-25 21:37:48 +00:00			`print('{}\t{}'.format(lang, word))`