wordfreq/scripts/top_n.py

"""
A quick script to output the top N words (1000 for now) in each language.
You can send the output to a file and diff it to see changes between wordfreq
versions.
"""
import wordfreq


N = 1000

if __name__ == '__main__':
    for lang in sorted(wordfreq.available_languages()):
        for word in wordfreq.top_n_list(lang, 1000):
            print('{}\t{}'.format(lang, word))
v1.7: update tokenization, update data, add `bn` and `mk` 2017-08-25 21:37:48 +00:00			`"""`
			`A quick script to output the top N words (1000 for now) in each language.`
			`You can send the output to a file and diff it to see changes between wordfreq`
			`versions.`
			`"""`
			`import wordfreq`


			`N = 1000`

Protect top_n from running on import 2019-04-16 15:33:22 +00:00			`if __name__ == '__main__':`
			`for lang in sorted(wordfreq.available_languages()):`
			`for word in wordfreq.top_n_list(lang, 1000):`
			`print('{}\t{}'.format(lang, word))`